Presented herein are systems, methods, and architectures related to augmented reality (AR) surgical visualization of one or more dual-modality probe species in tissue. As described herein, near infrared (NIR) images are detected and rendered in real time. The NIR images are registered and/or overlaid with one or more radiological images (e.g., which were obtained preoperatively/perioperatively) by a processor [e.g., that uses an artificial neural network (ANN) or convolutional neural network (CNN) reconstruction algorithm] to produce a real-time AR overlay (3D representation). The AR overlay is displayed to a surgeon in real time. Additionally, a dynamic motion tracker tracks the location of fiducial tracking sensors on/in/about the subject, and this information is also used by the processor in producing (e.g., positionally adjusting) the AR overlay. The real-time AR overlay can improve surgery outcomes, for example, by providing additional real-time information about a surgical site via an intuitive visual interface.

3D image data of a skeletal portion is acquired. A location of a proximal portion of a tool is calculated and a location is derived of a distal portion of the tool with respect to the skeletal portion, with respect to the 3D image data. A display indicates the derived location. First and second 2D images of the distal portion of the tool are acquired from two different poses of a 2D imaging device with respect to the subject and registered with the 3D image data. The location of the distal portion with respect to the 3D image data of the skeletal portion is determined based on the registration and an identified location of the distal portion within the 2D x-rays. Based upon the determined location, the display updates the indicated location of the distal portion. Other embodiments are also described.

Method and system form a correlated view of human or other animal anatomy using at least one transparent display screen associated with an electronic mobile device. The view relates an optical view with other electromagnetic spectrum images with a non-optical electromagnetic image of selected portions of human or other animal anatomy. At least three visible position markers associate with selected positions of a predetermined portion of human or other animal anatomy. The disclosure forms a correlated view of the predetermined portion of human or other animal anatomy by relating said at least one non-optical electromagnetic image of the at least three visible position markers with a visual image of said at least three visible position markers. The view correlates the size and dimensions of the optical view and non-optical electromagnetic image of the predetermined portion of human or other animal anatomy.

The invention relates to a method of navigation of a tool to be used in a surgical operation for treating a target region within the body of a patient.

A radiographic marker containing a sensing medium that initially includes a gas and liquid mixture for producing increased signal intensity in a first imaging modality. The radiographic marker can have a permeable portion allowing the exchange of the gases or liquids of the sensing medium to be changed or exchanged for at least a second fluid in the surrounding tissue to reduce the bubbles or air pockets created by the gas portion of the sensing medium. The change or exchange of gas for the second liquid in the radiographic marker produces a detectable signal intensity of the radiographic marker in a second imaging modality different from the first imaging modality.

A system and associated instruments for locating, and accurately and controllably delivering, a device to an area sufficiently near a bone defect using anatomical landmarks is provided. The instruments allow the surgeon to navigate to the area around the bone defect quickly and easily, while so facilitating proper insertion of the device. In some embodiments, the defect is located on a femur. Guide instruments having a plurality of device portals are also provided for use as standalone instruments or as accessories to the system. In addition, a protective guide sleeve is provided for the insert of small diameter devices.

An implantable tissue marker incorporates a contrast agent sealed within a chamber in a container formed from a solid material. The contrast agent is selected to produce a change, such as an increase, in signal intensity under magnetic resonance imaging (MRI). An additional contrast agent may also be sealed within the chamber to provide visibility under another imaging modality, such as computed tomographic (CT) imaging or ultrasound imaging.

A real-time applicator position monitoring system (RAPS) measures brachytherapy applicator displacement in real-time by computing the relative displacement between two infrared reflective targets, one attached to the applicator and the other to the patient's skin. In an aspect, RAPS can be used with any brachytherapy application. RAPS measures the applicator motion during HDR brachytherapy treatment, as well as during the transfer of the patient from the imaging room (e.g., where the CT and MR scanners are located) to the HDR BT operating/treatment room.

A patient reference device is provided for use during a medical procedure. The patient reference device includes a housing having a back side and a front side, at least three tracking markers attached to the front side of the housing, the housing extending around the at least three tracking markers and beyond a horizontal plane defined by tops of the at least three tracking markers, the housing terminating at a substantially continuous edge, and a sterile cover attached to the substantially continuous edge of the housing for covering the housing and the tracking markers.

Embodiments of the disclosure may be drawn to brachytherapy markers. Exemplary markers may include an inner ring consisting of one or more of copper, brass, gold, silver, or titanium; an outer coating consisting of one or more of nickel or iron oxide, wherein a thickness of the outer coating may be about 1 μm to about 30 μm; and a central opening, wherein a diameter of the central opening may be about 0.50 mm to about 3.00 mm.