A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

A head stabilization device or HFD includes a plurality of integrated markers. The HFD may be in the form of a skull clamp, vacuum bag, combinations thereof, or other supporting structure. The integrated markers include MRI markers detectable by an MRI scanner and fiducial markers detectable by a registration tool of a navigation system. The markers provide a reference point relative to an operation site in a patient for use in a navigation guided procedure and aid in registering or calibrating the location of the patient with captured images used in the navigation guided procedure.

A positioning system includes a group of positioning devices including a first device comprising a first positioning source associated with a first positioning modality, the first positioning source being configured to view a first field, a second device comprising a second positioning source associated with a second positioning modality that is of a different type than the first positioning modality, the second positioning source being configured to view a second field, a third device comprising one or more first markers detectable within the first field using the first positioning modality, and a fourth device comprising one or more second markers detectable within the second field using the second positioning modality. A linking structure physically links two of the group of positioning devices to one another in a fixed, rigid relative position and orientation.

The invention relates to a method for displaying an injection point for a medical instrument. The method comprises the following steps: Providing at least one marker on a surface of an object, with such marker exhibiting the property that it can be recorded both tomographically, in particular fluoroscopically, and also optically; Generating tomographic image data that can be used to reconstruct a fluoroscopic image of the at least one marker, located on the surface of the object, together with the object; Determining the insertion point for the medical instrument on the surface of the object relative to the at least one marker in the coordinate system of the tomographic image data; Generating visual image data that can be used to reconstruct a visual image of the at least one marker, located on the surface of the object, together with the object; Transforming the coordinate of the insertion point in the coordinate system of the tomographic image data into the coordinate system of the visual image data using the relative position of the insertion point to the at least one marker; and Displaying the insertion point for the medical instrument in real time in a view of the object.

An augmented reality system includes a head-mountable augmented reality platform (152) having a display to provide guidance to a user. A prediction module (115) is trained in a procedure and is configured to predict a next activity in the procedure based on a current condition. An image generation module (148) is responsive to the prediction module to provide a visual cue of a predicted next activity to the user through the head-mountable augmented reality platform.

Systems and methods for tracking a target volume, e.g., tumor, in real-time during radiation treatment are provided. The system includes a memory to store a pre-acquired 3D image of the anatomy of interest in a first reference frame and a processor, operative coupled with the memory, to receive, from an ultrasound probe, a set-up ultrasound image of the anatomy of interest in a second reference frame. The processor further to establish a transformation between the first and second reference frames by registering the set-up ultrasound image with the pre-acquired 3D image and receive, from the ultrasound probe, an intrafraction ultrasound image of the anatomy of interest. The processor further to register the intrafraction ultrasound image with the set-up ultrasound image and track motion of the anatomy of interest based on the registered intrafraction ultrasound image.

A magnetic marker for marking a site in tissue in the body. In one embodiment, the marker comprises a magnetic metallic glass. In another embodiment, the marker is in a non-spherical configuration having an anisotropy ratio less than 9. In yet another embodiment, the marker is in a non-spherical configuration having an anisotropy ratio less than 6. In yet another embodiment, the marker is in a non-spherical configuration having an anisotropy ratio less than 3.

The invention relates to a measurement device 1 comprising a rotatable magnetic object 4 which can oscillate with a resonant frequency if excited by an external magnetic torque. The measurement device 1 is adapted such that the resonant frequency depends on the temperature or on another physical or chemical quantity like pressure, in order to allow for a wireless temperature measurement or measurement of the other physical or chemical quantity via an external magnetic field providing the external magnetic torque. This measurement device can be relatively small, can be read-out over a relatively larger distance and allows for a very accurate measurement.

A medical procedure system, including a medical instrument to be inserted into a body part, and including position-tracking transducers to provide position signals, a distal end, and at least one radiopaque marker, a position tracking sub-system to compute a position including at least one location and orientation of the distal end in a position-tracking sub-system coordinate frame responsively to the position signals, a fluoroscope to capture fluoroscopic images of an interior of the body part and the radiopaque marker(s), and a registration sub-system to render, to a display, the captured fluoroscopic images including at least one marker-image of the radiopaque marker(s), and at least one graphical representation indicative of the computed position of the distal end, receive user-alignment input aligning the graphical representation(s) with the marker-image(s), and register the position-tracking sub-system coordinate frame with a coordinate frame of the fluoroscope responsively to the received user-alignment input.

Markers (e.g., treatment site markers, biopsy site markers) are composed of a non-metallic material having a composition and/or other features or characteristics such that the markers will generate twinkling artifacts when imaged with ultrasound. In this way, the composition of the markers enables their detection and localization using ultrasound. The markers are generally composed of non-metallic materials that enhance the twinkling artifact.