A method for enhanced surgical navigation, and a system performing the method and displaying graphical user interfaces associated with the method. A 3D spatial map of a surgical site is generated using a 3D endoscope including a camera source and an IR scan source. The method includes detecting a needle tip protruding from an anatomy and determining a needle protrusion distance corresponding to a distance between the needle tip and a surface of the anatomy using the 3D spatial map. A position of a surgical tool in the 3D spatial map is detected and a determination is made by the system indicative of whether the needle protrusion distance is sufficient for grasping by the surgical tool. A warning is generated when it is determined that the needle protrusion distance is not sufficient for grasping by the surgical tool.

A surgical system for operating on a bone of a patient is described. The surgical system includes a reference device including one or more radiopaque markers, a first sensor configured to generate a first signal pertaining to orientation data of the reference device relative to a first coordinate system, a surgical instrument for coupling to an end effector, a second sensor configured to generate a second signal pertaining to orientation data of at least one of the end effector and the surgical instrument relative to a second coordinate system, and a navigation system. The navigation system is configured to determine an orientation of at least one of the end effector and the surgical instrument and superimpose a virtual representation of at least one of the end effector and the surgical instrument over the image based on the determined orientation and user input.

A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

A system for aiding surgery on a patient is described including a display device and a storage device that stores an image of at least a portion of the anatomy of the patient, including one or more surgical navigation markers positioned on the patient, for display on the display device. An analyser is adapted to receive positional data of a probe based on positioning of the probe relative to the one or more markers on the patient. Based on the positional data, the analyser outputs correctional data to adjust an alignment of the image on the display device to match locations of said one or more markers.

Registration of a surgical image acquisition device (e.g. an endoscope) using preoperative and live contour signatures of an anatomical object is described. A control unit includes a processor configured to compare the real-time contour signature to the database of preoperative contour signatures of the anatomical object to generate a group of potential contour signature matches for selection of a final contour match. Registration of an image acquisition device to the surgical site is realized based upon an orientation corresponding to the selected final contour signature match.

Systems and methods are provided in which intraoperatively acquired surface data is employed to verify the correspondence of an intraoperatively selected spinal level with a spinal level that is pre-selected based on volumetric image data. Segmented surface data corresponding to the pre-selected spinal levels may be obtained from the volumetric image data, such that the segmented surface data corresponds to a spinal segment that is expected to be exposed and identified intraoperatively during the surgical procedure. The segmented surface data from the pre-selected spinal level, and adjacent segmented surface data from an adjacent spinal level that is adjacent to the pre-selected spinal level, is registered to the intraoperative surface data, and quality measures associated with the registration are obtained, thereby permitting an assessment or a determination of whether or not the pre-selected spinal surface (in the volumetric frame or reference) is likely to correspond to the intraoperatively selected spinal level.

A force sensed surface scanning system (20) employs a scanning robot (41) and a surface scanning controller (50). The scanning robot (41) includes a surface scanning end-effector (43) for generating force sensing data informative of a contact force applied by the surface scanning end-effector (43) to an anatomical organ. In operation, the surface scanning controller (50) controls a surface scanning of the anatomical organ by the surface scanning end-effector (43) including the surface scanning end-effector (43) generating the force sensing data, and further constructs an intraoperative volume model of the anatomical organ responsive to the force sensing data generated by the surface scanning end-effector (43) indicating a defined surface deformation offset of the anatomical organ.

Systems and methods for visualizing navigation of a medical device with respect to a target using a live fluoroscopic view. The methods include displaying, in a screen, a three-dimensional (3D) view of a 3D model of a target from the perspective of a medical device tip. The methods also include displaying, in the screen, a live two-dimensional (2D) fluoroscopic view showing a medical device, and displaying a target mark, which corresponds to the 3D model of the target, overlaid on the live 2D fluoroscopic view. The methods may include determining whether the medical device tip is aligned with the target, displaying the target mark in a first color if the medical device tip is aligned with the target, and displaying the target mark in second color different from the first color if the medical device tip is not aligned with the target.

An apparatus is provided that is visible by both a three dimensional (3D) scanner system of a medical navigation system and a camera of the medical navigation system. The apparatus involves a rigid member and a plurality of markers attached to the rigid member. Each of the plurality of markers includes a reflective surface portion visible by the camera and a distinct identifiable portion visible by the 3D scanner system. The apparatus further involves a connector mechanism to connect the apparatus to a reference location. The apparatus is in a field of view of the 3D scanner system and the camera within a timeframe of the 3D scan.

A surgical system includes an arm extending from the base and having a distal end configured to be coupled to a tool, a first marker coupled in fixed relation to the base, and a tracking system. The tracking system is configured to collect first data indicative of a position of the first marker and collect second data indicative of a position an anatomical feature of a patient. The surgical system also includes a processor configured to calculate a position of the tool relative to the anatomical feature based on the first data and the second data.