A surgical system for operating on a bone of a patient is described. The surgical system includes a reference device including one or more radiopaque markers, a first sensor configured to generate a first signal pertaining to orientation data of the reference device relative to a first coordinate system, a surgical instrument for coupling to an end effector, a second sensor configured to generate a second signal pertaining to orientation data of at least one of the end effector and the surgical instrument relative to a second coordinate system, and a navigation system. The navigation system is configured to determine an orientation of at least one of the end effector and the surgical instrument and superimpose a virtual representation of at least one of the end effector and the surgical instrument over the image based on the determined orientation and user input.

A method for creating a patient-specific surgical plan includes receiving one or more pre-operative images of a patient having one or more infirmities affecting one or more anatomical joints. three-dimensional anatomical model of the one or more anatomical joints is created based on the one or more pre-operative images. One or more transfer functions and the three-dimensional anatomical model are used to identify a patient-specific implantation geometry that corrects the one or more infirmities. The transfer functions model performance of the one or more anatomical joints as a function of anatomical geometry and anatomical implantation features. surgical plan comprising the patient-specific implantation geometry may then be displayed.

A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

A surgical system comprises an articulated mechanical arm comprising arm segments connected serially by arm joints that flex and rotate, and first and second input-devices. The second input-device comprises a handle configurable to be oriented in any orientation in an x-y-z space, and the handle comprises segment members and joint members corresponding to the arm segments and arm joints of the arm. The arm joints can be actuatable by, and have the same degrees of freedom as, the handle joint member. A method of using the surgical system includes retroflecting the arm, transitioning control of the arm from the first input device to the second input device, and performing a surgical action, during which a displacement vector or a reorientation arc of the handle member through the x-y-z space is translated to a corresponding displacement vector or corresponding reorientation arc of the end effector in the same x-y-z space.

A system for performing a surgical procedure includes a controller including a memory and a processor, the memory storing instructions, which when executed by the processor cause the processor to receive an image captured by a camera, generate a segmented image by applying a first threshold value to the image captured by the camera, identify a lumen within the segmented image, determine a centroid of the lumen within the segmented image, and align a portion of a surgical device operably coupled to the controller with the centroid of the lumen.

The present disclosure provides a system for enabling autonomous or semi-autonomous surgical operations. The system comprises: one or more processors that are individually or collectively configured to: process an image data stream comprising one or more images of a surgical site; fit a parametric model to a tissue surface identified in the one or more images; determine a direction for aligning a tool based in part on the parametric model; determine an optimal path for automatically moving the tool to perform a surgical procedure at the surgical site; and generate one or more control signals for controlling i) a movement of the tool based on the optimal path and ii) a tension force applied to the tissue by the tool during the surgical procedure.

The present invention relates to a method for producing complex reality three-dimensional images and a system for same, the method comprising: (a) a step for determining first reality three-dimensional spatial coordinates for a three-dimensional image of a human body; (b) a step for determining second reality three-dimensional spacial coordinates for an image of an item of medical equipment; (c) a step for obtaining a three-dimensional image of the area surrounding the medical equipment, from an imaging means in the medical equipment, and determining third reality three-dimensional spatial coordinates for said image; (d) a step for examining an image that is at the same coordinates in the three kinds of three-dimensional spatial coordinates; and (e) a step for producing a complex reality three-dimensional image by selecting the one image that is at the same coordinates, if there is one image at the same coordinates, or selecting the necessary image or images from among a plurality of images, if there are multiple images at the same coordinates.

Registration of a surgical image acquisition device (e.g. an endoscope) using preoperative and live contour signatures of an anatomical object is described. A control unit includes a processor configured to compare the real-time contour signature to the database of preoperative contour signatures of the anatomical object to generate a group of potential contour signature matches for selection of a final contour match. Registration of an image acquisition device to the surgical site is realized based upon an orientation corresponding to the selected final contour signature match.

Systems and methods are provided in which intraoperatively acquired surface data is employed to verify the correspondence of an intraoperatively selected spinal level with a spinal level that is pre-selected based on volumetric image data. Segmented surface data corresponding to the pre-selected spinal levels may be obtained from the volumetric image data, such that the segmented surface data corresponds to a spinal segment that is expected to be exposed and identified intraoperatively during the surgical procedure. The segmented surface data from the pre-selected spinal level, and adjacent segmented surface data from an adjacent spinal level that is adjacent to the pre-selected spinal level, is registered to the intraoperative surface data, and quality measures associated with the registration are obtained, thereby permitting an assessment or a determination of whether or not the pre-selected spinal surface (in the volumetric frame or reference) is likely to correspond to the intraoperatively selected spinal level.

Cutting tools, systems and methods for navigated procedures are provided. A cutting tool (e.g. oscillating blade, etc.) for a power tool has an optically trackable feature in a defined positional relationship relative to a cutting feature of the cutting tool. The trackable feature may include reflective material applied to a surface (e.g. a recessed blade surface). The trackable feature is be imaged by a camera integral with or attached to the power tool and provided to a computing unit of a navigation system to determine a relative pose of the cutting feature and camera. The camera may also track a patient's bone such that the computing unit may determine a relative position of the bone and camera. The unit then computes a relative pose of the cutting feature with respect to the patient's bone and provides same for determining display information and/or to a robotic controller for procedural control.