Provided is an image processing device including a matching unit that performs matching processing between a predetermined pattern on a surface of a 3D model of a biological tissue including an operating site generated on the basis of a preoperative diagnosis image and a predetermined pattern on a surface of the biological tissue included in a captured image during surgery, a shift amount estimation unit that estimates an amount of deformation from a preoperative state of the biological tissue on the basis of a result of the matching processing and information regarding a three-dimensional position of a photographing region which is a region photographed during surgery on the surface of the biological tissue, and a 3D model update unit that updates the 3D model generated before surgery on the basis of the estimated amount of deformation of the biological tissue.

A method for enhanced surgical navigation, and a system performing the method and displaying graphical user interfaces associated with the method. A 3D spatial map of a surgical site is generated using a 3D endoscope including a camera source and an IR scan source. The method includes detecting a needle tip protruding from an anatomy and determining a needle protrusion distance corresponding to a distance between the needle tip and a surface of the anatomy using the 3D spatial map. A position of a surgical tool in the 3D spatial map is detected and a determination is made by the system indicative of whether the needle protrusion distance is sufficient for grasping by the surgical tool. A warning is generated when it is determined that the needle protrusion distance is not sufficient for grasping by the surgical tool.

A system may comprise a tool including at least one reference feature. a processor, and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, may cause the system to receive image data including an image of the tool and the at least one reference feature, determine a pose of the tool from the image data, and modify the image data to visually decrement a portion of the image data corresponding to the at least one reference feature.

A surgical system according to one or more embodiments may include: manipulators respectively supporting an endoscope and first and second surgical instruments; a remote control apparatus including a display device, a first operation handle for right hand to operate the first surgical instrument, and a second operation handle for left hand to operate the second surgical instrument; and a control apparatus. The control apparatus may display, on the display device, a graphical user interface, overlapped with the image captured by the endoscope, the graphical user interface including a first area that displays information on the first surgical instrument to be operated by the first operation handle, a second area that displays information on the second surgical instrument to be operated by the second operation handle, and a third area that displays information on the endoscope, which are arranged side by side in order from right to left.

Methods, systems, and computer-readable media for detecting image degradation during a surgical procedure are provided. A method includes receiving images of a surgical instrument; obtaining baseline images of an edge of the surgical instrument; comparing a characteristic of the images of the surgical instrument to a characteristic of the baseline images of the edge of the surgical instrument, the images of the surgical instrument being received subsequent to obtaining the baseline images of the edge of the surgical instrument and being received while the surgical instrument is disposed at a surgical site in a patient; determining whether the images of the surgical instrument are degraded, based on the comparing of the characteristic of the images of the surgical instrument and the characteristic of the baseline images of the surgical instrument; and generating an image degradation notification, in response to a determination that the images of the surgical instrument are degraded.

A method for creating a patient-specific surgical plan includes receiving one or more pre-operative images of a patient having one or more infirmities affecting one or more anatomical joints. three-dimensional anatomical model of the one or more anatomical joints is created based on the one or more pre-operative images. One or more transfer functions and the three-dimensional anatomical model are used to identify a patient-specific implantation geometry that corrects the one or more infirmities. The transfer functions model performance of the one or more anatomical joints as a function of anatomical geometry and anatomical implantation features. surgical plan comprising the patient-specific implantation geometry may then be displayed.

Apparatus and methods are described for performing a procedure using a robotic unit. A tool-actuation arm is driven to move linearly, to thereby move at least the portion of the tool linearly with respect to the end effector. The tool-actuation arm is driven to become retracted to a given distance from the tool mount, thereby causing the tool-actuation arm to fold automatically by actuating an automatic tool-actuation arm folding mechanism. Other applications are also described.

The present disclosure provides a system for enabling autonomous or semi-autonomous surgical operations. The system comprises: one or more processors that are individually or collectively configured to: process an image data stream comprising one or more images of a surgical site; fit a parametric model to a tissue surface identified in the one or more images; determine a direction for aligning a tool based in part on the parametric model; determine an optimal path for automatically moving the tool to perform a surgical procedure at the surgical site; and generate one or more control signals for controlling i) a movement of the tool based on the optimal path and ii) a tension force applied to the tissue by the tool during the surgical procedure.

A method for adjusting the operation of a surgical instrument using machine learning in a surgical suite is disclosed. The method comprises the steps of gathering data during surgical procedures, wherein the surgical procedures include the use of a surgical instrument, analyzing the gathered data to determine an appropriate operational adjustment of the surgical instrument, and adjusting the operation of the surgical instrument to improve the operation of the surgical instrument.

An access device for accessing an intervertebral disc having an outer shield comprising an access shield with a larger diameter (˜16-30 mm) that reaches from the skin down to the facet line, with an inner shield having a second smaller diameter (˜5-12 mm) extending past the access shield and reaches down to the disc level. This combines the benefits of the direct visual microsurgical/mini open approaches and the percutaneous, “ultra-MIS” techniques.