Provided is an image processing device including a matching unit that performs matching processing between a predetermined pattern on a surface of a 3D model of a biological tissue including an operating site generated on the basis of a preoperative diagnosis image and a predetermined pattern on a surface of the biological tissue included in a captured image during surgery, a shift amount estimation unit that estimates an amount of deformation from a preoperative state of the biological tissue on the basis of a result of the matching processing and information regarding a three-dimensional position of a photographing region which is a region photographed during surgery on the surface of the biological tissue, and a 3D model update unit that updates the 3D model generated before surgery on the basis of the estimated amount of deformation of the biological tissue.

The present technology relates to an image processing device, a method of image processing, and a surgical microscope that can detect and report a dangerous condition on the basis of a tomographic image during eye surgery. An image processing device includes: a dangerous condition detection unit configured to detect a dangerous condition on the basis of a tomographic image of an eye acquired during surgery of the eye; and a control information generation unit configured to generate and output control information used to manage the detected dangerous condition. The present technology is applicable to, for example, a surgical system used for eye surgery or other surgical procedures.

A method of verifying torque measurements of a reaction torque transducer of an instrument drive unit includes a controller receiving a verification signal, generating an acceptable range of torques, receiving a torque signal, comparing the torque signal to the acceptable range of torques, and stopping a motor if the torque applied by the motor is outside of the acceptable range of torques. The verification signal is indicative of the current drawn by the motor and the torque signal is indicative of torque applied by the motor.

A method for providing a feedback on a surgical outcome by a computer includes dividing, by the computer, actual surgical data obtained in an actual surgical process into a plurality of detailed surgical operations to obtain actual surgical cue sheet data composed of the plurality of detailed surgical operations, obtaining, by the computer, reference cue sheet data about the actual surgery, and comparing, by the computer, the actual surgical cue sheet data with the reference cue sheet data, and providing, by the computer, the feedback based on the comparison result.

A method for enhanced surgical navigation, and a system performing the method and displaying graphical user interfaces associated with the method. A 3D spatial map of a surgical site is generated using a 3D endoscope including a camera source and an IR scan source. The method includes detecting a needle tip protruding from an anatomy and determining a needle protrusion distance corresponding to a distance between the needle tip and a surface of the anatomy using the 3D spatial map. A position of a surgical tool in the 3D spatial map is detected and a determination is made by the system indicative of whether the needle protrusion distance is sufficient for grasping by the surgical tool. A warning is generated when it is determined that the needle protrusion distance is not sufficient for grasping by the surgical tool.

Techniques for automated rotation of a needle in a computer-assisted system include an end effector having a drive mechanism configured to be coupled to a curved needle and configured to rotationally actuate the curved needle along an arcuate path and a control unit coupled to the drive mechanism. The control unit is configured to, in response to receiving a first input, cause the drive mechanism to rotationally actuate the curved needle by a first preset rotation amount along the arcuate path, and, in response to receiving a second input, cause the drive mechanism to rotationally actuate the curved needle by a second preset rotation amount along the arcuate path.

A system for performing a minimally invasive procedure comprises a flexible catheter with a lumen extending therethrough. The system also comprises an elongate instrument sized for passage through the lumen and an optical coherence tomographic sensor coupled to the elongate instrument. The system also comprises a control system that includes one or more processors. The control system is configured to receive sensor data from the optical coherence tomographic sensor, profile a tissue based on the received sensor data, generate an output signal based on the profiled tissue, and based on receipt of the output signal, generate a command to indicate or affect movement of the elongate instrument.

Systems and methods are provided in which intraoperatively acquired surface data is employed to verify the correspondence of an intraoperatively selected spinal level with a spinal level that is pre-selected based on volumetric image data. Segmented surface data corresponding to the pre-selected spinal levels may be obtained from the volumetric image data, such that the segmented surface data corresponds to a spinal segment that is expected to be exposed and identified intraoperatively during the surgical procedure. The segmented surface data from the pre-selected spinal level, and adjacent segmented surface data from an adjacent spinal level that is adjacent to the pre-selected spinal level, is registered to the intraoperative surface data, and quality measures associated with the registration are obtained, thereby permitting an assessment or a determination of whether or not the pre-selected spinal surface (in the volumetric frame or reference) is likely to correspond to the intraoperatively selected spinal level.

A method for adjusting the operation of a surgical instrument using machine learning in a surgical suite is disclosed. The method comprises the steps of gathering data during surgical procedures, wherein the surgical procedures include the use of a surgical instrument, analyzing the gathered data to determine an appropriate operational adjustment of the surgical instrument, and adjusting the operation of the surgical instrument to improve the operation of the surgical instrument.

A surgical system includes an arm extending from the base and having a distal end configured to be coupled to a tool, a first marker coupled in fixed relation to the base, and a tracking system. The tracking system is configured to collect first data indicative of a position of the first marker and collect second data indicative of a position an anatomical feature of a patient. The surgical system also includes a processor configured to calculate a position of the tool relative to the anatomical feature based on the first data and the second data.