An optical imaging system for imaging a target during a medical procedure, the optical imaging system involving a first camera for capturing a first image of the target, a second wide-field camera for capturing a second image of the target, at least one optional path folding mirror disposed in an optical path between the target and a lens of the second camera, and a processor for receiving the first image and the second image, the processor configured to apply an image transform to one of the first image and the second wide-field image and combine the transformed image with the other one of the images to produce a stereoscopic image of the target.

A system for controlling a medical image capture device during surgery is provided, the system including circuitry configured to acquire first image data from the medical image capture device, the first image data being of an appearance of a surgical scene at a first instance of time; determine, based on a predicted appearance of the surgical scene based on the first image data at a second instance of time after the first instance of time, one or more desired image capture properties of the medical image capture device; and control the medical image capture device at a third instance of time, the third instance of time being between the first instance of time and the second instance of time, in accordance with the one or more desired image capture properties of the medical image capture device.

The invention relates to a method for displaying an injection point for a medical instrument. The method comprises the following steps: Providing at least one marker on a surface of an object, with such marker exhibiting the property that it can be recorded both tomographically, in particular fluoroscopically, and also optically; Generating tomographic image data that can be used to reconstruct a fluoroscopic image of the at least one marker, located on the surface of the object, together with the object; Determining the insertion point for the medical instrument on the surface of the object relative to the at least one marker in the coordinate system of the tomographic image data; Generating visual image data that can be used to reconstruct a visual image of the at least one marker, located on the surface of the object, together with the object; Transforming the coordinate of the insertion point in the coordinate system of the tomographic image data into the coordinate system of the visual image data using the relative position of the insertion point to the at least one marker; and Displaying the insertion point for the medical instrument in real time in a view of the object.

An exemplary system is configured to detect user input directing a telestration element to be drawn within an image depicting a surface within a scene; render, based on depth data representative of a depth map for the scene and within a three dimensional (3D) image depicting the surface within the scene, the telestration element; record a 3D position within the scene at which the telestration element is rendered within the 3D image; detect a telestration termination event that removes the telestration element from being rendered within the 3D image; and indicate, subsequent to the telestration termination event, an option to again render the telestration element at the 3D position.

A robotic system for treating a patient includes a robotic arm with an end effector for treating the patient, wherein the robotic arm is configured to be movable in a space surrounding the patient, and the end effector is configured to be movable individually and co-movable with the robotic arm in said space; a sensing device for acquiring data associating with coordinates and images of the end effector and the patient; and a controller in communications with the robotic arm and the sensing device for controlling movements of the robotic arm with the end effector and treatments of the patient with the end effector based on the acquired data and a treatment plan.

An accuracy system configured to determine the accuracy of a stereotactic system The accuracy system is configured to determine a displacement between a pointer tip positioned by the stereotactic system and a target point defined by a phantom base. The accuracy system is configured to mechanically engage the phantom base when the phantom base mechanically engages the stereotactic system to determine the displacement. In examples, a gauge support mechanically engages a pin of the phantom base and determines the displacement using one or more visible indicia. In examples, a gauge frame supports one or more cameras and determines the displacement using a first image and a second image obtained by the one or more cameras. The accuracy system provides an output viewable by a practitioner to indicate the determined displacement.

A number of improvements are provided relating to computer aided surgery utilizing an on tool tracking system. The various improvements relate generally to both the methods used during computer aided surgery and the devices used during such procedures. Other improvements relate to the structure of the tools used during a procedure and how the tools can be controlled using the OTT device. Still other improvements relate to methods of providing feedback during a procedure to improve either the efficiency or quality, or both, for a procedure including the rate of and type of data processed depending upon a CAS mode.

A display system for a medical suite comprises a scanning device configured to capture scanning data in the medical suite. At least one display configured to display information in an operating region of the medical suite. A controller is in communication with the scanning device and the display. The controller is configured to control the scanning device to capture identifying information of a patient. Based on the identifying information, the controller is configured to authenticate an identity of the patient. Based on the identity, the controller is configured to access a patient record for the patient. The controller is further configured to control the at least one display to display information based on the patient record.

A method for generating an intraoperative 3D brain model while a patient is operated. Before an opening in a patient's skull is made, the method includes: providing a preoperative 3D brain model of a patient's brain and converting it to a preoperative 3D brain point cloud; providing a preoperative 3D face model of a patient's face and converting it to a preoperative 3D face point cloud. After the opening in the patient's skull is made, the method includes: matching the intraoperative 3D face point cloud with the preoperative 3D face point cloud to find a face point transformation; transforming the intraoperative 3D brain point cloud based on said face point cloud transformation; comparing the intraoperative 3D brain point cloud with the preoperative 3D brain point cloud to determine a brain shift; and converting the preoperative 3D brain model to generate an intraoperative 3D brain model based on said brain shift.

A method for adjusting the operation of a surgical instrument using machine learning in a surgical suite is disclosed.