A surgical system for computer assisted navigation during surgery, includes at least one processor that obtains a 3D radiological representation of a targeted anatomical structure of a patient and a set of fiducials of a registration fixture. The operations attempt to register locations of the set of fiducials in the 3D radiological representation to a 3D imaging space tracked by a camera tracking system. Based on determining one of the fiducials of the set has a location that was not successfully registered to the 3D imaging space, the operations display at least one view of the 3D radiological representation with a graphical overlay indicating the fiducial has not been successfully registered to the 3D imaging space, receive user-supplied location information identifying where the fiducial is located in the 3D radiological representation, and register the location of the fiducial to the 3D imaging space based on the user-supplied location information.

A robotic system is configured to automatically trigger a robotic action based on an identified phase of a medical procedure. The robotic system includes a video capture device; a robotic manipulator; one or more sensors; an input device; and control circuitry. The control circuitry is configured to: determine a first status of the robotic manipulator based on sensor data from the one or more sensors; identify a first input from the input device for initiating a first action of the robotic manipulator; perform a first analysis of a video of a patient site captured by the video capture device; identify a first phase of the medical procedure based at least in part on the first status of the robotic manipulator, the first input, and the first analysis of the video; and trigger a first automatic robotic action of the robotic manipulator based on the identified first phase.

A robotic system is configured to evaluate an identified phase of a medical procedure. The robotic system includes a video capture device; a robotic manipulator; one or more sensors; an input device; a data store; and control circuitry. The control circuitry is configured to: determine a first status of the robotic manipulator based on sensor data from the one or more sensors; identify a first input from the input device for initiating a first action of the robotic manipulator; perform a first analysis of a video of a patient site captured by the video capture device; identify a first phase of the medical procedure based at least in part on the first status of the robotic manipulator, the first input, and the first analysis of the video; and generate an evaluation of the first phase of the medical procedure based on one or more metrics associated with the first phase.

A method for engaging and disengaging a surgical instrument of a surgical robotic system including receiving a sequence of user inputs from one or more user interface devices of the surgical robotic system; determining, by one or more processors communicatively coupled to the user interface devices and the surgical instrument, whether the sequence of user inputs indicates an intentional engagement or disengagement of a teleoperation mode in which the surgical instrument is controlled by user inputs received from the user interface devices; in response to determining of engagement, transition the surgical robotic system into the teleoperation mode; and in response to determining of disengagement, transition the surgical robotic system out of the teleoperation mode such that the user interface devices are prevented from controlling the surgical instrument.

Provided herein are surgical lighting devices, systems, and methods. In particular, provided herein are sterile surgical lights and uses thereof.

A camera tracking system receives patient reference tracking information indicating pose of a patient reference array tracked by a patient tracking camera relative to a patient reference frame. A local XR headset view pose transform is determined between a local XR headset reference frame and the patient reference frame. Remote reference tracking information is received indicating pose of a remote reference array tracked by a remote reference tracking camera. A remote XR headset view pose transform is determined between a remote XR headset reference frame of a remote XR headset and the remote reference array. A 3D computer image is transformed from a local pose determined using the local XR headset view pose transform to a remote pose determined using the remote XR headset view pose transform. The transformed 3D computer image is provided to the remote XR headset for display with the remote pose relative to the remote XR headset reference frame.

An exemplary system includes a memory storing instructions and a processor communicatively coupled to the memory. The processor may be configured to execute the instructions to obtain one or more operating characteristics of an instrument located in a surgical space; obtain one or more anatomical characteristics associated with the surgical space; and direct a computer-assisted surgical system to automatically perform, based on the based on the one or more operating characteristics of the device and the one or more anatomical characteristics associated with the surgical space, an operation with the instrument located in the surgical space.

Surgical systems and methods are provided that utilize augmented reality navigation and visualization techniques for transferring aspects of a preoperative surgical plan to an actual surgical site. The surgical systems and methods may be utilized to achieve accurate alignment of a surgical positioning object, such as a guide pin for guiding surgical reaming procedures, between the preoperative surgical plan and the intraoperative anatomy associated with the actual surgical site. Augmented reality may be utilized to achieve visualization of both an entry point and a drilling trajectory of the surgical positioning object in a manner that avoids occluding the intraoperative anatomy during the procedure.

Automated user preferences can be applied on head-mounted devices, such as smartglasses. A head-mounted device is configured for this purpose. Upon recognizing a three-dimensional orientation of the head-mounted device as a three-dimensional orientation for which an associated set of parameters is stored, the parameters associated with the recognized three-dimensional orientation for the image sensor are automatically loaded and set.

The present application relates to an optical observation device which is controlled in a sterility preserving manner, and to a corresponding controlling program and/or program storage medium. The optical observation device includes a main structure having at least one optical camera, a motorized support for positioning the main structure, and a control unit that receives a sequence of images from the at least one optical camera, searches a current image from the sequence of images for a trackable object, tracks the trackable object shown in the sequence of images subsequent to the current image, and controls the motorized support structure.