An image processing part applies an image process by software to a surgical region image, and a display control part controls a display of the surgical region image to which the image process is applied. The image processing part produces a pre-update processed image acquired by applying the image process established before updating the software to the surgical region image and a post-update processed image acquired by applying the image process established after updating the software to the surgical region image, and the display control part controls a display of at least a portion of at least either one of the pre-update processed image or the post-update processed image. The present technique is applicable to a CCU of an endoscopic surgery system.

A surgical system according to one or more embodiments may include: manipulators respectively supporting an endoscope and first and second surgical instruments; a remote control apparatus including a display device, a first operation handle for right hand to operate the first surgical instrument, and a second operation handle for left hand to operate the second surgical instrument; and a control apparatus. The control apparatus may display, on the display device, a graphical user interface, overlapped with the image captured by the endoscope, the graphical user interface including a first area that displays information on the first surgical instrument to be operated by the first operation handle, a second area that displays information on the second surgical instrument to be operated by the second operation handle, and a third area that displays information on the endoscope, which are arranged side by side in order from right to left.

A robotic system is configured to evaluate an identified phase of a medical procedure. The robotic system includes a video capture device; a robotic manipulator; one or more sensors; an input device; a data store; and control circuitry. The control circuitry is configured to: determine a first status of the robotic manipulator based on sensor data from the one or more sensors; identify a first input from the input device for initiating a first action of the robotic manipulator; perform a first analysis of a video of a patient site captured by the video capture device; identify a first phase of the medical procedure based at least in part on the first status of the robotic manipulator, the first input, and the first analysis of the video; and generate an evaluation of the first phase of the medical procedure based on one or more metrics associated with the first phase.

A system for determining relative positions of subsystems of a robot-assisted surgical system includes a subsystem component including a plurality of manipulator arms and a surgeon console. Each subsystem component includes at least one of an optical tracker and a light emitter. Image data from the optical trackers is analyzed to determine the relative positions of the subsystems.

A camera tracking system receives patient reference tracking information indicating pose of a patient reference array tracked by a patient tracking camera relative to a patient reference frame. A local XR headset view pose transform is determined between a local XR headset reference frame and the patient reference frame. Remote reference tracking information is received indicating pose of a remote reference array tracked by a remote reference tracking camera. A remote XR headset view pose transform is determined between a remote XR headset reference frame of a remote XR headset and the remote reference array. A 3D computer image is transformed from a local pose determined using the local XR headset view pose transform to a remote pose determined using the remote XR headset view pose transform. The transformed 3D computer image is provided to the remote XR headset for display with the remote pose relative to the remote XR headset reference frame.

A system that compensates for movement during a surgical procedure on a patient includes a lidar array and a processor. The surgical procedure operates according to a surgical plan. The lidar array tracks the movement of the patient, a medical instrument, and/or a medical professional during the procedure. The processor modifies the surgical plan to compensate for one or more of the movements.

A system for using robotic telesurgery to implant a smart implant is disclosed. The system comprises a remote doctor module communicatively coupled with an operating room module over a cloud network. The operating room module comprises a robotic arm, a processor, and communication interface which communicates with the smart implant during the surgical procedure. The Operating Room Module testing the smart implant prior to implantation surgery; correlating data collected during the implantation surgery against past data from previous surgeries; determining whether the plurality of sensors is working properly; and transferring communication with the smart implant to a user device receive and monitor data from the plurality of sensors integrated into the smart implant to determine the smart implant is operating according as expected and to monitor the patient's condition.

The present invention relates to an apparatus for tracking a position of an interventional device respective an image plane of an ultrasound field. The position includes an out-of-plane distance (Dop). A geometry-providing unit (GPU) includes a plurality of transducer-to-distal-end lengths (Ltde.sub.1 . . . n), each length corresponding to a predetermined distance (Ltde) between a distal end of an interventional device and an ultrasound detector attached to the interventional device, for each of a plurality of interventional device types (T.sub.1 . . . n). An image fusion unit (IFU) receives data indicative of the type (T) of the interventional device being tracked; and based on the type (T): selects from the geometry-providing unit (GPU), a corresponding transducer-to-distal-end length (Ltde); and indicates in a reconstructed ultrasound image (RUI) both the out-of-plane distance (Dop) and the transducer-to-distal-end length (Ltde) for the interventional device within the ultrasound field.

Devices and methods for performing a surgical step or surgical procedure with visual guidance using an optical head mounted display are disclosed.

In an example, a graphical user interface can be used to display a graphical representation of a virtual reference structure for an anatomic structure, the reference structure being determined from geometry of the anatomic structure. A location parameter along the reference structure is determined in response to a first user input from a user input device. A graphical proxy marker is displayed on the graphical representation of the reference structure based on the location parameter. A fixed location is selected along the reference structure for a final graphical marker in response to a second user input from the from the user input device. An output visualization is generated to include at least one view of the anatomic structure and a graphical representation of the final graphical marker at the fixed location.