A display control apparatus includes a processor, and the processor determines, in work on an object within a space, which one of a first picked-up image by a first image pickup device disposed at a first predetermined position within the space and a second picked-up image by a second image pickup device disposed at a second predetermined position different from the first predetermined position within the space is appropriate for confirmation of procedure in a state associated with the work on the object using a treatment instrument, outputs a determination result and controls display using at least one of the first picked-up image or the second picked-up image based on the determination result.

A robotic surgical system includes a first automated surgical system with a first user control console; a first robotic actuator; and a first surgical system controller comprising a first processor and a first memory component configured to store a first set of processor instructions and a first set of processor data. The robotic surgical system further includes a first surgical system communication interface; and a second automated surgical system that has a second user control console; a second robotic actuator; a second surgical system controller comprising a second processor and a second memory component configured to store a second set of processor instructions and a second set of processor data; and a second surgical system communication interface in data communication with the first surgical system communication interface. The second automated surgical system is controllable through the first user control console.

A system and a method are disclosed for forming an anastomosis between a first layer of tissue and a second layer of tissue of a patient's body. The system includes a first anastomosis device component and a second anastomosis device component configured to interact with the first anastomosis device component. The first anastomosis device component is configured to be delivered to a first lumen inside the patient's body. The second anastomosis device component is configured to be delivered to a second lumen inside the patient's body. The second anastomosis device includes one or more sensors configured to capture sensor data for determining an alignment of the second anastomosis device component relative to the first anastomosis device component, or for characterizing the position or orientation of the second anastomosis device component in three-dimensional space.

Described are colonoscopy systems and methods of using such systems. The colonoscopy systems may include an optical scanning system having at least one illuminator configured to produce spatially patterned light and solid light in at least one frame to illuminate tissue within the colon, and at least one camera configured to capture the at least one image of the illuminated tissue within the colon. Additionally, the optical scanning system may include at least one control system configured to construct at least one three dimensional point cloud representations of the tissue within the colon and detect at least one feature of interest using the at least one three dimensional point cloud and a pre-trained artificial intelligence engine.

A surgical system for computer assisted navigation during surgery, includes at least one processor that obtains a 3D radiological representation of a targeted anatomical structure of a patient and a set of fiducials of a registration fixture. The operations attempt to register locations of the set of fiducials in the 3D radiological representation to a 3D imaging space tracked by a camera tracking system. Based on determining one of the fiducials of the set has a location that was not successfully registered to the 3D imaging space, the operations display at least one view of the 3D radiological representation with a graphical overlay indicating the fiducial has not been successfully registered to the 3D imaging space, receive user-supplied location information identifying where the fiducial is located in the 3D radiological representation, and register the location of the fiducial to the 3D imaging space based on the user-supplied location information.

A robotic system is configured to automatically trigger a robotic action based on an identified phase of a medical procedure. The robotic system includes a video capture device; a robotic manipulator; one or more sensors; an input device; and control circuitry. The control circuitry is configured to: determine a first status of the robotic manipulator based on sensor data from the one or more sensors; identify a first input from the input device for initiating a first action of the robotic manipulator; perform a first analysis of a video of a patient site captured by the video capture device; identify a first phase of the medical procedure based at least in part on the first status of the robotic manipulator, the first input, and the first analysis of the video; and trigger a first automatic robotic action of the robotic manipulator based on the identified first phase.

A robotic system is configured to evaluate an identified phase of a medical procedure. The robotic system includes a video capture device; a robotic manipulator; one or more sensors; an input device; a data store; and control circuitry. The control circuitry is configured to: determine a first status of the robotic manipulator based on sensor data from the one or more sensors; identify a first input from the input device for initiating a first action of the robotic manipulator; perform a first analysis of a video of a patient site captured by the video capture device; identify a first phase of the medical procedure based at least in part on the first status of the robotic manipulator, the first input, and the first analysis of the video; and generate an evaluation of the first phase of the medical procedure based on one or more metrics associated with the first phase.

A system for using robotic telesurgery to implant a smart implant is disclosed. The system comprises a remote doctor module communicatively coupled with an operating room module over a cloud network. The operating room module comprises a robotic arm, a processor, and communication interface which communicates with the smart implant during the surgical procedure. The Operating Room Module testing the smart implant prior to implantation surgery; correlating data collected during the implantation surgery against past data from previous surgeries; determining whether the plurality of sensors is working properly; and transferring communication with the smart implant to a user device receive and monitor data from the plurality of sensors integrated into the smart implant to determine the smart implant is operating according as expected and to monitor the patient's condition.

Devices and methods for performing a surgical step or surgical procedure with visual guidance using an optical head mounted display are disclosed.

Systems and methods for operating a robotic surgical system are provided. The system includes a surgical tool, a manipulator comprising links for controlling the tool, a navigation system includes a tracker and a localizer to monitor a state of the tracker. Controller(s) determine a relationship between one or more components of the manipulator and one or more components of the navigation system by utilizing kinematic measurement data from the manipulator and navigation data from the navigation system. The controller(s) utilize the relationship to determine whether an error has occurred relating to at least one of the manipulator and the navigation system. The error is at least one of undesired movement of the manipulator, undesired movement of the localizer, failure of any one or more components of the manipulator or the localizer, and/or improper calibration data.