Collisions between a minimally invasive surgical instrument and patient tissue are prevented in various ways. A real time image of a surgical site is mosaiced over a previously recorded more distal image of the site. Surgical instruments are visible in the real time image, and representations of the surgical instruments as they would appear in the previously recorded image are generated and displayed on the previously recorded image. Consequently, a person moving the surgical instruments sees a representation of the instruments outside the field of view of an imaging system taking the real time images.

Certain aspects relate to systems and techniques for surgical robotic arm setup. In one aspect, there is provided a system including a first robotic arm configured to manipulate a medical instrument, a processor, and a memory. The processor may be configured to: determine a minimum stroke length of the first robotic arm that allows advancing of the medical instrument by the first robotic arm to reach a target region from an access point via a path, determine a boundary for an initial pose of the first robotic arm based on the minimum stroke length and a mapping stored in the memory, and during an arm setup phase prior to performing a procedure, provide an indication of the boundary during movement of the first robotic arm.

Telerobotic, telesurgical, and surgical robotic devices, systems, and methods selectively calibrate end effector jaws by bringing the jaw elements into engagement with each other. Commanded torque signals may bring the end effector elements into engagement while monitoring the resulting position of a drive system, optionally using a second derivative of the torque/position relationship so as to identify an end effector engagement position. Calibration can allow the end effector engagement position to correspond to a nominal closed position of an input handle by compensating for wear on the end effector, the end effector drive system, then manipulator, the manipulator drive system, the manipulator/end effector interfacing, and manufacturing tolerances.

A system includes a master manipulator and a controller. The controller determines, before the system enters a following mode, a relative orientation between an orientations of an axis of the master manipulator in an eye frame and a corresponding axis of a slave instrument tip in a camera frame. After the system enters the following mode, the controller determines whether an orientation misalignment between the orientations of the axis of the master manipulator and the corresponding axis of the slave instrument tip is less than or equal to a maximum permitted orientation error. When the orientation misalignment is less than or equal to the maximum permitted orientation error, the controller receives a command indicating a desired orientation of the slave instrument tip from the master manipulator and commands the system to orient the slave instrument tip based on the desired orientation of the slave instrument tip and the relative orientation.

A controller stores the orientations of a master tool grip and a slave surgical instrument tip upon completion of a master-slave alignment process, and enters following. During following each commanded movement of the slave surgical instrument tip from the master tool grip is processed by the controller to compensate for any alignment error between the master tool grip and the slave surgical instrument tip before following was entered. The result of this processing is that the motion of the slave surgical instrument tip intuitively corresponds to the motion of the master tool grip despite an initial swooping orientation misalignment between the master tool grip and the slave surgical instrument tip.

A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.

One example method for improving the efficiency of robotic surgical procedures by integrating applications into the surgeon console user interface is presented. The method includes generating and displaying a first graphical user interface at a surgeon console associated with a robotic surgical device during a robotic surgical procedure, and detecting a combination of user actions through control devices of the surgeon console. The method further includes responsive to detecting the combination of the user actions, causing surgical tools of the robotic surgical device to be locked and generating and displaying a second graphical user interface at the surgeon console which includes user interfaces of applications and is configured to be interactive through the control devices. The method further includes detecting a user action to exit the application mode, causing the surgical tools to be unlocked, and updating and displaying the first graphical user interface at the surgeon console.

Methods, apparatuses, and systems for edge computing for robotic telesurgery using artificial intelligence are disclosed. A robotic surgical system includes surgery equipment and can communicate via a cloud network. The system can include operation room (OR) equipment and a surgical computer. The surgical computer transfers data between a remote surgeon, the OR equipment, and the surgery equipment. The surgical computer receives, using the OR equipment and the surgery equipment, data related to a surgical procedure. The data is related to the surgical procedure and is computed using artificial intelligence (AI). The surgical computer determines a risk assessment based on data related to the surgery equipment. The surgical computer sends an indication of the determined risk assessment to the remote surgeon.

A surgical system and method involve a robotic system with a base and a localizer that monitors a tracker supported by the robotic system. Sensor(s) are coupled to the robotic system and/or the localizer. Controller(s) determine a relationship between the base and the localizer. The controller(s) monitor the relationship to detect an error related to one or both of the robotic system and the localizer. The controller(s) utilize the sensor(s) to determine a cause of the error.

An apparatus for providing haptic guidance during manipulation of an end-effector includes a robotic arm. The robotic arm has at least one actuated joint, at least one other joint connected to the at least one actuated joint, and a physical constraint movable by actuation of the at least one actuated joint. The physical constraint limits the motion of the at least one other joint in at least one direction. The apparatus further includes an end-effector configured to be manipulated by an application of external forces and connected to the at least one other joint.