An endoscopic vessel harvesting system for surgical removal of a blood vessel to be used for coronary bypass uses endoscopic instruments for isolating and severing the vessel. An endoscopic camera in the endoscopic instruments captures images from a distal tip of the instrument within a dissected tunnel around the vessel. An image processor assembles a three-dimensional model of the tunnel from a series of images captured by the endoscopic camera. An augmented-reality display coupled to the image processor renders (e.g., visibly displays to the user in their field of view) a consolidated map representing the three-dimensional model along with a marker in association with the map indicating a current location of the distal tip.

A robotic surgical system in which the system applies a scaling factor between user input from a user input device and corresponding movements of the robotic manipulator. Scaling factors may be applied or adjusted based on detected conditions such as the type of instrument being manipulated, detected distance between multiple instruments being manipulated, user biometric parameters.

A virtual reality system providing a virtual robotic surgical environment, and methods for using the virtual reality system, are described herein. Within the virtual reality system, various user modes enable different kinds of interactions between a user and the virtual robotic surgical environment. For example, one variation of a method for facilitating navigation of a virtual robotic surgical environment includes displaying a first-person perspective view of the virtual robotic surgical environment from a first vantage point, displaying a first window view of the virtual robotic surgical environment from a second vantage point and displaying a second window view of the virtual robotic surgical environment from a third vantage point. Additionally, in response to a user input associating the first and second window views, a trajectory between the second and third vantage points can be generated sequentially linking the first and second window views.

Provided is a control device including a control unit that calculates a first positional relationship between an eye of an observer observing an object displayed on a display unit and a first point in a master-side three-dimensional coordinate system, and controls an imaging unit that images the object so that a second positional relationship between the imaging unit and a second point corresponding to the first point in a slave-side three-dimensional coordinate system corresponds to the first positional relationship.

A robotic surgical system and method are disclosed for transitioning control to a secondary robotic arm controller. In one embodiment, a robotic surgical system comprises a user console comprising a display device and a user input device; a robotic arm configured to be coupled to an operating table; a primary robotic arm controller configured to move the robotic arm in response to a signal received from the user input device at the user console; and a secondary robotic arm controller configured to move the robotic arm in response to a signal received from a user input device remote from the user console. Control over movement of the robotic arm is transitioned from the primary robotic arm controller to the secondary robotic arm controller in response to a failure in the primary robotic arm controller. Other embodiments are provided.

In an embodiment, an electrogram (EGM) processing system provides, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry. The HMD also displays an electrogram waveform. The EGM processing system determines a gaze direction of the user by processing sensor data from the HMD. The HMD displays a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform. The EGM processing system determines a measurement of the electrogram waveform using the location of the marker. The HMD displays the measurement of the electrogram waveform.

A computer assisted surgery system comprising: a computerised surgical apparatus; and a control apparatus; wherein the control apparatus comprises circuitry configured to: receive information indicating a first region of a surgical scene from which information is obtained by the computerised surgical apparatus to make a decision; receive information indicating a second region of the surgical scene from which information is obtained by a medical professional to make a decision; determine if there is a discrepancy between the first and second regions of the surgical scene; and if there is a discrepancy between the first and second regions of the surgical scene: perform a predetermined process based on the discrepancy.

Systems, methods, and instrumentalities are disclosed for switching a control scheme to control a set of system modules and/or modular devices of a surgical hub. A surgical hub may determine a first control scheme that is configured to control a set of system modules and/or modular devices. The surgical hub may receive an input from one of the set of modules or a device located in an OR. The surgical hub may make a determination that at least one of a safety status level or an overload status level of the surgical hub is higher than its threshold value. Based on at least the received input and the determination, the surgical hub may determine a second control scheme to be used to control the set of system modules. The surgical hub may send a control program indicating the second control scheme to one or more system modules and/or modular devices.

A teleoperational medical system includes a teleoperational control system, a teleoperational manipulator, an operator controller. The control system includes a processing unit configured to: determine a position and orientation of a marker on an operator of the operator controller; determine whether a head portion of the operator is directed toward or away from a display region of a display; based on a determination that the head portion is directed toward the display region, initiate an operator following mode in which a movement of the operator controller provides a corresponding movement to the teleoperational manipulator; and based on a determination that the head portion is directed away, suspend the operator following mode. The determination that the head portion is directed away from the display region of the display device includes determining whether the head portion of the operator is directed away from the display region for a threshold time period.

A robot-assisted surgical system has a user interface operable by a user, a first robotic manipulator having a first surgical instrument, and a second robotic manipulator having a second surgical instrument. The system receives user input in response to movement of the input device by a user and causes the manipulator to move the first surgical instrument in response to the user input, determines a vector defined by the position of the first surgical instrument relative to the second surgical instrument, generates dynamic control signals based on the determined vector, and causes the manipulator to move the second surgical instrument in response to said dynamic control signals.