A method for disengagement detection of a surgical instrument of a surgical robotic system, the method comprising: determining whether a user's head is unstable prior to disengagement of a teleoperation mode; determining whether a pressure release has occurred relative to at least one of a first user input device or a second user input device for controlling a surgical instrument of the surgical robotic system during the teleoperation mode; and in response to determining the user's head is unstable or determining the pressure release has occurred, determining whether a distance change between the first user input device and the second user input device indicates the user is performing an unintended action prior to disengagement of the teleoperation mode.

An exemplary system includes a memory storing instructions and a processor communicatively coupled to the memory. The processor may be configured to execute the instructions to obtain one or more operating characteristics of an instrument located in a surgical space; obtain one or more anatomical characteristics associated with the surgical space; and direct a computer-assisted surgical system to automatically perform, based on the based on the one or more operating characteristics of the device and the one or more anatomical characteristics associated with the surgical space, an operation with the instrument located in the surgical space.

Automated user preferences can be applied on head-mounted devices, such as smartglasses. A head-mounted device is configured for this purpose. Upon recognizing a three-dimensional orientation of the head-mounted device as a three-dimensional orientation for which an associated set of parameters is stored, the parameters associated with the recognized three-dimensional orientation for the image sensor are automatically loaded and set.

A computing system may use redundant communication pathways for communicating surgical imaging feed(s). The computing system may obtain multiple surgical video streams via multiple pathways. The multiple surgical video streams may include copies of the same video. The surgical video streams may be obtained, for example, from the same intra-body imaging feed, such as intra-body visual light feed. For example, a first video stream may be obtained via a communication pathway, and a second video stream may be obtained via another communication pathway. The computing system may display or send a surgical video stream for display. The computing system may whether the video stream being displayed has encountered any issues. Upon detecting an issue with the video stream being displayed, the computing system may display or send another obtained surgical video stream for display.

A user interface for a surgical robotic system includes a plurality of handles, each removably attachable to a user interface assembly by a quick release connector. The selection of handles can include handles of varying size, degree of complexity, handles adapted for laparoscopic motion, handles adapted for true cartesian motion or handles customized to surgeon anthropometric data, etc.

A mixed reality (MR) visualization system includes an MR device comprising a holographic display configured to display a holographic image to an operator, a hand-held ultrasound imaging device configured to obtain a real-time ultrasound image of a subject's anatomy, and a computing device communicatively coupled to the MR device and the hand-held ultrasound imaging device. The computing device includes a non-volatile memory and a processor. The computing device is configured to receive the real-time ultrasound image, determine a real-time 3D position and orientation of the hand-held ultrasound imaging device, generate a modified real-time ultrasound image by modifying the real-time ultrasound image to correspond to the real-time 3D position and orientation of the hand-held ultrasound imaging device, and transmit the modified real-time ultrasound image to the MR device for display as the holographic image positioned at a predetermined location relative to the hand-held ultrasound imaging device.

A method for performing auto-focus in a camera is disclosed. The method includes: receiving, from a tracking system for tracking a position of a medical instrument, a signal; determining, based on the received signal, that the medical instrument is removed from a field of view of the camera; in response to determining that a continuous auto-focus mode for the camera is enabled: retrieving, from a database, a first focus distance value representing a focus distance that was most recently set with intent for the camera; and automatically updating a focus distance of the camera to the first focus distance value.

An augmented reality and extended reality surgical system comprising three 3D viewing options of: (i) an AR/XR headset or headsets, (ii) one or more autostereoscopic “3D glasses free” monitor(s); and (iii) one or more digital ocular stereoscopic 3D viewports which is mounted to a cobotic arm viewing option for ergonomically sound viewing. The system may comprise a wearable device, such as a head mounted display or glasses, that provides the user with virtual reality, augmented reality, and/or mixed reality for surgery visualization. This system is all digital and features both wired and wireless connections that have approximately the same latency of less than 20 milliseconds. This may allow the user to access 2D or 3D imaging, magnification, virtual visualization, six-degrees of freedom (6DoF) image management, and/or other images while still viewing real reality and thus maintaining a presence in the operating room. The all-digital multi-option 3D viewing surgery system provides an ergonomically sound surgery visualization system.

An apparatus for obtaining an image of a retina has an optical relay that defines an optical path and is configured to relay an image of the iris along the optical path to a pupil; a shutter disposed at the pupil and configured to define at least a first shutter aperture for control of light transmission through the pupil position; a tube lens disposed to direct light from the shutter aperture to an image sensor; and a prismatic input port disposed between the shutter and the tube lens and configured to combine, onto the optical path, light from the relay with light conveyed along a second light path that is orthogonal to the optical path.

A method of operating a surgical control system comprises generating an image of a surgical environment from a viewpoint of an imaging tool. The image includes a field of view. The method further comprises displaying the image on a display system configured to be mounted to a head of a user. The method further comprises detecting a movement of the head of the user and determining if the movement of the user's head is within a boundary corresponding to the field of view. The method further comprises, if the movement of the user's head is determined to be within the boundary: generating a changed image of the surgical environment from a changed viewpoint of the imaging tool; and displaying the changed image on the display system. The changed image includes a changed field of view corresponding to the detected movement of the user's head.