A surgical instrument assembly may include a processor, a surgical instrument configured to operate on an anatomical structure, and a display coupled to the processor and attached to the surgical instrument. The processor can be configured to determine a position of the medical imaging device, from which the medical imaging device can generate an X-ray image that includes holes of an intramedullary nail shown as circles, for instance perfect circles. In an example, the processor identifies the intramedullary nail, so as to determine an intramedullary nail identity, and determines the position of the medical imaging device based on a portion of at least two locking holes of the intramedullary nail and based on the intramedullary nail identity.

A method for performing auto-focus in a camera is disclosed. The method includes: receiving, from a tracking system for tracking a position of a medical instrument, a signal; determining, based on the received signal, that the medical instrument is removed from a field of view of the camera; in response to determining that a continuous auto-focus mode for the camera is enabled: retrieving, from a database, a first focus distance value representing a focus distance that was most recently set with intent for the camera; and automatically updating a focus distance of the camera to the first focus distance value.

The following invention is a vocally activated control system for controlling an apparatus in a surgical setting, the system comprises: a. a voice sensor configured to detect vocal commands generated by surgeons during surgery; b. a signal transmitter connected to the voice sensor, the transmitter is configured to convert a vocal command into a transmittable signal and transmit it; c. a processor connected to a signal transmitter configured to receive a transmittable vocal signal, the processor is configured to convert a vocal signal to a predetermined set of operative instructions associated with the apparatus, the predetermined set of operative instructions comprising at least one instruction; and d. control means connected to the processor and apparatus; the control means is configured to receive a predetermined set of operative instructions and to cause the apparatus to operate accordingly; Said voice sensor and said transmitter are integrated within a wearable element.

Various surgical systems are disclosed. A surgical system can include a surgical robot and a surgical hub. The surgical robot can include a control unit in signal communication with a control console and a robotic tool. The surgical hub can include a display. The surgical hub can be in signal communication with the control unit. A facility can include a plurality of surgical hubs that communicate data from the surgical robots to a primary server. To alleviate bandwidth competition among the surgical hubs, the surgical hubs can include prioritization protocols for collecting, storing, and/or communicating data to the primary server.

A system for controlling a medical image capture device during surgery, the system including: circuitry configured to receive a first image of the surgical scene, captured by the medical image capture device from a first viewpoint, and additional information of the scene; determine, for the medical image capture device, in accordance with the additional information and previous viewpoint information of surgical scenes, one or more candidate viewpoints from which to obtain an image of the surgical scene; provide, in accordance with the first image of the surgical scene, for each of the one or more candidate viewpoints, a simulated image of the surgical scene from the candidate viewpoint; control the medical image capture device to obtain an image of the surgical scene from the candidate viewpoint corresponding to a selection of one of the one or more simulated images of the surgical scene.

A method and a system for image-guided intervention such as a percutaneous treatment or diagnosis of a patient may include at least one of a pre-registration method and a re-registration method. The pre-registration method is configured to permit for an efficient virtual representation of a planned trajectory to target tissue during the intervention, for example, as a holographic light ray shown through an augmented reality system. In turn, this allows the operator to align a physical instrument such as a medical probe for the intervention. The re-registration method is configured to adjust for inaccuracy in the virtual representation generated by the pre-registration method, as determined by live imaging of the patient during the intervention. The re-registration method may employ the use of intersectional contour lines to define the target tissue as viewed through the augmented reality system, which permits for an unobstructed view of the target tissue for the intervention.

Generally, a sterile adapter for use in robotic surgery may include a frame configured to be interposed between a tool driver and a surgical tool, a plate assembly coupled to the frame, and at least one rotatable coupler supported by the plate assembly and configured to communicate torque from an output drive of the tool driver to an input drive of the surgical tool.

Examples relate to a microscope system comprising a Light-Emitting Diode (LED)-based illumination system and at least one image sensor assembly, and to a corresponding system, method and computer program. The LED-based illumination system is configured to emit radiation power having at least one peak at a wavelength that is tuned to an excitation wavelength of at least one fluorescent material and/or to emit radiation power across a white light spectrum, with the light emitted across the white light spectrum being filtered such that light having a wavelength spectrum that coincides with at least one fluorescence emission wavelength spectrum of the at least one fluorescent material is attenuated or blocked. The at least one image sensor assembly is configured to generate image data, with the image data (at least) representing light reflected by a sample that is illuminated by the LED-based illumination system. The microscope system comprises one or more processors, configured to process the image data to generate processed image data.

For teleoperation of a surgical robotic system, the control of the surgical robotic system accounts for a limited degree of freedom of a tool in a surgical robotic system. A projection from the greater DOF of the user input commands to the lesser DOF of the tool is included within or as part of the inverse kinematics. The projection identifies feasible motion in the end-effector domain. This projection allows for a general solution that works for tools having different degrees of freedom and will converge on a solution.

For teleoperation of a surgical robotic system, the user command for the pose of the end effector is projected into a subspace reachable by the end effector. For example, a user command with six DOF is projected to a five DOF subspace. The six DOF user interface device may be used to more intuitively control, based on the projection, the end effector with the limited DOF relative to the user interface device.