One or more camera lenses used for robotic surgery can be cleaned without the need to remove and reinsert one or more cameras. The approaches described herein facilitate cleaning the one or more lenses or one or more protective windows on demand and without the need to remove and reinsert the one or more cameras. Cleaning can include one or more of washing or wiping the one or more lenses or one or more protective windows.

A method for exporting a three-dimensional dental design model based on a three-dimensional dental library model (4) from an augmented reality application (6) which is adapted to visualize an image of the dental library model (4) rendered by a virtual camera with a preliminary pose and scale in a photo (2) of a face of a patient taken by a camera under a viewing axis to the face of the patient, the photo (2) including a mouth opening showing at least part of the present situation of the patient's dentition.

A system for visualizing one or more bubbles formed by a catheter, the system includes a fluid container, a pulse generator, a schlieren imaging assembly, and a processor. The fluid container is configured to: (i) contain a fluid, and (ii) receive into the fluid the catheter having one or more electrodes. The pulse generator is configured to apply one or more pulses to at least one of the electrodes. The schlieren imaging assembly is configured to acquire schlieren images of the bubbles occurring in the fluid when applying the one or more pulses, and the processor is configured to visualize the bubbles using the schlieren images.

Distance estimation is optimized in virtual or augmented reality. A distance map of a surgical instrument to a region of interest is determined, at least at the beginning and when a position of the surgical instrument has changed. A render-image is rendered based on a medical 3D image and the position of the surgical instrument, at least at the beginning and when the position of the surgical instrument has changed. At least the region of interest and those parts of the surgical instrument positioned in the volume of the render-image are shown in the render-image. Based on the distance map, at least for a predefined area of the region of interest, visible, acoustic, and/or haptic distance-information is added.

Disclosed is a sterile cover (100) for a Mixed Reality (MR) device (101). The sterile cover (100) may comprise a first case (102) arranged for covering a front side of the MR device (101). The first case (102) may comprise a hard case with an embedded clear layer (114) for covering a glass area of the front side of the MR device (101). The sterile cover (100) may further comprise a second case (104). The second case (104) may be arranged for covering a headband side of the MR device (101). The second case (104) may comprise a stretchable case for allowing a flexible adjustment of the headband side of the MR device (101) within the second case (104).

A wearable device and a method for adjusting a display state based on an environment are provided. The method is adapted for the wearable device. The method includes: capturing an environmental image; when determining that there is a specific object in the environmental image, determining a display mode of a display circuit based on the specific object; and controlling the display circuit to be adjusted to a display state corresponding to the display mode.

Augmented reality glasses with auto coregistration of an invisible field on visible reality which allows eyes to recognize a real space and precisely performs coregistration on only diagnosis and treatment information of invisible light, which is emitted from a specific area, to the real space.

A follicular unit harvesting process receives images for analysis and identifies and highlights clusters of hair. The analysis includes pixel type determination, pixel clustering, cluster classification and cluster highlighting or replacement. The analysis of the pixels is performed concurrently, and the results of the analysis are optionally used for automated treatment planning.

A surgical system includes a detector that includes an array of pixels configured to detect light reflected by a surgical device and generate a first signal. The first signal includes a first dataset representative of a visible image of the surgical device. The surgical system also includes a processor configured to receive the first signal and a second signal representative of one or more operating parameters of the surgical device. The processor is also configured to generate a modified image of the surgical device that includes information related to one or more operating parameters.

Methods and system perform tool tracking during minimally invasive robotic surgery. Tool states are determined. using triangulation techniques or a Bayesian filter from either or both non-endoscopically derived and endoscopically derived tool state information, or from either or both non-visually derived and visually derived tool state information. The non-endoscopically derived tool state information is derived from sensor data provided either by sensors associated with a mechanism for manipulating the tool, or sensors capable of detecting identifiable signals emanating or reflecting from the tool and indicative of its position, of external cameras viewing an end of the tool extending out of the body. The endoscopically derived tool state information is derived from image data provided by an endoscope inserted in the body so as to view the tool.