Devices and methods for performing a surgical step or surgical procedure with visual guidance using an optical head mounted display are disclosed.

A surgical system includes a plurality of voice sensors located in a surgical environment and configured to detect sound and generate a first plurality of signals. The surgical system also includes a position indicator, in proximity to a designated user, configured to indicate a first position of the designated user and generate a second signal representative of the first position. The surgical system further includes a processor configured to receive the first plurality of signals and the second signal and determine, based on the first plurality of signals, a second position. The processor is also configured to compare the detected sound with registered voice command of the designated user stored in a memory to verify the designated user's credentials, and send a command signal to a surgical instrument to carry out an operation related to the voice command based on at least one of the verification of the designated user's credentials, the first position and the second position.

A surgical system includes a camera tracking system that determines a first pose transform between a first object coordinate system and the first tracking camera coordinate system based on first object tracking information from the first tracking camera which indicates pose of the first object. The camera tracking system determines a second pose transform between the first object coordinate system and the second tracking camera coordinate system based on first object tracking information from the second tracking camera indicating pose of the first object, and determines a third pose transform between a second object coordinate system and the second tracking camera coordinate system based on second object tracking information from the second tracking camera indicating pose of the second object. The camera tracking system determines a fourth pose transform between the second object coordinate system and the first tracking camera coordinate system based on combining the first, second, and third pose transforms.

An illumination system for a lighting assembly comprises a light assembly configured to selectively illuminate an operating region in a surgical suite and a plurality of light sources positioned within the light assembly and configured to emit light. The system further comprises at least one imager configured to capture image data and a controller. The controller is configured to scan the image data in at least one region of interest for a shaded region and identify a location of the shaded region within the region of interest. The controller is further configured to control the light assembly to activate at least one of the light sources to emit light impinging on the shaded region within the region of interest.

The present invention relates to a digital image reality aligning kit, applied to a mixed reality system integrated with a surgical navigation system including: a plurality of moveable markers corresponded to a plurality of moveable marker coordinates respectively and a part of the plurality of moveable markers configured on a surgical instrument; a positioning marker corresponded to a positioning marker coordinate and configured in proximity to a surgical area corresponded to a surgical area coordinate, when the positioning marker is settled, the relative position thereof with respect to the other part of the plurality of moveable markers and the surgical area are determined accordingly, so as to transform the surgical area coordinate to the positioning marker coordinate; and a mixed reality device corresponded to a mixed reality device coordinate and detecting the positioning marker to transform the positioning marker coordinate to the mixed reality device coordinate accordingly, so as to project a surgical area digital image corresponded to a surgical area digital image coordinate onto the surgical area.

Robotic systems and methods are provided for trajectory guidance during surgical procedures, for example, robotically monitoring and identifying a desired trajectory of surgical access devices and implants for the purpose of preventing unintended injury to surrounding tissues, such as nerves, blood vessels, cartilage, or bone. The robotic systems and methods provided herein allow medical professionals to practice with little to no exposure of the medical professional to radiation.

A system determining a location for a surgical procedure, the system including a jig having a frame, a first marker fixed to the frame, wherein the first marker includes a scanable label, and a second marker moveably connected to the frame, such that the second marker can move positions independent of the frame, and wherein the second marker includes a scanable label. The system also includes a mixed reality headset configured to scan the scanable label of the first marker and the scanable label of the second marker, to provide location data to the mixed reality headset.

Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to a workstation cart. One or more embodiments of the workstation cart (“workstation”) include a monitor, a first module, a second module and a third module connected to main support beam. An Augmented Reality (AR) headset device holder is disposed upon the first module. One or more AR headset device charging cables are connected to the second module. At least one computer system and a router are located inside the first module. A power unit and/or a battery(s) are located inside the third module.

A system includes a mobile device having one or more cameras to take images; a sensor detecting reflected light from one or more lasers and a diffuser to detect object range or dimension; code for motion tracking, environmental understanding by detecting planes in an environment, and estimating light and dimensions of the surrounding based on the one or more lasers; code to estimate a three-dimensional (3D) volume of an object from multiple perspectives and from projected laser beams to measure size or scale and determine locations of points on the object's surface in a plane or a slice using time-of-flight, wherein positions and cross-sections for different slices are correlated to construct a 3D model of the object, including object position and shape; the device receiving user request to select a content from one or more augmented, virtual, or extended reality contents and rendering a reality view of the environment.

An image-guided tool and method for ophthalmic surgical procedures is disclosed comprising a processor, a display, an imaging system, and a memory communicatively coupled to the processor. The memory stores instructions executable by the processor and includes an artificial intelligence (AI) model. The processor is arranged to receive from the imaging system visual images in real-time of a surgical field during the ophthalmic surgical procedure and using the AI model to extract regions of interest in the surgical field. Upon selection of a region of interest by the AI model, the AI model develops operating image features based on the surgical instruments used in the region of interest and the phase of the surgical procedure being performed. Augmented visual images are then constructed that include the real-time visual image and the image features and surgical phase information. The augmented image is displayed on the display.