Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to Field Visualization Engine. The Field Visualization Engine tracks one or more collimator poses relative to one or more Augmented Reality (AR) headset device poses. Each respective collimator pose and each respective headset device pose corresponds to a three-dimensional (3D) unified coordinate space (“3D space”). The Field Visualization Engine generates an AR representation of a beam emanating from the collimator based at least on a current collimator pose and a current headset device pose. The Field Visualization Engine further generates an AR visualization of emanation of the beam throughout an AR display of medical data.

A system and method is provided for planning a surgical procedure. The system includes a model of an anatomical region including simulated bone, a tracked tool, a tracking system, a display device, and a computer system configured to receive information from the tracking system, generate and display the model and the tracked tool, and store the tracking system information in a computer readable memory that is portable to a surgical navigation system. The method includes acquiring volumetric data of a patient anatomical region, extracting, providing and registering a three-dimensional model with the volumetric data, using a tracked tool to perform a simulated surgical procedure including removing and replacing a bone section on the model, viewing the model and the tracked tool on a display device, recording the procedure with a tracking system, storing the procedure in a computer readable memory, and porting the procedure into a surgical navigation system.

Devices and methods for performing a surgical step or surgical procedure with visual guidance using an optical head mounted display are disclosed.

A surgical system includes a camera tracking system that determines a first pose transform between a first object coordinate system and the first tracking camera coordinate system based on first object tracking information from the first tracking camera which indicates pose of the first object. The camera tracking system determines a second pose transform between the first object coordinate system and the second tracking camera coordinate system based on first object tracking information from the second tracking camera indicating pose of the first object, and determines a third pose transform between a second object coordinate system and the second tracking camera coordinate system based on second object tracking information from the second tracking camera indicating pose of the second object. The camera tracking system determines a fourth pose transform between the second object coordinate system and the first tracking camera coordinate system based on combining the first, second, and third pose transforms.

Systems, devices, and methods for surgical illumination and imaging of ophthalmologic structures within a human eye are disclosed. In various embodiments, an emitter, imaging sensor, and a system control image processor are configured to irradiate ophthalmologic structures with near infrared light, detect near-infrared scatter from the irradiated ophthalmologic structures and visible light in real-time and generate or otherwise cause an image to be displayed on the user display that includes the detected near-infrared scatter from the irradiated ophthalmologic structures displayed in real-time. In one or more embodiments, the image is a virtual image of the irradiated ophthalmologic structures generated at least based on near-infrared light scattering coefficients of the irradiated ophthalmologic structures. In certain embodiments, the image displayed on the user display includes the detected near-infrared scatter from the irradiated ophthalmologic structures overlaid on a real-time view from a surgical microscope.

Virtual reality (VR) surgical systems with haptic feedback are described herein that can be used to simulate several instruments and surgeries. The instruments can include a tool assembly; first and second brackets each having first shafts that are rotatably coupled at first and second end regions of the tool assembly and second shafts that are rotatably coupled to first and second robotic arms; a surgical tool assembly coupled to an end portion of the tool assembly and having an elongated member that extends within the tool assembly; an elongated member position sensor assembly configured to provide position information of a position of the elongated member to a computing unit; and an elongated member force feedback assembly housed within the cavity and coupled to the elongated member. The elongated member force feedback assembly is configured to provide haptic feedback to the user of the instrument.

A stereoscopic camera with fluorescence visualization is disclosed. An example stereoscopic camera includes a visible light source, a near-infrared light source, and a near-ultraviolet light source. The stereoscopic camera also includes a light filter assembly having left and right filter magazines positioned respectively along left and right optical paths and configured to selectively enable certain wavelengths of light to pass through. Each of the left and right filter magazines includes an infrared cut filter, a near-ultraviolent cut filter, and a near-infrared bandpass filter. A controller of the camera is configured to provide for a visible light mode, an indocyanine green (“ICG”) fluorescence mode, and a 5-aminolevulinic acid (“ALA”) fluorescence mode by synchronizing the activation of the light sources with the selection of the filters. A processor of the camera combines image data from the different modes to enable fluorescence emission light to be superimposed on visible light stereoscopic images.

The present invention relates to a digital image reality aligning kit, applied to a mixed reality system integrated with a surgical navigation system including: a plurality of moveable markers corresponded to a plurality of moveable marker coordinates respectively and a part of the plurality of moveable markers configured on a surgical instrument; a positioning marker corresponded to a positioning marker coordinate and configured in proximity to a surgical area corresponded to a surgical area coordinate, when the positioning marker is settled, the relative position thereof with respect to the other part of the plurality of moveable markers and the surgical area are determined accordingly, so as to transform the surgical area coordinate to the positioning marker coordinate; and a mixed reality device corresponded to a mixed reality device coordinate and detecting the positioning marker to transform the positioning marker coordinate to the mixed reality device coordinate accordingly, so as to project a surgical area digital image corresponded to a surgical area digital image coordinate onto the surgical area.

Devices, systems, and methods are provided for control over automated movement of catheters and other elongate bodies. Fluid and/or pull-wire drive systems can be used to provide robotically coordinated lateral bending motions and a processor of the system can generate synchronized actuator drive signals to move the tool along an at least partially laterally constrained path, with the path optionally extending along the axis of a virtual model of the catheter that has been driven in silico into alignment with a target tissue adjacent an open workspace such as an open chamber of the heart.

Robotic systems and methods are provided for trajectory guidance during surgical procedures, for example, robotically monitoring and identifying a desired trajectory of surgical access devices and implants for the purpose of preventing unintended injury to surrounding tissues, such as nerves, blood vessels, cartilage, or bone. The robotic systems and methods provided herein allow medical professionals to practice with little to no exposure of the medical professional to radiation.