The present disclosure relates to devices used to access the pericardial space of the heart. In particular, the present disclosure describes an apparatus to enable an operator to access the pericardial space of the heart, and deliver cardiac therapies to the pericardial space, under direct visualization through a single, small incision.

The present disclosure provides a method of medical procedure using augmented reality for superimposing a patient's medical images (e.g., CT or MRI) over a real-time camera view of the patient. Prior to the medical procedure, the patient's medical images are processed to generate a 3D model that represents a skin contour of the patient's body. The 3D model is further processed to generate a skin marker that comprises only selected portions of the 3D model. At the time of the medical procedure, 3D images of the patient's body are captured using a camera, which are then registered with the skin marker. Then, the patient's medical images can be superimposed over the real-time camera view that is presented to the person performing the medical procedure.

A position is determined for each fiducial marker of a plurality of fiducial markers in an image volume. Based on the determined positions, a position and orientation of the registration fixture with respect to the anatomical feature is determined. A position is determined for each tracked marker of a first plurality of tracked markers on the registration fixture and a second plurality of tracked markers on the robot arm in a tracking data frame. Based on the determined positions of tracked markers, a position and orientation of the registration fixture and the robot arm of a surgical robot with respect to the tracking space are determined.

The invention relates to a viewing system for use in a surgical environment. Various real object detection devices detect locations of real objects in a real environment, such as a patient and body part of patient, medical staff, robots, a cutting tool on a robot, implant transferred by robot into body part, surgical tools, and disposable items. A map generator generates a map that forms a digital representation or a digital twin of the real environment. Various guiding modules including a room setup module, an anatomy registration module, a surgical planning module, and a surgical execution module make use of the digital representation to guide virtual or real objects based on the digital representation.

A camera tracking system for computer assisted navigation during surgery. The camera tracking system includes a processor operative to receive streams of video frames from tracking cameras which image a plurality of physical objects arranged as a reference array. For each of the physical objects imaged in a sequence of the video frames, that processor determines a set of coordinates for the physical object over the sequence of the video frames. For each of the physical objects, the processor generates an arithmetic combination of the set of coordinates for the physical object. The processor generates an array template identifying coordinates of the physical objects based on the arithmetic combinations of the sets of coordinates for the physical objects, and tracks pose of the physical objects of the reference array over time based on comparison of the array template to the reference array imaged in the streams of video frames.

Various embodiments disclosed herein relate to improved systems and methods for performing computer-aided surgical navigation using augmented reality. A tracking device having one or more optically detectable points is mounted to a patient via surgical hardware. The detectable points are identified by a sensor. One or more augmented reality marker assemblies that each have an augmented reality fiducial marker or symbol are also attached to the tracking device,. A computer system generates augmented reality information and transmits it to a display screen, such as a near-eye augmented reality device, for display thereon. The near-eye augmented reality device also has an image capture device capable of capturing the augmented reality symbols, and thereby determining a three-dimensional orientation associated with the tracking device, augmented reality markers, and a user wearing the near-eye reality device.

Methods and systems for performing computer-assisted surgery, including robot-assisted image-guided surgery. Embodiments include marker devices for an image guided surgery system, marker systems and arrays for tracking a robotic arm using a motion tracking system, and image guided surgery methods and systems using optical sensors.

A method of generating a combined image of a body part from a sequence of partially overlapping source images of the body part, each of the partially overlapping source images showing the body part at one of a plurality of different times, the source images being ordered in the sequence according to the different times, the method including defining a temporally coherent sequence of transformations, for registering the partially overlapping source images in the sequence with each other, registering the source images to each other using the defined temporally coherent sequence of transformations, to obtain co-registered images, and combining at least some of the co-registered images into a combined image. Related apparatus and methods are also described.

A method of treating a bone fracture includes taking a first 2D image of an implant and a reference body with an imaging device; creating a 3D orientation of the reference body and the implant based on the 2D image; determining an actual axis of delivery of a bone screw through an opening extending through the implant; determining an optimal axis of delivery of the bone screw through the opening such that the optimal axis of delivery guides the bone screw toward a medically optimal location; and moving the implant such that the optimal axis of delivery and the actual axis of delivery coincide.

A method for processing angiography image data by using an imaging catheter path that is directly detected from the angiography data as a co-registration path or using detected marker locations from the angiography data to generate a co-registration path. If the acquired angiography data includes synchronized cardiac phase signals and a predetermined quantity of angiography image frames not including contrast media, then a directly detected imaging catheter path is used as the co-registration path. Otherwise the co-registration path is determined based upon detected marker locations from the angiography image data.