A method of automatically registering a surgical navigation system to a patient's anatomy is provided. The method comprises programming a surgical navigation system with a first spatial relationship between a surgical component and a reference array connected to the surgical component, programming the surgical navigation system with a second spatial relationship between an anatomical feature of a patient and the surgical component, installing the surgical component on the patient such that the surgical component engages the anatomical feature in the second spatial relationship, and locating the reference array with the surgical navigation system. The navigation system automatically recognizes the position of the reference array relative to the patient's anatomy.

A data processing method performed by a computer for detecting reflections of light pulses, comprising the steps: acquiring a camera signal representing a series of camera images of a camera viewing field; detecting whether the camera signal includes one or more light mark portions within the camera viewing field possibly representing a light pulse reflection; relating the detected light mark portions in the series of camera images to a pre-defined emission pattern of the light pulses; and determining that a light mark portion is a reflected light pulse, if the light mark portion in the series of camera images matches to the pre-defined emission pattern of the light pulses.

Provided is an image processing device including a matching unit that performs matching processing between a predetermined pattern on a surface of a 3D model of a biological tissue including an operating site generated on the basis of a preoperative diagnosis image and a predetermined pattern on a surface of the biological tissue included in a captured image during surgery, a shift amount estimation unit that estimates an amount of deformation from a preoperative state of the biological tissue on the basis of a result of the matching processing and information regarding a three-dimensional position of a photographing region which is a region photographed during surgery on the surface of the biological tissue, and a 3D model update unit that updates the 3D model generated before surgery on the basis of the estimated amount of deformation of the biological tissue.

A system and method for constructing fluoroscopic-based three dimensional volumetric data from two dimensional fluoroscopic images including a computing device configured to facilitate navigation of a medical device to a target area within a patient and a fluoroscopic imaging device configured to acquire a fluoroscopic video of the target area about a plurality of angles relative to the target area. The computing device is configured to determine a pose of the fluoroscopic imaging device for each frame of the fluoroscopic video and to construct fluoroscopic-based three dimensional volumetric data of the target area in which soft tissue objects are visible using a fast iterative three dimensional construction algorithm.

The present disclosure provides a method of medical procedure using augmented reality for superimposing a patient's medical images (e.g., CT or MRI) over a real-time camera view of the patient. Prior to the medical procedure, the patient's medical images are processed to generate a 3D model that represents a skin contour of the patient's body. The 3D model is further processed to generate a skin marker that comprises only selected portions of the 3D model. At the time of the medical procedure, 3D images of the patient's body are captured using a camera, which are then registered with the skin marker. Then, the patient's medical images can be superimposed over the real-time camera view that is presented to the person performing the medical procedure.

A method for providing a feedback on a surgical outcome by a computer includes dividing, by the computer, actual surgical data obtained in an actual surgical process into a plurality of detailed surgical operations to obtain actual surgical cue sheet data composed of the plurality of detailed surgical operations, obtaining, by the computer, reference cue sheet data about the actual surgery, and comparing, by the computer, the actual surgical cue sheet data with the reference cue sheet data, and providing, by the computer, the feedback based on the comparison result.

A system may comprise a first catheter having a first steerable segment and a second catheter disposed within the first catheter. The second catheter may have a second steerable segment. The system may also comprise an imaging element supported at a distal end of the second catheter, a coil reference sensor supported at a distal portion of the second catheter, and a processor in electrical communication with the coil reference sensor. The processor may be configured to determine a position of a distal portion of the first catheter with reference to the coil reference sensor.

A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

In an embodiment, an electrogram (EGM) processing system provides, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry. The HMD also displays an electrogram waveform. The EGM processing system determines a gaze direction of the user by processing sensor data from the HMD. The HMD displays a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform. The EGM processing system determines a measurement of the electrogram waveform using the location of the marker. The HMD displays the measurement of the electrogram waveform.

A number of improvements are provided relating to computer aided surgery. The improvement relates to both the methods used during computer aided surgery and the devices used during such procedures. Some of the improvement relate to controlling the selection of which data to display during a procedure and/or how the data is displayed to aid the surgeon. Other improvements relate to the structure of the tools used during a procedure and how the tools can be controlled automatically to improve the efficiency of the procedure. Still other improvements relate to methods of providing feedback during a procedure to improve either the efficiency or quality, or both, for a procedure.