An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.

An integrated catheter placement system for placing a catheter in a vasculature of a patient. The system includes a system console with a tip location mode and an ultrasound mode viewable on a display, a magnetic assembly emanating a magnetic field, a tip location sensor designed to sense the magnetic field, and an ultrasound probe for ultrasonically imaging an internal portion of the patient. The magnetic field may provide magnetic field information for locating the magnetic assembly relative to the tip location sensor. The tip location sensor is designed to communicate the magnetic field information to the system console. The system console is designed to display an icon representative of a location of the magnetic assembly relative to the tip location sensor in the tip location mode.

A video processing apparatus includes a housing defining an interior space, the housing having first, second, third, and fourth sides and a back side extending between the first, second, third and fourth sides, the back side including a back wall having a main portion laying on a back plane, a recessed portion recessed from the back plane and defining a video connection recess, and a recessed wall extending from the main portion to the recessed portion, the recessed wall having a video connector opening, and the recessed portion having an angled surface lying at an angle of at least 5 degrees relative to the back plane; and a video output socket in the interior space and aligned with the video connector opening of the recessed wall, whereby the angled surface facilitates insertion of a video connector into the video output socket.

Disclosed are systems, methods, and techniques for registering a HMD coordinate system of a head-mounted display (HMD) and a localizer coordinate system of a surgical navigation localizer. A camera of the HMD captures at least one image of a registration device having a registration coordinate system and a plurality of registration markers. The registration markers are analyzed in the at least one image to determine a pose of the HMD coordinate system relative to the registration coordinate system. One or more position sensors comprised in the localizer detect a plurality of tracking markers comprised in the registration device to determine a pose of the registration coordinate system relative to the localizer coordinate system. The HMD coordinate system and the localizer coordinate system are registered using the registration device, wherein positions of the registration markers are known with respect to positions of the tracking markers in the registration coordinate system.

The present disclosure provides a method of medical procedure using augmented reality for superimposing a patient's medical images (e.g., CT or MRI) over a real-time camera view of the patient. Prior to the medical procedure, the patient's medical images are processed to generate a 3D model that represents a skin contour of the patient's body. The 3D model is further processed to generate a skin marker that comprises only selected portions of the 3D model. At the time of the medical procedure, 3D images of the patient's body are captured using a camera, which are then registered with the skin marker. Then, the patient's medical images can be superimposed over the real-time camera view that is presented to the person performing the medical procedure.

A method for creating a patient-specific surgical plan includes receiving one or more pre-operative images of a patient having one or more infirmities affecting one or more anatomical joints. three-dimensional anatomical model of the one or more anatomical joints is created based on the one or more pre-operative images. One or more transfer functions and the three-dimensional anatomical model are used to identify a patient-specific implantation geometry that corrects the one or more infirmities. The transfer functions model performance of the one or more anatomical joints as a function of anatomical geometry and anatomical implantation features. surgical plan comprising the patient-specific implantation geometry may then be displayed.

In an embodiment, an electrogram (EGM) processing system provides, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry. The HMD also displays an electrogram waveform. The EGM processing system determines a gaze direction of the user by processing sensor data from the HMD. The HMD displays a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform. The EGM processing system determines a measurement of the electrogram waveform using the location of the marker. The HMD displays the measurement of the electrogram waveform.

A dental restoration device includes a sleeve having an exterior surface and an interior pocket that is at least partially filled with a dental cement, and a crown having an exterior surface and an interior surface that is mated to the exterior surface of the crown and bonded thereto by an adhesive disposed between the exterior surface of the sleeve and the interior surface of the crown.

A number of improvements are provided relating to computer aided surgery. The improvement relates to both the methods used during computer aided surgery and the devices used during such procedures. Some of the improvement relate to controlling the selection of which data to display during a procedure and/or how the data is displayed to aid the surgeon. Other improvements relate to the structure of the tools used during a procedure and how the tools can be controlled automatically to improve the efficiency of the procedure. Still other improvements relate to methods of providing feedback during a procedure to improve either the efficiency or quality, or both, for a procedure.

A method for adjusting the operation of a surgical instrument using machine learning in a surgical suite is disclosed. The method comprises the steps of gathering data during surgical procedures, wherein the surgical procedures include the use of a surgical instrument, analyzing the gathered data to determine an appropriate operational adjustment of the surgical instrument, and adjusting the operation of the surgical instrument to improve the operation of the surgical instrument.