Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

A device for checking post cut plane accuracy and alignment following bone removal in a bone of a patient during a computer-assisted surgical procedure to create a bone surface is provided. The device includes a body having an axis and adapted to contact the bone surface. One or more alignment features are associated with the body and are accessible when the body is in contact with the bone surface. Each of the one or more alignment features has a known orientation and position relative to the axis. A method for checking post cut plane accuracy and alignment following removal of bone from a patient to create a bone surface during a computer-assisted surgical procedure is also provided. A computer-assisted surgical system is provided that includes a tracking system, a tracked digitizer probe, the aforementioned device, a tracked surgical device, and one or more computers with software for determining the orientation.

A system for facilitating arthroplasty procedures includes a robotic device, a reaming tool configured to interface with the robotic device, and a processing circuit communicable with the robotic device. The processing circuit is configured to obtain a surgical plan comprising a first planned position of an implant cup and a second planned position of an implant augment relative to a bone of a patient, determine a planned bone modification configured to prepare the bone to receive the implant cup in the first planned position and the implant augment in the second planned position, generate one or more virtual objects based on the planned bone modification, control the robotic device to constrain the cutting tool with the one or more virtual objects while the cutting tool interfaces with the robotic device and is operated to modify the bone in accordance with the planned bone modification.

A method for determining a work volume includes receiving image information from an imaging device corresponding to an array of tracking markers fixed to a flexible mesh, the mesh placed over a patient and over at least one surgical instrument adjacent to or connected to the patient; determining a position of each tracking marker in the array of tracking markers based on the image information; defining a boundary for movement of a robotic arm based on determined tracking marker positions, such that the robotic arm does not contact the patient or the at least one surgical instrument during movement of the robotic arm; and controlling the robotic arm based on the defined boundary.

A method of implanting a prosthetic component using bone density information comprises positioning a bone density reference proximate a patient, obtaining two-dimensional x-ray images of a bone of the patient including the bone density reference, determining a density of the bone from the bone density reference in the two-dimensional x-ray images, superimposing the density of the bone into a three-dimensional mean bone model to generate a patient-specific mean bone model, determining an interface between the bone and the prosthetic component based on bone density information of the patient-specific mean bone model, and implanting the prosthetic component in the bone at the interface. Determining the interface comprises evaluating bone density at the interface to place the prosthetic component, determining bone load threshold at the interface to avoid damaging the bone, and determining hardness for the prosthetic implant at the interface to avoid damaging the bone.

Systems and methods are provided for planning a procedure. A display device is configured to display a first virtual element. A controller device having a processor is configured to be in communication with the display device, and the controller device is further configured to direct the display device to display the first virtual element. A physical control element is in communication with the controller device, and is configured to correspond to the first virtual element such that an actual manipulation of the control element is displayed, via the processor of the controller device and on the display device, as a corresponding response of the first virtual element to the actual manipulation of the control element. Associated systems, methods, and computer program products are also provided.

Methods and systems for providing feedback during a medical procedure are provided. A saved optical image of a field of view (FOV) of a site of the medical procedure is obtained along with a live optical image of the FOV of the site during the medical procedure. Navigational information relative to the site of the medical procedure is determined. The navigational information is then mapped to a common coordinate space, to determine the navigational information relative to the FOV of the saved and live optical images of the surgical site. Virtual representations of the navigational information is overlaid on the saved and/or live optical images and displayed on at least one display.

Method and related system for marker-based navigation. A first image is capturing (S530) with a medical imaging apparatus (ENDO), whilst a light source (LS1) of an implanted marker device (MD) is in a low intensity state and a second light source (LS2) of the medical imaging apparatus (IA) is in a high intensity state, higher than the low intensity state of the marker. A second image is captured (S560) with the medical imaging apparatus (ENDO), whilst the light source (LS1) of the implanted marker device is in a high intensity state and the second light source (LS2) of the medical imaging apparatus (IA) is in a low intensity state, lower than the high intensity state of the marker. The two images may then be combined to obtain a combined image that represents the location of the marker at high signal-to-noise-ratio.

A system and a computer-implemented method for intra-operatively predicting an outcome of a planar cut performed with a planar surgical tool on a target bone of a subject, wherein the planar surgical tool comprises a planar cutting surface. Also, non-transitory computer readable medium including instructions which, when executed by a computer, cause the computer to carry out the steps of the method.

A surgical imaging system comprising circuitry configured to accentuate an image characteristic of an area in captured images; identify the change of the image characteristic in the area; and identify the position of a physiological feature relative to the surgical device on the basis of the change in the image characteristic.