Embodiments of the invention provide systems and methods for providing augmented reality to a surgeon with the steps of acquiring at least one preoperative medical scan image of a region of interest in which the surgery is to be performed and introducing a fiducial device non-invasively or minimal invasively into a body lumen present in the region of interest of a patient. The fiducial device will be in particular introduced into a lumen, which can be clearly identified in the medical scan image. The fiducial device is adapted to emit infrared light either by using infrared light source or by using fluorescent material placed in or in the fiducial device ad to be excited by illumination light or exciting light. After acquiring at least one imaging light live image and one infrared live image the tissue structure of the body lumen with the fiducial device placed therein is clearly detectable within the live image and can reliably registered and matched to the scan image for presenting the overlaid images and to the surgeon.

In general, devices, systems, and methods for fiducial identification and tracking are provided.

A method for navigational support of a person performing a resection on a patient following extraction of a resectate includes recording a first surface data set of the resectate using an ex vivo scan appliance, and determining a second surface data set of the extraction region using a recording instrument. The second surface data set covers at least one part of the remaining tissue surface of the extraction region of the resectate in the patient. The method also includes registering the first surface data set of the resectate with the second surface data set of the extraction region based on corresponding surface features of the resectate and the remaining tissue surface in the extraction region, and performing at least one support measure that supports the navigation in the extraction region relative to the resectate, using the registration.

A surgical camera system includes a camera with at least one sensor configured to capture image data comprising a first range of wavelengths and a second range of wavelengths. An excitation light source emits an excitation emission at an excitation wavelength. A controller is in communication with the at least one sensor of the camera. The controller is configured to process the image data from the at least one sensor and detect at least one fluorescent portion of the image data in response to a fluorescent emission generated by a fluorescent agent in the second range of wavelengths. The controller is further configured to generate enhanced image data demonstrating the at least one fluorescent portion of the surgical implement in the image data.

Markers for use in bodily tissue take a variety of forms, and may include a plurality of ultrasound reflective elements, for example hollow shells filled with air, and a hydrogel that binds the ultrasound reflective elements. The hydrogel may be natural or artificial and may be cross-linked. An ultrasound system advantageously injects variance in a drive signal, that varies a frequency or phase of an ultrasound interrogation signal from a nominal frequency or nominal phase. The amount of variation is preferable one to six orders of magnitude less than the nominal frequency or phase. The ultrasound system can present or detect a twinkling artifact at least in a Doppler mode of operation, resulting from interaction of the varying interrogation signal with the ultrasound reflective elements.

A surgical system for use with a surgical instrument in a surgical procedure performed on an anatomical organ is disclosed. The surgical system comprises at least one imaging device and a control circuit configured to identify anatomical structures relevant to the surgical procedure from visualization data from the at least one imaging device, propose a surgical resection path for removing a portion of the anatomical organ by the surgical instrument, and present parameters of the surgical instrument in accordance with the surgical resection path. The surgical resection path is determined based on the anatomical structures.

The present disclosure involves object recognition as a method of registration, using a stereoscopic camera on Augmented Reality (AR) glasses or an endoscope as the image capture technology. Exemplary objects include surgical tools, anatomical components or features, such as bone or cartilage, etc. By detecting just a portion of the object in the image data of the surgical scene, the present disclosure may register and track a portion of the patient's anatomy, such as the pelvis, the knee, etc. The present disclosure also optionally displays information on the AR glasses themselves, such as the entire pelvis, the femur, the tibia, etc. The present disclosure may include combinations of the foregoing features, and may eliminate the need for electromagnetic, inertial, or infrared stereoscopic tracking as the tracking technology.

A medical robot system, including a robot coupled to an effectuator element with the robot configured for controlled movement and positioning. The system may include a transmitter configured to emit signals, and the transmitter is coupled to an instrument coupled to the effectuator element. The system may further include a motor assembly coupled to the robot and a plurality of receivers configured to receive the signals emitted by the transmitter. A control unit is coupled to the motor assembly and the plurality of receivers, and the control unit is configured to supply instruction signals to the motor assembly. The instruction signals can be configured to cause the motor assembly to selectively move the effectuator element and is further configured to (i) calculate a position of the transmitter; (ii) display the position of the at least one transmitter; and (iii) selectively control actuation of the motor assembly.

Systems and methods for visualization of a surgical site are disclosed. An imaging device provides image data of the surgical site. A computing device detects, in the image data, at least one obstruction. The computing device filters the image data to remove the at least one obstruction by being configured to alter pixels related to the at least one obstruction based on at least one of (i) one or more buffered frames and (ii) one or more pixels adjacent to the pixels related to the at least one obstruction. The computing device generates an output from the filtered image data. A display device presents the output for visualization of the surgical site.

Robotic system and methods for robotic arthroplasty are provided. The robotic system includes a machining system and a guidance system. The guidance station tracks movement of one or more of various objects in the operating room, such as a surgical tool, a tibia of a patient, a talus of the patient, or a component of an implant. The guidance system tracks these objects for purposes of displaying their relative positions and orientations to the surgeon and, in some cases, for purposes of controlling movement of the surgical tool of the machining system relative to virtual cutting boundaries or other virtual objects associated with the tibia and talus to facilitate preparation of bone to receive an ankle implant system.