Methods and apparatuses are provided for performing surgery and other interventional procedures on human and non-human animals with a semi-autonomous and/or fully autonomous robotic system. The methods and apparatuses include a system for controlling magnetic fields to dynamically detect the location of magnetizable tools and to manipulate said tools in order to obtain a favorable therapeutic or diagnostic outcome.

Augmented reality glasses with auto coregistration of an invisible field on visible reality which allows eyes to recognize a real space and precisely performs coregistration on only diagnosis and treatment information of invisible light, which is emitted from a specific area, to the real space.

A digital loupe system is provided which can include a number of features. In one embodiment, the digital loupe system can include a stereo camera pair and a distance sensor. The system can further include a processor configured to perform a transformation to image signals from the stereo camera pair based on a distance measurement from the distance sensor and from camera calibration information. In some examples, the system can use the depth information and the calibration information to correct for parallax between the cameras to provide a multi-channel image. Ergonomic head mounting systems are also provided. In some implementations, the head mounting systems can be configurable to support the weight of a digital loupe system, including placing one or two oculars in a line of sight with an eye of a user, while improving overall ergonomics, including peripheral vision, comfort, stability, and adjustability. Methods of use are also provided.

A surgical system includes a detector that includes an array of pixels configured to detect light reflected by a surgical device and generate a first signal. The first signal includes a first dataset representative of a visible image of the surgical device. The surgical system also includes a processor configured to receive the first signal and a second signal representative of one or more operating parameters of the surgical device. The processor is also configured to generate a modified image of the surgical device that includes information related to one or more operating parameters.

Provided is a medical display control device including a display control unit that causes a first captured medical image and a second captured medical image to be simultaneously displayed, the first captured medical image having been captured in an imaging device in a first imaging mode where imaging is performed with special light, the second captured medical image having been captured in the imaging device in a second imaging mode different from the first imaging mode before the first captured medical image.

Electrophysiology mapping and visualization systems are described herein where such devices may be used to visualize tissue regions as well as map the electrophysiological activity of the tissue. Such a system may include a deployment catheter and an attached hood deployable into an expanded configuration. In use, the imaging hood is placed against or adjacent to a region of tissue to be imaged in a body lumen that is normally filled with an opaque bodily fluid such as blood. A translucent or transparent fluid, such as saline, can be pumped into the imaging hood until the fluid displaces any blood, thereby leaving a clear region of tissue to be imaged via an imaging element in the deployment catheter. A position of the catheter and/or hood may be tracked and the hood may also be used to detect the electrophysiological activity of the visualized tissue for mapping.

Devices and methods for performing a surgical step or surgical procedure with visual guidance using an optical head mounted display are disclosed.

A surgical navigation system includes a first tracking unit, a second tracking unit and a processing unit. The first tracking unit captures a first infrared image of a position identification unit that includes a reference target fixed on a patient and an instrument target disposed on a surgical instrument. The second tracking unit captures a second infrared image of the position identification unit. The processing unit performs image recognition on the first and second infrared images with respect to the position identification unit, and uses, based on a result of the image recognition, a pathological image and one of the first and second infrared images to generate an augmented reality image. When both the first and second images have both the reference target and the instrument target, one of the first image and the second image with a higher accuracy is used to generate the augmented reality image.

The disclosed system uses medical imaging and live imaging on a patient’s non-rigid tissue structures and increases preciseness and reliability by shaping the patient’s body during surgery so that the outer shape of the patient’s body during surgery is identical to the outer shape of the body during imaging. The processing unit will precisely overlay a scan image (or an image or a graphical representation derived from several scan images) and a live image acquired during surgery for enhancing a surgeon’s understanding and orientation during surgery.

The disclosed system uses a body shape capturing device for acquiring a patient's body shape and a 3D shape generating device for additively manufacturing a patient receiving device that is at least partially adapted to the patient's body shape or at least partially deviates from the patient's body shape bringing the patient's body into a desired shape so that the outer shape of the patient's body during surgery is identical to the outer shape of the body during shape capturing. The patient receiving device comprises at least one tracker element that is detectable by a detection system. The detection system captures data indicating the at least one tracker element's position and/or orientation during surgery enabling, particularly for surgical operations on or in soft tissues with high flexibly and with no specific natural or artificial landmarks, the surgeon to orientate/navigate in live images from the surgical site.