A presentation device for displaying a graphical presentation of an augmented reality is disclosed. The presentation device includes a recording unit, a first display unit, and a processing unit. The recording unit is configured to capture a relative positioning of the first display unit in respect of a presentation area and capture a second set of graphical information. The processing unit is configured to generate an augmented reality based on a received dataset, supply a graphical presentation of the augmented reality by virtual mapping to the presentation area, and adjust the augmented reality and/or the graphical presentation thereof as a function of the second set of graphical information. The first display unit is at least partially transparent and is configured to display the graphical presentation of the augmented reality.

A number of improvements are provided relating to computer aided surgery utilizing an on tool tracking system. The various improvements relate generally to both the methods used during computer aided surgery and the devices used during such procedures. Other improvements relate to the structure of the tools used during a procedure and how the tools can be controlled using the OTT device. Still other improvements relate to methods of providing feedback during a procedure to improve either the efficiency or quality, or both, for a procedure including the rate of and type of data processed depending upon a CAS mode.

A system and method for providing image guidance for placement of one or more medical devices at a target location. The system can determine one or more intersections between a medical device and an image region based at least in part on first emplacement data and second emplacement data. Using the determined intersections, the system can cause one or more displays to display perspective views of image guidance cues, including an intersection indicator in a virtual 3D space.

Systems, devices, and methods for surgical illumination and imaging of ophthalmologic structures within a human eye are disclosed. In various embodiments, an emitter, imaging sensor, and a system control image processor are configured to irradiate ophthalmologic structures with near infrared light, detect near-infrared scatter from the irradiated ophthalmologic structures and visible light in real-time and generate or otherwise cause an image to be displayed on the user display that includes the detected near-infrared scatter from the irradiated ophthalmologic structures displayed in real-time. In one or more embodiments, the image is a virtual image of the irradiated ophthalmologic structures generated at least based on near-infrared light scattering coefficients of the irradiated ophthalmologic structures. In certain embodiments, the image displayed on the user display includes the detected near-infrared scatter from the irradiated ophthalmologic structures overlaid on a real-time view from a surgical microscope.

A method for adjusting the operation of a surgical instrument using machine learning in a surgical suite is disclosed.

Certain aspects relate to biopsy apparatuses, systems and techniques for biopsy using a biopsy pattern. Some aspects relate to moving a distal portion of a medical instrument to one or more sample locations of the biopsy pattern and guiding the instrument to obtain tissue samples from the sample locations within the biopsy pattern. Some aspects relate to obtaining the biopsy pattern and adjusting the sample locations within the biopsy pattern based on various factors such as anatomical features.

A dual mode augmented reality surgical system configured to operate in both a tracking and a non-tracking mode includes a head mounted display configured to provide an optical view of a patient and to inject received data content over top of the optical view to form an augmented reality view of the patient, and comprising internal tracking means configured to determine a surgeon's position as well as angle and direction of view relative to the patient. The system further includes an augmented reality computing system comprising one or more processors, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors.

A stretch-measurement probe includes an elongate outer sleeve, expansion feature associated with a distal portion of the outer sleeve, and an elongate inner rod disposed at least partially within the outer sleeve. The expansion feature is configured to allow a longitudinal distance between a proximal end of the outer sleeve and the distal end of the outer sleeve to be varied.

A surgery assistance system includes: an endoscope; a display configured to display an image from the endoscope; a treatment tool that includes an end effector at a distal end; an input device that inputs an instruction to the end effector; and a processor connected to the endoscope, the display, the treatment tool, and the input device, wherein the processor is configured to detect a distal end position of the end effector based on the instruction, record the detected distal end position, and estimate a first treatment surface from a plurality of recorded distal end positions.

Methods, non-transitory computer readable media, interface adapter devices, and surgical computing devices and systems that detect and analyze connectivity of an end effector to a robotic arm are disclosed. With this technology, an interface adapter device of a robotic arm includes a connectivity sensor that determines when an end effector is disconnected from the robotic arm to be used as a handpiece by a surgeon to carry out particular surgical task(s) associated with a surgical procedure. The interface adapter device can instruct the robotic arm to automatically enter an inactive state defined in a surgical plan for the surgical procedure upon detection of the disconnection. Upon reconnection of the handpiece, or installation of a different handpiece, the interface adapter device automatically facilitates readjustment of the robotic arm based on an active state (e.g., automated resumption of the surgical procedure) defined in a surgical plan for the surgical procedure.