A surgical system is configured to augment the visualization environment presented to the surgeon by merging, in real-time, video feed and ultrasound imaging; tracking anatomy and instruments; identifying critical structures; generating and displaying 3-dimensional models of relevant anatomy; providing actionable guidance to the user; and enabling data collection and processing. The surgical system may include a tissue-marking surgical instrument configured to simultaneously identify critical structures beneath an organ surface and mark the organ surface at a location overlapping the identified critical structures.

The present invention provides an oral image marker detection method for detecting a marker, which is the reference when an oral scan image and a CT image are matched, the method comprising the steps of: aligning oral scan images in the horizontal plane direction; estimating a marker candidate area from the aligned oral scan images and detecting an undivided marker from the marker candidate area; and dividing the undivided marker to estimate a marker in the undivided marker, and estimating the area from the upper surface of the undivided marker to a certain depth in the lower direction to be the marker.

A system includes a robotic arm, an autosteroscopic display, a user image capture device, an image processor, and a controller. The robotic arm is coupled to a patient image capture device. The autostereoscopic display is configured to display an image of a surgical site obtained from the patient image capture device. The image processor is configured to identify a location of at least part of a user in an image obtained from the user image capture device. The controller is configured to, in a first mode, adjust a three dimensional aspect of the image displayed on autostereoscopic display based on the identified location, and, in a second mode, move the robotic arm or instrument based on a relationship between the identified location and the surgical site image.

A surgical system includes a detector, comprising an array of pixels configured to detect light reflected by a surgical instrument and generate a first signal comprising a first dataset representative of a visible image of the surgical instrument. The surgical system also includes a processor configured to receive the first signal, generate a modified image of the surgical instrument that includes a control panel. The control panel includes one or more control elements representative of one or more operating parameters of the surgical instrument. The processor is further configured to receive an input to the control panel from a user, the input being effective to change one of the operating parameters. The processor is also configured to generate a command signal based on the input to change the one of the operating parameters.

A method for performing a surgical procedure includes generating, by a computing device, an anatomical map of a patient from a plurality of images; positioning a trocar obturator adjacent to the patient; calculating, by the computing device, a projected path of the trocar obturator; overlaying, by the computing device, the projected path of the trocar obturator with the anatomical map of the patient; and displaying the projected path of the trocar obturator and the anatomical map of the patient on a display device to define an augmented image.

Methods and systems are provided to generate metamerically matched illumination on a surgical site. The metamerically matched illumination may reduce or remove strobing effects associated with illumination devices during a surgery or surgical procedure. By metamerically matching illuminants in the illumination in combination with estimates of the human visual system, the illumination of the surgical site can visually appear to a user as a continuous white light, while maintaining distinct underlying spectra in the illumination. The light reflected by the surgical object may also be captured and metamerically matched, such that the reflected light appears as a single continuous color.

There is provided a system for cardiac electromagnetic/magnetic catheterization for diagnosing and treating blood vessels of a patient. The system having at least one electromagnetic intraluminal capsule able to force its way through a narrowing blood vessel, the capsule carrying a camera allowing visualization of blood vessels of a patient. There is a portable electromagnetic tip, where the tip pulls the electromagnetic capsule by electromagnetic force, and when the magnetic tip moves along a body of a patient and pulls the intraluminal electromagnetic capsule along with it towards a narrowing blood vessel visualized by the camera, so that the capsule then treats the narrowing site and clears the blood vessel from coronary plaque. In addition working capsule can replace diseased valve in any cardiac position for either temporary or permanent needs.

Certain aspects relate to systems and techniques for articulating medical instruments. In one aspect, the instrument includes a wrist having at least two degrees of freedom of movement, and an end effector coupled to the wrist. The end effector can include an upper jaw, a lower jaw, and a firing mechanism configured to form staples in tissue. Actuation of the firing mechanism can be decoupled from the movement of the wrist in the at least two degrees of freedom.

A method for adjusting the operation of a surgical instrument using machine learning in a surgical suite is disclosed.

Certain aspects relate to biopsy apparatuses, systems and techniques for biopsy using a biopsy pattern. Some aspects relate to moving a distal portion of a medical instrument to one or more sample locations of the biopsy pattern and guiding the instrument to obtain tissue samples from the sample locations within the biopsy pattern. Some aspects relate to obtaining the biopsy pattern and adjusting the sample locations within the biopsy pattern based on various factors such as anatomical features.