A method for displaying guidance information using a graphical user interface during an medical procedure comprises displaying, in a first mode of the graphical user interface, first image data from a perspective corresponding to a distal end of an elongate device. The first image data includes a virtual roadmap. The method also comprises transitioning from the first mode of the graphical user interface to a second mode of the graphical user interface. The transition is based on an occurrence of a triggering condition. The method also comprises displaying, in the second mode of the graphical user interface, second image data from a perspective corresponding to the distal end of the elongate device. The second image data includes a target indicator corresponding to a target location and an alignment indicator corresponding to an expected location of the medical procedure at the target location.

A system for use with a balloon disposed at a distal end of an intrabody probe includes an output device, configured to produce an output indicating whether the balloon is elongated, and a processor. The processor is configured to calculate, based on respective locations of multiple elements disposed on a surface of the balloon, multiple values, over an interval, of a parameter indicative of a radius of the balloon. The processor is further configured to modify a state of the output based on at least one of the values. Other embodiments are also described.

Surgical devices and surgical systems are disclosed. The surgical device can comprise an actuator and a control circuit configured to adjust one or more functions of the surgical device based on a signal from a situationally-aware surgical hub. A surgical system can comprise a screen and a control circuit configured to communicate a priority level of a recommendation to the clinician on the display.

According to an embodiment of the inventive concept, a method for matching an actual surgical image and a 3D-based virtual surgical simulation environment, which is performed by an apparatus, includes setting POI information during surgery at each of surgery steps in a pre-stored surgical image obtained by performing surgery the same as the actual surgical image, matching the POI information with a virtual pneumoperitoneum model of a patient, which is used for the 3D-based virtual surgical simulation environment, the virtual pneumoperitoneum model being displayed on a UI, recognizing a real-time surgery step of the actual surgical image and determining a location of the POI information for the respective recognized surgery step, and obtaining and displaying image information, which is captured by moving a location of an endoscope inserted into the virtual pneumoperitoneum model to the same location as the determined location of the POI information, through the UI.

Medical imaging systems and methods are provided herein that provide for navigation and procedure planning without segmentation. A method comprises receiving, by a medical imaging system having at least: one processing device, three-dimensional image data of a patient anatomy. The method also comprises filtering the three-dimensional data to display a portion of the three-dimensional image data that is associated with the patient anatomy and receiving, at the processing device, input from an operator input device. The input comprises navigational directions for virtual movement within a space defined by the three-dimensional image data. The method also includes tracking the virtual movement and generating a first model of the patient anatomy based on the tracked virtual movement.

A medical system comprises a display system and a medical instrument. The system further comprises a control system communicatively coupled to the display system. The control is system configured to display image data of a patient anatomy via the display system. The control system is further configured to determine, while the medical instrument navigates the patient anatomy, that a distal portion of the medical instrument is within a threshold distance of a target location in the patient anatomy. The control system is further configured to display an anatomical boundary via the display system if the distal portion of the medical instrument is within the threshold distance of the target location, the anatomical boundary indicating a surface of an anatomical structure of the patient anatomy.

Logic may provide a deformity analysis to create a treatment plan for external fixators. Logic may further perform additional refinements to the treatment plan to improve the patient experience. Logic may further include pre-operative osteotomy to select an osteotomy and to provide real-time updates to a post-operative image based on changes to an osteotomy line, orientation, and/or rotation point. Logic may facilitate movement of one or two portions of a medical image to determine an alignment of bone segments in the portions of the medical image. Logic may generate deformity parameters based on a combination of translations and/or rotations of the movement to align the portions. Logic may create a treatment plan including a prescription for an external fixator based on deformity parameters.

A computer-assisted surgery system allows a user to control movements of a surgical tool by providing, to a control unit, inputs in the form of measured displacements via a movable part of a handle while treating a region of interest with the tool. The control unit is configured to enable motion of the tool with respect to an anatomical structure only if a user moves the movable part, receive the measured displacement of the movable part, receive from a localization unit the relative position and orientation of the tool relative to the anatomical structure, based on the measured displacement, on the surgical plan and on the relative position and orientation of the tool relative to the anatomical structure, compute an instruction to send to a motorized joint to move a robotic arm to operate the tool according to an optimal trajectory, and send the computed instruction to the motorized joint.

A robotic system is configured to automatically identify phases of a medical procedure. The robotic system includes a video capture device, a robotic manipulator, one or more sensors, an input device, and control circuitry. The control circuitry is configured to: determine a first position of the robotic manipulator based on sensor data; determine a first procedure from a set of procedures based on a user input and the sensor data; narrow a set of procedure phases to a subset of the procedure phases based on the determined first procedure; perform a first analysis of a captured video of a patient site; identify a first phase of the medical procedure from the subset of the procedure phases based on the first position of the robotic manipulator and the first analysis of the video; and generate a first video marker indicating a beginning of the first phase of the medical procedure.

The present disclosure relates generally to a surgical system. The surgical system comprises one or more surgical instrument assemblies and a surgical navigation system. The surgical instrument assemblies comprises a tracking device capable of being tracked by the surgical navigation system. The surgical system is also configured to allow the user to define one or more alert zones relative to anatomical structures of the patient and/or a surgical pathway. The surgical system further comprises an alert device in communication with the surgical navigation system, such that the alert device is configured to provide a user-perceptible alert to the surgeon or medical professional based on the position of the surgical instrument, as determined by the surgical navigation system, relative to the defined alert zones and/or surgical pathway.