A computer-implemented method to improve the point collection process during registration of a bone for a computer-assisted surgical procedure is provided. Based on bone digitization data, a simulation is performed to confirm the accuracy of the registration for different digitization regions. Results are tested to identify which digitization regions meet a predefined accuracy requirement. The resulting information is used to perform a computer-assisted surgical procedure. A computerized simulation method for registration of a bone for a computer-assisted surgical procedure is also provided based on processor executing random stroking an expected exposed surface of a bone model with multiple of stroke curves to cover most of the bone model surface with uniform noise and a random sample consensus is applied to remove outlying point to yield the best registration results, to find the top subset as to overlap. A method to perform computer-assisted surgery is also provided.

Devices, systems, and methods are provided for control over automated movement of catheters and other elongate bodies. Fluid and/or pull-wire drive systems can be used to provide robotically coordinated lateral bending motions and a processor of the system can generate synchronized actuator drive signals to move the tool along an at least partially laterally constrained path, with the path optionally extending along the axis of a virtual model of the catheter that has been driven in silico into alignment with a target tissue adjacent an open workspace such as an open chamber of the heart.

A system includes a mobile device having one or more cameras to take images; a sensor detecting reflected light from one or more lasers and a diffuser to detect object range or dimension; code for motion tracking, environmental understanding by detecting planes in an environment, and estimating light and dimensions of the surrounding based on the one or more lasers; code to estimate a three-dimensional (3D) volume of an object from multiple perspectives and from projected laser beams to measure size or scale and determine locations of points on the object's surface in a plane or a slice using time-of-flight, wherein positions and cross-sections for different slices are correlated to construct a 3D model of the object, including object position and shape; the device receiving user request to select a content from one or more augmented, virtual, or extended reality contents and rendering a reality view of the environment.

A method for displaying guidance information using a graphical user interface during an medical procedure comprises displaying, in a first mode of the graphical user interface, first image data from a perspective corresponding to a distal end of an elongate device. The first image data includes a virtual roadmap. The method also comprises transitioning from the first mode of the graphical user interface to a second mode of the graphical user interface. The transition is based on an occurrence of a triggering condition. The method also comprises displaying, in the second mode of the graphical user interface, second image data from a perspective corresponding to the distal end of the elongate device. The second image data includes a target indicator corresponding to a target location and an alignment indicator corresponding to an expected location of the medical procedure at the target location.

Surgical devices and surgical systems are disclosed. The surgical device can comprise an actuator and a control circuit configured to adjust one or more functions of the surgical device based on a signal from a situationally-aware surgical hub. A surgical system can comprise a screen and a control circuit configured to communicate a priority level of a recommendation to the clinician on the display.

Example methods and systems may be used intraoperatively to help surgeons perform accurate and replicable surgeries, such as knee arthroplasty surgeries. An example system combines real time measurement and tracking components with functionality to compile data collected by the hardware to register a bone of a patient, calculate an axis (e.g., mechanical axis) of the leg of the patient, assist a surgeon in placing cut guides, and verify a placement of an inserted prosthesis.

An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Systems and methods for assisting users with accurate tool identification. A tool includes a tool feature, and a navigation system includes a localizer to detect a position of the tool feature. A memory stores identification data associated with a plurality of tools. Controller(s) is/are coupled to the navigation system, the memory and the display. The controller(s) receive, from the localizer, the detected position of the tool feature and compare the detected position of the tool feature with the identification data stored in the memory to determine an identity of the tool. The controller(s) present, on a display, the identity of the tool and an identity of at least one other tool.

A medical system comprises a display system and a medical instrument. The system further comprises a control system communicatively coupled to the display system. The control is system configured to display image data of a patient anatomy via the display system. The control system is further configured to determine, while the medical instrument navigates the patient anatomy, that a distal portion of the medical instrument is within a threshold distance of a target location in the patient anatomy. The control system is further configured to display an anatomical boundary via the display system if the distal portion of the medical instrument is within the threshold distance of the target location, the anatomical boundary indicating a surface of an anatomical structure of the patient anatomy.

A computer-assisted surgery system allows a user to control movements of a surgical tool by providing, to a control unit, inputs in the form of measured displacements via a movable part of a handle while treating a region of interest with the tool. The control unit is configured to enable motion of the tool with respect to an anatomical structure only if a user moves the movable part, receive the measured displacement of the movable part, receive from a localization unit the relative position and orientation of the tool relative to the anatomical structure, based on the measured displacement, on the surgical plan and on the relative position and orientation of the tool relative to the anatomical structure, compute an instruction to send to a motorized joint to move a robotic arm to operate the tool according to an optimal trajectory, and send the computed instruction to the motorized joint.