A surgical system is configured to augment the visualization environment presented to the surgeon by merging, in real-time, video feed and ultrasound imaging; tracking anatomy and instruments; identifying critical structures; generating and displaying 3-dimensional models of relevant anatomy; providing actionable guidance to the user; and enabling data collection and processing. The surgical system may include a tissue-marking surgical instrument configured to simultaneously identify critical structures beneath an organ surface and mark the organ surface at a location overlapping the identified critical structures.

Treating femoroacetrabular impingement. At least one example is a method comprising: monitoring, by a procedure controller, location of a first member of an acetabulofemoral joint in a three-dimensional coordinate space; tracking, by the procedure controller, an amount of bone resected from the first member of the acetabulofemoral joint by tracking a distal end of a resection device in the three-dimensional coordinate space; and controlling, by the procedure controller, a rate of resection of the resection device based on the location of the distal end of the resection device relative to a planned resection volume associated the first member of the acetabulofemoral joint.

A surgical skill training system includes: a data collecting unit configured to collect actual surgical skill data on a patient of an operating surgeon; an image providing server configured to generate a 3-dimensional (3D) surgical image for surgical skill training, based on the actual surgical skill data; and a user device configured to display the 3D surgical image, wherein the image providing server includes: a patient image generating unit configured to generate a patient image, based on patient information of the patient; a surgical stage classifying unit configured to classify the actual surgical skill data into actual surgical skill data for each surgical stage performed by the operating surgeon; and a 3D image generating unit configured to generate the 3D surgical image by using the patient image, and feature information detected from the actual surgical skill data.

A surgical system includes a detector, comprising an array of pixels configured to detect light reflected by a surgical instrument and generate a first signal comprising a first dataset representative of a visible image of the surgical instrument. The surgical system also includes a processor configured to receive the first signal, generate a modified image of the surgical instrument that includes a control panel. The control panel includes one or more control elements representative of one or more operating parameters of the surgical instrument. The processor is further configured to receive an input to the control panel from a user, the input being effective to change one of the operating parameters. The processor is also configured to generate a command signal based on the input to change the one of the operating parameters.

An augmented reality interventional system which provides contextual overlays (116) to assist or guide a user (101) or enhance the performance of the interventional procedure by the user that uses an interactive medical device (102) to perform the interventional procedure. The system includes a graphic processing module (110) that is configured to generate at least one contextual overlay on an augmented reality display device system (106). The contextual overlays may identify a component (104) or control of the interactive medical device. The contextual overlays may also identify steps of a procedure to be performed by the user and provide instructions for performance of the procedure. The contextual overlays may also identify a specific region of the environment to assist or guide the user or enhance the performance of the interventional procedure by identifying paths or protocols to reduce radiation exposure.

Medical imaging systems and methods are provided herein that provide for navigation and procedure planning without segmentation. A method comprises receiving, by a medical imaging system having at least one processing device, three-dimensional image data of a patient anatomy. The method also comprises filtering the three-dimensional data to display a portion of the three-dimensional image data that is associated with the patient anatomy and receiving, at the processing device, input from an operator input device. The input comprises navigational directions for virtual movement within a space defined by the three-dimensional image data. The method also includes tracking the virtual movement, defining a tracked pathway based on the tracked virtual movement, and generating a model of the patient anatomy based on the tracked pathway. The model of the patient anatomy is a line model including one or more lines based on the tracked pathway.

A method of controlling a function of a surgical instrument of a surgical robot with a input of a user interface includes selecting a function of a surgical instrument to link a input of the user interface with the function of the surgical instrument, actuating the input to activate the function of the surgical instrument, and delinking the input from the surgical instrument in response to an event of the surgical robot or the user interface.

A multicatheter subsystem is provided for a steerable catheter robotic system. The subsystem includes a flexible output sheath, a plurality of flexible multi-lumen assemblies and a plurality of robotic instruments for performing a surgical procedure. The plurality of flexible multi-lumen assemblies extends through the outer sheath. Each of the multi-lumen assemblies has a proximal end and a distal end. Each of the robotic instruments is operatively and removably attachable to the distal end of one of the multi-lumen assemblies such that each instrument is teleoperable independently of every other robotic instrument. At least a first of the robotic instruments includes a plurality of interconnected articulating segments. Each of the articulating segments is operatively and removably attachable to a different one of the multi-lumen assemblies.

A method for performing a surgical procedure includes generating, by a computing device, an anatomical map of a patient from a plurality of images; positioning a trocar obturator adjacent to the patient; calculating, by the computing device, a projected path of the trocar obturator; overlaying, by the computing device, the projected path of the trocar obturator with the anatomical map of the patient; and displaying the projected path of the trocar obturator and the anatomical map of the patient on a display device to define an augmented image.

Methods, apparatuses, and systems for transcribing and performing analysis on patient data are disclosed. Data is collected from one or more medical professionals as well as sensors and imaging devices positioned on or oriented towards a patient. An analysis is performed on the patient data and the data is presented to a medical professional via a verbal interface in a conversational manner, allowing the medical professional to provide additional data such as observations or instructions which may be used for further analysis or to perform actions related to the patient's care.