As an expert gives instructions to cause movements of their own hands transferred directly as tactile force sense while perceiving surrounding information of a collaborator on a real-time basis and watching the collaborator's line-of-sight end and movements of the collaborator's hands, the collaborator indirectly receives the instructions of the expert's manual skills, which are the expert's tacit knowledge, on a real-time basis while sharing realistic sensations with the expert who is at a remote location when the collaborator performs an act of working with their own hands.

A surgical workflow system for assisting a surgical procedure comprises a workflow controller. The workflow controller is configured to access a pre-scripted workflow having a plurality of workflow steps associated with the surgical procedure, obtain camera video data of the surgical procedure, monitor the surgical procedure from the camera video data, predict occurrence of an anticipated deviation from one or more of the workflow steps of the pre-scripted workflow, generate event information to address the predicted occurrence of the anticipated deviation, and automatically respond to the predicted occurrence of the anticipated deviation by being configured to transmit the event information to a participant of the surgical procedure through an information conveyor device.

A UI for a HMD system includes a HMD configured to be worn by a surgeon. A tracker is configured to track head gestures by the surgeon. A footswitch is configured to detect foot motion inputs by the surgeon. A computer couples to the HMD, the tracker, and the footswitch. A user interface includes the HMD, tracker, and footswitch. The use interface is configured to: provide to the computer the head gesture in association with the foot motion input, and display an image relating to a surgical procedure on the HMD. The computer is configured to: apply the head gesture received in association with the foot motion input to perform a first action on the HMD system when the HMD system is in a first system mode, and perform a second action on the HMD system when the HMD system is in a second system mode.

A centralized controller includes a recording unit, a judgement unit, a processing unit and an execution unit. The judgement unit reads out information on a plurality of kinds of operation from the recording unit and performs scene correspondence judgement as to whether or not each of the plurality of kinds of operation is operation corresponding to the scene for each of scenes of a surgery defined in advance. The processing unit generates at least part of setting values of a plurality of pieces of controlled equipment from a plurality of kinds of operation which are respectively judged as the operation corresponding to the scene through the scene correspondence judgement and records the setting values in the recording unit. The execution unit collectively sets the setting values for one or more pieces of controlled equipment for each of the scenes of the surgery.

Use of augmented reality to provide a real-time two-dimensional representation of medical imaging data to a user in a three-dimensional space. An augmented reality system is discussed that may provide a single stage processing for video data ingestion directly from a video data output of a medical imaging device. In turn, latency in the resulting video data presented to the user via an augmented reality display may be reduced. The augmented reality system may also allow for a high degree of control over the virtual position, rotation, size, and/or opacity of the two-dimensional representation of the video data in the three-dimensional space associated with the augmented reality system.

A number of improvements are provided relating to computer aided surgery. The improvement relates to both the methods used during computer aided surgery and the devices used during such procedures. Some of the improvement relate to controlling the selection of which data to display during a procedure and/or how the data is displayed to aid the surgeon. Other improvements relate to the structure of the tools used during a procedure and how the tools can be controlled automatically to improve the efficiency of the procedure. Still other improvements relate to methods of providing feedback during a procedure to improve either the efficiency or quality, or both, for a procedure.

An operation profile system may collect surgical session data representative of surgical procedure operations performed during a surgical session and may access operation pattern data representative of multiple historical patterns of surgical procedure operations. The system may identify, based on the operation pattern data and the surgical session data, a first historical pattern included in the multiple historical patterns of surgical procedure operations and that matches a first collected pattern from the surgical procedure operations. The system may provide, for use during the surgical session, a first operation profile associated with the first historical pattern that matches the first collected pattern.

Methods, systems, and devices for treating osteochondral defects (OCDs) are disclosed. The disclosed methods and systems include collecting joint surface data using image-free methods, generating a three-dimensional (3D) healthy bone model based on the joint surface data and a database of healthy bone anatomies, defining the OCD boundary on the joint, generating a 3D implant model based on the 3D healthy bone model and the OCD boundary, manufacturing an implant based on the 3D implant model, generating an implantation plan, the resected cavity on the joint. The implant includes a 3D-printed titanium alloy substrate having a first and second porous layer separated by a nonporous layer. A polymer material is over-molded onto the second porous layer and treated to exhibit properties that mimic cartilage, while the first porous layer allows the implant to fuse to patient bone.

A computing device for generating and using a graphical user interface (GUI) is disclosed. The computing device includes one or more controllers configured to generate a graphical representation of a plurality of electrodes of an ablation catheter for displaying via the GUI; designate, via the GUI, at least some of the plurality of electrodes to be active electrodes; automatically designate the active electrodes as a source electrode or a sink electrode; assign an amount of energy to each of the designated source electrodes; and estimate an amount of energy associated with each of the designated sink electrodes based at least in part on the assigned energy of the designated source electrodes.

A computer-implemented method for generating and presenting an electronic display of guidance for performing a robotic medical procedure may include receiving a plurality of prior procedure data sets; receiving or identifying objective data defining one or more of a duration or a patient outcome of the robotic medical procedure; executing an algorithm to identify a pattern across the plurality of prior procedure data sets; receiving information about an instance of the robotic medical procedure to be performed in the future for a patient outside the population; automatically generating guidance for performing the robotic medical procedure; and generating and presenting an electronic display of the guidance for performing the robotic medical procedure.