In a coupled control mode, an operator directly controls movement of an associated manipulator with an input device while indirectly controlling movement of one or more non-associated manipulators, in response to commanded motion of the directly controlled manipulator, to achieve a secondary objective. By automatically performing secondary tasks through coupled control modes, the system's usability is enhanced by reducing the operator's need to switch to another direct mode to manually achieve the desired secondary objective. Thus, coupled control modes allow the operator to better focus on performing tasks and to pay less attention to managing the system.

The present invention relates to a method, such as a surgical method for assisting a surgeon for placing screws in the spine using a robot attached to a passive structure. The present invention also related to a method, such as a surgical method for assisting a surgeon for removing volumes in the body of a patient using a robot attached to a passive structure and to a device to carry out said methods. The present invention further concerns a device suitable to carry out the methods according to the present invention.

A method of compensating for motion of objects during a surgical procedure is provided. The method includes determining a pose of an anatomy of a patient; determining a pose of a surgical tool of a surgical device; defining a relationship between the pose of the anatomy and a position, an orientation, a velocity, and/or an acceleration of the surgical tool; associating the pose of the anatomy, the pose of the surgical tool, and the relationship; and updating the association in response to a motion of the anatomy and/or a motion of the surgical tool without interrupting operation of the surgical device during the surgical procedure.

A system and method are provided for determining one or more characteristics of a device. The system and method comprises initiating an algorithm to correct for shift and drift of a reference catheter (203), determining an initial shape and position of a portion of the reference catheter at time 0 when the algorithm is initiated (201), determining a current shape and position of the portion of the reference catheter at time t after the algorithm has been initiated (205), calculating a closest fit of the current shape and position of the portion of the reference catheter to the initial shape and position of the portion of the reference catheter by iteratively adjusting a set of solution parameters (209), and determining a minimal error solution parameter (211).

In certain embodiments, the systems, apparatus, and methods disclosed herein relate to robotic surgical systems with built-in navigation capability for patient position tracking and surgical instrument guidance during a surgical procedure, without the need for a separate navigation system. Robotic based navigation of surgical instruments during surgical procedures allows for easy registration and operative volume identification and tracking. The systems, apparatus, and methods herein allow re-registration, model updates, and operative volumes to be performed intra-operatively with minimal disruption to the surgical workflow. In certain embodiments, navigational assistance can be provided to a surgeon by displaying a surgical instrument's position relative to a patient's anatomy. Additionally, by revising pre-operatively defined data such as operative volumes, patient-robot orientation relationships, and anatomical models of the patient, a higher degree of precision and lower risk of complications and serious medical error can be achieved.

A system including an instrument adapted to be manually supported and moved by a user. The instrument having a hand-held portion, a drive mechanism movably coupled to the hand-held portion, and a plurality of actuators operatively coupled to the drive mechanism for moving the drive mechanism in at least two degrees of freedom relative to the hand-held portion. The instrument also includes a tracking device for tracking the instrument and a working portion removably coupled to the drive mechanism by a coupling assembly. The system further comprises a navigation system for determining a position of the working portion and a bone to be cut during the medical procedure and a control system in communication with the actuators and configured to control the actuators to actively position the working portion such that the working portion is substantially maintained on a plane.

A method, apparatus, and computer readable medium are provided for utilizing augmented reality visualization to assist surgery. An example method includes generating a three dimensional reconstruction of an image stack representing a target area of a patient, and superimposing, by a head-mounted display, a projection of the three dimensional reconstruction onto a field of view of a user. The method further includes maintaining alignment between the projection and the user's actual view of the target area using a plurality of fiducial markers associated with the target area. In some embodiments, the method further includes scanning the target area to generate the image stack.

Apparatus and methods are provided for imaging a tool inside a portion of a subject's body that undergoes motion. A plurality of image frames of the portion are acquired. An image frame in which the tool is enhanced is generated by (a) identifying radiopaque markers in the image frames, (b) identifying edge lines in a vicinity of the markers within the image frames, the edge lines corresponding to contours of the tool, (c) in response to the identifying of the edge lines, selecting a subset of the image frames that are based upon the acquired image frames, based upon a level of similarity between the edge lines in the selected image frames to one another, (d) aligning the contours in a plurality of the selected image frames, and (e) averaging the plurality of aligned frames to generate an averaged image frame. Other applications are also described.

Apparatus and methods are described for use with a portion of a body of a subject including acquiring a plurality of images of the portion, and displaying one of the images. In response to receiving an input that is indicative of a given location within the image, an indication of a region within the portion is generated on the image. In response to receiving a further input, a dimension of the region that is indicated within the image is modified. In response thereto, at least one tool that is suitable for being placed at the region is identified, and/or a dimension of at least one tool that is suitable for being placed at the region is identified. An output is generated is response to the identification. Other applications are also described.

A surgical instrument navigation system is provided that visually simulates a virtual volumetric scene of a body cavity of a patient from a point of view of a surgical instrument residing in the cavity of the patient, wherein the surgical instrument, as provided, may be a steerable surgical catheter with a biopsy device and/or a surgical catheter with a side-exiting medical instrument, among others. Additionally, systems, methods and devices are provided for forming a respiratory-gated point cloud of a patient's respiratory system and for placing a localization element in an organ of a patient.