A system for tracking a hand within a surgical environment is disclosed. The system comprises a hand covering including an opening to receive the hand and a plurality of trackable regions that each include at least one tracking feature. The system further comprises a tracking unit including one or more sensors configured to detect a location of each tracking feature. The system further comprises a processor configured to cause the system to receive the location of each tracking feature from the tracking unit, determine a position and an orientation of each trackable region of the hand covering, and calculate an overall position, orientation, and/or pose of the hand. Various actions or settings may be controlled within the surgical workspace by utilizing particular gestures or movements that are identified by the system via the processor.

A method of deploying an interventional instrument comprises identifying a target structure within a patient anatomy in an anatomic frame of reference. The method further comprises determining a target region representing a location of the target structure in the the anatomic frame of reference with respect to a current location of the interventional instrument and recording a first engagement location of the interventional instrument within the target. Determining the target region includes determining a probabilistic distribution of the location of the target structure relative to the current location of the interventional instrument and associating each of the plurality of target points with a probability of engaging the target structure.

A system for use in surgery includes a central body, a visualization system operably connected to the central body, a video rendering system, a head-mounted display for displaying images from the video rendering system, a sensor system, and a robotic device operably connected to the central body. The visualization system includes at least one camera and a pan system and/or a tilt system. The sensor system tracks the position and/or orientation in space of the head-mounted display relative to a reference point. The pan system and/or the tilt system are configured to adjust the field of view of the camera in response to information from the sensor system about changes in at least one of position and orientation in space of the head-mounted display relative to the reference point.

A medical robot system, including a robot coupled to an effectuator element with the robot configured for controlled movement and positioning. The system may include a transmitter configured to emit one or more signals, and the transmitter is coupled to an instrument coupled to the effectuator element. The system may further include a motor assembly coupled to the robot and a plurality of receivers configured to receive the one or more signals emitted by the transmitter. A control unit is coupled to the motor assembly and the plurality of receivers, and the control unit is configured to supply one or more instruction signals to the motor assembly. The instruction signals can be configured to cause the motor assembly to selectively move the effectuator element and is further configured to (i) calculate a position of the at least one transmitter by analysis of the signals received by the plurality of receivers; (ii) display the position of the at least one transmitter with respect to the body of the patient; and (iii) selectively control actuation of the motor assembly in response to the signals received by the plurality of receivers.

An obstruction detection system for a robotic catheter system including a robotic catheter manipulator assembly including one or more catheter manipulation bases and one or more sheath manipulation bases. Each manipulation base may be generally linearly movable on one or more tracks relative to the robotic catheter manipulator assembly. The obstruction detection system may include one or more obstruction detection sensors disposed on the track or on the manipulation bases to detect an obstruction along a path of motion of one or more manipulation bases. A software system may be provided for monitoring movement of the catheter and sheath manipulation bases, and/or a status of the obstruction detection sensors.

Implementations relate to a master control device. In some implementations, a master control device includes a control body comprising a proximal end, a thumb grip portion, and a finger grip portion. The control body has a length configured to engage the proximal end of the control body in the palm of a hand of the user while the hand engages the thumb grip portion with a thumb of the hand and the finger grip portion with a finger of the hand. The control body is configured to allow the proximal end of the control body to be selectively engaged by the palm of the hand and selectively disengaged from the palm of the hand while the hand engages the thumb grip portion with the thumb of the hand and the finger grip portion with the finger of the hand.

A computer-assisted surgical system includes a function selection system configured to detect an actuation and a de-actuation of a user input mechanism associated with a user control mechanism for controlling a surgical instrument coupled to a manipulator arm of a computer-assisted surgical system, the user input mechanism configured to facilitate activation and deactivation of a clutch mode of operation in which the user control mechanism is decoupled from controlling the surgical instrument. Based on the detecting of the actuation and the de-actuation of the user input mechanism, the function selection system determines information associated with the user input mechanism and the user control mechanism, compares the information to a set of defined criteria, and performs, when the information satisfies the set of defined criteria, a function associated with a different mode of operation of the computer assisted surgical system.

An optical shape sensing system includes an attachment device (130) coupled at an anatomical position relative to a bone. An optical shape sensing fiber (102) is coupled to the attachment device and configured to identify a position and orientation of the attachment device. An optical shape sensing module (115) is configured to receive feedback from the optical shape sensing fiber and register the position and orientation of the attachment device relative to an anatomical map.

A surgical system includes a first detector that includes a first array of pixels configured to detect light reflected by a surgical instrument and generate a first signal comprising a first dataset representative of a visible image of the surgical instrument. The surgical system also includes a second detector, comprising a second array of pixels configured to detect infrared radiation produced by the surgical instrument during a procedure using the surgical instrument and generate a second signal comprising a second dataset representative of an infrared image of the surgical instrument. The surgical system further includes a processor configured to receive the first and second signals, identify from the first dataset data representative of the surgical instrument, and identify from the second dataset data representative of one or more regions of the surgical instrument above a predetermined threshold temperature. The processor is also configured to generate a modified image of the surgical instrument based on data identified from the first and second dataset. The modified image includes visible indicia in the one or more region of the surgical instrument at or above the predetermined temperature.

A haptic device comprising: an array of soft hydraulic skin stretch devices, and soft microtubule muscles configured to control the skin stretch devices.