Systems and methods are provided for planning a procedure. A display device is configured to display a first virtual element. A controller device having a processor is configured to be in communication with the display device, and the controller device is further configured to direct the display device to display the first virtual element. A physical control element is in communication with the controller device, and is configured to correspond to the first virtual element such that an actual manipulation of the control element is displayed, via the processor of the controller device and on the display device, as a corresponding response of the first virtual element to the actual manipulation of the control element. Associated systems, methods, and computer program products are also provided.

A surgical instrument includes a distal portion. A force sensor is operatively mounted on the distal portion. The force sensor includes a wireless package, which wirelessly provides (1) identification information of the surgical instrument and (2) strain data related to the distal portion. A surgical end effector includes a jaw and the distal portion is on a non-contact portion of the jaw. The wireless package includes a surface acoustic wave strain sensor with identification information. The wireless package also includes a small folded antenna electrically coupled to the surface acoustic wave strain sensor with identification information. The identification information includes an identification of a type of surgical instrument and unique identification of the specific surgical instrument in the type of surgical instrument.

A method and system for hand tracking in a robotic system includes a hand tracking system and a controller coupled to the hand tracking system. The controller is configured to receive, from the hand tracking system, a plurality of locations of a hand; determine if the hand is in a first hand pose based on the plurality of locations; in response to determining that the hand is in the first hand pose, and switch the robotic system to a hand trajectory detection mode. While in the hand trajectory detection mode, the control unit is configured to detect, based on hand tracking information from the hand tracking system, that the hand has performed a first hand trajectory of a plurality of known hand trajectories; and in response to detecting the first hand trajectory, change a mode of operation of the robotic system.

Embodiments relate to robotic arm assemblies. The robotic arm assembly includes an end-effector assembly. The end-effector assembly includes an instrument assembly. The instrument assembly includes an instrument and instrument driven portion. The elongated body includes an instrument central axis. The instrument driven portion includes a first central axis. The instrument driven portion is secured to a proximal end of the instrument in such a way that, when the instrument driven portion is driven to rotate, the instrument rotates relative to the first central axis. The end-effector assembly includes an instrument drive assembly. The instrument drive assembly includes an instrument drive portion. The instrument drive portion includes a second central axis. The instrument drive portion is configured to drive the instrument driven portion to rotate the distal end of the instrument relative to the first central axis. The second central axis intersects with and orthogonal to the first central axis.

A surgical manipulator and method of operating the same. The surgical manipulator includes an arm with a plurality of links and joints, wherein an angle between adjacent links forms a joint angle. The arm includes a distal end configured to support a surgical instrument with an energy applicator. At least one controller is coupled to the arm and models the surgical instrument and the energy applicator as a virtual rigid body. The controller(s) determine a commanded pose for the surgical instrument and the energy applicator based on a summation of a plurality of forces and/or torques, wherein the plurality of forces and/or torques are selectively applied to the virtual rigid body to emulate orientation and movement of the surgical instrument and the energy applicator. The controller(s) determine commanded joint angles for the arm that place the surgical instrument and the energy applicator according to the commanded pose.

A method of verifying torque measurements of a reaction torque transducer of an instrument drive unit includes a controller receiving a verification signal, generating an acceptable range of torques, receiving a torque signal, comparing the torque signal to the acceptable range of torques, and stopping a motor if the torque applied by the motor is outside of the acceptable range of torques. The verification signal is indicative of the current drawn by the motor and the torque signal is indicative of torque applied by the motor.

A method for enhanced surgical navigation, and a system performing the method and displaying graphical user interfaces associated with the method. A 3D spatial map of a surgical site is generated using a 3D endoscope including a camera source and an IR scan source. The method includes detecting a needle tip protruding from an anatomy and determining a needle protrusion distance corresponding to a distance between the needle tip and a surface of the anatomy using the 3D spatial map. A position of a surgical tool in the 3D spatial map is detected and a determination is made by the system indicative of whether the needle protrusion distance is sufficient for grasping by the surgical tool. A warning is generated when it is determined that the needle protrusion distance is not sufficient for grasping by the surgical tool.

A variety of applications can include apparatus and/or methods that provide an axial force transducer. Two coils wound coaxially with respect to each other can be used with a magnet to determine a distance traveled based on application of an axial force to an instrument component. The two coils and magnet can be configured in a number of ways with respect to the instrument component. In various embodiments, the difference between an inductance associated with one of the two coils along with its relation to the magnet and an inductance associated with the other one of the two coils along with its relation to the magnet can be used to determine the axial force on the component of the instrument associated with the distance travelled. Additional apparatus, systems, and methods are disclosed.

A surgical system comprises an articulated mechanical arm comprising arm segments connected serially by arm joints that flex and rotate, and first and second input-devices. The second input-device comprises a handle configurable to be oriented in any orientation in an x-y-z space, and the handle comprises segment members and joint members corresponding to the arm segments and arm joints of the arm. The arm joints can be actuatable by, and have the same degrees of freedom as, the handle joint member. A method of using the surgical system includes retroflecting the arm, transitioning control of the arm from the first input device to the second input device, and performing a surgical action, during which a displacement vector or a reorientation arc of the handle member through the x-y-z space is translated to a corresponding displacement vector or corresponding reorientation arc of the end effector in the same x-y-z space.

A robotic surgery method for cutting a bone of a patient includes characterizing the geometry and positioning of the bone and manually moving a handheld manipulator, the handheld manipulator operatively coupled to a bone cutting tool having an end effector portion, to cut a portion of the bone with the end effector portion. The handheld manipulator further comprises a manipulator housing and an actuator assembly movably coupled between the manipulator housing and the bone cutting tool. The method further includes causing the actuator assembly to automatically move relative to the manipulator housing to maintain the end effector portion of the tool within a desired bone cutting envelope in response to movement of the manipulator housing relative to the bone.