A method of assigning an auxiliary input device to control a surgical instrument in a computer-assisted surgical system includes detecting a first surgical instrument coupled to a first manipulator interface assembly of a computer-assisted surgical system, the first manipulator interface assembly being controlled by a first input device. The method further includes detecting an initial relative position of the first input device and either assigning control of an auxiliary function of the first surgical instrument to a first auxiliary input device disposed in a left position relative to a second auxiliary input device if the initial relative position of the first input device is detected to be at a left position relative to a second input device or assigning may also include assigning control of an auxiliary function of the first surgical instrument to the second auxiliary input device disposed in a right position relative to the first auxiliary input device if the initial relative position the first input device is detected to be at a right position relative to the second input device.

A versatile, compact, and high-fidelity haptic device is provided. The mechanical transparency of the design and the selection of proper actuation meet the challenges of an accurate and stiff haptic device with high and isotropic force capability. Such a haptic interface enables a precise remote control and provides perfect sense of the task interaction in any environments and applications.

A teleoperated robotic system that includes master control arms, slave arms, and a mobile platform. In use, a user manipulates the master control arms to control movement of the slave arms. The teleoperated robotic system can include two master control arms and two slave arms. The master control arms and the slave arms can be mounted on the platform. The platform can provide support for the master control arms and for a teleoperator, or user, of the robotic system. Thus, a mobile platform can allow the robotic system to be moved from place to place to locate the slave arms in a position for use. Additionally, the user can be positioned on the platform, such that the user can see and hear, directly, the slave arms and the workspace in which the slave arms operate.

A robotic system for remote operation of human-controllable equipment includes a remotely operable robotic subsystem configured to be at least one of mounted on or arranged adjacent to the human-controllable equipment to be controlled, and a remote controller that is configured to be operated by a human. The remote controller emulates a control representation of the human-controllable equipment such that a human can provide commands using the control representation. The remotely operable robotic subsystem is configured to receive commands from the remote controller to thereby operate the human-controllable equipment.

A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Techniques for input control visualization include a control console. The control console includes a first input control operable by an operator and outside of a field of view of the operator, a display within the field of view of the operator, and one or more sensors. The one or more sensors acquire information about the first input control and a physical environment surrounding the first input control. A representation of the first input control and the physical environment is generated from the information. The representation is displayed on the display.

A teleoperated robotic system that includes master control arms, slave arms, and a mobile platform. In use, a user manipulates the master control arms to control movement of the slave arms. The teleoperated robotic system can include two master control arms and two slave arms. The master control arms and the slave arms can be mounted on the platform. The platform can provide support for the master control arms and for a teleoperator, or user, of the robotic system. Thus, a mobile platform can allow the robotic system to be moved from place to place to locate the slave arms in a position for use. Additionally, the user can be positioned on the platform, such that the user can see and hear, directly, the slave arms and the workspace in which the slave arms operate.

A powered user interface for a robotic surgical system having a manipulator and a surgical instrument mounted to the manipulator includes a base and a linkage assembly that includes two two-bar linkage mechanisms. The linkage assembly is rotatably mounted to the base at a base joint, and a handle mounted to each of the two-bar linkage mechanisms. Sensors and actuators are arranged to measure and actuate the position and orientation of the user interface.

A powered user interface for a robotic surgical system includes a base, a handle mounted to the base and moveable relative to the base in at least six degrees of freedom, and actuators. The interface operates in accordance with a first mode of operation in which the actuators are operated to constrain predetermined ones of the joints to permit motion of the handle in only 4DOF with respect to the base, and a second mode of operation in which the actuators permit motion of the handle in at least 6DOF with respect to the base.

In a method of operation of a robot, the robot identifies a set of candidate actions that may be performed by the robot, and collects, for each candidate action of the set of candidate actions, a respective set of ancillary data. The robot transmits a request for instructions to a tele-operation system that is communicatively coupled to the robot. The request for instructions includes each candidate action and each respective set of ancillary data. The robot receives, and executes, the instructions from the tele-operation system. The robot updates a control model, based at least in part on each candidate action, each respective set of ancillary data, and the instructions, to increase a level of autonomy of the robot. The robot may transmit the request for instructions to the tele-operation system in response to determining the robot is unable to select a candidate action to perform in furtherance of an objective.