A surgical robotic system comprising: a surgical robot; a user interface console coupled to the surgical robot whereby a user can control motion of the surgical robot; a data logger for logging data from a surgical procedure performed by means of the robot; and a portable user terminal; the system further comprising: a display controllable by one of the data logger and the user terminal, that one of the data logger and the user terminal being configured for displaying a machine-readable code whereby the data logger or a user of the user terminal can be identified; and a camera coupled to the other of the data logger and the user terminal; the said other of the data logger and the user terminal being configured to, on receiving from the camera an image of a machine-readable code, decode that code to identify the data logger or a user of the user terminal and to cause the identified entity to be logged in association with a procedure performed by means of the robot.

The present disclosure describes robots and tele-operation systems where a select control paradigm is selected from a plurality of control paradigms based on an identity of an operator, role of an operator, or expected tasks to be performed by the robot. Generic robots can be operated in accordance with any of the plurality of control paradigms, such that any of said generic robots can serve a role or act as an assistant to an operator by selection of an appropriate control paradigm. Control paradigms can be operator specific, or specific to a faction or role which an operator fits in, or specific to a set of tasks to be performed by the robot. The present disclosure also describes feedback mechanisms by which a robot or tele-operator system receive operator feedback and update a control paradigm, to gradually improve the control paradigm over time.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio augmentation of physical robot sounds. A robot can determine that a first physically moveable component of the robot is to be actuated and in response, obtain a conditional state of the robot. The robot can obtain an audio object that generates an audio enhancement for the first physically moveable component being actuated, the audio enhancement having one or more characteristics that match the obtained conditional state of the robot. The robot can output the audio enhancement while actuating the first physically moveable component.

Provided is an electronic device. The electronic device may include: a user interface; a processor operatively connected to the user interface; and a memory operatively connected to the processor, wherein the memory may store instructions that, when executed, cause the processor to control the electronic device to: receive an input via the user interface; determine a task including plural actions based on the input; execute a first action among the plural actions of the determined task; obtain context information related to the task while executing the first action; determine at least one first threshold associated with the first action based at least in part on the obtained context information; and determine the result of the first action based on the execution of the first action being completed based on the at least one first threshold.

A system for detecting an anomaly in an execution of a task in mixed human-robot processes. Receiving human worker (HW) signals and robot signals. A processor to extract from the HW signals, task information, measurements relating to a state of the HW, and input into a Human Performance (HP) model, to obtain a state of the HW based on previously learned boundaries of the state of the HW, the state of the HW is then inputted into a Human-Robot Interaction (HRI) model, to determine a classification of an anomaly or no anomaly. Update HRI model with robot operation signals, HW signals and classified anomaly, determine a control action of a robot interacting with the HW or a type of an anomaly alarm using the updated HRI model and classified anomaly. Output the control action of the robot to change a robot action or output the type of the anomaly alarm.

A multiaxial motion control device, having a motion detector to be attached to a moveable object to detect multiple axial movement of the moveable object and to output detection results and a control device to convert said detection results into motion control commands for a multiaxial motion driving device, in particular motion control commands for a plurality of arm segments of a robot arm. A method to control motions of the multiaxial motion driving device, in particular the robot arm, using the control device are also provided.

User-initiated break-away clutching includes a robotic system having a joint, a brake or drive unit coupled to the joint, and a control system coupled with the brake or drive unit. The control system is configured to determine a first manual effort applied to the joint; inhibit, using the brake or drive unit, manual articulation of the joint in response to the first manual effort being below an articulation threshold; facilitate, using the brake or drive unit, the manual articulation of the joint in response to the first manual effort exceeding the articulation threshold; and inhibit, using the brake or drive unit, further manual articulation of the joint in response to a determination that a speed of the manual articulation of the joint is below a speed threshold.

A system for cognitive assistance in aircraft assembly includes a system to monitor an aircraft assembly process and acquire physical and physiological data on a human worker performing assembly operations. A cognitive model of the human worker on a data-processing device is coupled to the monitoring system to receive acquired physical and physiological data of the human worker, the cognitive model configured to provide state information on the human worker and prognostic data on expected behavior of the human worker during the aircraft assembly process. The state information and the prognostic data are continuously updated during the aircraft assembly process. A system control is coupled to the monitoring system and the cognitive model to assess current state of the aircraft assembly process based on the monitored aircraft assembly process, the state information of the of the human worker and the prognostic data of the cognitive model.

Described is system for tele-robotic operations over time-delayed communication links. Sensor data is acquired from at least one sensor for sensing surroundings of a robot having at least one robotic arm for manipulating an object. A three-dimensional model of the sensed surroundings is generated, and the sensor data is fit to the three-dimensional model. Using the three-dimensional model, a user demonstrates a movement path for the at least one robotic arm. A flow field representing the movement path is generated and combined with obstacle-repellent forces to provide force feedback to the user through a haptic device. The flow field comprises a set of parameters, and the set of parameters are transmitted to the robot to execute a movement of the at least one robotic arm for manipulating the object.

In one embodiment, communicating robot intentions to human beings involves determining movements that a robot will make to complete a task, visually communicating a long-term intention of the robot that provides an indication of the movements the robot will make in completing the task, and visually communicating a short-tem intention of the robot that provides an indication of a movement of the robot will make within the next few seconds in working toward completing the task.