Telerobotic, telesurgical, and/or surgical robotic devices, systems, and methods employ surgical robotic linkages that may have more degrees of freedom than an associated surgical end effector in space. A processor can calculate a tool motion that includes pivoting of the tool about an aperture site. Linkages movable along a range of configurations for a given end effector position may be driven toward configurations which inhibit collisions. Refined robotic linkages and methods for their use are also provided.

A management system is a management system which includes a remote work system having at least one master unit and a plurality of slave units which can be remotely operated and a management server, in which each of the plurality of slave units includes a gripping unit that is configured to grip a target, grip the target by means of autonomous control, and, when being connected to the master unit by the management server, grip the target by means of a remote operation by the master unit, the master unit is configured to perform the remote operation on the plurality of slave units, and the management server includes an operation management unit that is configured to connect the master unit and the plurality of slave units when a remote operation is required.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for integrating sensor streams for robotic demonstration learning. One of the methods includes selecting, by a learning system for a robot, a base update rate for combining multiple sensor streams into a task state representation. The learning system repeatedly generates the task state representation at the base update rate, including combining, during each time period defined by the update rate, the task state representation from most recently updated sensor data processed by the plurality of neural networks. The learning system repeatedly uses the task state representations to generate commands for the robot at the base update rate.

A method for remotely controlling a robot situated within a factory infrastructure. The method includes: receiving safety condition signals, which represent at least one safety condition which must be met for the robot to be allowed to be remotely controlled; checking whether the at least one safety condition is met; generating remote control signals for remotely controlling the robot based on a result of the check whether the at least one safety condition is met; and outputting the generated remote control signals. A device, a computer program, and a machine-readable memory medium, are also described.

Systems, computer program products, and methods for constructing models and simulations of real-world environments are described. A robot employs various sensors to collect data from its environment and provides this data to a tele-operation system. Any number of tele-artists may access the tele-operation system and use the robot sensor data to collaboratively construct a simulated scene representative of the robot's environment. The tele-artists may continue to update the simulation in real-time as the robot explores its environment and provides more sensor data. The robot may use the simulation in support of fundamental operations through its cognitive architecture, such as action planning and hypothesis generation.

An artificial intelligence controller of the robot may monitor the adaptations made to the simulation by the tele-artists in response to the sensor data in order to learn (e.g., via reinforcement learning) how to autonomously generate and update its own simulation based on its own sensor data.

A robotic system is disclosed. The system includes a memory configured to store for each of a plurality of items a set of attribute values representing one or more physical attributes of the item. The system includes one or more processors coupled to the communication interface and configured to use the attribute values as inputs to a physic engine configured to compute the stability of a simulated stack of items comprising at least a subset of the plurality of items.

A method includes determining a movement of an industrial robot in a manufacturing environment from a first position to a second position. The method also includes displaying an image showing a trajectory of the movement of the robot on a wearable headset. The displaying of the image comprises at least one of: displaying an augmented reality (AR) graphical image or video of the trajectory superimposed on a real-time actual image of the robot, or displaying a virtual reality (VR) graphical image or video showing a graphical representation of the robot together with the trajectory.

A surgical robot includes a controller configured or programmed to control a display to superimpose guide information indicating a moving direction of a medical cart based on a steering angle of a steering device on an image captured by an imaging device and display the guide information.

A method for a remote collaboration, as a method for providing an augmented reality (AR)-based remote collaboration between a robot located in a worksite, a field worker terminal, and a remote administrator terminal located outside the worksite, includes acquiring a captured image including a field image captured by a robot located at the worksite or a captured image including a user image captured by the field worker terminal, displaying the captured image of the worksite, generating virtual content based on an input of a remote administrator and a field worker with respect to the displayed captured image, and displaying an AR image in which the virtual content is augmented on the displayed captured image.

An operation system including: a prediction unit configured to determine a predicted value of a motion of an operator at a prediction time that is a time after elapse of a prediction time interval from the present using a predetermined machine learning model from a biomedical signal of the operator; a control unit configured to control a motion of a robot on the basis of the predicted value; and a prediction time setting unit configured to determine the prediction time interval on the basis of a delay time from a current value of the motion of the operator to the motion of the robot.