Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for generating safety information for a motion plan for one or more robots in an operating environment. One of the methods includes: obtaining a definition of the motion plan, obtaining data specifying a safety footprint volume for a first robot in the operating environment, obtaining one or more safety constraints for the motion plan according to the safety footprint volume for the first robot, determining whether a first safety constraint of the one or more safety constraints is satisfied, in response to determining that the first safety constraint is not satisfied, generating information indicating a violation of a safety constraint.

A robot may perform emergency stopping. The robot includes: a driving device configured to perform movement of the robot; a stop switch configured to output a stop switch signal; a controller configured to output a stop signal; and a stop circuit configured to output a first control signal and a second control signal for stopping the driving device. The stop circuit may output the first control signal and the second control signal in response to the stop signal and the stop switch signal.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for providing user feedback for robotic demonstration learning. One of the methods includes initiating a local demonstration learning process to collect respective local demonstration data for each of one or more demonstration subtasks defined by a skill template to be executed by a robot. Local demonstration data is repeatedly collected for each of the one or more demonstration subtasks of the skill template while a user manipulates a robot to perform each of the one or more demonstration subtasks defined by the skill template. A respective progress value for each of the one or more demonstration subtasks defined by the skill template is maintained. A user interface presentation is generated that presents a suggested demonstration to be performed by the user based on a respective progress value for each demonstration subtask.

A system and method palletize containers having electrical terminals for charging electronic devices packaged therein. First, a stacking pattern is determined on the basis of the sizes, shapes, and locations of electrical terminals on both the pallets and the containers to be stacked. These data may be read, for example, with a computer vision system that uses an articulating robotic arm, and may be encoded in a two-dimensional barcode on each pallet and/or container. Next, the robotic arm stacks the container so that its terminals make electrical contact with terminals on the pallet, or on a previously-stacked layer of containers. Then, the placement is tested to ensure that a good electrical connection exists vertically through the entire stack. Once the pallet is finalized, all electronic devices carried thereon may be simultaneously charged during transit or storage.

A method of transporting an object using a system comprising a plurality of robots. The method comprises one or more robots of the plurality of robots arranging themselves to each exert a respective transporting force on the object. Each of the one or more robots evaluates whether it satisfies a transport criterion while arranged to exert the respective transporting force on the object. If all of the one or more robots satisfy the transport criterion, the one or more robots exert the respective transporting forces on the object to transport the object towards a destination. At least one of the one or more robots evaluates whether it satisfies the transport criterion based on observations of other robots of the plurality of robots within its vicinity.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for modifying a process definition to ensure accuracy, timeliness, or both of workcell measurement. One of the methods includes receiving an initial process definition for a process to be performed by a robot, wherein the process definition defines a sequence of actions to be performed in a workcell, and wherein a first action in the sequence of actions has an associated measurement tolerance; computing a predicted accumulated measurement variance for each of one or more actions that occur before the first action in the sequence; determining that the predicted accumulated measurement variance for the one or more actions that occur before the first action in the sequence exceeds a threshold; and in response, generating a modified process definition that inserts a measurement action at a location in the sequence before the first action.

A method for controlling a patrolling robot is provided. The method includes the steps of: acquiring, as first situation information on the patrolling robot, at least one of weight information on a support coupled to the patrolling robot and image information on the support and information on a location of the patrolling robot in a patrolling place; and determining a task and a travel route of the patrolling robot on the basis of the first situation information.

An automation server accesses a task for a robotic device. The automation server generates motor control commands for the robotic device to complete the task. The automation server transmits, via a network and in a format defined by an Application Program Interface (API), the motor control commands from the automation server to a fleet manager associated with the robotic device, the motor control commands for forwarding from the fleet manager to the robotic device. The automation server receives, from one or more sensors attached to the robotic device and via the network, robotic device sensor data. The automation server receives, from multiple remote sensors and via the network, remote sensor data. The automation server adjusts the generated motor control commands to complete the task based on the robotic device sensor data and the remote sensor data.

A system and method for detecting and fixing robotic process automation failures, including collecting tasks from at least one client computerized device, processing the tasks via robotic process automation, collecting tasks that failed to complete per task type, recording successful execution steps per each of the failed tasks, evaluating the recorded successful execution steps with respect to the failed task types, and providing selected execution steps that best fix the failed tasks, thereby fixing the robotic process automation failures.

Disclosed embodiments provide techniques for virtual reality enabled activity allocation. A camera system monitors a physical environment from multiple angles, generating real-time video feeds of the physical environment. A real-time virtual reality environment (RTVRE) rendering system utilizes the real-time video feeds as input to create a virtual reality environment that is representative of the physical environment. A user performs an action in the virtual environment that corresponds to a task to be performed in the physical environment. A computer-implemented virtual reality control management system assesses the task and assigns the task to an electromechanical device that is best-suited to perform the task, based on a scoring algorithm. This enables actions such as remote monitoring and control of a premises. Thus, disclosed embodiments improve the technical field of remote monitoring and control of a premises.