The present disclosure is directed to methods, computer program products, and computer systems for instructing a robot to prepare a food dish by replacing the human chef's movements and actions. Monitoring a human chef is carried out in an instrumented application-specific setting, a standardized robotic kitchen in this instance, and involves using sensors and computers to watch, monitor, record and interpret the motions and actions of the human chef, in order to develop a robot-executable set of commands robust to variations and changes in the environment, capable of allowing a robotic or automated system in a robotic kitchen to prepare the same dish to the standards and quality as the dish prepared by the human chef.

Methods and systems for enabling human-machine collaborations include a generalizable framework that supports dynamic adaptation and reuse of robotic capability representations and human-machine collaborative behaviors. Specifically, a method of feedback-enabled user-robot collaboration includes obtaining a robot capability that models a robot's functionality for performing task actions, specializing the robot capability with an information kernel that encapsulates task-related parameters associated with the task actions, and providing an instance of the specialized robot capability as a robot capability element that controls the robot's functionality based on the task-related parameters. The method also includes obtaining, based on the robot capability element's user interaction requirements, user interaction capability elements, via which the robot capability element receives user input and provides user feedback, controlling, based on the task-related parameters, the robot's functionality to perform the task actions in collaboration with the user input; and providing the user feedback including task-related information generated by the robot capability element in association with the task actions.

A system and method of instructing a device is disclosed. The system includes a signal source for providing at least one visual signal where the at least one visual signal is substantially indicative of at least one activity to be performed by the device. A visual signal capturing element captures the at least one visual signal and communicates the at least one visual signal to the device where the device interprets the at least one visual signal and performs the activity autonomously and without requiring any additional signals or other information from the signal source.

The present disclosure is directed to methods, computer program products, and computer systems for instructing a robot to prepare a food dish by replacing the human chef's movements and actions. Monitoring a human chef is carried out in an instrumented application-specific setting, a standardized robotic kitchen in this instance, and involves using sensors and computers to watch, monitor, record and interpret the motions and actions of the human chef, in order to develop a robot-executable set of commands robust to variations and changes in the environment, capable of allowing a robotic or automated system in a robotic kitchen to prepare the same dish to the standards and quality as the dish prepared by the human chef.

A computing system identifies a trajectory example generated by a human operator. The trajectory example includes trajectory information of the human operator while performing a task to be learned by a control system of the computing system. Based on the trajectory example, the computing system trains the control system to perform the task exemplified in the trajectory example. Training the control system includes generating an output trajectory of a robot performing the task. The computing system identifies an updated trajectory example generated by the human operator based on the trajectory example and the output trajectory of the robot performing the task. Based on the updated trajectory example, the computing system continues to train the control system to perform the task exemplified in the updated trajectory example.

Example methods and systems are disclosed for performing automated tasks with a robot system. In one example, a robot system includes a robotic arm and an end-effector coupled to the robotic arm. The end-effector is actuatable among more than two states of actuation. The robot system also includes an analog control switch located on the end-effector. The analog control switch is actuatable among more than two switch positions. The analog control switch is configured such that actuation of the analog control switch among the more than two switch positions causes a corresponding actuation of the end-effector among the more than two states of actuation.

A control engine is trained to operate a robotic camera according to a variety of different cinematographic techniques. The control engine may reconfigure the robotic camera to respond to a set of cues, to enforce a set of constraints, or to apply one or more characteristic styles. A training engine trains a network within the control engine based on training data that exemplifies cue responses, enforced constraints, and characteristic styles.

A machine learning device for learning a motion of a robot engaged in a task performed by a human and a robot in cooperation with each other, including a state observation unit that observes a state variable indicating a state of the robot when the human and the robot cooperate with each other and perform a task; a reward calculation unit that calculates a reward based on control data and the state variable for controlling the robot and on an action of the human; and a value function update unit that updates an action value function for controlling a motion of the robot, based on the reward and the state variable.

The present disclosure is directed to methods, computer program products, and computer systems for instructing a robot to prepare a food dish by replacing the human chef's movements and actions. Monitoring a human chef is carried out in an instrumented application-specific setting, a standardized robotic kitchen in this instance, and involves using sensors and computers to watch, monitor, record and interpret the motions and actions of the human chef, in order to develop a robot-executable set of commands robust to variations and changes in the environment, capable of allowing a robotic or automated system in a robotic kitchen to prepare the same dish to the standards and quality as the dish prepared by the human chef.

A teaching device capable of teaching not only movement work but also more detailed working content. The teaching device is provided with input section for inputting work information such as work of pinching workpieces which is carried out by a robot arm at a working position. When carrying out motion capture by moving jig (an object which mimics the robot arm) which is provided with marker section, a user manipulate input section at an appropriate timing to input the working content to be performed by the robot arm as work information, and thus it is possible to set fine working content of the robot arm in teaching device. Accordingly, teaching device is capable of linking positional information of jig and the like and work information generating control information for controlling the robot arm.