Training and/or use of a machine learning model for placement of an object secured by an end effector of a robot. A trained machine learning model can be used to process: (1) a current image, captured by a vision component of a robot, that captures an end effector securing an object; (2) a candidate end effector action that defines a candidate motion of the end effector; and (3) a target placement input that indicates a target placement location for the object. Based on the processing, a prediction can be generated that indicates likelihood of successful placement of the object in the target placement location with application of the motion defined by the candidate end effector action. At many iterations, the candidate end effector action with the highest probability is selected and control commands provided to cause the end effector to move in conformance with the corresponding end effector action. When at least one release criteria is satisfied, control commands can be provided to cause the end effector to release the object, thereby leading to the object being placed in the target placement location.

A control device sets a relative relation amount between a plurality of target objects that are to be final objectives, repeatedly acquires observation data from a sensor and calculates the relative relation amount between the plurality of target objects existing in the environment from the acquired observation data. Further, the control device determines a series of the relative relation amounts in a state that is to be an objective from the relative relation amount at a time point at which control of the behavior starts until the relative relation amount as the final objectives is realized, and repeatedly determines control instructions so as to change the relative relation amount in a present state calculated from the latest observation data into the relative relation amount in a state of an objective to be transitioned to next. Then, the control device outputs the determined control instruction to a robot device.

A method is disclosed for estimating a trajectory of an object on a map given a sequence of traces for the moving object. Each trace of the object including information defining a position measured at a given time for the object, as well as information as to an area of accuracy around the measured position. The method processes pairs of successive traces, corresponding to two positions successive in time in the sequence of measured positions for the moving object. For each trace of a pair of successive traces, the method defines road segments on the map within the area of accuracy of the trace. For each road segment within the area of accuracy of a first trace of a pair of traces and each road segment within the area of accuracy of the second trace of the pair, the method determines at least one candidate path between the two road segments. A neural network and a neural graph model are used to compute the most probable sequence of candidate paths to estimate the trajectory of the object on the map.

A method, system and non-transitory instructions for control input, comprising, taking an integral of an output value from a Motion Decision Neural Network for a movable joint to generate an integrated output value. Generating a subsequent output value using a machine learning algorithm that includes a sensor value and the integrated output value as inputs to the Motion Decision Neural Network and imparting movement with the moveable joint according to an integral of the subsequent output value.

A robot control device includes at least one memory, and at least one processor, wherein the at least one processor is configured to obtain environmental information in a real environment, obtain information related to an action to be performed by a robot in the real environment based on the environmental information and a first policy, obtain information related to a control value that causes the robot to perform the action based on the information related to the action and a second policy, and control the robot based on the information related to the control value. The first policy is learned by using a virtual robot in a simulation environment.

Training and/or use of a machine learning model for placement of an object secured by an end effector of a robot. A trained machine learning model can be used to process: (1) a current image, captured by a vision component of a robot, that captures an end effector securing an object; (2) a candidate end effector action that defines a candidate motion of the end effector; and (3) a target placement input that indicates a target placement location for the object. Based on the processing, a prediction can be generated that indicates likelihood of successful placement of the object in the target placement location with application of the motion defined by the candidate end effector action. At many iterations, the candidate end effector action with the highest probability is selected and control commands provided to cause the end effector to move in conformance with the corresponding end effector action. When at least one release criteria is satisfied, control commands can be provided to cause the end effector to release the object, thereby leading to the object being placed in the target placement location.

A teaching device for a laser machining system which performs laser machining on a workpiece while moving an irradiation position of laser light using a robot includes a graphical user interface processing unit which displays machining periods, in each of which machining is performed by irradiating a corresponding one of a plurality of machining points set for the workpiece with the laser light while the robot moves along a machining path, and non-machining intervals between the machining periods of the machining points arranged in time series in a band-like region in a distinguishable manner.

A human pilot controls a robotic arm and gripper by simulating a set of desired motions with the human hand. In at least one embodiment, one or more images of the pilot's hand are captured and analyzed to determine a set of hand poses. In at least one embodiment, the set of hand poses is translated to a corresponding set of robotic-gripper poses. In at least one embodiment, a set of motions is determined that perform the set of robotic-gripper poses, and the robot is directed to perform the set of motions.

Deep machine learning methods and apparatus related to semantic robotic grasping are provided. Some implementations relate to training a training a grasp neural network, a semantic neural network, and a joint neural network of a semantic grasping model. In some of those implementations, the joint network is a deep neural network and can be trained based on both: grasp losses generated based on grasp predictions generated over a grasp neural network, and semantic losses generated based on semantic predictions generated over the semantic neural network. Some implementations are directed to utilization of the trained semantic grasping model to servo, or control, a grasping end effector of a robot to achieve a successful grasp of an object having desired semantic feature(s).

A vibration display device including a vibration acquisition unit that acquires a vibration state of a distal end section of a robot that is a robot in a simulation or in a real world, the distal end section being moved based on an operation program, and a vibration trajectory drawing unit that draws, on a display device, the vibration state along a trajectory of the distal end section of the robot or that draws, on the display device, the vibration state as the trajectory.