In one embodiment, a method includes receiving, from a first sensor on a robot, first sensor data indicative of an environment of the robot. The method also includes identifying, based on the first sensor data, an object of an object type in the environment of the robot, where the object type is associated with a classifier that takes sensor data from a predetermined pose relative to the object as input. The method further includes causing the robot to position a second sensor on the robot at the predetermined pose relative to the object. The method additionally includes receiving, from the second sensor, second sensor data indicative of the object while the second sensor is positioned at the predetermined pose relative to the object. The method further includes determining, by inputting the second sensor data into the classifier, a property of the object.

This invention provides a robot control device for controlling a robot configured to perform a predetermined operation, where the robot control device comprises an acquisition unit configured to acquire a plurality of images captured by a plurality of image capturing devices including a first image capturing device and a second image capturing device different from the first image capturing device; and a specification unit configured to use the plurality of captured images acquired by the acquisition unit as inputs to a neural network, and configured to specify a control instruction for the robot based on an output as a result from the neural network.

A method for operating a transport robot includes receiving image data representative of a group of objects. One or more target objects are identified in the group based on the received image data. Addressable vacuum regions are selected based on the identified one or more target objects. The transport robot is command to cause the selected addressable vacuum regions to hold and transport the identified one or more target objects. The transport robot includes a multi-gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum. A vision sensor device can capture the image data, which is representative of the target objects adjacent to or held by the multi-gripper assembly.

A robot control system includes: a selector configured to perform a selection of a task object from among a plurality of workpieces by using a first vision sensor; and an operation control section configured to control a robot to perform a task on the task object by using a tool. The selection and the task are executed simultaneously and in parallel, the selector transmits the information of the selected task object to the operation control section before the task, and the operation control section controls the robot based on the transmitted information of the task object.

A system and method for operating a transport robot to simultaneously grasp and transfer multiple objects is disclosed. The transport robot includes a multi-gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum. The robotic system receives image data representative of a group of objects. Individual target objects are identified in the group based on the received image data. Addressable vacuum regions are selected based on the identified target objects. The transport robot is command to cause the selected addressable vacuum regions to simultaneously grasp and transfer multiple target objects.

There is provided an information processing apparatus to estimate a position of a distal end of a movable unit with a reduced processing load, the information processing including a position computer that computes, on the basis of first positional information obtained from reading of a projected marker by a first visual sensor and second positional information including positional information obtained from reading of the marker by a second visual sensor that moves relative to the first visual sensor, a position of a movable unit in which the second visual sensor is disposed. This makes it possible to estimate the position of the distal end of the movable unit with a reduced processing load.

The present disclosure is a robot system including a robot that performs work on a workpiece; a controller that controls the robot; a first camera that captures an image of the workpiece while being moved relative to the workpiece by means of the operation of the robot; and a second camera that is capable of acquiring, in synchronization with image capturing by the first camera, an image that represents the relative positional relationship between the first camera and the workpiece. The controller includes a correcting unit that corrects, on the basis of the image acquired by the second camera, the image-capturing timing of the first camera so that an image is captured at a position at which the workpiece is appropriately captured in the field of view of the first camera.

A method for operating a transport robot includes receiving image data representative of a group of objects. One or more target objects are identified in the group based on the received image data. Addressable vacuum regions are selected based on the identified one or more target objects. The transport robot is command to cause the selected addressable vacuum regions to hold and transport the identified one or more target objects. The transport robot includes a multi-gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum. A vision sensor device can capture the image data, which is representative of the target objects adjacent to or held by the multi-gripper assembly.

In one embodiment, a method includes receiving, from a first sensor on a robot, first sensor data indicative of an environment of the robot. The method also includes identifying, based on the first sensor data, an object of an object type in the environment of the robot, where the object type is associated with a classifier that takes sensor data from a predetermined pose relative to the object as input. The method further includes causing the robot to position a second sensor on the robot at the predetermined pose relative to the object. The method additionally includes receiving, from the second sensor, second sensor data indicative of the object while the second sensor is positioned at the predetermined pose relative to the object. The method further includes determining, by inputting the second sensor data into the classifier, a property of the object.

A system and method for operating a transport robot to simultaneously grasp and transfer multiple objects is disclosed. The transport robot includes a multi-gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum. The robotic system receives image data representative of a group of objects. Individual target objects are identified in the group based on the received image data. Addressable vacuum regions are selected based on the identified target objects. The transport robot is command to cause the selected addressable vacuum regions to simultaneously grasp and transfer multiple target objects.