A simulation device for simulating the operations of a robot that follows a workpiece when the workpiece is conveyed by a conveyer that conveys workpieces along an arc-shaped track. The simulation device includes a robot model arranging section that arranges a robot model in virtual space; a conveyer model arranging section that arranges a conveyer model in the virtual space, the conveyer model being capable of conveying a workpiece model along an arc-shaped virtual track; a workpiece model arranging section that arranges a workpiece model on the conveyer model in the virtual space; a detection device model arranging section that arranges a detection device model in the virtual space capable of detecting the workpiece model; an operation range setting section that sets a following operation range of the robot model in the virtual space; and a simulation execution section that executes simulations.

Provided is art capable of recognizing the states of a plurality of target objects arranged in a prescribed space region. This target object recognition device is provided with: a plurality of calculation processing units (21, 22) which each calculate the attitude state of a target object in a prescribed space region using a different technique; a state recognition unit (23) which recognizes the layout state of all of a plurality of target objects arranged in the space region; a method determination unit (24) which, in accordance with the result of the recognition by the state recognition unit (23), determines a method for using the results of the calculation performed by the calculation processing units (21, 22); and a target object recognition unit (25) which recognizes the attitude states of the target objects by means of the determined method for using the results of the calculation.

An information processing apparatus obtains a plurality of combinations of a position of a work target candidate and a transport machine optimum control parameter which is a control parameter of the transport machine that maximizes performance of the work on a work target when the work target candidate is set as the work target, based on a captured image obtained by capturing an area including a plurality of the work target candidates transported by the transport machine, determines the work target from among the work target candidates based on the combinations, controls the transport machine based on the transport machine optimum control parameter of the determined work target, generates a control plan of the robot based on a position of the determined work target and the transport machine optimum control parameter of the work target and controls the robot according to the generated control plan.

A method for operating a robotic system includes determining a discretized object model based on source sensor data; comparing the discretized object model to a packing plan or to master data; determining a discretized platform model based on destination sensor data; determining height measures based on the destination sensor data; comparing the discretized platform model and/or the height measures to an expected platform model and/or expected height measures; and determining one or more errors by (i) determining at least one source matching error by identifying one or more disparities between (a) the discretized object model and (b) the packing plan or the master data or (ii) determining at least one destination matching error by identifying one or more disparities between (a) the discretized platform model or the height measures and (b) the expected platform model or the expected height measures, respectively.

A system and method for automatically moving one or more parts between a bin at a source location and a destination using a robot is provided. The system includes a first vision system to identify a part within the bin and to determine the pick location and pick orientation of the part. A second vision system determines the location and orientation of a destination inside or outside of the bin, which may or may not be in a fixed location. A controller plans the best path for the robot to follow in moving the part between the pick location and the destination. An end effector is attached to the robot for picking the part from the bin, holding the part as the robot moves it, and placing the part at the destination. The system may also check the part for quality by one or both of the vision systems.

A system and method for motion planning is presented. The system is configured, when an object is or has been in a camera field of view of a camera, to receive first image information that is generated when the camera has a first camera pose. The system is further configured to determine, based on the first image information, a first estimate of the object structure, and to identify, based on the first estimate of the object structure or based on the first image information, an object corner. The system is further configured to cause an end effector apparatus to move the camera to a second camera pose, and to receive second image information for representing the object's structure. The system is configured to determine a second estimate of the object's structure based on the second image information, and to generate a motion plan based on at least the second estimate.

A system and method for motion planning is presented. The system is configured, when an object is or has been in a camera field of view of a camera, to receive first image information that is generated when the camera has a first camera pose. The system is further configured to determine, based on the first image information, a first estimate of the object structure, and to identify, based on the first estimate of the object structure or based on the first image information, an object corner. The system is further configured to cause an end effector apparatus to move the camera to a second camera pose, and to receive second image information for representing the object's structure. The system is configured to determine a second estimate of the object's structure based on the second image information, and to generate a motion plan based on at least the second estimate.

A method and computing system for performing object detection are presented. The computing system may be configured to: receive first image information that represents at least a first portion of an object structure of an object in a camera's field of view, wherein the first image information is associate with a first camera pose; generate or update, based on the first image information, sensed structure information representing the object structure; identify an object corner associated with the object structure; cause the robot arm to move the camera to a second camera pose in which the camera is pointed at the object corner; receive second image information associated with the second camera pose; update the sensed structure information based on the second image information; determine, based on the updated sensed structure information, an object type associated with the object; determine one or more robot interaction locations based on the object type.

Methods, apparatus, systems, and computer-readable media are provided for enabling users to approximately identify a space within an environment inhabited by a plurality of objects that user wishes for a robot to manipulate. In various implementations, an approximation of a space within an environment may be identified based on user input. The actual space within the environment may then be extrapolated based at least in part on the approximation and one or more attributes of the environment. A plurality of objects that are co-present within the space and that are to be manipulated by a robot may be identified. The robot may then be operated to manipulate the identified plurality of objects.

A trajectory information generating unit is included, the trajectory information generating unit generating trajectory information that defines a trajectory for which a picking hand picks one of one or more works stored in one supply container included in one or more supply containers and arranges the work in one arrangement container included in one or more arrangement containers. After performing a process of generating trajectory information representing a first work included in the one or more works and before a movement of the first work is completed, the trajectory information generating unit may generate trajectory information representing a second work included in the one or more work and different from the first work by using an operation result in the process of generating the trajectory information regarding the first work.