An object gripping system includes a position and orientation measurement unit configured to measure a position and an orientation of at least one target object based on an image obtained by capturing the at least one target object. A selection unit is further provided to select at least one holdable target object based on the position and orientation. A determination unit determines, as an object to be held, a holdable target object based on a priority set, when assembling the holdable target object to an assembly destination object, and a controlling unit controls a holding unit to hold the object to be held, which is determined by the determination unit.

A capacitive force sensor 101 of the present invention includes a plurality of cells each including a lower electrode 104, a movable member that includes an upper electrode 107 and has flexibility, and a support 105b arranged to movably support the movable member and to form a gap 106 between the upper and the lower electrodes. The plural cells are grouped into elements each including one or more of the cells, and the one or more cells in a same element are electrically connected to each other.

An example system includes a robotic device having a robotic manipulator and a support stand. The support stand may receive an object placed thereon in a given orientation and maintain the given orientation. The robotic manipulator may pick up an object in a first orientation with respect to the robotic manipulator and determine a target pose for the object. Based on the determined target pose, a control system may determine to reorient the object with respect to the robotic manipulator using the support stand. The robotic manipulator may place the object on the support stand in a particular orientation and pick up the object, disposed on the support stand in the particular orientation, in a second orientation with respect to the robotic manipulator. While the object is held in the second orientation with respect to the robotic manipulator, the robotic device may move the object to the target pose.

A manipulator system includes a manipulator unit to pick up one object from objects placed on a first place, a recognition unit to perform a first recognition process recognizing the one object to be picked up from the first place, and a second recognition process recognizing an orientation of the one object picked up from the first place, and a controller to control a first transfer operation, and a second transfer operation. When the first transfer operation is performed, the controller instructs the manipulator unit to pick up and move the one object recognized by the first recognition process to an outside of the first place. When the second transfer operation is performed, the controller instructs the manipulator unit to transfer the one object to a second place by setting the orientation of the one object with an orientation determined based on a recognition result of the second recognition process.

A pickup device for picking up a target object from a plurality of objects randomly piled up in a container, and for placing the target object in a predetermined posture to a target location is provided. The device includes an approximate position obtaining part for obtaining information on an approximate position of the target object, based on information on a height distribution of the objects in the container, which is obtained by a first visual sensor. The device also includes a placement operation controlling part for controlling a robot so as to bring the target object into a predetermined position and posture relative to the target location, based on information on a position and posture of the target object relative to a robot, which is obtained by a second visual sensor.

A capacitive force sensor 101 of the present invention includes a plurality of cells each including a lower electrode 104, a movable member that includes an upper electrode 107 and has flexibility, and a support 105b arranged to movably support the movable member and to form a gap 106 between the upper and the lower electrodes. The plural cells are grouped into elements each including one or more of the cells, and the one or more cells in a same element are electrically connected to each other.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for automatically generating object representations. One of the methods includes grasping, by a robot, an object at a first grasp point and generating a first partial object mesh based on one or more first sensor measurements of the object when held by the robot at the first grasp point. A second grasp point is identified for the object that is located in a region captured by the one or more first sensor measurements. A second partial object mesh is generated based on one or more second sensor measurements of the object when held by the robot at the second grasp point.

According to an embodiment, there is provided a handling system capable of handling a plurality of objects, the handling system including: a movable arm, a holder, a sensor, and a controller. The holder is attached to the movable arm and is capable of holding the object. The sensor is capable of detecting the object. The controller controls the movable arm and the holder. The controller determines whether or not to change an arrangement of the object before the object is held, on the basis of information acquired from the sensor. In a case where it is determined to change the arrangement of the object, the controller evaluates effectiveness of an arrangement change operation for each object, and decides on an arrangement change operation on the basis of an evaluation result.