A calibration device performs calibration based on detection results of an object from a sensor. The calibration device includes a determiner that determines, based on a size of a field of view of the sensor and a size of the object, a range in which a posture of a robotic arm with the object attached or with the sensor attached to detect the object is changed, an obtainer that repeatedly obtains a combination of information about the posture of the robotic arm and a detection result of the object from the sensor while the posture of the robotic arm is being changed within the range determined by the determiner to obtain a plurality of the combinations, and a calibrator that performs, based on the plurality of combinations obtained by the obtainer, calibration to determine correspondence between the postures of the robotic arm and the detection results of the object.

This method is for calibrating a coordinate system of an image capture device and a coordinate system of a robot arm in a robot system that includes a display device, the image capture device, and the robot arm to which one of the display device and the image capture device is fixed, the robot arm having a drive shaft. The method includes: acquiring first captured image data based on first image data; acquiring second captured image data based on second image data different from the first image data; and calibrating the coordinate system of the image capture device and the coordinate system of the robot arm, using the first captured image data and the second captured image data.

A method, system and computer program product are provided for aligning wire contacts with wire contact insertion holes of a connector to facilitate the automated insertion of the wire ends of a wire bundle assembly into the wire contact insertion holes of a connector. Methods may include: obtaining captured images from at least two image capture devices attached to an end-effector of a robot of a wire gripper of the end-effector; detecting, within at least one image from each of the at least two image capture devices, a wire contact; detecting, within at least one image from each of the at least two image capture devices, one or more insertion holes of the connector; identifying corrective movement for the robot end-effector that aligns a target hole of the one or more insertion holes of the connector with the wire connector; and causing the robot to move the end-effector according to the identified corrective movement.

An image processing apparatus that processes an image of a recognition target on a mounting surface captured by an image pickup apparatus, the image processing apparatus includes an extraction unit configured to extract an area from the image based on a first distance from the recognition target to the image pickup apparatus, a height of a designated recognition target, and a second distance from the image pickup apparatus to the mounting surface, and a recognition unit configured to perform recognition processing on the area.

A calibration system that calibrates robots installed in a process includes: a reference measuring element; a flange measuring element attached to a flange provided at an arm tip of each robot; a fixed measuring device configured to measure the flange measuring element of each robot and the reference measuring element; and a controller configured to control the robots, calculate a position and attitude relation between the flange measuring element of each robot and the reference measuring element based on a measured result measured by the fixed measuring device, and calculate an error between a design installation position and attitude of each robot and an actual installation position and attitude of the robot by using the measured position and attitude relation and position and attitude data of the flange measuring element in a robot coordinate system at the time when the robot has been measured by the fixed measuring device.

A robot system includes a robot, a vision sensor, a controller, and an input unit. The vision sensor configured to measure a feature point and obtain a measured coordinate value. The controller configured to control the robot. The input unit configured to receive an input from a user toward the controller. The controller obtains, via the input unit, setting information data on a determination point which is different from the feature point. The robot system uses a coordinate value of the determination point and the measured coordinate value, and determines whether the robot is taking a target position and orientation.

A supplementary metrology position determination system is provided for use with a robot. The robot includes a movable arm configuration and a motion control system configured to control an end tool position with a robot accuracy (i.e., based on sensors included in the robot). The supplementary system includes cameras and 2D scales, each of which is attached to the movable arm configuration (e.g., as attached on arm portions and/or rotary joints). The cameras are operated to acquire images for determining relative positions of the scales. The scales may be coupled to rotary joints (e.g., as may be utilized to determine rotary motion as well as any motion transverse to a rotary axis), and/or to arm portions (e.g., as may be utilized to determine any bending or twisting of the arm portions). Such information may be utilized to achieve higher accuracy (e.g., for measurement operations and/or control of the robot, etc.).

On the basis of a measured shape, which is a three-dimensional shape of a subject measured by means of a measuring unit using an image captured when an image capturing unit is disposed in a first position and a first attitude, a movement control unit determines a second position and a second attitude for capturing an image of the subject again, and sends an instruction to a movement mechanism. The three-dimensional shape is represented by means of height information from a reference surface. The movement control unit extracts, from the measured shape, a deficient region having deficient height information, and determines the second position and the second attitude on the basis of the height information around the deficient region of the measured shape. The position and attitude of the image capturing unit can be determined in such a way as to make it easy to eliminate the effects of shadows.

Embodiments of the present disclosure provide methods for managing a robot system. In the method, orientations for links in the robot system may be obtained when the links are arranged in at least one posture, here each of the orientations indicates a direction pointed by one of the links. At least one image of an object placed in the robot system may be obtained from a vision device equipped on one of the links. Based on the orientations and the at least one image, a first mapping may be determined between a vision coordinate system of the vision device and a link coordination system of the link. Further, embodiments of present disclosure provide apparatuses, systems, and computer readable media for managing a robot system. The vision device may be calibrated by the first mapping and may be used to manage operations of the robot system.

A robot system includes a robot, a robot work environment in which the robot works, and a robot controller including circuitry that stores position information indicating a position of each of measured robot postures in the robot work environment, obtains a measured position of each of the measured robot postures based on a detection result obtained by a sensor, and corrects a movement position of the robot based on the measured position.