A system is disclosed for providing extrinsic calibration of a camera to a relative working environment of a programmable motion device that includes an end-effector. The system includes a fiducial located at or near the end-effector, at least one camera system for viewing the fiducial as the programmable motion device moves in at least three degrees of freedom, and for capturing a plurality of images containing the fiducial, and a calibration system for analyzing the plurality of images to determine a fiducial location with respect to the camera to permit calibration of the camera with the programmable motion device.

An object inspection device capable of sharing an image or an inspection parameter for surface inspection of an object to be inspected among a plurality of object inspection devices. The object inspection device includes a camera, a robot relatively positioning the object and the camera, an index, and a controller controlling the camera and the robot. The controller is configured to control the robot to position the index and the camera at any relative position, cause the camera to image the index to acquire imaged data of the index, hold the robot at a position where the index is disposed at an index reference point in the image coordinate system based on the imaged data and coordinate data of the index reference point, and adjust an inspection position using the position of the robot at this time.

A system and method for performing automatic camera calibration is provided. The system receives a calibration image, and determines a plurality of image coordinates for representing respective locations at which a plurality of pattern elements of a calibration pattern appear in a calibration image. The system determines, based on the plurality of image coordinates and defined pattern element coordinates, an estimate for a first lens distortion parameter of a set of lens distortion parameters, wherein the estimate for the first lens distortion parameter is determined while estimating a second lens distortion parameter of the set of lens distortion parameters to be zero, or is determined without estimating the second lens distortion parameter. The system determines, after the estimate of the first lens distortion parameter is determined, an estimate for the second lens distortion parameter based on the estimate for the first lens distortion parameter.

A calibration method, in a robot having a robot arm, of obtaining a position relationship between a first control point set for an end effector attached to a distal end of the robot arm and a second control point set on the distal end of the robot arm, includes a sixth step of calculating a second position relationship between a second reference position obtained from a position of the second control point in a third state and a position of the second control point in a fourth state and a first feature point in the fourth state, and a seventh step of calculating coordinates of the first feature point in a robot coordinate system based on a first position relationship and the second position relationship.

The disclosed system includes a robot configured to perform a task on a workpiece. A camera having a field of view is operably connected to the robot. A light system is configured to project structured light onto a region of interest having a smaller area within the field of view. A control system is operably coupled to the robot and the camera is configured to determine a depth of the workpiece relative to a position of the robot using the structured light projected onto the workpiece within the region of interest.

A robot control system and a method for camera calibration verification is presented. The robot control system is configured to perform a first camera calibration, and to control a robot arm to move a verification symbol to a reference location. The robot control system further receives, from a camera, a reference image of the verification symbol, and determines a reference image coordinate for the verification symbol. The robot control system further controls the robot arm to move the verification symbol to the reference location again during an idle period, receives an additional image of the verification symbol, and determines a verification image coordinate. The robot control system determines a deviation parameter value based the reference image coordinate and the verification image coordinate, and whether the deviation parameter value exceeds a defined threshold, and performs a second camera calibration if the threshold is exceeded.

A supplementary metrology position coordinates determination (SMPD) system is used with a robot. “Robot accuracy” (e.g., for controlling and sensing an end tool position of an end tool that is mounted proximate to a distal end of its movable arm configuration) is based on robot position sensors included in the robot. The SMPD system includes an imaging configuration and an XY scale and an alignment sensor for sensing alignment/misalignment therebetween, and an image triggering portion and processing portion. One of the XY scale or imaging configuration is coupled to the movable arm configuration and the other is coupled to a stationary element (e.g., a frame above the robot). The imaging configuration acquires an image of the XY scale with known alignment/misalignment, which is utilized to determine metrology position coordinates that are indicative of the end tool position, with an accuracy level that is better than the robot accuracy.

A method and system for determining poses for camera calibration is presented. The system determines a range of pattern orientations for performing the camera calibration, and determines a surface region on a surface of an imaginary sphere, which represents possible pattern orientations for the calibration pattern. The system determines a plurality of poses for the calibration pattern to adopt. The plurality of poses may be defined by respective combinations of a plurality of respective locations within the camera field of view and a plurality of respective sets of pose angle values. Each set of pose angle values of the plurality of respective sets may be based on a respective surface point selected from within the surface region on the surface of the imaginary sphere. The system outputs a plurality of robot movement commands based on the plurality of poses that are determined.

A robot including an arm, a tool attached to the arm, a measurement fixture to be attached to a tip portion of the tool detachably, and a controller that recognizes a reference coordinate system used to control the arm, and that controls the arm. The controller stores data indicating a positional relationship between a tip of the tool and the measurement fixture or data to be used to calculate the positional relationship, and the controller calculates positional coordinates of the tip of the tool in the reference coordinate system based on position data of the measurement fixture and the positional relationship, where the position data is detected by using acquired image data from a visual sensor whose position is associated with the reference coordinate system.

A computing system and a method for calibration verification is presented. The computing system is configured to perform a first calibration operation, and to control a robot arm to move a verification symbol to a reference location. The robot control system further receives, from a camera, a reference image of the verification symbol, and determines a reference image coordinate for the verification symbol. The robot control system further controls the robot arm to move the verification symbol to the reference location again during an idle period, receives an additional image of the verification symbol, and determines a verification image coordinate. The robot control system determines a deviation parameter value based the reference image coordinate and the verification image coordinate, and whether the deviation parameter value exceeds a defined threshold, and performs a second calibration operation if the threshold is exceeded.