Patent classifications
G05B2219/40584
HISTORY MANAGEMENT DEVICE AND PROGRAM
Provided is a history management device for managing history information pertaining to the results of execution of a prescribed process by an industrial machine, the history management device comprising a display unit and a history display control unit that controls the display of history information on the display unit. The history display control unit reads history information from both a first storage unit that stores history information and a second storage unit that stores history information and has a property differing from that of the first storage unit, and the history display control unit simultaneously displays the history information on the display unit.
Image-based guidance for robotic wire pickup
Systems and methods for automated wire pickup using image-based robot guidance. The machine vision-based system includes: a robot arm; a tool head coupled to the distal end of the robot arm and including a wire gripper motor; a wire gripper movably coupled to the tool head and operatively coupled to the wire gripper motor; a wire holder configured for clamping a wire; cameras mounted to the distal end of the robot arm and having first and second fields of view which intersect in a volume of space that includes the tip of the wire gripper and the wire holder; and a computer system configured to control operation of the robot arm motors and wire gripper motor. More specifically, the computer system is configured for visually estimating the position and orientation of a contact-equipped wire being held by the wire holder and then generating robot guidance to enable automated pickup of the end section of the wire by the wire gripper.
Method and computing system for performing motion planning based on image information generated by a camera
A system and method for motion planning is presented. The system is configured, when an object is or has been in a camera field of view of a camera, to receive first image information that is generated when the camera has a first camera pose. The system is further configured to determine, based on the first image information, a first estimate of the object structure, and to identify, based on the first estimate of the object structure or based on the first image information, an object corner. The system is further configured to cause an end effector apparatus to move the camera to a second camera pose, and to receive second image information for representing the object's structure. The system is configured to determine a second estimate of the object's structure based on the second image information, and to generate a motion plan based on at least the second estimate.
Robotic Wire Insertion Using Connector Segmentation
A method for inserting a wire. An image of a connector is generated using a camera system connected to an end effector. The end effector is at a connector pose facing the connector. A region in the image encompassing the connector is selected. An initial mask is created using the image and the region. The initial mask comprises a background region and a connector region. A segmentation mask is created using the initial mask and the image, wherein the segmentation mask includes edges for the connector. Thresholding is applied to the segmentation mask to recover pixels for the connector and generate a final mask. The final mask is used to insert the wire into the connector.
POSITION AND POSTURE MEASUREMENT SYSTEM
Provided is a system that is capable of accurately measuring the three-dimensional position and posture of an object under measurement with simple teaching and in a short measurement time. A position and posture measurement system according to the present invention is provided with: a vision sensor that has already been calibrated; a position and posture moving unit that is capable of moving the three-dimensional position and posture of an object under measurement or the vision sensor; a calibration-data storage unit; an image processing unit that processes a captured image of the object under measurement; a position and posture measurement unit that measures the three-dimensional position and posture of the object under measurement by using the result of the image processing; an image-capturing-position correction unit that executes correction processing at least once, the correction processing being processing in which the vision sensor or the object under measurement is moved by the position and posture moving unit by using the measured three-dimensional position and posture and in which the image processing and the measurement of the three-dimensional position and posture are then sequentially carried out; and an image-capturing-position correction termination unit that executes the correction processing again upon determining that the correction processing is not to be terminated, while adopting the three-dimensional position and posture calculated either the last or in the middle as a three-dimensional position and posture to be used for robot control upon determining that the correction processing is to be terminated.
METHOD FOR THE SAFE OPERATION OF A MACHINE
A method for the safe operation of a machine, which has a movable machine part comprising a hazardous section, comprises: the movable machine part moving according to a predefined sequence program; and an environment of the hazardous section being monitored, wherein, in the event of an engagement of an object into a defined protective volume, which is dependent on the current position of the hazardous section, within the monitored environment, a safety-related reaction is triggered that comprises the movement of the movable machine part being stopped if the engagement exceeds a defined engagement threshold of the protective volume. For a teaching-in of the protective volume, it is provided: that an initial protective volume is first predefined; that the machine is controlled so that the movable machine part moves according to the predefined sequence program while the environment of the hazardous section is monitored; that, if the movement of the movable machine part is stopped as a result of an object engaging into initial protective volume, a teach-in mode can be started by means of a first user input, in which teach-in mode the movement is continued and position data of objects in the environment of the hazardous section are acquired in so doing; that the teach-in mode can be terminated by means of a second user input; and that the protective volume is defined based on the acquired position data.
MACHINING SYSTEM AND REMOVAL SYSTEM HAVING MACHINING CHIP REMOVING FUNCTION
Disclosed is a machining system wherein provisions are made to be able to remove machining chips reliably without requiring human intervention. The machining system includes: an image processing unit which detects the position and amount of machining chips by comparing images captured of a workpiece and a machining tool before and after execution of a machining step; a condition judging unit which, based on the detected amount of machining chips, determines whether or not there is a need to execute a removal step; and a result judging unit which judges the result of the removal step by comparing the images captured of the workpiece W and the machining tool before and after the execution of the removal step.
Device and method for training a machine learning model to derive a movement vector for a robot from image data
A method for training a machine learning model to derive a movement vector for a robot from image data. The method includes acquiring images from a perspective of an end-effector of the robot, forming training image data elements from the acquired images, generating augmentations of the training image data elements, training an encoder network using contrastive loss and training a neural network to reduce a loss between movement vectors output by the neural network in response to embedding outputs provided by the encoder network and respective ground truth movement vectors.
CONTROL DEVICE AND CONTROL METHOD OF ROBOT, ROBOT SYSTEM, AND DEVICE AND METHOD OF GENERATING OPERATION PROGRAM OF ROBOT
A control device of a robot includes a robot control section configured to control the robot so as to sequentially position the robot at a plurality of target positions, which are set based on shape data representing a shape of a workpiece, and cause the robot to execute a work along a work target portion on the workpiece, and cause the robot to continue the work beyond a final target position of the plurality of target positions after the robot reaches the final target position, the final target position being set to correspond to an end of the work target portion in the shape data.
Robot control device
A robot control device includes: a reliability computing unit that is inputted with a feature quantity obtained from a sensor signal indicating a measurement result obtained by an external sensor installed in a main body of a robot or a surrounding environment of the robot, and computes a reliability for the sensor signal on the basis of a temporal change or a spatial change of the feature quantity; a correction command value computing unit that computes a trajectory correction amount for correcting a trajectory of the robot on the basis of the reliability and correction information calculated on the basis of the feature quantity; and a command value generation unit that generates a location command value for the robot on the basis of a predetermined target trajectory of the robot and the trajectory correction amount.