A method for controlling a robot to insert an object into an insertion. The method includes controlling the robot to hold the object, generating an estimate of a target position to insert the object into the insertion, controlling the robot to move to the estimated target position, taking a camera image using a camera mounted on the robot after having controlled the robot to move to the estimated target position, feeding the camera image into a neural network which is trained to derive, from camera images, movement vectors which specify movements from the positions at which the camera images are taken to insert objects into insertions and controlling the robot to move according to the movement vector derived by the neural network from the camera image.

A method for training a neural network to derive, from an image of a camera mounted on a robot, a movement vector for the robot to insert an object into an insertion. The method includes controlling the robot to hold the object, bringing the robot into a target position in which the object is inserted in the insertion, for a plurality of positions different from the target position controlling the robot to move away from the target position to the position, taking a camera image by the camera and labelling the camera image by a movement vector to move back from the position to the target position and training the neural network using the labelled camera images.

A method for training a neural network to derive, from an image of a camera mounted on a robot, a movement vector to insert an object into an insertion. The method includes, for a plurality of positions in which the object held by the robot touches a plane in which the insertion is located controlling the robot to move to the position, taking a camera image by the camera and labelling the camera image with a movement vector between the position and the insertion in the plane and training the neural network using the labelled camera images.

Embodiments of the disclosure provide a box retrieval method and apparatus, a system, a robot, and a storage medium. The method is applied to a warehouse robot, and includes: acquiring a detection image, where the detection image includes an image of a target box and neighboring objects; determining a box spacing between the target box and each neighboring object according to the detection image; and if the box spacing satisfies retrieval conditions for a warehouse robot, retrieving the target box. Automatic detection of the box spacing is achieved with low detection cost and high detection accuracy, and goods is retrieved only when the spacing satisfies conditions, such that goods retrieval safety is increased, and the probability of goods damage and falling down of shelves during a retrieval process is greatly lowered.

A prewashing system includes a dish recognizing unit that recognizes a dish that is an object of prewashing executed prior to main washing, a first prewashing unit that performs prewashing of the dish that is the object of prewashing by a flow of water, a second prewashing unit that performs prewashing of the dish that is the object of prewashing by a washing tool, a prewashing method deciding unit that decides a prewashing method using at least one of the first prewashing unit and the second prewashing unit, on the basis of a form of the dish that is the object of prewashing, which is recognized by the dish recognizing unit, and a prewashing executing unit that executes prewashing of the dish that is the object of prewashing, by the prewashing method decided by the prewashing method deciding unit.

The invention relates to a method for gripping an object by a handling system, including a robot with at least one robot arm, a gripping device which is connected to the robot arm and has a pneumatically operated suction gripper having an elastically deformable contact portion for contact with an outer surface of the object to be gripped, an identifier for identifying the outer surface of the object to be gripped and a controller which interacts with the identifier and is designed to control the robot.

A control device of a robot includes a robot control section configured to control the robot so as to sequentially position the robot at a plurality of target positions, which are set based on shape data representing a shape of a workpiece, and cause the robot to execute a work along a work target portion on the workpiece, and cause the robot to continue the work beyond a final target position of the plurality of target positions after the robot reaches the final target position, the final target position being set to correspond to an end of the work target portion in the shape data.

Systems and methods for automated wire pickup using image-based robot guidance. The machine vision-based system includes: a robot arm; a tool head coupled to the distal end of the robot arm and including a wire gripper motor; a wire gripper movably coupled to the tool head and operatively coupled to the wire gripper motor; a wire holder configured for clamping a wire; camera means mounted to the distal end of the robot arm and having first and second fields of view which intersect in a volume of space that includes the tip of the wire gripper and the wire holder; and a computer system configured to control operation of the robot arm motors and wire gripper motor. More specifically, the computer system is configured for visually estimating the position and orientation of a contact-equipped wire being held by the wire holder and then generating robot guidance to enable automated pickup of the end section of the wire by the wire gripper.

The present disclosure is a robot system including a robot that performs work on a workpiece; a controller that controls the robot; a first camera that captures an image of the workpiece while being moved relative to the workpiece by means of the operation of the robot; and a second camera that is capable of acquiring, in synchronization with image capturing by the first camera, an image that represents the relative positional relationship between the first camera and the workpiece. The controller includes a correcting unit that corrects, on the basis of the image acquired by the second camera, the image-capturing timing of the first camera so that an image is captured at a position at which the workpiece is appropriately captured in the field of view of the first camera.

A control apparatus, comprising: an image obtaining unit configured to obtain an image in which a control target that a robot controls and a target position to which the control target is to be moved are imaged by an imaging apparatus that is attached to the robot; an axial direction obtainment unit configured to obtain an axial direction of a rotational axis of the control target; a target position detection unit configured to detect the target position in the image; an operation generation unit configured to generate an operation for the control target so that the target position is present in the axial direction and to further generate an operation by which the control target becomes closer to the target position in the axial direction; and a control unit configured to control the control target in accordance with the operation.