A computer-implemented method executed by data processing hardware of a robot causes the data processing hardware to perform operations. The operations include receiving a sensor pointing command that commands the robot to use a sensor to capture sensor data of a location in an environment of the robot. The sensor is disposed on the robot. The operations include determining, based on an orientation of the sensor relative to the location, a direction for pointing the sensor toward the location, and an alignment pose of the robot to cause the sensor to point in the direction toward the location. The operations include commanding the robot to move from a current pose to the alignment pose. After the robot moves to the alignment pose and the sensor is pointing in the direction toward the location, the operations include commanding the sensor to capture the sensor data of the location in the environment.

A method includes receiving, by a control system of a robotic device, data about an object in an environment from a remote computing device, where the data comprises at least location data and identifier data. The method further includes, based on the location data, causing at least one appendage of the robotic device to move through a predetermined learning motion path. The method additionally includes, while the at least one appendage moves through the predetermined learning motion path, causing one or more visual sensors to capture a plurality of images for potential association with the identifier data. The method further includes sending, to the remote computing device, the plurality of captured images to be displayed on a display interface of the remote computing device.

A method includes receiving, by a control system of a robotic device, data about an object in an environment from a remote computing device, where the data comprises at least location data and identifier data. The method further includes, based on the location data, causing at least one appendage of the robotic device to move through a predetermined learning motion path. The method additionally includes, while the at least one appendage moves through the predetermined learning motion path, causing one or more visual sensors to capture a plurality of images for potential association with the identifier data. The method further includes sending, to the remote computing device, the plurality of captured images to be displayed on a display interface of the remote computing device.

A robot operating device includes a camera that is attached to a distal end of a robot arm or a position adjacent to the distal end and that acquires an image; a display which displays the image acquired by the camera; an operation-accepting unit which accepts an operation that is performed by an operator on the image displayed on the display unit; and a controller which moves the robot arm based on the operation accepted by the operation-accepting unit.

A mounting device includes a control device. The control device images an imaging range which includes an illuminant of a light emitting component and acquires a light emitting component image when mounting the light emitting component which includes the illuminant onto a board. Next, the control device detects coordinates (illuminant detected center coordinates) of a center of the illuminant based on the light emitting component image. The control device performs the mounting of the light emitting component such that the light emitting component is held, the light emitting component moves over the board, and a center of the illuminant is positioned at predetermined coordinates on the board based on the illuminant detected center coordinates, without using information relating to an outer shape of the light emitting component which is based on the light emitting component image.

A mounting device includes a control device. The control device images an imaging range which includes an illuminant of a light emitting component and acquires a light emitting component image when mounting the light emitting component which includes the illuminant onto a board. Next, the control device detects coordinates (illuminant detected center coordinates) of a center of the illuminant based on the light emitting component image. The control device performs the mounting of the light emitting component such that the light emitting component is held, the light emitting component moves over the board, and a center of the illuminant is positioned at predetermined coordinates on the board based on the illuminant detected center coordinates, without using information relating to an outer shape of the light emitting component which is based on the light emitting component image.

The present teachings provide a method of controlling a remote vehicle having an end effector and an image sensing device. The method includes obtaining an image of an object with the image sensing device, determining a ray from a focal point of the image to the object based on the obtained image, positioning the end effector of the remote vehicle to align with the determined ray, and moving the end effector along the determined ray to approach the object.

The present disclosure relates to a method and apparatus for estimating a systematic error of a commissioning tool of an industrial robot, the industrial robot including an operational tool and an application camera, the commissioning tool including a touchscreen and a stylus, the method including: a driving step of driving the operational tool to rotate around a preset rotation axis; a first image obtaining step of obtaining a plurality of first images of the operational tool during rotation; and a first offset calculating step of calculating a first offset of the stylus relative to the operational tool according to the plurality of first images, so as to obtain the systematic error.

A mounting device includes a control device. The control device images an imaging range which includes an illuminant of a light emitting component and acquires a light emitting component image when mounting the light emitting component which includes the illuminant onto a board. Next, the control device detects coordinates (illuminant detected center coordinates) of a center of the illuminant based on the light emitting component image. The control device performs the mounting of the light emitting component such that the light emitting component is held, the light emitting component moves over the board, and a center of the illuminant is positioned at predetermined coordinates on the board based on the illuminant detected center coordinates, without using information relating to an outer shape of the light emitting component which is based on the light emitting component image.

A mounting device includes a control device. The control device images an imaging range which includes an illuminant of a light emitting component and acquires a light emitting component image when mounting the light emitting component which includes the illuminant onto a board. Next, the control device detects coordinates (illuminant detected center coordinates) of a center of the illuminant based on the light emitting component image. The control device performs the mounting of the light emitting component such that the light emitting component is held, the light emitting component moves over the board, and a center of the illuminant is positioned at predetermined coordinates on the board based on the illuminant detected center coordinates, without using information relating to an outer shape of the light emitting component which is based on the light emitting component image.