A robotic control system directs a robot to take an object from a human grasp by obtaining an image of a human hand holding an object, estimating the pose of the human hand and the object, and determining a grasp pose for the robot that will not interfere with the human hand. In at least one example, a depth camera is used to obtain a point cloud of the human hand holding the object. The point cloud is provided to a deep network that is trained to generate a grasp pose for a robotic gripper that can take the object from the human's hand without pinching or touching the human's fingers.

A process, system and device for monitoring a ground engaging tool secured to earth working equipment that includes capturing an image of the ground engaging tool secured to the earth working equipment and subjected to wearing with a mobile device, determining a dimension of the ground engaging tool subject to wear, operating at least one processor and memory storing computer-executable instructions to calculate at least one result including the extent of wear experienced by the ground engaging tool and/or an estimate of when the ground engaging tool will reach a fully worn condition, and/or schedule when to replace the ground engaging tool.

A robot system is provided that includes a base, an articulable arm, a visual acquisition unit, and at least one processor. The articulable arm extends from the base and is configured to be moved toward a target. The visual acquisition unit is mounted to the arm or the base, and acquires environmental information. The at least one processor is operably coupled to the arm and the visual acquisition unit, the at least one processor configured to: generate an environmental model using the environmental information; select, from a plurality of planning schemes, using the environmental model, at least one planning scheme to translate the arm toward the target; plan movement of the arm toward the target using the selected at least one planning scheme; and control movement of the arm toward the target using the at least one selected planning scheme.

A robot control apparatus for controlling a robot manipulating a target object includes a measurement unit configured to measure a change of a gripping unit configured to grip the target object when the gripping unit contacts the target object, a first acquisition unit configured to acquire the change of the gripping unit measured by the measurement unit, a second acquisition unit configured to acquire a gripping state, which is a state of gripping of the target object by the gripping unit, based on the change of the gripping unit acquired by the first acquisition unit, and a control unit configured to control an action of the robot based on the gripping state acquired by the second acquisition unit.

A robotic control system directs a robot to take an object from a human grasp by obtaining an image of a human hand holding an object, estimating the pose of the human hand and the object, and determining a grasp pose for the robot that will not interfere with the human hand. In at least one example, a depth camera is used to obtain a point cloud of the human hand holding the object. The point cloud is provided to a deep network that is trained to generate a grasp pose for a robotic gripper that can take the object from the human's hand without pinching or touching the human's fingers.

A learning method is performed by a computers The method includes: receiving a first image that includes an object; generating a first rectangle in the first image, the first rectangle including therein a figure, that is set in advance to have a first inclination and that represents a gripping position of an object, and having a side parallel to a first direction; inputting the first image to a model, which outputs, from the input image, a rectangle parallel to the first direction and an inclination, to cause the model to output a second rectangle and a second inclination; and updating the model such that errors of the second rectangle and the second inclination with respect to the first rectangle and the first inclination respectively decrease.

A method for designing block layouts for use in block placement during construction, the method including, in one or more electronic processing devices, acquiring plan data indicative of a construction plan, identifying walls and intersections within the construction plan, identifying a number of possible intersection layouts for each intersection, generating different block layouts, each block layout including a combination of intersection layouts, the combination including one of the number of possible intersection layouts for each intersection and at least one wall layout for each wall, the wall layouts being generated based on the combination of intersection layouts and selecting one of the different block layouts.

A control apparatus, comprising: an image obtaining unit configured to obtain an image in which a control target that a robot controls and a target position to which the control target is to be moved are imaged by an imaging apparatus that is attached to the robot; an axial direction obtainment unit configured to obtain an axial direction of a rotational axis of the control target; a target position detection unit configured to detect the target position in the image; an operation generation unit configured to generate an operation for the control target so that the target position is present in the axial direction and to further generate an operation by which the control target becomes closer to the target position in the axial direction; and a control unit configured to control the control target in accordance with the operation.

A robotic system includes a manipulator assembly and a processing system. The manipulator assembly includes a first manipulator, a second manipulator, and a drivable structure. The first manipulator and the second manipulator are mechanically coupled to the drivable structure. The processing system is configured to determine a drivable structure motion for effecting a commanded motion for a first end effector of a first tool mechanically coupled to the first manipulator. Performing only the drivable structure motion would cause motion of the first end effector simultaneously with motion of a second end effector, the second end effector being of a second tool mechanically coupled to the second manipulator. The processing system is further configured to determine a movement of the second manipulator and the second tool that, when performed simultaneously with the drivable structure motion, would compensate for the motion of the second end effector.

A robot system is provided, comprising: a robot including a first sensor configured to measure a displacement quantity of a coordinate position between a work point and a target point defined for each of a plurality of objects with different shapes or a physical quantity that changes due to the displacement quantity at a first operation frequency; and a control apparatus for controlling the robot, including a coarse operation management unit configured to move the target point to the vicinity of the object at a second operation frequency, a calculation control unit configured to generate a control signal to correct the displacement quantity at a third operation frequency in such a manner that the target point approaches the work point, and a correction drive unit configured to execute a correction operation to align the target point with the work point based on the control signal; wherein the second operation frequency is a frequency less than or equal to ½ of the first and third operation frequencies.