A system includes a first fixture to support one side of a part and a robot that has a second fixture to support an opposite side of the part with respect to the one side. One of the part sides has a target on a surface that indicates a location for the operation. The system has a sensor to measure the target in 3-dimensional space. A tool performs the operation at the location, and a controller moves the robot to pick up the part from the first fixture using the second fixture. The controller presents the target to the sensor for measuring the x,y,z coordinates and the yaw, pitch and roll of the target. The controller moves the second fixture with the part to the tool based upon the measurement.

A robotic system for operating a machine includes an arm, an actuator coupled to the arm and configured to indicate a change in an interactive medium of the machine when the actuator physically interfaces with the interactive medium, a visual source configured to provide an image of the machine in a field of view; and a processor coupled to the arm and the visual source. Images obtained from the field of view can be used to extract information about the machine and that information can be used to operate the arm to actuate the interactive medium of machine and perform the physical task using the machine.

A manipulator system configured to perform a work to a workpiece being moved by a moving device, includes a robotic arm, having one or more joints and to which a tool configured to perform the work to the workpiece is attached, an operating device configured to operate the robotic arm, a first imaging means configured to image the workpiece, while following the movement of the workpiece, a second imaging means fixedly provided in a work area to image a situation of the work to the workpiece, a displaying means configured to display an image imaged by the first imaging means and an image imaged by the second imaging means, and a control device configured to control the operation of the robotic arm based on an operating instruction of the operating device, while detecting a moving amount of the workpiece being moved by the moving device and carrying out a tracking control of the robotic arm according to the moving amount of the workpiece.

Grasping of an object, by an end effector of a robot, based on a final grasp pose, of the end effector, that is determined after the end effector has been traversed to a pre-grasp pose. An end effector vision component can be utilized to capture instance(s) of end effector vision data after the end effector has been traversed to the pre-grasp pose, and the final grasp pose can be determined based on the end effector vision data. For example, the final grasp pose can be determined based on selecting instance(s) of pre-stored visual features(s) that satisfy similarity condition(s) relative to current visual features of the instance(s) of end effector vision data, and determining the final grasp pose based on pre-stored grasp criteria stored in association with the selected instance(s) of pre-stored visual feature(s).

Techniques are disclosed for controlling robotic systems to perform assembly tasks. In some embodiments, a robot control application receives sensor data associated with one or more parts. The robot control application applies a grasp perception model to predict one or more grasp proposals indicating regions of the one or more parts that a robotic system can grasp. The robot control application causes the robotic system to grasp one of the parts based on a corresponding grasp proposal. If the pose of the grasped part needs to be changed in order to assemble the part with one or more other parts, the robot control application determines movements of the robotic system required to re-grasp the part in a different pose. In addition, the robot control application determines movements of the robot system for assembling the part with the one or more other parts based on results of a motion planning technique.

The present technology relates to an information processing device, an information processing method, a program, and a robot capable of estimate a value outside a detection range of a sensor. A control device of a first aspect of the present technology is a device that acquires detection results of a sensor unit composed of a plurality of sensors including a first sensor having a predetermined detection range, and a second sensor having a range in a detection range thereof in which detection by the first sensor is not possible and estimates a detected value of the first sensor outside the predetermined detection range on the basis of detection results of the second sensor. The present technology can be applied to a device that controls a robot having a hand part capable of gripping an object.

Systems and methods for determining a pose of an object held by a flexible end effector of a robot are disclosed. A method of determining a pose of the object includes receiving tactile data from tactile sensors, receiving curvature data from curvature sensors, determining a plurality of segments of the flexible end effector from the curvature data, assigning a frame to each segment, determining a location of each point of contact between the object and the flexible end effector from the tactile data, calculating a set of relative transformations and determining a location of each point relative to one of the frames, generating continuous data from the determined location of each point, and providing the continuous data to a pose determination algorithm that uses the continuous data to determine the pose of the object.

According to one embodiment, a handling system includes a movable arm, a holding unit, a sensor, and a controller. The holding unit is attached to the movable arm and capable of holding an object by selecting one or more of a plurality of holding methods. The sensor is capable of detecting a plurality of the objects. The controller controls the movable arm and the holding unit. The controller calculates a score based on a selected holding method for each object and each holding method on the basis of information acquired from the sensor. The controller selects a next object to be held and a holding method on the basis of the score. The controller calculates a position at which the selected object is held and a posture of the movable arm.

A multimodal sensing architecture utilizes an array of single sensor or multi-sensor groups (superpixels) to facilitate advanced object-manipulation and recognition tasks performed by mechanical end effectors in robotic systems. The single-sensors/superpixels are spatially arrayed over contact surfaces of the end effector fingers and include, e.g., pressure sensors and vibration sensors that facilitate the simultaneous detection of both static and dynamic events occurring on the end effector, and optionally include proximity sensors and/or temperature sensors. A readout circuit receives the sensor data from the superpixels and transmits the sensor data onto a shared sensor data bus. An optional multimodal control generator receives and processes the sensor data and generates multimodal control signals that cause the robot system's control circuit to adjust control operations performed by the end effector or other portions of the robot mechanism and when the sensor data indicates non-standard operating conditions.

A robot system including a master device configured to receive a manipulating instruction from an operator and transmit the received manipulating instruction as a manipulating input signal, a plurality of slave robots configured to operate according to the manipulating input signal transmitted from the master device, a management control device configured to manage operations of the plurality of slave robots, respectively, and an output device configured to output information transmitted from the management control device. The management control device determines a priority of transmitting the manipulating input signal from the master device to the slave robot among the plurality of slave robots that are in a standby state of the manipulating input signal, and transmits information related to the determined priority to the output device. Thus, the operator is able to efficiently transmit the manipulating input signal to the plurality of slave robots through the master device.