A method is provided that includes controlling a robotic gripping device to cause a plurality of digits of the robotic gripping device to move towards each other in an attempt to grasp an object. The method also includes receiving, from at least one non-contact sensor on the robotic gripping device, first sensor data indicative of a region between the plurality of digits of the robotic gripping device. The method further includes receiving, from the at least one non-contact sensor on the robotic gripping device, second sensor data indicative of the region between the plurality of digits of the robotic gripping device, where the second sensor data is based on a different sensing modality than the first sensor data. The method additionally includes determining, using an object-in-hand classifier that takes as input the first sensor data and the second sensor data, a result of the attempt to grasp the object.

A robotic gripping device is provided. The robotic gripping device includes a palm and a plurality of digits coupled to the palm. The robotic gripping device also includes a time-of-flight sensor arranged on the palm such that the time-of-flight sensor is configured to generate time-of-flight distance data in a direction between the plurality of digits. The robotic gripping device additionally includes an infrared camera, including an infrared illumination source, where the infrared camera is arranged on the palm such that the infrared camera is configured to generate grayscale image data in the direction between the plurality of digits.

A robot system which includes a manipulator, slave arm, an output device, a storage device and a control device. Control device is configured, after a given first process, to output to the output device an inquiry of asking which operating mode among three operating modes of an automatic operation mode, manual operation mode, and hybrid operation mode the slave arm is to be operated in a second process, and execute first operation processing in which, when selected information for instructing the operating mode selected from the three operating modes is inputted, the selected information is stored in the storage device, and second operation processing in which, when the number of times that first selected information is stored in the storage device becomes equal to or more than a first threshold number of times, the selected operating mode is outputted to the output device after the first process is ended.

Robot system includes robot main body including robot arm, end effector attached to robot arm, and force sensing device detecting force applied to end effector's tip end, actual reaction-force information generator generating force-sensing information according to force detected by force sensing device, and output force-sensing information as actual reaction-force information, virtual reaction-force information generator outputting force component detected by force sensing device, that has a magnitude proportional to time differentiation value, as virtual reaction-force information, adder configured to output information obtained by adding actual reaction-force information outputted from actual reaction-force information generator to virtual reaction-force information outputted from virtual reaction-force information generator, as synthetic reaction-force information, operating device outputting, when operator is made to sense a force according to synthetic reaction-force information outputted from adder and operator operates, operating information according to operation, and motion controller controlling robot main body's operation according to operating information outputted from operating device.

A robot system includes a robot main body, memory part configured to store information for causing robot main body to perform given operation, as saved operational information, motion controller configured to control operation of robot main body by using saved operational information as automatic operational information for causing robot main body to operate, and an operation correcting device configured to generate, by being operated, manipulating information for correcting operation of robot main body during operation. Motion controller controls robot main body to perform an operation corrected from operation related to automatic operational information in response to a reception of the manipulating information while robot main body is operating by using automatic operational information. Memory part is configured to be storable of corrected operational information for causing robot main body to perform corrected operation as saved operational information, when robot main body performs corrected operation.

A robot system is provided, which includes a robot body including, robot arm and an end effector attached to robot arm, and operating device, having operating part and configured to output, when operating part is operated, operational information according to operation, a motion controller configured to control operation of robot body according to the operational information outputted from the operating device, a velocity detector configured to detect a velocity at a tip end of the end effector, a virtual reaction-force information generating module configured to output force information containing a first force component having a positive correlation to the velocity at the tip end of the end effector, as virtual reaction-force information, and a force applying device configured to give a force to the operating part in order to make an operator perceive a force according to the virtual reaction-force information outputted from the virtual reaction-force information generating module.

Embodiments are generally directed to generating a training dataset of labelled examples of sensor images and grasp configurations using a set of three-dimensional (3D) models of objects, one or more analytic mechanical representations of either or both of grasp forces and grasp torques, and statistical sampling to model uncertainty in either or both sensing and control. Embodiments can also include using the training dataset to train a function approximator that takes as input a sensor image and returns data that is used to select grasp configurations for a robot grasping or targeting mechanism.

A robotic gripping device is provided. The robotic gripping device includes a palm and a plurality of digits coupled to the palm. The robotic gripping device also includes a time-of-flight sensor arranged on the palm such that the time-of-flight sensor is configured to generate time-of-flight distance data in a direction between the plurality of digits. The robotic gripping device additionally includes an infrared camera, including an infrared illumination source, where the infrared camera is arranged on the palm such that the infrared camera is configured to generate grayscale image data in the direction between the plurality of digits.

An articulated arm system is disclosed that includes an articulated arm including an end effector, and a robotic arm control systems including at least one sensor for sensing at least one of the position, movement or acceleration of the articulated arm, and a main controller for providing computational control of the articulated arm, and an on-board controller for providing, responsive to the at least one sensor, a motion signal that directly controls at least a portion of the articulated arm.

Robot system which includes a master device configured to receive an operating instruction from an operator, slave arm, storage device configured to store operating sequence information that defines processing carried out by slave arm, and control device configured to control operation of slave arm. Control device includes a receiver configured to receive an input signal, motion controller configured to determine whether operating mode of slave arm is to be automatic, manual or correctable automatic mode and control operation of slave arm in determined operating mode, and continuation determinator configured to determine whether continuation of automatic mode is permitted. In a process at which slave arm is scheduled to operate in automatic mode, after motion controller suspends operation of slave arm in automatic mode at a given step of process, continuation determinator determines whether continuation of automatic mode is permitted based on input signal received by receiver when operation is suspended.