Grasping of an object, by an end effector of a robot, based on a grasp strategy that is selected using one or more machine learning models. The grasp strategy utilized for a given grasp is one of a plurality of candidate grasp strategies. Each candidate grasp strategy defines a different group of one or more values that influence performance of a grasp attempt in a manner that is unique relative to the other grasp strategies. For example, value(s) of a grasp strategy can define a grasp direction for grasping the object (e.g., “top”, “side”), a grasp type for grasping the object (e.g., “pinch”, “power”), grasp force applied in grasping the object, pre-grasp manipulations to be performed on the object, and/or post-grasp manipulations to be performed on the object.

A software compensated robotic system makes use of recurrent neural networks and image processing to control operation and/or movement of an end effector. Images are used to compensate for variations in the response of the robotic system to command signals. This compensation allows for the use of components having lower reproducibility, precision and/or accuracy that would otherwise be practical.

A handling device according to an embodiment includes a manipulator, a normal grid generation unit, a hand kernel generation unit, a calculation unit, and a control unit. The normal grid generation unit converts a depth image into a point cloud, generates spatial data including an object to be grasped that is divided into a plurality of grids from the point cloud, and calculates a normal vector of the point cloud included in the grid using spherical coordinates. The hand kernel generation unit generates a hand kernel of each suction pad. The calculation unit calculates ease of grasping the object to be grasped by a plurality of suction pads based on a 3D convolution calculation using a grid including the spatial data and the hand kernel. The control unit controls a grasping operation of the manipulator based on the ease of grasping the object to be grasped by the plurality of suction pads.

An adaptive manipulation apparatus and method are provided. The adaptive manipulation method includes steps of providing a mobile manipulation apparatus comprising a manipulator, a sensor and a processor for a manipulation of an object placed on a carrier having a plurality of markers spaced apart from each other, the sensor detecting the plurality of markers to obtain a run time marker information, the processor, according to the base-case motion plan, generating a run time motion plan, wherein the run time motion plan comprises a plurality of second pose-aware actions, and the plurality of second pose-aware actions are modified from the plurality of first pose-aware actions according to the run time marker information, and the processor further executing the run time motion plan for controlling the manipulator to manipulate the object.

An object of the present invention is to provide a technique for a gripping system having an arm mechanism and a hand mechanism attached to the arm mechanism, by which an operation of the arm mechanism can be stopped as soon as the hand mechanism contacts an object. In the gripping system according to the present invention, the hand mechanism is provided with a contact detection unit for detecting that a predetermined site of the hand mechanism has come into contact with the object. The hand mechanism is also provided with a signal transmission unit that is electrically connected to an arm control device. The signal transmission unit transmits a command signal to stop the operation of the arm mechanism directly to the arm control device at the point where the contact detection unit detects that the predetermined site of the hand mechanism has come into contact with the object.

According to an embodiment, an article posture changing device includes: a first end effector configured to grasp a projected tag of an article by adsorption; an arm unit configured to support the first end effector and move the first end effector along at least a vertical direction; and a controller configured to control the arm unit and the first end effector to grasp the tag, lift the article upward, separate the article from a placement surface, change an angle of the article by weight thereof, move the article downward, place the article on the placement surface, and release the grasp of the tag.

A method for automatically transferring spouted pouches provides a simple, efficient approach for automatically loading spouted pouches from a container to a belt conveyor. And, an automatic pouch transferring assembly is also provided.

In current applications of autonomous machines in industrial settings, the environment, in particular the devices and systems with which the machine interacts, is known such that the autonomous machine can operate in the particular environment successfully. Thus, current approaches to automating tasks within varying environments, for instance complex environments having uncertainties, lack capabilities and efficiencies. In an example aspect, a method for operating an autonomous machine within a physical environment includes detecting an object within the physical environment. The autonomous machine can determine and perform a principle of operation associated with a detected subcomponent of the object, so as to complete a task that requires that the autonomous machine interacts with the object. In some cases, the autonomous machine has not previously encountered the object.

A method for controlling a robotic system includes: capturing, by an imaging system, one or more images of a scene; computing, by a processing circuit including a processor and memory, one or more instance segmentation masks based on the one or more images, the one or more instance segmentation masks detecting one or more objects in the scene; computing, by the processing circuit, one or more pickability scores for the one or more objects; selecting, by the processing circuit, an object among the one or more objects based on the one or more pickability scores; computing, by the processing circuit, an object picking plan for the selected object; and outputting, by the processing circuit, the object picking plan to a controller configured to control an end effector of a robotic arm to pick the selected object.

An information processing apparatus including a display unit configured to display a state of a robot system based on first data is characterized in that at least one element of the robot system based on the first data can be outputted with second data that is different from the first data.