The disclosure provides a gripping position determination device, a gripping position determination system, a gripping position determination method, and a recording medium. The gripping position determination device for a robot hand having a plurality of multi joint fingers includes: a frictional force distribution calculation part estimating, from a predictive control of a gripping force when an object is gripped by at least two fingers, a frictional force between one of the gripping fingers and the object, and calculates a frictional force distribution where grapping of the object is possible on a surface of the object based on a value related to a frictional force calculated by using the estimated frictional force; a grippable region selection part selecting, from the frictional force distribution, at least one grippable region; and a gripping position calculation part calculating, from the selected grippable region, a gripping position where stable gripping of the object is possible.

Methods, apparatus, systems, and computer-readable media are provided for selective robot deployment. In various implementations, a context of a user may be determined based at least in part on a record of one or more computing interactions associated with the user. In various implementations, a robot-performable task of the user may be identified based at least in part on the context. In various implementations, a measure of potential or actual interest of the user in deploying a robot to perform the robot-performable task may be determined. In various embodiments, the robot may be selectively deployed based on the measure of potential or actual interest.

A robotic system includes a robot having a picking arm to grasp an inventory item and a shuttle. The shuttle includes a platform adapted to receive the inventory item from the picking arm of the robot. The platform is moveable between a pick-up location located substantially adjacent to the robot and an end location spaced a distance apart from the pick-up location. The system improves efficiency as transportation of the item from the pick-up location to the end location is divided between the robot and the shuttle.

A plurality of sensors are configured to provide a corresponding output that reflects a sensed value associated with engagement of a robotic arm end effector with an item. The respective outputs of one or more sensors comprising the plurality of sensors are used to determine one or more inputs to a multi-modal model configured to provide, based at least in part on the one or more inputs, an output associated with slippage of the item within or from a grasp of the robotic arm end effector. A determination associated with slippage of the item within or from the grasp of the robotic arm end effector is made based at least in part on an output of the multi-modal model. A responsive action is taken based at least in part on the determination associated with slippage of the item within or from the grasp of the robotic arm end effector.

Systems and methods for online augmentation for learned grasping are provided. In one embodiment, a method is provided that includes identifying an action from a discrete action space. The method includes identifying a second set of grasps of the agent utilizing a transition model based on the action and at least one contact parameter. The at least one contact parameter defines allowed states of contact for the agent. The method includes applying a reward function to evaluate each grasp of the second set of grasps based on a set of contact forces within a friction cone that minimizes a difference between an actual net wrench on the object and a predetermined net wrench. The reward function is optimized online using a lookahead tree. The method includes selecting a next grasp from the second set. The method includes causing the agent to execute the next grasp.

Embodiments are generally directed to generating a training dataset of labelled examples of sensor images and grasp configurations using a set of three-dimensional (3D) models of objects, one or more analytic mechanical representations of either or both of grasp forces and grasp torques, and statistical sampling to model uncertainty in either or both sensing and control. Embodiments can also include using the training dataset to train a function approximator that takes as input a sensor image and returns data that is used to select grasp configurations for a robot grasping or targeting mechanism.

A robotic system includes a robot having a picking arm to grasp an inventory item and a shuttle. The shuttle includes a platform adapted to receive the inventory item from the picking arm of the robot. The platform is moveable between a pick-up location located substantially adjacent to the robot and an end location spaced a distance apart from the pick-up location. The system improves efficiency as transportation of the item from the pick-up location to the end location is divided between the robot and the shuttle.

A robotic system includes a robot having a picking arm to grasp an inventory item and a shuttle. The shuttle includes a platform adapted to receive the inventory item from the picking arm of the robot. The platform is moveable between a pick-up location located substantially adjacent to the robot and an end location spaced a distance apart from the pick-up location. The system improves efficiency as transportation of the item from the pick-up location to the end location is divided between the robot and the shuttle.

A plurality of sensors are configured to provide a corresponding output that reflects a sensed value associated with engagement of a robotic arm end effector with an item. The respective outputs of one or more sensors comprising the plurality of sensors are used to determine one or more inputs to a multi-modal model configured to provide, based at least in part on the one or more inputs, an output associated with slippage of the item within or from a grasp of the robotic arm end effector. A determination associated with slippage of the item within or from the grasp of the robotic arm end effector is made based at least in part on an output of the multi-modal model. A responsive action is taken based at least in part on the determination associated with slippage of the item within or from the grasp of the robotic arm end effector.

Methods, apparatus, systems, and computer-readable media are provided for selective robot deployment. In various implementations, a context of a user may be determined based at least in part on a record of one or more computing interactions associated with the user. In various implementations, a robot-performable task of the user may be identified based at least in part on the context. In various implementations, a measure of potential or actual interest of the user in deploying a robot to perform the robot-performable task may be determined. In various embodiments, the robot may be selectively deployed based on the measure of potential or actual interest.