A method and system for picking or put-away within a logistics facility. The system includes a central server and at least one mobile manipulation robot. The central server is configured to communicate with the robots to send and receive picking data which includes a unique identification for each item to be picked, a location within the logistics facility of the items to be picked, and a route for the robot to take within the logistics facility. The robots can then autonomously navigate and position themselves within the logistics facility by recognition of landmarks by at least one of a plurality of sensors. The sensors also provide signals related to detection, identification, and location of a item to be picked or put-away, and processors on the robots analyze the sensor information to generate movements of a unique articulated arm and end effector on the robot to pick or put-away the item.

A robotic system comprising a mobile chassis, a conveyor oriented substantially parallel to a longitudinal axis of the chassis, one or more robotic arms disposed adjacent to the conveyor, and one or more cameras positioned to view at least a portion of a top surface of the conveyor is disclosed. The system uses the mobile chassis, the conveyor, and the robotic arms to load items into a truck or other container, including by using image data generated by the one or more cameras to assess a state of items on the top surface of the conveyor; determine based at least in part on the image data that an additional item is to be added to the top surface of the conveyor; and operate a robotically controlled structure to cause an item to be added to the top surface of the conveyor.

A robotic system with independently controllable higher derivatives is disclosed. An indication is received of a trajectory through which an end effector comprising a robotic arm is to be moved. A plan is determined to use a combination of one or more motors and one or more energy removal devices to move one or more elements comprising the robotic arm in a manner that will result in the end effector being moved through the trajectory, including by using the one or more motors to apply torque to said one or more elements comprising the robotic arm during a first interval and using the one or more energy removal devices to remove energy from one or more of said elements during a second interval that starts after the start of the first interval. Commands to implement the plan are sent via a communication interface.

A sensing system with a detecting device that is used to detect a position of a target and a controller, where, for display on a display device or projection by a projection apparatus, the controller creates an augmented-reality image that shows: at least one of a setting related to detection of the target using the detecting device, a setting of a moving apparatus, and a setting of a robot that performs work on the target, a position of the target being recognized by the controller, a result of the detection of the target, a work plan of the moving apparatus, a work plan of the robot, a determination result of the controller and a parameter related to the target.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating grasps for objects within a container. One of the methods includes determining a set of grasp proposals with associated grasping windows, wherein each grasp proposal has a different respective position within a workspace. A respective set of waypoints is determined for each grasp proposal, each set comprising a pre-grasp pose and a grasp pose within the workspace. A final selected grasp proposal is used to control an end effector of a robot to grasp an object in the workspace based on a calculated grasp trajectory associated to the selected grasp proposal.

A processing system is disclosed for providing processing of objects that includes a programmable motion device including an end effector, a perception system for recognizing any of the identity, location, and orientation of an object presented in a plurality of objects at an input location, a grasp acquisition system for acquiring the object using the end effector to permit the object to be moved from the plurality of objects to one of a plurality of destination bins, and a motion planning system for determining a changing portion of a trajectory path of the end effector from the object to a base location proximate to the input location, and determining an unchanging portion of a trajectory path of the end effector from the base location to a destination bin location proximate to a destination bin.

A mobile manipulator robot for retrieving inventory items from a storage system. The robot includes a body, a wheel assembly, a sensor to locate a position of the robot within the storage system, an interface configured to send processor readable data to a remote processor and to an operator interface, and receive processor executable instructions from the remote processor and from the operator interface, an imaging device to capture images of the inventory items, a picking manipulator, first and second pneumatic gripping elements for grasping the inventory items, and a coupler configured to mate with a valve to access a pneumatic supply for operating at least one of the first or second pneumatic gripping elements. The robot is configured to transition the valve from a closed condition to an open condition and selectively place one of the first or the second pneumatic gripping elements in communication with the pneumatic supply.

An information processing device includes processing circuitry. The processing circuitry is configured to acquire one or more pieces of first state information representing a state of each of one or more second subjects related to a first subject to be a subject of inference at first time, and one or more pieces of second state information representing a state of each of the one or more second subjects at second time; and generate learning data for use in reinforcement learning of a machine learning model for use in inference. The learning data includes the first state information at least part of which is replaced with any of the one or more pieces of the second state information, and the second state information at least part of which is replaced with any of the one or more pieces of the first state information.

The present disclosure relates to a material handling system for manipulating items. The material handling system includes a repositioning system comprising a robotic tool which includes a robotic arm portion and an end effector. The robotic tool is configured to manipulate an item in a first orientation and reorient the item to a second orientation. The material handling system further includes a vision system having one or more sensors positioned within the material handling system. The vision system is configured to generate inputs corresponding to the characteristics of the items. The material handling system may further include a controller executing instructions to cause the material handling system to identify the item in the first orientation, based on the one or more characteristics of the item, initiate, by the repositioning system, picking of the item in the first orientation, and re-orient the item in the second orientation.

A robotic system includes a robot having a picking arm to grasp an inventory item and a shuttle. The shuttle includes a platform adapted to receive the inventory item from the picking arm of the robot. The platform is moveable between a pick-up location located substantially adjacent to the robot and an end location spaced a distance apart from the pick-up location. The system improves efficiency as transportation of the item from the pick-up location to the end location is divided between the robot and the shuttle.