In an embodiment, a method includes determining a given material to manipulate to achieve a goal state. The goal state can be one or more deformable or granular materials in a particular arrangement. The method further includes, for the given material, determining, a respective outcome for each of a plurality of candidate actions to manipulate the given material. The determining can be performed with a physics-based model, in one embodiment. The method further can include determining a given action of the candidate actions, where the outcome of the given action reaching the goal state is within at least one tolerance. The method further includes, based on a selected action of the given actions, generating a first motion plan for the selected action.

A conveyance robot system according to the present disclosure includes an intrusion detection sensor that detects an intrusion of an object into the arm opening, and a distance sensor that measures a clearance distance indicating a distance between an arm entry/exit surface and a shelf, the arm entry/exit surface being a surface of the conveyance robot in which the arm opening is provided from among surfaces of the conveyance robot 1 constituting the safety cover, and the object being stored in the shelf. The distance sensor is disposed at a fixed height of the shelf in a horizontal direction and at a height of the shelf corresponding to a part to be measured.

A user can easily create a robot program. A measuring device includes a position determination processing part that determines a holding position, held by a robot hand, of a workpiece placed in a work space and determines coordinates of a fixed via point having any single attribute based on a result of measurement made by a measuring part and holding information, the fixed via point being one of an approach position of the robot hand for holding the holding position, the holding position, and a retreat position after holding, and an output part that outputs, to a robot controller, the coordinates of the fixed via point determined by the position determination processing part and attribute information showing the attribute of the fixed via point.

A robotic post includes a processor and a memory. The robotic post may include a manipulation arm and a swiveling or otherwise movable trunk or base. One or more sensors provided on the robotic post enable the robotic post to determine the position and location of a piece of luggage. The processor, based on the sensor input, causes the robotic post to rotate, tilt or move toward the luggage to orient and secure a hook or gripper onto the handle of the luggage. The post may move, under control of the processor, to another location. When presented with authorization by a user, the luggage is released at the second location.

The image processing device according to the invention includes: a first acquisition unit to acquire a captured image; a display control unit to display a setting screen to allow to user to set an image processing area, which is an area where predetermine image processing is performed, in the image acquired by the first acquisition unit on a display device; and a second acquisition unit configured to acquire movable range information indicating a movable range of a working device, operations of which are controlled on the basis of a result of the predetermined image processing. The display control unit controls the display of the setting screen so as to cause the user to identify a range in which the working device is not able to operate in the image, on the basis of the movable range information acquired by the second acquisition unit.

A method of training a robot system for manipulation of objects, the robot system being able to perform a set of skills, wherein each skill is learned as a skill model, the method comprising: receiving physical input from a human trainer, regarding the skill to be learned by the robot; determining for the skill model a set of task parameters including determining for each task parameter of the set of task parameters if a task parameter is an attached task parameter, which is related to an object being part of said kinesthetic demonstration or if a task parameter is a free task parameter, which is not related to a physical object; obtaining data for each task parameter of the set of task parameters from the set of kinesthetic demonstrations, and training the skill model with the set of task parameters and the data obtained for each task parameter.

One variation of a method for automatically generating a planogram for a store includes: dispatching a robotic system to autonomously navigate within the store during a mapping routine; accessing a floor map of the floor space generated by the robotic system from map data collected during the mapping routine; identifying a shelving structure within the map of the floor space; defining a first set of waypoints along an aisle facing the shelving structure; dispatching the robotic system to navigate to and to capture optical data at the set of waypoints during an imaging routine; receiving a set of images generated from optical data recorded by the robotic system during the imaging routine; identifying products and positions of products in the set of images; and generating a planogram of the shelving segment based on products and positions of products identified in the set of images.

A robotic system includes a robotic arm and a movable hardstop disposed proximate to the robotic arm. The movable hardstop is separated from the robotic arm by at least one clearance in a first operating condition. The movable hardstop physically contacts the robotic arm in a second operating condition. The robotic system also includes one or more controllers configured to control movement of the robotic arm and movement of the movable hardstop such that the first operating condition is maintained or such that, if the second operating condition occurs, the hardtop blocks movement of the robotic arm.

A position detector for generating 3D position information of an object in a position determination space for the object. The position detector has a camera with a lens and an image sensor that defines an imaging area with one first light deflecting element arranged in the imaging area as the camera and the at least one light deflecting element are adapted to simultaneously produce on the image sensor at least two images of the position determination space, a first image being produced by light beams deflected at the first light deflecting element, the at least two images differ with respect to the viewing direction of the position determination space.

A mobile robot includes a receiving unit that receives designation of a destination region including a destination, a moving unit that moves toward the destination region, and a seeking unit that seeks a client after movement toward the destination region starts. The moving unit moves toward the sought client.