A cleaning robot that performs cleaning while travelling a space to be cleaned, the cleaning robot including: a travelling unit that moves the cleaning robot; a cleaning unit that cleans the space to be cleaned; an image capturing unit that captures an image viewed from the cleaning robot; a voice input unit to which a user's voice instructions are input; and a controller obtaining the user's motion instructions through the image capturing unit and determining a restricted area in which entry of the cleaning robot is prohibited and/or a focused cleaning area to be intensely cleaned by the cleaning robot based on the user's motion instructions or the user's voice instructions when the user's voice instructions are input through the voice input unit. The restricted area and the focused cleaning area may be input to the cleaning robot through the user's voice and motion.

A new technology of prediction of manipulability in response even to an instruction with missing information in an object manipulation task to have a robot manipulate some kind of object is provided. An instruction understanding system includes an obtaining engine configured to obtain a linguistic expression of a name of an object to be manipulated and a linguistic expression of a situation where the object corresponding to the name is placed in a real environment and a classifier configured to receive input of the linguistic expression of the name and the linguistic expression of the situation and output manipulability of the object corresponding to the name in the real environment.

A method and system for piece-picking or piece put-away within a logistics facility. The system includes a central server and at least one mobile manipulation robot. The central server is configured to communicate with the robots to send and receive piece-picking data which includes a unique identification for each piece to be picked, a location within the logistics facility of the pieces to be picked, and a route for the robot to take within the logistics facility. The robots can then autonomously navigate and position themselves within the logistics facility by recognition of landmarks by at least one of a plurality of sensors. The sensors also provide signals related to detection, identification, and location of a piece to be picked or put-away, and processors on the robots analyze the sensor information to generate movements of a unique articulated arm and end effector on the robot to pick or put-away the piece.

A voice interactive robot interacting with a user by voice includes a main body, a movable part capable of moving relative to the main body, a following control unit that moves the movable part so that the movable part follows the user, a temporary origin setting unit that sets a temporary origin of the movable part in response to movement of the movable part by the following control unit, an acquisition unit that acquires an operation instruction issued in relation to the movable part, and an operation execution unit that moves the movable part in accordance with the operation instruction using the temporary origin as a reference.

A method and system for piece-picking or piece put-away within a logistics facility. The system includes a central server and at least one mobile manipulation robot. The central server is configured to communicate with the robots to send and receive piece-picking data which includes a unique identification for each piece to be picked, a location within the logistics facility of the pieces to be picked, and a route for the robot to take within the logistics facility. The robots can then autonomously navigate and position themselves within the logistics facility by recognition of landmarks by at least one of a plurality of sensors. The sensors also provide signals related to detection, identification, and location of a piece to be picked or put-away, and processors on the robots analyze the sensor information to generate movements of a unique articulated arm and end effector on the robot to pick or put-away the piece.

The present invention provides a system and the accompanying method for controlling physical objects placed on an interactive board with voice commands. The system includes multiple physical objects, each embedded with an identifier and a wireless communication module, an interactive board that is configured to recognize the identifier and location information of a physical object placed on the interactive board, a processor operatively connected to the interactive board, a memory unit operatively connected to the processor and configured to store the correlation relationship between identifiers of physical objects and names of physical objects, a wireless communication module operatively connected to the processor, and a voice input module operatively connected to the processor and configured to receives a voice command from a user. Once multiple physical objects are placed on the interactive board, the processor is configured to generate a command instruction for each of the physical objects, based on the voice command from the user and the identifier and location information of the physical objects.

Devices, methods, and systems for voice control of components of a facility are described herein. One computing device apparatus includes a memory, and a processor configured to execute executable instructions stored in the memory to receive a voice command or voice query from a user, determine location context information associated with the computing device, and determine which component or components of the facility are associated with the voice command or voice query based, at least in part, on the location context information associated with the computing device.

A method and system for piece-picking or piece put-away within a logistics facility. The system includes a central server and at least one mobile manipulation robot. The central server is configured to communicate with the robots to send and receive piece-picking data which includes a unique identification for each piece to be picked, a location within the logistics facility of the pieces to be picked, and a route for the robot to take within the logistics facility. The robots can then autonomously navigate and position themselves within the logistics facility by recognition of landmarks by at least one of a plurality of sensors. The sensors also provide signals related to detection, identification, and location of a piece to be picked or put-away, and processors on the robots analyze the sensor information to generate movements of a unique articulated arm and end effector on the robot to pick or put-away the piece.

A method and system for piece-picking or piece put-away within a logistics facility. The system includes a central server and at least one mobile manipulation robot. The central server is configured to communicate with the robots to send and receive piece-picking data which includes a unique identification for each piece to be picked, a location within the logistics facility of the pieces to be picked, and a route for the robot to take within the logistics facility. The robots can then autonomously navigate and position themselves within the logistics facility by recognition of landmarks by at least one of a plurality of sensors. The sensors also provide signals related to detection, identification, and location of a piece to be picked or put-away, and processors on the robots analyze the sensor information to generate movements of a unique articulated arm and end effector on the robot to pick or put-away the piece.

A cleaning robot that performs cleaning while travelling a space to be cleaned, the cleaning robot including: a travelling unit that moves the cleaning robot; a cleaning unit that cleans the space to be cleaned; an image capturing unit that captures an image viewed from the cleaning robot; a voice input unit to which a user's voice instructions are input; and a controller obtaining the user's motion instructions through the image capturing unit and determining a restricted area in which entry of the cleaning robot is prohibited and/or a focused cleaning area to be intensely cleaned by the cleaning robot based on the user's motion instructions or the user's voice instructions when the user's voice instructions are input through the voice input unit. The restricted area and the focused cleaning area may be input to the cleaning robot through the user's voice and motion.