Methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio augmentation of physical robot sounds. A robot can determine that a first physically moveable component of the robot is to be actuated and in response, obtain a conditional state of the robot. The robot can obtain an audio object that generates an audio enhancement for the first physically moveable component being actuated, the audio enhancement having one or more characteristics that match the obtained conditional state of the robot. The robot can output the audio enhancement while actuating the first physically moveable component.

Provided is an electronic device. The electronic device may include: a user interface; a processor operatively connected to the user interface; and a memory operatively connected to the processor, wherein the memory may store instructions that, when executed, cause the processor to control the electronic device to: receive an input via the user interface; determine a task including plural actions based on the input; execute a first action among the plural actions of the determined task; obtain context information related to the task while executing the first action; determine at least one first threshold associated with the first action based at least in part on the obtained context information; and determine the result of the first action based on the execution of the first action being completed based on the at least one first threshold.

A computing device performs computation for controlling operations of a mobile manipulator configured to hold a plurality of target objects with a manipulator and move the target objects to predetermined positions. The computing device includes a storage and a calculator. The storage stores a trained machine learning model trained by inputting a plurality of training data sets, which are combinations of state variables and pieces of determination data associated with the state variables. The training data sets are acquired in advance. The calculator outputs a movement-target object to be moved to a predetermined position at current time by inputting the state variable to the trained machine learning model read from the storage. The state variable contains relative positions of the target objects to a specific portion of the mobile manipulator. The determination data associated with the state variable represents the movement-target object.

An apparatus, system and method of operating an autonomous mobile robot having a height of at least one meter. The apparatus, system and method may include a mobile robot body; at least two phased array antennas associated with the mobile body, wherein the phased array antennas enable wireless communication between on-board features of the mobile robot, including at least mobility hardware proximate to a base of the mobile robot body, and off-board sensors related to at least navigation of the mobility hardware; and a processing system communicative with the on-board features and the off-board sensors via intercommunication with the phased antennas, and comprising non-transitory computing code which, when executed by at least one processor associated with the processing system.

In an embodiment, a method and system use various sensors to determine a shape of a collection of materials (e.g., foodstuffs). A controller can determine a trajectory which achieves the desired end-state, possibly chosen from a set of feasible, collision-free trajectories to execute, and a robot executes that trajectory. The robot, executing that trajectory, scoops, grabs, or otherwise acquires the desired amount of material from the collection of materials at a desired location. The robot then deposits the collected material in the desired receptacle at a specific location and orientation.

A food preparation system arranged in a kitchen includes a gantry fixed with the kitchen, at least one robot arm having an end effector supported on a base in the kitchen, where the base is movably mounted on the gantry, defining a reaching distance of the robot from the end effector to the base, along a travel path of the base on the gantry, a storage container arranged in the kitchen, within the reaching distance of the at least one robot arm, and configured for storing a food item, at least one ingredient distribution device arranged in the kitchen, within the reaching distance of the at least one robot arm, and configured for dispensing at least one ingredient on the food item, and an oven arranged in the kitchen, within the reaching distance of the at least one robot arm, and configured for baking the food item.

A control system, method and computer program product cooperate to assist control for an autonomous robot. An interface receives recognition information from an autonomous robot, said recognition information including candidate target objects to interact with the autonomous robot. A display control unit causes a display image to be displayed on a display of candidate target objects, wherein at least two of the candidate target objects are displayed with an associated indication of a target object score.

A mobile robotic arm configured to provide on-demand assistance is disclosed. In an example, a robotic system includes a platform, at least two wheels connected to the platform and driven by respective motors, a robotic arm having a base that is connected to the platform, an end-effector connected to the robotic arm at an end opposite the base, and a processor communicatively coupled to the respective motors, the robotic arm, and the end-effector. The processor is configured to receive a command or determine that an item has fallen on a floor, locate the item on the floor, determine a distance and a heading to the item, cause the respective motors to move the platform to the item within range of the robotic arm, cause the robotic arm to grasp the item with the end-effector, and cause the robotic arm to provide the item to a user.

There is provided a data processing device, a data processing method, and a cooking robot that allow for object sensing with use of an appropriate algorithm. The data processing device according to one aspect of the present technology adaptively selects, in accordance with an object sensing condition, and executes an object sensing program in which an object sensing algorithm for sensing an object on the basis of sensor data output from a sensor mounted on a robot is defined. The present technology can be applied to sensor devices mounted on various devices.

In an embodiment, a method for handling an order includes determining a plurality of ingredients based on an order, received from a user over a network, for a location having a plurality of robots. The method further includes planning at least one trajectory for at least one robot based on the plurality of ingredients and utensils available at the location, and proximity of each ingredient and utensil to the at least one robot. Each trajectory can be configured to move one of the plurality of ingredients into a container associated with the order. In an embodiment, the method includes executing the at least one trajectory by the at least one robot to fulfill the order. In an embodiment, the method includes moving the container to a pickup area.