This specification relates to robots and audio processing in robots. In general, one innovative aspect of the subject matter described in this specification can be embodied in a robot that includes: a body and one or more physically moveable components; a plurality of accessory input subsystems and one or more other sensor subsystems; one or more processors; and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the robot to perform operations. The operations can include: receiving one or more sensor inputs from the one or more other sensor subsystems; determining a predicted direction of a detected sound emitter based on the one or more sensor inputs of the one or more other sensor subsystems; calculating a spatial filter based on the predicted direction; obtaining, by the plurality of accessory input subsystems, respective audio inputs; and processing the respective audio inputs according to the calculated spatial filter.

A robot with an impact buffering member on the surface of a robot arm for alleviating the impact when the arm contacts an object; and a contact detection unit for detecting a contact between the robot arm and object. The unit has a soft porous member on the front surface side of the impact buffering member and softer than the member; a housing member including the soft porous member and formed of a flexible material; a fluid discharge pipe for discharging a fluid inside the housing member when the object makes contact so the volume of the housing member decreases; and a volume change detection portion for detecting a change in volume of the housing member by utilizing the discharged fluid. It is possible to secure sufficient safety in a cooperative work between a person and a robot or the like, even when the person contacts the robot arm.

A robot with an impact buffering member on the surface of a robot arm for alleviating the impact when the arm contacts an object; and a contact detection unit for detecting a contact between the robot arm and object. The unit has a soft porous member on the front surface side of the impact buffering member and softer than the member; a housing member including the soft porous member and formed of a flexible material; a fluid discharge pipe for discharging a fluid inside the housing member when the object makes contact so the volume of the housing member decreases; and a volume change detection portion for detecting a change in volume of the housing member by utilizing the discharged fluid. It is possible to secure sufficient safety in a cooperative work between a person and a robot or the like, even when the person contacts the robot arm.

The present disclosure provides a method for virtual interaction, a physical robot, a display terminal, and a system to enhance man-machine interaction experience. The method for virtual interaction includes: acquiring data measured by at least one sensor of a first physical robot from performing measurement at a real scene within a current measurement range, where the current measurement range changes with a movement of the first physical robot in the real scene; and drawing, according to the data measured by the at least one sensor, a virtual scene corresponding to the real scene within the current measurement range, and displaying the virtual scene on a display terminal.

An external input device is employed, the external input device being configured to operate a robot system including an imaging apparatus capable of changing an imaging point of view and a robot apparatus, the external input device includes a display area, a robot apparatus operation unit configured to operate the robot apparatus, an imaging operation unit configured to operate the imaging apparatus, and an image display unit configured to display an image captured by the imaging apparatus, wherein the robot apparatus operation unit, the imaging operation unit, and the image display unit are displayed on the display area, and wherein the image display unit is disposed between the robot apparatus operation unit and the imaging operation unit.

An example system comprising a pressure sensor array, a proximity sensor comprising circuitry to sense an object approaching the pressure sensor array based on a change in a resonance frequency of the proximity sensor, and a controller to receive from the proximity sensor the sensed change in the resonance frequency and designate the pressure sensor array as active responsive to the sensed resonance frequency being below a threshold or inactive responsive to the sensed resonance frequency being above the threshold, wherein a data transmission rate of the active pressure sensor array is greater than a data transmission rate of the inactive pressure sensor array.

A robot system includes a robot including a plurality of fingers for holding a target object and a control device configured to control a motion of the robot. The control device includes one or more processors. The processors acquire an image of a first target object and a second target object taken by an imaging device. The processors control the motion of the robot based on the image such that the robot moves the first target object with at least one finger included in the fingers in a direction in which a gap is formed between the first target object and the second target object, inserts at least one finger included in the fingers into the gap, and holds the first target object.

An apparatus such as a robot capable of performing goal oriented tasks may include one or more touch sensors to receive touch perception feedback on the location of objects and structures within an environment. A fusion engine may be configured to combine touch perception data with other types of sensor data such as data received from an image or distance sensor. The apparatus may combine distance sensor data with touch sensor data using inference models such as Bayesian inference. The touch sensor may be mounted onto an adjustable arm of a robot. The apparatus may use the data it has received from both a touch sensor and distance sensor to build a map of its environment and perform goal oriented tasks such as cleaning or moving objects.

An end effector (400) for a robotic arm, the end effector (400) comprising: two pipe engaging jaws (404), each jaw comprising an inner contour configured for engaging a pipe section, wherein at least one jaw (404) is a fixed jaw; wherein the end effector (400) is configured to restrict radial movement of the pipe section while permitting axial movement.

A system for calibrating a deformable sensor is provided. The system includes a deformable sensor including a housing, a deformable membrane coupled to an upper portion of the housing, and an enclosure defined by the housing and the deformable member; an imaging sensor configured to capture an image of the deformable membrane of the deformable sensor; and a controller. The enclosure is configured to be filled with a medium. The controller is configured to: receive the image of the deformable membrane of the deformable sensor; determine whether a contour of the deformable membrane in the image of the deformable membrane of the deformable sensor corresponds to a predetermined contour; and adjust a volume of the medium in the enclosure of the deformable sensor in response to the determination that the contour of the deformable membrane is different from the predetermined contour.