A system surrounds an area with a first set of display panels. A second set of display panels is positioned above the area, and a third set of display panels is positioned below the area. A subject is positioned within the area and may be on an omnidirectional treadmill within the area. A controller communicates content to the first set of display panels, the second set of display panels, and the third set of display panels that presents a multidimensional scene when displayed. A set of sensors capture sensor data of the subject within the area while content is displayed. One or more of the sensors may be coupled to a repositioning system that repositions sensors so the subject remains in a field of view of different sensors. From sensor data of the subject, a representation of the subject may be generated for insertion into other video content.

A robot for order fulfillment includes a mobility assembly, an arm, a pneumatically actuatable tool, and a coupler having a mating end in selective communication with the pneumatically actuatable tool. The mating end of the coupler being configured to access a pneumatic supply from an external pneumatic source such that the robot need not include a large compressor.

Devices, systems, and methods for autonomously sorting dirty laundry articles into batched loads for washing are described. For example, an autonomous sorting system includes an enclosed channel including a stationary floor extending between an inlet end and an outlet end of the channel, a plurality of arms disposed in series along the enclosed channel for selectively grasping at least one of the plurality of deformable articles in sequence. The system includes an outlet orifice adjacent the outlet end through which each separated deformable article exits the enclosed channel upon release by the terminal gripper of the one of the plurality of arms, and one or more conveyors disposed adjacent the outlet end configured for receiving thereon a plurality of bins for collecting for washing together two or more articles of the plurality of deformable articles released through the outlet orifice having a common sensor-detected one or more characteristics.

The present invention relates to a robot and method for estimating an orientation on the basis of a vanishing point in a low-luminance image, and the robot for estimating an orientation on the basis of a vanishing point in a low-luminance image according to an embodiment of the present invention includes a camera unit configured to capture an image of at least one of a forward area and an upward area of the robot and an image processor configured to extract line segments from a first image captured by the camera unit by applying histogram equalization and a rolling guidance filter to the first image, calculate a vanishing point on the basis of the line segments, and estimate a global angle of the robot corresponding to the vanishing point.

Robot assisted multi-view 3D scanning measurement based on path planning includes firstly, establishing a virtual simulation platform to complete the setting of measurement poses and measurement paths and perform the path evaluations of measurement paths. Then, completing the preliminary hand-eye calibration based on the properties of Kronecker product, and the preliminary hand-eye calibration is optimized by establishing a reprojection error cost function as the fitness function of the particle swarm optimization algorithm. Lastly, moving the robot to the measurement poses of the planned measurement paths, obtaining a single-view point cloud of the measured object and transforming it from the camera coordinate system to the robot base coordinate system to obtain a registered single-view point cloud based on the optimized hand-eye matrix. When registered single-view point clouds of all measurement poses are obtained, the points under the robot base coordinate system form a complete point cloud of the measured object.

To reliably connect a device to be charged such as a robot and a charging device. There is provided a charging device including a charging stand having a charging terminal to be connected to a device to be charged and an engaging portion that performs positioning with the device to be charged, and a support member that supports the charging stand movably in the horizontal direction. With this configuration, the charging stand can be moved in the horizontal direction. Therefore, it is possible to reliably connect the device to be charged such as a robot and the charging device.

A method includes receiving sensor data of an environment about a robot and generating a plurality of waypoints and a plurality of edges each connecting a pair of the waypoints. The method includes receiving a target destination for the robot to navigate to and determining a route specification based on waypoints and corresponding edges for the robot to follow for navigating the robot to the target destination selected from waypoints and edges previously generated. For each waypoint, the method includes generating a goal region encompassing the corresponding waypoint and generating at least one constraint region encompassing a goal region. The at least one constraint region establishes boundaries for the robot to remain within while traversing toward the target destination. The method includes navigating the robot to the target destination by traversing the robot through each goal region while maintaining the robot within the at least one constraint region.

A method for eliminating misjudgment of a reflective light applied to an autonomous robot is provided. The autonomous robot includes a driving system and an optical sensing system that includes a light source and a light sensor. The light source emits a transverse linear light as detection light and the light sensor senses reflective light signals from an object that reflects the detection light. In the method, a frame image including the reflective light signals is captured by the light sensor, characteristics of the reflective light signals are analyzed, and the characteristics of the reflective light signals can be corrected based on the characteristics of previous reflective light signals stored in a memory of the autonomous robot in order to exclude abnormal information. The object can be confirmed based on the corrected characteristics of reflective light signals. The misjudgment caused by the abnormal information can therefore be eliminated.

A device for distributing designated items includes means for autonomously moving the robotic device; storage means including multiple compartments, means for dispensing items from the storage means; a memory module containing optical recognition scans and personal information of persons located within a premise, and substantive information of the designated items, optical recognition scanners, a control module in communication with the means for autonomously moving, the optical recognition scanners, the memory and the means for dispensing. The control unit directs movement of the device, directs the optical recognition scanners to scan persons, and compares images from the optical recognition scanners to optical recognitions in the memory to identify persons. Upon identifying a person, the control unit searches personal information of the person and identifies designated items specified for that person, and then directs the means for dispensing to dispense the designated item.

A robotic device for distributing designated items to designated persons, includes: a motion unit to autonomously move said robotic device; storage means including multiple compartments; an item dispenser to dispense items from said storage means; a memory module containing optical recognition scans and personal information of persons located within a premises, and substantive information of the designated items; optical recognition scanners; a control module in communication with the motion unit, the optical recognition scanners, the memory and the item dispenser. The control unit directs movement of the robotic device, directs the optical recognition scanners to scan persons, and compares images from the optical recognition scanners to optical recognitions in the memory. Upon identifying a person, the control unit searches personal information of the person and identifies designated items specified for that person, and then directs the item dispenser to dispense the designated item.