A service robot for guiding and describing a displayed vehicle and a method for operating the robot, may include a projector for projecting visual information related to a target vehicle; monitoring means for monitoring a state of a user; and a controller configured to: suggest, to the user, presentation of visual information in conjunction with a guide description of the target vehicle; determine, via the monitoring means, whether the user has accepted the suggestion; and upon determination that the user has accepted the suggestion, present the visual information via the projector.

A building monitoring system includes a first sensor configured to detect a first condition in the space, a second sensor configured to detect a second condition in the space, and a robotic sentinel. The robotic sentinel includes a memory for storing one or more rules each configured to identify an alert condition for the space based on the first and/or second conditions in the space, a communications module configured to communicate with a remote device over a network, and a controller operatively coupled to the sensors, the memory, and the communications module. The controller is configured to apply the one or more rules to the first and second detected conditions in the space to identify one or more alert conditions and determine what action is required by the robotic sentinel, and if action is required, command the robotic sentinel to travel to a location of the alert condition.

An operation adjustment apparatus includes a camera arranged so as to capture images of a robot and a hand. The robot controller includes an operation control unit that sends an operation command to the robot at a predetermined control cycle. The camera captures images at a time interval that coincides with the control cycle. A determination unit of the robot controller determines whether an operation of the hand is appropriate based on a result of image processing performed by an image processing unit. If the determination unit determines that the operation of the hand is not appropriate, a correction unit of the robot controller corrects a command statement included in an operation program so that the operation of the hand is an appropriate operation.

Systems and methods for classifying at least a portion of an image as being textured or textureless are presented. The system receives an image generated by an image capture device, wherein the image represents one or more objects in a field of view of the image capture device. The system generates one or more bitmaps based on at least one image portion of the image. The one or more bitmaps describe whether one or more features for feature detection are present in the at least one image portion, or describe whether one or more visual features for feature detection are present in the at least one image portion, or describe whether there is variation in intensity across the at least one image portion. The system determines whether to classify the at least one image portion as textured or textureless based on the one or more bitmaps.

A system for performing autonomous agriculture within an agriculture production environment includes one or more agriculture pods, a stationary robot system, and one or more mobile robots. The agriculture pods include one or more plants and one or more sensor modules for monitoring the plants. The stationary robot system collects sensor data from the sensor modules, performs farming operations on the plants according to an operation schedule based on the collected sensor data, and generates a set of instruction for transporting the agriculture pods within the agriculture production environment. The stationary robot system communicates the set of instructions to the agriculture pods. The mobile robots transport the agriculture pods between the stationary robot system and one or more other locations within the agriculture production environment according to the set of instructions.

A package imaging system can be configured to utilize unused or idle degrees of freedom associated with a robot to collect identification and modeling information. One or more sensors can be attached to the robot and configured to track a package between a first location and a second location. A final joint of the robot can be configured to cause one or more rotations of the package within the reference frame. The one or more sensors can capture one or more images of the package within the reference frame. Based on the one or more images, the package imaging system can determine a package identity from an identifier associated with the package. The package imaging system can also generate a three-dimensional model of the package by combining the one or more pictures.

A cascading expansion method of working space and working visual angle of stereo vision system is disclosed. One stereo vision system in the multi stereo vision systems is fixed as the global vision system, and the other stereo vision systems can move the position and adjust the visual angle according to the needs during the working process, so as to effectively expand the working space and working visual angle of the stereo vision system and improve the flexibility of the stereo vision system. For the target to be measured that cannot be seen under the global stereo vision, the indirect positioning of the target to be measured under the global coordinate system can be achieved through other stereo vision systems, so as to overcome the limitation of the limited visual angle of a single stereo vision system and the limited workspace.

A system and method for determining performance of a robot. In one form the robot is constructed as you assembling automotive workpieces onto an automobile assembly. In one form the robot accomplishes the task of assembling an automotive workpiece onto the automotive assembly by using vision feedback and force feedback. The vision feedback can use any number of features perform its function. Such features can include an artificial feature such as but not limited to a QR code, as well as a natural feature such as a portion of the workpiece or automotive assembly. In one embodiment the robot is capable of detecting a collision event and assessing the severity of the collision event. In another embodiment the robot is capable of evaluating its performance by attracting a performance metric against a performance threshold, and comparing a sensor fusion output with a sensor fusion output reference.

A robot position calibration apparatus is disclosed including a scan position controller configured to control the position of the robot by individually setting parameter sets related to the position of the robot for causing a scanner mounted on an end of the robot to scan an object in multiple scan positions around the robot, and a data receiver configured to receive, from the scanner, multiple scan data items generated by the scanner scanning the object in each of the multiple scan positions, and a parameter calibrator configured to calculate calibration values for the parameter sets having been individually set, by using multiple position information items corresponding to the parameter sets and the multiple scan data items.

Proposed is a capturing apparatus. The capturing apparatus may include a setting unit configured to set environment information of a robot equipped with a camera; and a pattern unit configured to set a capturing pattern of the robot based on the environment information.