The present invention provides a loop closure detection method and system, a multi-sensor fusion SLAM system, a robot, and a medium. Said system runs on a mobile robot, and comprises a similarity detection unit, a visual pose solving unit, and a laser pose solving unit. According to the loop closure detection system, the multi-sensor fusion SLAM system and the robot provided in the present invention, the speed and accuracy of loop closure detection in cases of a change in a viewing angle of the robot, a change in the environmental brightness, a weak texture, etc. can be significantly improved.

The present invention provides a loop closure detection method and system, a multi-sensor fusion SLAM system, a robot, and a medium. Said system runs on a mobile robot, and comprises a similarity detection unit, a visual pose solving unit, and a laser pose solving unit. According to the loop closure detection system, the multi-sensor fusion SLAM system and the robot provided in the present invention, the speed and accuracy of loop closure detection in cases of a change in a viewing angle of the robot, a change in the environmental brightness, a weak texture, etc. can be significantly improved.

An improved UAV system and methods for operation in an inventory management system. The methods include generating a three dimensional (3D) map and estimating a position and orientation of the UAV based upon this map; autonomously navigating the UAV in the environment by using the generated 3d map in conjunction with the position and the orientation of the UAV; performing static and dynamic obstacle avoidance in the environment using collision avoidance; and finding the optimal path from a source node to a destination node within the environment.

An improved UAV system and methods for operation in an inventory management system. The methods include generating a three dimensional (3D) map and estimating a position and orientation of the UAV based upon this map; autonomously navigating the UAV in the environment by using the generated 3d map in conjunction with the position and the orientation of the UAV; performing static and dynamic obstacle avoidance in the environment using collision avoidance; and finding the optimal path from a source node to a destination node within the environment.

Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model based on a selected subset of the images and depth data corresponding to each of the images of the subset. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment captured via a camera on the device, selecting a subset of the images based on assessing the images with respect to motion-based defects based on device motion and depth data, and generating a 3D model of the object based on the selected subset of the images and depth data corresponding to each of the images of the selected subset.

Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model based on a selected subset of the images and depth data corresponding to each of the images of the subset. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment captured via a camera on the device, selecting a subset of the images based on assessing the images with respect to motion-based defects based on device motion and depth data, and generating a 3D model of the object based on the selected subset of the images and depth data corresponding to each of the images of the selected subset.

Disclosed herein are a method of localization by synchronizing multi sensors and a robot implementing the same. The robot according to an embodiment includes a controller that, when a first sensor acquires first type information, generates first type odometry information using the first type information, that, at a time point when the first type odometry information is generated, acquires second type information by controlling a second sensor and then generates second type odometry information using the second type information, and that the robot by combining the first type odometry information and the second type odometry information.

Disclosed herein are a method of localization by synchronizing multi sensors and a robot implementing the same. The robot according to an embodiment includes a controller that, when a first sensor acquires first type information, generates first type odometry information using the first type information, that, at a time point when the first type odometry information is generated, acquires second type information by controlling a second sensor and then generates second type odometry information using the second type information, and that the robot by combining the first type odometry information and the second type odometry information.

One exemplary implementation facilitates object detection using multiple scans of an object in different lighting conditions. For example, a first scan of the object can be created by capturing images of the object by moving an image sensor on a first path in a first lighting condition, e.g., bright lighting. A second scan of the object can then be created by capturing additional images of the object by moving the image sensor on a second path in a second lighting condition, e.g., dim lighting. Implementations determine a transform that associates the scan data from these multiple scans to one another and use the transforms to generate a 3D model of the object in a single coordinate system. Augmented content can be positioned relative to that object in the single coordinate system and thus will be displayed in the appropriate location regardless of the lighting condition in which the physical object is later detected.

Systems and methods are provided for facilitating computer vision tasks (e.g., simultaneous location and mapping) and pass-through imaging include a head-mounted display (HMD) that includes a first set of one or more cameras configured for performing computer vision tasks and a second set of one or more cameras configured for capturing image data of an environment for projection to a user of the HMD. The first set of one or more cameras is configured to detect at least a visible spectrum light and at least a particular band of wavelengths of infrared (IR) light. The second set of one or more cameras includes one or more detachable IR filters configured to attenuate IR light, including at least a portion of the particular band of wavelengths of IR light.