A volume holographic film (such as a photopolymer) that is pre-recorded with patterns subsequently is used to encode LED or low-power laser light reflections from an eye into a binary pattern that can be read at very high speeds by a relatively simple complementary metal-oxide-semiconductor (CMOS) sensor that may be similar to a high framerate, low resolution mouse sensor. The low-resolution mono images from the film are translated into eye poses using, for instance, a look up table that correlates binary patterns to X, Y positions or using a pre-trained convolutional neural network to robustly interpret many variations of the binary patterns for conversion to X, Y positions.

Structured light is projected onto an object, and an image of the object as illuminated by the projected structured light is captured. Reference object points are identified within the captured image, and the structured light projected onto the object is modified based on the identified reference object points. An additional image of the object as illuminated by the modified projected structured light is captured, and additional reference object points are identified within the captured additional image.

Structured light is projected onto an object, and an image of the object as illuminated by the projected structured light is captured. Reference object points are identified within the captured image, and the structured light projected onto the object is modified based on the identified reference object points. An additional image of the object as illuminated by the modified projected structured light is captured, and additional reference object points are identified within the captured additional image.

An apparatus projecting light onto a projection surface comprises: a substrate having disposed thereon two or more LED clusters and two or more micro-lenses, each LED cluster comprising a plurality of LEDs and each of the micro-lenses being disposed the plurality of LEDs. Each of the LED clusters is arranged to emit light through each of the micro-lenses in a pattern of dots. A center of at least one LED cluster is off-set from an optical center of the micro-lens of its LED cluster. A projected image includes arrangements of individual dots and/or areas of smooth light resulting from the pattern of dots.

A method for depth sensing from an image of a projected pattern is performed at an electronic device with one or more processors and memory. The method includes receiving an image of a projection of an illumination pattern; for a portion of the image, selecting a candidate image of a plurality of candidate images by comparing the portion of the image with a plurality of candidate images; and determining a depth for the portion of the image based on depth information associated with the selected candidate image. Related electronic devices and computer readable storage medium are also disclosed.

The present invention discloses a depth sensing method, device and system based on symbols array plane structured light. The coded symbols array pattern is projected by the laser pattern projector to the target object or space, and the image sensor collects and obtains the successive sequence of the encoded image of the input symbols. Firstly, the input image encoded with the symbols is decoded. The decoding process includes preprocessing, symbols location, symbols recognition and symbols correction. Secondly, the disparity of the decoded symbols are calculated by the symbols match calculation between the decoded image of the input symbols with completed symbols recognition and the decoded image of the reference symbols with the known distance. Finally the depth calculation formula is combined to generate depth point cloud information of the target object or projection space that is represented in the form of grid. The present invention can quickly obtain high-resolution and high-precision depth information of the target object or projection space in dynamic scenes, which facilitates the porting or insertion as a module into the intelligent device for 3D modeling, 3D mapping, etc.

A mobile robot of the present disclosure includes a first pattern emission unit configured to emit a first patterned light downward and forward from the main body on a floor of an area to be cleaned; and an image acquisition unit configured to acquire an image of first patterned light emitted by the first pattern emission unit and incident on an obstacle. A pattern is detected from the acquired image to determine an obstacle, and a cliff is detected based on at least one of a shape or a position of the pattern in the image. The mobile robot may identify a travel path that does not lead to the cliff.

A method and system for inspecting an aircraft for defects. The system comprises a plurality of cameras and projectors mounted on a structural inspection frame for imaging substantially the entire exterior surface of the aircraft. The projectors can project structured light patterns onto an exterior surface of the aircraft so that the camera system can capture a three-dimensional map of the exterior surface of the aircraft. Image processing systems can compare the captured three-dimensional map with an approved reference model of the aircraft to determine if there are defects or damage to the surface of the aircraft. The system may be configured for use with a particular aircraft model or a plurality of aircraft models. If exterior defects or damage is found, the system can project reference patterns or data onto the surface of the aircraft to aid in visual inspection of the potentially damaged portions of the aircraft.

A method and system for inspecting an aircraft for defects. The system comprises a plurality of cameras and projectors mounted on a structural inspection frame for imaging substantially the entire exterior surface of the aircraft. The projectors can project structured light patterns onto an exterior surface of the aircraft so that the camera system can capture a three-dimensional map of the exterior surface of the aircraft. Image processing systems can compare the captured three-dimensional map with an approved reference model of the aircraft to determine if there are defects or damage to the surface of the aircraft. The system may be configured for use with a particular aircraft model or a plurality of aircraft models. If exterior defects or damage is found, the system can project reference patterns or data onto the surface of the aircraft to aid in visual inspection of the potentially damaged portions of the aircraft.

A projection video display device includes: a projection unit projecting a display video upon a projection surface; an image capture unit; detection units detecting the states of manipulation objects which carry out actions for the input manipulation; a manipulation instruction information generating unit, on the basis of the states of the manipulation objects which the detection units have detected, generating manipulation instruction information indicating a description of the input manipulation; and a communication unit connecting to the information processing device. The detection units detect movements of manipulation objects and attributes which represent the states of manipulation objects other than the movements. The manipulation instruction information generating unit generates, first control information for carrying out the pointer manipulation input upon the information processing device, and, on the basis of the attributes of the manipulation objects, second control information for carrying out a prescribed key input upon the information processing device.