The technology disclosed relates to relates to providing command input to a machine under control. It further relates to gesturally interacting with the machine. The technology disclosed also relates to providing monitoring information about a process under control. The technology disclosed further relates to providing biometric information about an individual. The technology disclosed yet further relates to providing abstract features information (pose, grab strength, pinch strength, confidence, and so forth) about an individual.

Systems and methods for displaying an image across a plurality of displays are described herein. Pixel intensity values in the multifocal display are determined using correlation values and numerical iterations. An eye tracking system measures eye tracking information about a position of a user's eye, and the pixel intensity values are modified based on the eye tracking information. An image is displayed on the plurality of displays based on the determined pixel intensity values. The plurality of displays may be within an HMD, and address vergence accommodation conflict by simulating retinal defocus blur.

An information processing apparatus acquires an image by imaging an imaging apparatus, detects an occurrence of a factor that influences a position and orientation estimation relating to an image, determines whether or not to register the acquired image based on the detected factor, and constructs an image database for estimating the position and orientation of the imaging apparatus from the image acquired by the acquisition unit using a group of images determined to be registered.

An information processing apparatus acquires an image by imaging an imaging apparatus, detects an occurrence of a factor that influences a position and orientation estimation relating to an image, determines whether or not to register the acquired image based on the detected factor, and constructs an image database for estimating the position and orientation of the imaging apparatus from the image acquired by the acquisition unit using a group of images determined to be registered.

Techniques are disclosed for drift correction for camera tracking. In some cases, the techniques include iterative optimization of the camera poses at selected keyframes captured along the camera trajectory to reduce pose errors. Such iterative optimization may include performing an alignment process using the point cloud of a given keyframe and a point cloud made from one or more overlapping keyframes, such as via an iterative closest point (ICP)-based expectation maximization. The keyframes may then be fused to reconstruct a more accurate model of the scene, discarding the existing model. The new model can then be used for tracking and meshing. In some instances, keyframes may be selected such that the overlap with other keyframes includes enough shape features to allow for alignment with the keyframe depth point cloud. In some cases, the techniques can be performed in a particular order giving precedence to keyframes having smaller pose errors.

Techniques are disclosed for drift correction for camera tracking. In some cases, the techniques include iterative optimization of the camera poses at selected keyframes captured along the camera trajectory to reduce pose errors. Such iterative optimization may include performing an alignment process using the point cloud of a given keyframe and a point cloud made from one or more overlapping keyframes, such as via an iterative closest point (ICP)-based expectation maximization. The keyframes may then be fused to reconstruct a more accurate model of the scene, discarding the existing model. The new model can then be used for tracking and meshing. In some instances, keyframes may be selected such that the overlap with other keyframes includes enough shape features to allow for alignment with the keyframe depth point cloud. In some cases, the techniques can be performed in a particular order giving precedence to keyframes having smaller pose errors.

A method and an apparatus for displaying a panorama image in an electronic device are provided. A method for operating an electronic device according to the present disclosure includes displaying a first image generated based on a plurality of image frames, determining a gazing region on the first image, when the gazing region covers at least part of a seam, realigning the image frames based on at least one feature point of the gazing region, and displaying a second image generated through the realignment. The electronic device can provide a high-quality registered image to the user by adaptively stitching the displayed images by considering the user's gazing region.

A method and an apparatus for displaying a panorama image in an electronic device are provided. A method for operating an electronic device according to the present disclosure includes displaying a first image generated based on a plurality of image frames, determining a gazing region on the first image, when the gazing region covers at least part of a seam, realigning the image frames based on at least one feature point of the gazing region, and displaying a second image generated through the realignment. The electronic device can provide a high-quality registered image to the user by adaptively stitching the displayed images by considering the user's gazing region.

A method and system are described. The method includes capturing a set of images from a 22 array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from a fifth camera, the fifth camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of four images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.

A method and system are described. The method includes capturing a set of images from a 22 array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from a fifth camera, the fifth camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of four images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.