An electronic device includes a first camera, a second camera, a display, a memory, and a processor. The processor collects a first image obtained by the first camera with respect to an external object and a second image obtained by the second camera with respect to the external object, generates a third image with respect to the external object using a first area of the first image and a second area of the second image, which corresponds to the first area, identifies an input associated with the third image displayed through the display, and displays an image generated using at least one of the first image, the second image, or depth information in response to the input. The generating operation of the third image includes generating the depth information with respect to the third image.

Techniques are described for passive three-dimensional (3D) image sensing based on chromatic differentiation. For example, an object can be imaged by using a photodetector array to detect light reflected off of the object and focused through a lens onto the array. Light components of different wavelengths tends to be focused through the lens to different focal lengths, which can tend to impact the brightness of each wavelength as detected. For example, if the detector array is closer to a shorter-wavelength focal plane, a white spot will tend to be detected with a higher magnitude of blue light components than of red light components. Ratios of brightness magnitudes for different wavelengths vary in a manner that strongly correlates to object distance from the lens. Embodiments exploit this correlation to passively detect object distance. Some embodiments further provide various types of distance and/or chromatic calibration to further facilitate such detection.

Techniques are described for passive three-dimensional (3D) image sensing based on chromatic differentiation. For example, an object can be imaged by using a photodetector array to detect light reflected off of the object and focused through a lens onto the array. Light components of different wavelengths tends to be focused through the lens to different focal lengths, which can tend to impact the brightness of each wavelength as detected. For example, if the detector array is closer to a shorter-wavelength focal plane, a white spot will tend to be detected with a higher magnitude of blue light components than of red light components. Ratios of brightness magnitudes for different wavelengths vary in a manner that strongly correlates to object distance from the lens. Embodiments exploit this correlation to passively detect object distance. Some embodiments further provide various types of distance and/or chromatic calibration to further facilitate such detection.

A stereo imaging system comprises a stereoscopic camera having left and right image capturing elements for capturing stereo images; a stereo viewer; and a processor configured to modify the stereo images prior to being displayed on the stereo viewer so that a disparity between corresponding points of the stereo images is adjusted as a function of a depth value within a region of interest in the stereo images after the depth value reaches a target depth value.

A stereo imaging system comprises a stereoscopic camera having left and right image capturing elements for capturing stereo images; a stereo viewer; and a processor configured to modify the stereo images prior to being displayed on the stereo viewer so that a disparity between corresponding points of the stereo images is adjusted as a function of a depth value within a region of interest in the stereo images after the depth value reaches a target depth value.

Disclosed herein is a method for encoding an immersive image. The method includes detecting a non-diffuse surface in a first texture image of a first view, generating an additional texture image from the first texture image based on the detected non-diffuse surface, performing pruning on the additional texture image based on a second texture image of a second view, generating a texture atlas based on the pruned additional texture image, and encoding the texture atlas.

Disclosed herein is a method for encoding an immersive image. The method includes detecting a non-diffuse surface in a first texture image of a first view, generating an additional texture image from the first texture image based on the detected non-diffuse surface, performing pruning on the additional texture image based on a second texture image of a second view, generating a texture atlas based on the pruned additional texture image, and encoding the texture atlas.

A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

A binocular see-through AR head-mounted display device is disclosed. Based on that the mapping relationships f.sub.c.fwdarw.s and f.sub.d.fwdarw.i are pre-stored in the head-mounted device, the position of the target object in the camera image is obtained through an image tracking method, and is mapped to the screen coordinate system of the head-mounted device for calculating the left/right image display position. Through a monocular distance finding method, the distance between the target object and the camera is real-time calculated referring to the imaging scale of the camera, so as to calculate a left-right image distance, thereby calculating the right or the right image display position. Correspondingly, the present invention also provides an information display method for a binocular see-through AR head-mounted display device and an augmented reality information display system. The present invention is highly reliable with low cost. The conventional depth of field adjustment is to change an image distance of an optical element. However, the present invention breaks conventional thinking, which calculates the left and the right image display positions for depth of field adjustment without changing a structure of an optical device. The present invention is novel and practical compared to changing an optical focal length.

A stereo image matching apparatus includes a processor which includes: a bit distributor distributing values of each pixel of stereo images into sequential N bits and outputting a plurality of stereo images including the sequential N bits; a plurality of cost calculators each receiving the plurality of stereo images and calculating matching cost values for each pixel of each of the stereo images; a confidence calculator calculating a matching confidence by using cost characteristics lit of the respective matching cost values calculated by the plurality of cost calculators; and a depth determiner determining that a depth value of which the matching confidence is high and the matching cost values are relatively low is a final depth value.