The occlusion is faithfully expressed even in the binocular vision in the AR display by a head mounted display apparatus or the like. A head mounted display apparatus 10 includes a lens 12, a lens 13, a camera 14, a camera 15, and a control processor 16. A CG image for a right eye is displayed on the lens 12. A CG image for a left eye is displayed on the lens 13. The camera 14 captures an image for the right eye. The camera 15 captures an image for the left eye. The control processor 16 generates the CG image for the right eye in which occlusion at the time of seeing by the right eye is expressed and the CG image for the left eye in which occlusion at the time of seeing by the left eye is expressed, based on the images captured by the cameras 14 and 15 and projects the generated CG image for the right eye and CG image for the left eye onto the lenses 12 and 13. A center of a lens of the camera 14 is provided at the same position as a center of the lens 12. A center of a lens of the camera 15 is provided at the same position as a center of the lens 13.

Simulation sighting binoculars include a camera, a screen, a pair of lenses which are arranged to face the screen, and electronic circuitry which is configured to: obtain a video frame from the camera; transmit, to a simulation platform, geolocation information and orientation information for the camera; receive simulation graphical elements and spatial positioning information for corresponding virtual objects; carry out a two-dimensional rendering of the virtual objects, in order to display them in a projection window E2; superimpose the two-dimensional rendering of the virtual objects in the projection window E2 and the video frame in a projection window E3; obtain a mixed-reality stereoscopic image using a pair of virtual cameras reproducing binocular vision which is adapted to the pair of lenses; and carry out, on the screen, a right-eye and left-eye display of the obtained mixed-reality stereoscopic image.

A binocular see-through AR head-mounted display device is disclosed. Based on that the mapping relationships f.sub.c.fwdarw.s and f.sub.d.fwdarw.i are pre-stored in the head-mounted device, the position of the target object in the camera image is obtained through an image tracking method, and is mapped to the screen coordinate system of the head-mounted device for calculating the left/right image display position. Through a monocular distance finding method, the distance between the target object and the camera is real-time calculated referring to the imaging scale of the camera, so as to calculate a left-right image distance, thereby calculating the right or the right image display position. Correspondingly, the present invention also provides an information display method for a binocular see-through AR head-mounted display device and an augmented reality information display system. The present invention is highly reliable with low cost. The conventional depth of field adjustment is to change an image distance of an optical element. However, the present invention breaks conventional thinking, which calculates the left and the right image display positions for depth of field adjustment without changing a structure of an optical device. The present invention is novel and practical compared to changing an optical focal length.

A stereo image matching apparatus includes a processor which includes: a bit distributor distributing values of each pixel of stereo images into sequential N bits and outputting a plurality of stereo images including the sequential N bits; a plurality of cost calculators each receiving the plurality of stereo images and calculating matching cost values for each pixel of each of the stereo images; a confidence calculator calculating a matching confidence by using cost characteristics lit of the respective matching cost values calculated by the plurality of cost calculators; and a depth determiner determining that a depth value of which the matching confidence is high and the matching cost values are relatively low is a final depth value.

An apparatus and method provide logic for processing information. In one implementation, an apparatus includes a display unit configured to display a first stereoscopic image. The first stereoscopic image includes a first and a second content, which may be disposed at corresponding display positions in a depth direction, and at least a portion of the first content appears to overlap at least a portion of the second content. A position-changing unit is configured to modify the display positions of the first and second content, in response to the apparent overlap. A control unit is configured to generate a signal to display, a second stereoscopic image that includes the first and second content disposed at the modified display positions. The display unit is further configured to display the second stereoscopic image such that the second stereoscopic image reduces the apparent overlap between the first and second content.

An apparatus and method provide logic for processing information. In one implementation, an apparatus includes a display unit configured to display a first stereoscopic image. The first stereoscopic image includes a first and a second content, which may be disposed at corresponding display positions in a depth direction, and at least a portion of the first content appears to overlap at least a portion of the second content. A position-changing unit is configured to modify the display positions of the first and second content, in response to the apparent overlap. A control unit is configured to generate a signal to display, a second stereoscopic image that includes the first and second content disposed at the modified display positions. The display unit is further configured to display the second stereoscopic image such that the second stereoscopic image reduces the apparent overlap between the first and second content.

A method of and apparatus configured to perform obtaining a captured image of a real environment. The real environment includes a device having a screen. The captured image includes the device having the screen. The pose of the screen is determined based on the captured image. From a source other than the captured image, 2D content to be displayed on a representation of the screen in the virtual scene is obtained. The 2D content is projected to produce projected 2D content. The projected 2D content aligned to the pose of the screen. The virtual scene is generated as a combination of a virtual content item and the projected 2D content.

A method of and apparatus configured to perform obtaining a captured image of a real environment. The real environment includes a device having a screen. The captured image includes the device having the screen. The pose of the screen is determined based on the captured image. From a source other than the captured image, 2D content to be displayed on a representation of the screen in the virtual scene is obtained. The 2D content is projected to produce projected 2D content. The projected 2D content aligned to the pose of the screen. The virtual scene is generated as a combination of a virtual content item and the projected 2D content.

A head-up display system includes a first projection module, a second projection module, and a first reflective optical element. The first projection module projects a first image. The second projection module projects a second image. The first reflective optical element reflects at least a part of the first image and at least a part of the second image. The first projection module includes a first display panel that displays the first image and projects the first image toward the first reflective optical element. The second projection module includes a second display panel that displays the second image, and an optical system that directs the second image toward the first reflective optical element.

A head-up display system includes a first projection module, a second projection module, and a first reflective optical element. The first projection module projects a first image. The second projection module projects a second image. The first reflective optical element reflects at least a part of the first image and at least a part of the second image. The first projection module includes a first display panel that displays the first image and projects the first image toward the first reflective optical element. The second projection module includes a second display panel that displays the second image, and an optical system that directs the second image toward the first reflective optical element.