A display system includes a waveguide plate comprising an in-coupling grating, an expansion grating, and a sampling grating. The display system includes a projection system configured to direct input light toward the in-coupling grating. The in-coupling grating is configured to diffract the input light to propagate within the waveguide plate. The in-coupling grating is configured to (i) cause a display portion of the input light to propagate toward the expansion grating in a manner that avoids diffraction by the expansion grating and (ii) cause a sampling portion of the input light to propagate toward the sampling grating. The expansion grating is configured to (i) diffract the display portion of the input light to cause the display portion of the input light to continue to propagate within the waveguide plate. The sampling grating is configured to diffract the sampling portion of the input light outward from the waveguide plate.

In one embodiment, a computing system may determine, determine an estimated distance of an eye of a user to a display plane of a display. The system may access correction maps corresponding to a number of reference distances to the display plane of the display. The system may select a first reference distance and a second reference distance based on the estimated distance. The system may generate a custom correction map for the user based on an interpolation of a first correction map corresponding to the first reference distance and a second correction map corresponding to the second reference distance. The system may adjust an image to be displayed on the display using the custom correction map. The custom correction map may correct non-uniformity of the display as viewed from the eye of the user. The system may display the image adjusted using the custom correction map on the display.

Embodiments of the present disclosure provide methods for implementing a mixed reality system with less power. In some examples, a passive state of the mixed reality system can have a GPU render predictable content that does not need to be processed by a CPU. In such examples, the predictable content can be identified and rendered by the GPU while the CPU is in a low-power mode. Accordingly, embodiments of the present disclosure provide benefits not available with conventional techniques because a CPU may consume more power than a corresponding GPU. In some examples, the passive state can take advantage of the fact that predictable content can be identified and rendered without the use of the CPU. In such examples, the passive state can render predictable content that does not need to be processed by the CPU.

Provided is a virtual tourism method which includes: detecting, by a virtual tourism client device, a change of a viewing direction of a user in real time, generating viewing direction information of the user according to the change of the viewing direction, wherein the viewing direction change is a change of a current viewing direction of the user with respect to a reference viewing direction; and obtaining, a part of video image data corresponding to the current viewing direction of the user from stored panoramic video image data according to the viewing direction information of the user and playing the part of the video image data.

A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes by determining whether features of the eye are at certain vertical positions relative to the HMD. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, and provides feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.

A near-eye display system including an optics module coupled with an electronics module having a controller. Wherein the optics module includes a planar waveguide operable to display virtual images, and a camera operable to capture pictures and videos. The planar waveguide coupled with the camera via the optics module, whereby a first view through the planar waveguide is oriented to be the same as a second view by the camera.

A headset for augmented reality applications is provided. The headset includes at least one eyepiece configured to provide a see-through image to a user via a transparent optical component, and to provide an artificial image through a display, and a dimming shutter configured to adjust a transparency level of the transparent optical component. The dimming shutter further includes an active liquid crystal layer configured to adjust a transparency level according to an electrical power provided between two electrodes, and a photoactive layer configured to adjust the transparency level upon absorption of an ultraviolet radiation for a selected period of time. A default orientation of a host material in the active liquid crystal layer may be in a dark state or in a clear state, when no electrical power is provided. A method and a memory storing instructions to execute the method for use of the above device are also provided.

While head-mountable devices can provide immersive experiences, a user wearing a head-mountable device can also benefit from activities that include body motion and promote the user's health. Because such activities may not be intrinsically necessary to the operation of head-mountable devices, it can be beneficial to provide additional or modified operations that allow a user to continue operation of a head-mountable device while performing the desired body motions. The head-mountable device can detect movement and/or stasis of the user and determine whether motion would be recommended. Upon determining that motion, an additional motion, or a different motion would be beneficial, the head-mountable device can provide an output to the user that promote such motions. The output can include a notification to the user and/or a modification of the user interface that encourages the user to move in a particular way.

An image processing device of an embodiment includes a control unit that generates a composite image and outputs the composite image to a display device, the composite image being acquired by combination of a first image captured in first exposure time and having first resolution, and a second image that is an image corresponding to a part of a region of the first image, and that is captured in second exposure time shorter than the first exposure time and has second resolution higher than the first resolution, the first image and the second image being input from an image sensor.

A system for displaying a stereo image is disclosed. The system includes a stereoscopic head up display (HUD) that includes a combiner and a display configured to display a stereo image. The system further includes either a head tracking sensor or an eye tracking sensor configured to generate a tracking dataset. The system further includes a processor and a memory with instructions that cause the processor to receive the tracking dataset, generate a distortion map based on the tracking dataset and a distortion function, receive a media stereo image, generate a stereo signal based on the distortion map and the media stereo image, and transmit the stereo signal to the display. The system is capable of conveying an image to an operator in the absence of a relay lens.