A display device including a display to generate a real image, and an optical system. The optical system includes a plurality of lenslets, each having one cluster of object pixels, where the assignation of object pixels to clusters may change periodically in time intervals. Each lenslet produces a ray pencil from each object pixel of its cluster which has waists laying close to a waist surface. The ray pencils are projected towards an eye position. The ray pencils are configured to generate a partial virtual image from the real image of its corresponding cluster. At least two of the lenslets cannot be made to coincide by a simple translation rigid motion. Foveal rays are a subset of rays emanating from the lenslets.

An extended field-of-view near-to-eye display system provides for AR/MR image viewing over about a 180° FOV. The display system may include a multiplicity of display panels per eye of a user and may include both high- and low-resolution display capabilities. The high-resolution displays may be positioned in front of the user's eyes in their primary visual field while the low-resolution displays may be positioned so as to be seen by the user's peripheral vision. The low-resolution displays provide cueing information to the user out to the limit of visual perception (for each eye), placing encoded light and movement in the periphery of the user's vision for enhanced situational awareness.

A display apparatus comprises a mirror assembly, a first mirror of the mirror assembly oscillating about a first axis upon excitation by a first excitation signal and the first or a second mirror of the mirror assembly oscillating about a second axis upon excitation by a second excitation signal, a light source projecting a light beam onto the mirror assembly for deflection by the mirror assembly towards an image area, the light source being controlled according to pixels of image frames, a gaze tracker detecting a user's region of interest, ROI, within the image area, and a controller modulating one of the excitation signals by a first modulation signal which is dependent on the ROI detected by the gaze tracker.

A method of compressing image data representing one or more images, the method including obtaining pixel data from the image data, the pixel data representing an pixel array within the one or more images, applying a transformation to the pixel data to determine a set of frequency coefficients indicative of frequency coefficients of the pixel array, encoding a selected subset of the set of frequency coefficients, generating an index indicative of the encoded frequency coefficients and generating compressed image data using the encoded frequency coefficients and the index.

In one embodiment, a computing system may determine, a predicted eye position of a viewer corresponding to a future time moment for displaying a frame. The system may generate a first correction map for the frame based on the predicted eye position of the viewer. The system may retrieve one or more second correction maps used for correcting one or more proceeding frames. The system may generate a third correction map based on the first correction map generated based on the predicted eye position of the viewer and the one or more second correction maps used for correcting the one or more proceeding frames. The system may adjust pixel values of the frame based at least on the third correction map. The system may output the frame with the adjusted pixel values to a display.

A headset for virtual reality imaging is provided. The headset includes a first display configured to generate multiple light beams from a central portion of a field of view in an image provided to a user, a first optical element configured to provide the light beams forming a central portion of the field of view through an eyebox of the headset that limits a volume including a pupil of the user, and a second display configured to provide a peripheral portion of the field of view for the image through the eyebox, wherein the second display includes multiple light emitting pixels arranged in a two-dimensional surface. A system and a method for using the above headset are also provided.

Disclosed herein are related to a system and a method for providing an artificial reality. In one aspect, a system includes a shared physical memory and a first processor having access to the shared physical memory. In one aspect, the first processor performs, during a first time period, a first rendering process to generate a first image frame of a first view of an artificial reality. In one aspect, the first processor performs, during a second time period, a second rendering process to generate a second image frame of a second view of the artificial reality. In one aspect, the system includes a second processor including a neural network and having access to the shared physical memory. In one aspect, the second processor performs, during a third time period overlapping a portion of the second time period, an image enhancing process on the first image frame.

A near-to-eye display apparatus includes a plurality of pixel island groups. Each pixel island group includes a plurality of pixel islands. Each pixel island corresponds to a micro lens. By adjusting a position of the micro lens relative to the corresponding pixel island in the pixel island group, on a plane where the micro lenses are located, or a position, of the pixel island in the pixel island group relative to the corresponding micro lens, on a plane where the pixel islands are located, imaging points in the imaging regions formed by at least part of different pixel islands in the pixel island groups do not overlap with each other and are arranged alternately.

A method for providing a personalized augmented reality (AR) display includes obtaining, at an augmented reality apparatus, image data of a camera field of view, the camera field of view covering a field of view of an externally oriented camera of the augmented reality apparatus, identifying a first object in the camera field of view based on the image data, and mapping a position of the first object relative to an augmented reality (AR) field of view. The method further includes determining, based on the identity of the first object, whether the first object is an augmentation target, and responsive to determining that the first object is the augmentation target, displaying, on the internally-facing display, an item of AR content associated with the augmentation target in the AR field of view.

A display device, a display method thereof, and a display system. The display device includes at least two display screens; and a light transmission portion, configured to transmit image light emitted by the at least two display screens to a predetermined region. The at least two display screens or the light transmission portion is configured to be movable, so that distances from image planes imaged by the at least two display screens through the light transmission portion to the predetermined region can be adjusted independently.