Methods and systems for depth-based foveated rendering in the display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include monitoring eye orientations of a user of a display system based on detected sensor information. A fixation point is determined based on the eye orientations, the fixation point representing a three-dimensional location with respect to a field of view. Location information of virtual objects to present is obtained, with the location information indicating three-dimensional positions of the virtual objects. Resolutions of at least one virtual object is adjusted based on a proximity of the at least one virtual object to the fixation point. The virtual objects are presented to a user by display system with the at least one virtual object being rendered according to the adjusted resolution.

A method includes displaying, on a display, a representation of a physical environment and a computer-generated object. The method includes generating a three-dimensional (3D) point cloud associated with the representation of the physical environment. The method includes obtaining depth information characterizing the physical environment. The method includes obtaining a capture event associated with a capture region within the representation of the physical environment. The capture region includes a portion of the computer-generated object. The method includes, in response to obtaining the capture event, disambiguating a group of points from the 3D point cloud, and generating, based on a function of the depth information and the group of points, a volumetric representation of the capture region. The group of points satisfies a spatial threshold with respect to the capture region. The volumetric representation includes a volumetric representation of the portion of the computer-generated object.

A method includes displaying, on a display, a representation of a physical environment and a computer-generated object. The method includes generating a three-dimensional (3D) point cloud associated with the representation of the physical environment. The method includes obtaining depth information characterizing the physical environment. The method includes obtaining a capture event associated with a capture region within the representation of the physical environment. The capture region includes a portion of the computer-generated object. The method includes, in response to obtaining the capture event, disambiguating a group of points from the 3D point cloud, and generating, based on a function of the depth information and the group of points, a volumetric representation of the capture region. The group of points satisfies a spatial threshold with respect to the capture region. The volumetric representation includes a volumetric representation of the portion of the computer-generated object.

Some embodiments of a method may include: identifying two-dimensional (2D) content present in an image of a real-world scene; retrieving metadata comprising depth information associated with the 2D content; generating a plurality of focal plane images using the metadata, the plurality of focal plane images comprising depth cues for the 2D content; and displaying the plurality of focal plane images as a see-through overlay synchronized with the 2D content.

Some embodiments of a method may include: identifying two-dimensional (2D) content present in an image of a real-world scene; retrieving metadata comprising depth information associated with the 2D content; generating a plurality of focal plane images using the metadata, the plurality of focal plane images comprising depth cues for the 2D content; and displaying the plurality of focal plane images as a see-through overlay synchronized with the 2D content.

An image processing device, including an image generation circuit and a multifocal length processing circuit, is provided. The image generation circuit generates multiple depth plane images with depth information and multiple corresponding zoom control information, and merges the multiple depth plane images and the multiple zoom control information according to an arrangement rule, to be a merged image data. The multifocal length processing circuit is configured to decompose the merged image data to restore the multiple depth plane images and the corresponding multiple zoom control information according to the arrangement rule, and to determine a time at which the restored multiple depth plane images are transmitted to a display device and a time at which the restored multiple zoom control information are transmitted to a zoom lens according to a frame rate of the display device. The disclosure also provides an image processing method and a 3D image generation system.

An image processing device, including an image generation circuit and a multifocal length processing circuit, is provided. The image generation circuit generates multiple depth plane images with depth information and multiple corresponding zoom control information, and merges the multiple depth plane images and the multiple zoom control information according to an arrangement rule, to be a merged image data. The multifocal length processing circuit is configured to decompose the merged image data to restore the multiple depth plane images and the corresponding multiple zoom control information according to the arrangement rule, and to determine a time at which the restored multiple depth plane images are transmitted to a display device and a time at which the restored multiple zoom control information are transmitted to a zoom lens according to a frame rate of the display device. The disclosure also provides an image processing method and a 3D image generation system.

A texture projecting light bulb includes an extended light source located within an integrator. The integrator includes at least one aperture configured to allow light to travel out of the interior of the integrator. In various embodiments, the interior of the integrator may be a diffusely reflective surface and the integrator may be configured to produce a uniform light distribution at the aperture to approximate a point source. The integrator may be surrounded by a light bulb enclosure. In various embodiments, the light bulb enclosure may include transparent and opaque regions configured to project a structured pattern of visible and/or infrared light.

A three-dimensional (3D) display apparatus, display module, and a manufacturing method thereof, are provided. The 3D display apparatus includes a display module including a first display panel configured to display a two-dimensional (2D) image, a second display panel disposed in front of the first display panel and spaced apart from the first display panel, and configured to display another 2D image that when combined with the 2D image displayed by the first display panel generates a 3D image, and a spacing panel comprising a rear surface on which the first display panel is attached and a front surface on which the second display panel is attached, the spacing panel providing an amount of space between the first display panel and the second display panel.

Methods and systems for generating stereoscopic content with granular control over binocular disparity based on multi-perspective imaging from representations of light fields are provided. The stereoscopic content is computed as piecewise continuous cuts through a representation of a light field, minimizing an energy reflecting prescribed parameters such as depth budget, maximum binocular disparity gradient, desired stereoscopic baseline. The methods and systems may be used for efficient and flexible stereoscopic post-processing, such as reducing excessive binocular disparity while preserving perceived depth or retargeting of already captured scenes to various view settings. Moreover, such methods and systems are highly useful for content creation in the context of multi-view autostereoscopic displays and provide a novel conceptual approach to stereoscopic image processing and post-production.