A volumetric display system including a volumetric display for displaying a scene viewable as a three-dimensional floating-in-the-air scene in a display space, enabling a user to reach a first object into the display space, a location determination unit locating real objects in the display space, providing a location of the first object when the first object is inserted into the display space, and a computer for receiving the location of the first object, detecting when the location of the first object is at a location where an object is displayed in the three-dimensional scene, thereby determining that the first object is viewable as touching the displayed object following a detection of the first object viewable as touching the displayed object, producing a new three-dimensional scene displaying the displayed object as if manipulated by the first object. Related apparatus and methods are also described.

There is provided a method of projection using an optical element having spatially variant optical power. The method comprises combining Fourier domain data representative of a 2D image with Fourier domain data having a first lensing effect to produce first holographic data. Light is spatially modulated with the first holographic data to form a first spatially modulated light beam. The first spatially modulated light beam is redirected using the optical element by illuminating a first region of the optical element with the first spatially modulated beam. The first lensing effect compensates for the optical power of the optical element in the first region.

Implementations of various computer methods to couple a computerized ball device which acts as a mobile computing device to record the users environment and project light towards waveguide eyeglasses or contacts which then allows a user to view imbedded light structure holograms in the waveguide while viewing the actual world. The computer ball device additionally has the ability to be docked in a drone cradle which creates a database map of the user's environment while not being utilized by the user for an immediate task. The device may also attach to a wrist band for mobility. The device also has the ability to couple the projected light structures so that a plurality of users may view the same light structure content to build an environment of trust. The device decouples the traditional design of head mounted virtual and mixed reality that place together the camera with the head mounted device.

Systems and method disclosed herein include, among other features, receiving an image for display within a display area of a display system, determining a first image component of the image, calculating a hologram of the image, displaying the hologram on a display device and spatially modulating light in accordance with the displayed hologram, and propagating the spatially modulated light through a pupil expander arranged to provide a plurality of different light propagation paths for the spatially modulated light from the display device to the viewing area, wherein each light propagation path corresponds to a respective continuous region of the image owing to the angular distribution of light from the hologram.

A system for training a machine learning algorithm to generate a plurality of ideal hologram phase correction maps includes a holographic head-up display (HUD) configured to display a plurality of duplicates of a graphic based on a hologram phase map. The system further includes a camera system configured to view each of the plurality of duplicates of the graphic. The system further includes a controller in electrical communication with the holographic HUD and the camera system. The controller is programmed to determine a plurality of ground-truth hologram phase correction maps using a genetic algorithm, the holographic HUD, and the camera system. The controller is further programmed to generate a training dataset including a plurality of images of the graphic and train the machine learning algorithm to generate the plurality of ideal hologram phase correction maps.

A system for displaying a holographic image of an object behind a real object surface, including a computing unit for computing data for displaying a three-dimensional image of an object, a location measurement unit for measuring a location of a surface of a real object, a display for displaying the three dimensional image of the object, wherein the computing unit is adapted to compute data to display the three-dimensional image of the object at least partly behind the surface of the real object. Related apparatus and methods are also described.

Provided are an electronic device for processing computer-generated holography (CGH) and a method thereof. The electronic device generates a plurality of depth layers (computer-generated holography) having different depth information from image data at a first view point, and reprojects each of the plurality of depth layers based on the user's pose information at the second view point different from the first view point to generates CGH.

Provided are an optical element and an image display apparatus that display an aerial image, in which the total volume of the apparatus is small, a reduction in size can realized, and a scenery can be recognized. The optical element includes: a light guide element including a light guide plate, an incidence diffraction element, and an emission diffraction element, the incidence diffraction element being disposed on a main surface of the light guide plate and the emission diffraction element being disposed on the main surface of the light guide plate; and a positive lens that is disposed at a position overlapping the emission diffraction element in a view from a direction perpendicular to the main surface of the light guide plate, in which the incidence diffraction element diffracts incident light such that the diffracted light is incident into the light guide plate, the emission diffraction element emits light propagating in the light guide plate from the light guide plate, and the positive lens collects the light that is emitted from the light guide plate by the emission diffraction element.

Projection displays include a highlight projector and a main projector. Highlights projected by the highlight projector boost luminance in highlight areas of a base image projected by the main projector. Various highlight projectors including steerable beams, holographic projectors and spatial light modulators are described.

A method of displaying a Computer Generated Holographic (CGH) image by a display, including setting pixel values of a Spatial Light Modulator (SLM) included in a Head Mounted Display (HMD), producing a interference based holographic image at a first location by projecting coherent light onto the SLM, and re-imaging the holographic image from the first location to form a holographic image in front of an eye of a viewer wearing the HMD. Related apparatus and methods are also described.