Disclosed are transparent energy relay waveguide systems for the superimposition of holographic opacity modulation states for holographic, light field, virtual, augmented and mixed reality applications. The light field system may comprise one or more energy waveguide relay systems with one or more energy modulation elements, each energy modulation element configured to modulate energy passing therethrough, whereby the energy passing therethrough may be directed according to 4D plenoptic functions or inverses thereof.

A first environment image of a first video environment and a first video record of a subject in the first video environment may be received from a computing device in a fixed position. Based on the first environment image and the first video record, data may be determined. The data may represent the subject separated from one or more features of the first video environment visible in the first video environment. Based on the data, a digital hologram of the subject may be caused to be represented in a second video environment.

Disclosed are relay elements exhibiting transverse localization. The relay elements may include a relay element body having one or more structures, where the structures can be coupled in series, in parallel and/or in stacked configurations. The structures may have multiple surfaces such that energy waves propagating therethrough the relay elements may experience spatial magnification or de-magnification.

A method for processing a three-dimensional holographic image includes obtaining depth images from depth data of a three-dimensional object, dividing each of the depth images into a predetermined number of sub-images, obtaining interference patterns of computer-generated hologram (CGH) patches corresponding to each of the sub-images by performing a Fourier transform to calculate an interference pattern in a CGH plane for object data included in each of the sub-images, and generating a CGH for the three-dimensional object using the obtained interference patterns of the CGH patches.

A display system arranged to receive a video stream of frames for display. The frame rate of the video stream is defined by a first clock signal comprising a plurality of first clock reset signals (between frames). A subframe rate of the display system is defined by a second clock signal comprising a plurality of second clock reset signals (between subframes). The second clock reset signals define n subframes for each frame of the video stream. That is, the subframe rate of the display system is n times faster than the frame rate of the video stream. The display system is arranged so that duration of every nth second clock reset signal is different to the duration of the other second clock reset signals such that synchronization between frames of the video stream and subframes of the display device is maintained.

A holographic display and method for operating the holographic display can include: a holographic display operable in a plurality of modes, a computing system, and a sensor. The holographic display can option include a user interface device. Views displayed by the display can optionally be processed or modified based on a viewer pose relative to the display.

Disclosed are systems and methods for manufacturing energy relays for energy directing systems and Transverse Anderson Localization. Systems and methods include providing first and second component engineered structures with first and second sets of engineered properties and forming a medium using the first component engineered structure and the second component engineered structure. The forming step includes randomizing a first engineered property in a first orientation of the medium resulting in a first variability of that engineered property in that plane, and the values of the second engineered property allowing for a variation of the first engineered property in a second orientation of the medium, where the variation of the first engineered property in the second orientation is less than the variation of the first engineered property in the first orientation.

Disclosed embodiments include an energy waveguide system having an array of waveguides and an energy inhibiting element configured to substantially fill a waveguide element aperture and selectively propagate energy along some energy propagation paths through the array of waveguides. In an embodiment, such an energy waveguide system may define energy propagation paths through the array of waveguides in accordance to a 4D plenoptic system. In an embodiment, energy propagating through the energy waveguide system may comprise energy propagation for stimulation of any sensory receptor response including visual, auditory, somatosensory systems, and the waveguides may be incorporated into a holographic display or an aggregated bidirectional seamless energy surface capable of both receiving and emitting two-dimensional, light field or holographic energy through waveguiding or other 4D plenoptic functions prescribing energy convergence within a viewing volume. The waveguides may include different structures configured for each or all sensory system or energy domain to direct energy through refraction, diffraction, reflection, or other approaches of affecting the propagation paths of energy.

Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for head tracking for video communications in a virtual environment. The system may provide a video conference session in a virtual environment. The system may provide a digital representation of the video conference participant in the virtual environment. The system may display one or more views of the virtual environment in the video conference. The system may track movement of the video conference participant to generate user movement information and may display movement of the video conference participant on the digital representation.

Energy systems are configured to direct energy according to a four-dimensional (4D) plenoptic function. In general, the energy systems include a plurality of energy devices, an energy relay system having one or more relay elements arranged to form a singular seamless energy surface, and an energy waveguide system such that energy can be relayed along energy propagation paths through the energy waveguide system to the singular seamless energy surface or from the singular seamless energy surface through the energy relay system to the plurality of energy devices.