Methods and systems for presenting an object on a screen of a head mounted display (HMD) include receiving an image of a real-world environment in proximity of a user wearing the HMD. The image is received from one or more forward facing cameras of the HMD and processed for rendering on a screen of the HMD by a processor within the HMD. A gaze direction of the user wearing the HMD, is detected using one or more gaze detecting cameras of the HMD that are directed toward one or each eye of the user. Images captured by the forward facing cameras are analyzed to identify an object captured in the real-world environment that is in line with the gaze direction of the user, wherein the image of the object is rendered at a first virtual distance that causes the object to appear out-of-focus when presented to the user. A signal is generated to adjust a zoom factor for lens of the one or more forward facing cameras so as to cause the object to be brought into focus. The adjustment of the zoom factor causes the image of the object to be presented on the screen of the HMD at a second virtual distance that allows the object to be discernible by the user.

A partial electronic see-through HMD includes one or more subassemblies that occlude a central portion of a user's field of view (the peripheral portions of the user's field of view may remain unobstructed). Each subassembly includes an outward facing camera, a display, and an eyepiece. Images of the occluded central zone are captured by the camera and projected to the user via the display and eyepiece. The projected images can also include electronic information, such as AR image overlays. The peripheral zones are not occluded and remain directly viewable by the user. Thus, the projected images complete (or partially complete) the user's FOV of the external environment between the peripheral zones and may provide additional electronic information to the user.

A virtual or augmented reality display system that controls power inputs to the display system as a function of image data. Image data itself is made of a plurality of image data frames, each with constituent color components of, and depth planes for displaying on, rendered content. Light sources or spatial light modulators to relay illumination from the light sources may receive signals from a display controlled to adjust a power setting to the light source or spatial light modulator based on control information embedded in an image data frame.

The present invention is directed to an optical device for augmented reality using total internal reflection, the optical device including: an optical means for transmitting at least part of real object image light toward the pupil of an eye of a user; wherein a total internal reflection space configured to transfer augmented reality image light, output from an image output unit, toward the pupil of the eye of the user is formed inside the optical means; and wherein the total internal reflection space is filled with a medium having an index of refraction lower than the index of refraction of the optical means, and the augmented reality image light transferred to the total internal reflection space through the inside of the optical means is reflected by total internal reflection on the total internal reflection space and then transferred toward the pupil of the eye of the user.

The disclosed liquid lens array may include a plurality of independently operable array sections, each of which may include (1) a base layer, (2) an aperture plate overlapping the base layer, the aperture plate defining a plurality of apertures extending through the aperture plate between an inner surface of the aperture plate facing the base layer and an outer surface of the aperture plate, (3) a liquid reservoir disposed between the base layer and the aperture plate, and (4) a side wall at least partially surrounding the liquid reservoir, the side wall extending between the base layer and the aperture plate. At least a portion of at least one of the base layer or the side wall may be deformable in the presence of an electrostatic field to change liquid volumes extending from the liquid reservoir at least partially through the apertures defined in the aperture plate. Various other methods, systems, and devices are also disclosed.

Imaging systems projecting augmented information on a physical object that at a minimum include a processor, a memory device operably connected to the processor, a projector operably coupled to the processor, and a distance-measuring device operably connected to the processor. The memory device stores augmented image information, and the processor is configured to project augmented image information onto the physical object. The distance-measuring device is configured to measure the distance to the physical object. The processor uses distance measurement information from the distance measuring device to adjust scaling of the augmented image information. The processor provides the scale adjusted augmented image information to the projector. System can also be used for fluorescence imaging during open surgery, for endoscopic fluorescence imaging and for registration of surgical instruments.

An imaging system includes an image realisation device, and projection optics for rendering a display image on a display screen. The image realisation device includes an image realisation surface and a light structuring device having a surface with a first and second region. The light structuring device simulates a first lens on the first region of the surface. A first source image formed on a first region of the image realisation surface and projected through the projection optics renders a first display image on the display screen at a first apparent depth. The light structuring device simulates a second lens on the second region of the surface. A second source image formed on a second region of the image realisation surface and projected through the projection optics renders a second display image on the display screen at a second apparent depth. The first and second lens are independently configurable.

A near-eye light field display device includes a plurality of sub-aperture light field emitting modules and a bi-telecentric lens group. The plurality of sub-aperture light field emitting modules are adapted to generate a plurality of sub-aperture light fields. The bi-telecentric lens group is disposed on one side of the plurality of sub-aperture light field emitting modules, wherein the plurality of sub-aperture light fields pass through the bi-telecentric lens group and are converted into an exit light field by the bi-telecentric lens group, and the exit light field is incident on a receiver.

Diffraction gratings provide optical elements in head-mounted display systems to, e.g., incouple light into or out-couple light out of a waveguide. These diffraction gratings may be configured to have reduced polarization sensitivity. Such gratings may, for example, incouple or outcouple light of different polarizations with similar level of efficiency. The diffraction gratings and waveguides may include a transmissive layer and a metal layer. The diffraction grating may comprises a blazed grating.

In some embodiments, an augmented reality system includes at least one waveguide that is configured to receive and redirect light toward a user, and is further configured to allow ambient light from an environment of the user to pass therethrough toward the user. The augmented reality system also includes a first adaptive lens assembly positioned between the at least one waveguide and the environment, a second adaptive lens assembly positioned between the at least one waveguide and the user, and at least one processor operatively coupled to the first and second adaptive lens assemblies. Each lens assembly of the augmented reality system is selectively switchable between at least two different states in which the respective lens assembly is configured to impart at least two different optical powers to light passing therethrough, respectively. The at least one processor is configured to cause the first and second adaptive lens assemblies to synchronously switch between different states in a manner such that the first and second adaptive lens assemblies impart a substantially constant net optical power to ambient light from the environment passing therethrough.