HEAD MOUNTED DISPLAY USING SPATIAL LIGHT MODULATOR TO GENERATE A HOLOGRAPHIC IMAGE
20170255013 ยท 2017-09-07
Inventors
Cpc classification
G02B2027/013
PHYSICS
G03H2227/02
PHYSICS
G03H1/2294
PHYSICS
G02B2027/0152
PHYSICS
International classification
G03H1/22
PHYSICS
Abstract
A head mounted display device includes a light source that emits a high coherence light beam, a beam expansion/diverging element that expands the light beam emitted by the light source, and a beam converging element that converges the expanded light beam into a viewing zone. The light beam from the beam converging element is incident onto a spatial light modulator (SLM), and the SLM is configured to add a phase pattern and/or an amplitude pattern to the light beam to generate a virtual image that is visible to a user wearing the head mounted display device. The light converging element creates a beam or scanning beam axis that converges towards the eye, which enables a large field of view for a virtual or holographic image to be displayed.
Claims
1. A head mounted display device comprising: a light source that emits a high coherence light beam; a beam expansion/diverging element that expands the light beam emitted by the light source; a beam converging element that converges the expanded light beam into a viewing zone; and a spatial light modulator (SLM) onto which the light beam from the beam converging element is incident, and the SLM is configured to add a phase pattern and/or an amplitude pattern to the light beam to generate a holographic virtual image that is visible to a user wearing the head mounted display device.
2. The head mounted display device of claim 1, wherein the light source comprises a scanning projector that emits modulated laser beams that are rasterized angularly by a scanning mirror.
3. The head mounted display of claim 2, wherein the scanning projector includes a two axis micro-electromechanical system (MEMS) mirror.
4. The head mounted display device of claim 1, wherein the light source comprises a static non-scanning light source including a plurality of laser elements that are switchable sequentially in synchronization with the SLM to superpose different holographic virtual images.
5. The head mounted display device of claim 1, wherein the light source comprises one or more light emitting diodes (LEDs) that each respectively produces a holographic virtual image, wherein positions of the LEDs generates different viewing zones or positions of holographic virtual images.
6. The head mounted display device of claims 1, wherein the light source comprises a scanning laser, and a scanning along a y-axis perpendicular to the light path is offset by an amount defined by a beam waist of the laser beam.
7. The head mounted display device of claim 1, wherein the SLM is a transparent liquid crystal display panel.
8. The head mounted display device of claim 1, wherein the beam expansion element is configured to generated an expanded beam wavefront of the light beam generated by the light source, the beam converging element is configured to converge the scanning beam axis, and the SLM is configured to display a phase pattern and/or amplitude pattern to generate the holographic virtual image, wherein at the user's eye a spatial extent of a beam waist of the beam wavefront defines the viewing zone of the holographic virtual image.
9. The head mounted display device of claim 1, wherein the beam converging element is a curved mirror with a reflective coating on one curved side.
10. The head mounted display device of claim 1, wherein the beam converging element is configured as a Fresnel lens.
11. The head mounted display device of claim 1, wherein the beam converging element comprises a transparent substrate and a curved element with a reflective coating.
12. The head mounted display device of claim 1, wherein the SLM is curved.
13. The head mounted display device of claim 1, wherein the beam converging element is astigmatic to converge the light beam towards two orthogonal astigmatic lines.
14. The head mounted display device of claim 1, wherein the SLM is a reflective SLM.
15. The head mounted display of claim 14, further comprising a beam splitter for directing light from the SLM to the viewing zone.
16. The head mounted display of claim 14, wherein the beam converging element includes a refractive lens.
17. The head mounted display device of claim 1, including a single beam converging element in combination with a plurality of SLMs and/or a plurality of light sources.
18. The head mounted display device of claim 1, further comprising an optical element configured to reflect the beam from the SLM into the viewing zone.
19. The head mounted display device of claim 18, wherein the optical element is partially transparent.
20. The head mounted display device of claim 1, further comprising a viewing zone steering element configured to move the viewing zone in accordance with an eye position of the user.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0021] In the annexed drawings, like references indicate like parts or features:
[0022]
[0023]
[0026]
[0027]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
DESCRIPTION OF REFERENCE NUMERALS
[0042] 1: Laser Source
[0043] 2: Eye
[0044] 3: Pupil of the eye
[0045] 4: Retina of the eye
[0046] 10: Beam expanding/diverging element
[0047] 11: Beam converging element
[0048] 12: Spatial Light Modulator (SLM)
[0049] 13: Beam axis of instantaneous laser beam
[0050] 14: Expanded/Diverging laser beam wave front
[0051] 15: Scanning laser beam with beam axis converging towards/near the eye's pupil
[0052] 16: Diverging wave front of a point image emerging from the SLM
[0053] 17: Phase and/or amplitude pattern added to the light by the spatial light modulator according to the first embodiment
[0054] 18: Virtual image of a point created by hologram
[0055] 19: Overlapping area of scanning laser beam.
[0056] 20: Static (non-scanning) laser source according to the second embodiment
[0057] 21: Beam diverging element according to the second embodiment
[0058] 22: Diverging wave front
[0059] 23: Wave front converging towards the eye
[0060] 30: Curved SLM according to the second embodiment
[0061] 40: Beam converging element which creates an astigmatic converging wave front according to the forth embodiment
[0062] 50: Plurality of high spatial coherence LED light sources according to the fifth embodiment
[0063] 60: Beam splitter cube according to the sixth embodiment
[0064] 61: Reflective SLM according to the sixth embodiment
[0065] 70: Light converging element according to the seventh embodiment
[0066] 71: SLM according to the seventh embodiment
[0067] 80: Light guide or reflector according to the eighth embodiment
[0068] 90: Viewing zone steering element according to the ninth embodiment
[0069] 91a-b: Viewing Zone/Eye point at different locations as switched by the viewing zone steering element.
[0070] 100: Beam waist of laser
[0071] 101: Scanning path of laser beam
[0072] 102: Resetting of the laser scanner's y-axis (with laser switched off)
[0073] 200: Convergence angle of laser beam according to the first embodiment
[0074] 201: Field of view of the holographic image according to the first embodiment
[0075] 202: Size of viewing zone according to the first embodiment
[0076] 203: Contour of ellipsoid Fresnel lens according to the first embodiment
[0077] 204: Partially reflective coating according to the first embodiment
[0078] 205: Transparent substrate according to the first embodiment
[0079] 206: Convergence point of light converging from small angle (paraxial) from the optical axis
[0080] 207: Convergence point of light corresponding to wide viewing angle
[0081] 208: Rays obstructed by the eye/iris of the eye
DETAILED DESCRIPTION OF INVENTION
[0082] An aspect of this invention is a head mounted display or similar display devices that are fixed to the head. In exemplary embodiments, the display device includes a high coherence light source, a beam diverging/expansion element, a light converging element, and a spatial light modulator (SLM).
1.SUP.st .Embodiment
[0083] The first embodiment of this invention is shown in
[0084]
[0085] The laser beam passes through a beam expansion/diverging element 10, which expands the beam to a diameter larger than the MEMS mirror. The expanded/divergent beam waist size is such that, after passing through all subsequent optics in the HMD system and the pupil 3 of the eye 2, the optics would allow a small spot on the retina 4. The described component 10 in a preferred embodiment is a simple beam expander, but could also include diffraction optics, mirror optics, or refraction optics used for expanding or diverging the beam. In addition, the component 10 could also have multiple optical elements if the expanded light source requires a decent beam quality.
[0086] The expanded laser beam is incident onto a beam converging element 11. The converging element 11 causes the beam axis 13 of the scanning laser beam at different times to converge in space towards the eye. The large convergence angle 200 of the laser beam would allow an image with a large field of view (FoV) to be seen without the need for the SLM to deflect light by large angles.
[0087] The beam emerging from the converging element 11 follows an optical path and is incident onto a spatial light modulator (SLM) 12 before entering the pupil 3 of the eye. The SLM displays a phase pattern, which could be a kernel (convolution matrix) convoluted with the image or a general hologram pattern, resulting in an image that the eye can accommodate. However, instead of or apart from displaying a phase pattern, the SLM may also introduce amplitude modulation to the laser beam.
[0088] The SLM 12 in a preferred embodiment is a transparent high resolution LCD panel capable of providing phase modulation in the polarization of the laser beam. However, depending on the exact polarization state of the light source, and whether the SLM is capable of phase and/or amplitude modulation, the LCD panel may also include polarizers in front and/or after the pixel matrix as in the case of known liquid crystal display configurations. When compared to competing SLM technologies such as reflective SLMs, LCDs may allow a more light weight HMD design by the elimination of certain optical elements such as beam splitter cubes. However, other known SLM technologies, such as liquid crystal on silicon (LCoS) and MEMS mirror arrays could also be used in place of the LCD panel to achieve the other advantages described in this invention.
[0089] If a transmission SLM is placed in front of the eye, it is still possible for the user to see the real world directly. This can be achieved by sequentially switching the hologram on and off, along with making the converging element 11 partially transparent, with additional known active optics to sequentially black out the real world.
[0090] The laser beam wave front of an instantaneous scanning laser beam 13 is shown in
[0091] Using a laser scanning projector to produce holograms offers several advantages over the use of a static light source:
[0092] Firstly, it is possible that the beam expanding/diverging element 10 is small and may have a stronger power than the beam converging element 11, so the converging scanning laser beam axis 15 could already have a weak divergence close to what the eye can accommodate. If this is the case, then the phase mask displayed by the SLM 12 will not be required to provide such large phase modulation as the SLM will not need to turn a convergent wave front into a divergent wave front. Since pixel size is one of the major limiting technologies of SLMs, the configuration could provide good image quality relative ones where the wave front incident onto the SLM is converging.
[0093] In addition to creating a point on the retina 4, the SLM 12 can produce a single phase profile such that the retina sees an extended image. In this case, the SLM's phase profile would be the superposition of the holograms of many point images.
[0094] Secondly, because the beam illuminates different areas of the SLM time sequentially, the number of phase masks superposed onto each other can be reduced. Several sets of superposed phase masks can be separated time sequentially by displaying multiple holograms per image frame. This could lead to simpler algorithms for hologram generation and better image quality. The SLM need only be updated once or not more than a small number of times per image frame.
[0095] For color images, three lasers can be scanned sequentially or in a multiplex manner, and the appropriate holographic phase image is displayed. The brightness of each part of the image then can be an amalgamation of either a variation in the brightness of the laser and/or the transmission of the hologram on the SLM.
[0096] The SLM can create a holographic view from the beam from a phase and/or an amplitude approach by adding a phase pattern and/or amplitude pattern to the light beam to generate the holographic image. The phase and/or amplitude hologram can be made with either an additional polarizer or having a polarized laser source. An amplitude hologram would require an additional polarizer.
[0097] Although the drawing has depicted the converging beam axis as being convergent directly through the eye's pupil, it is also possible to have a configuration where the un-diffracted beam is converging to a region close to the eye rather directly through the pupil. In this case, only light diffracted by the SLM will enter the eye. This could be useful for making the un-diffracted zero order beam invisible to the user. However, other known methods of eliminating or hiding the un-diffracted beam from the viewer can also be used.
[0098]
[0099] The position of the virtual images displayed by the device can also be controlled by changing the modulation amplitude/spatial frequency of the phase pattern hologram 17 on the SLM. An exemplary phase pattern/kernel displayed by the SLM could take the form of a Fresnel lens. Although the phase pattern/kernel could be translation invariant throughout the plane of the SLM for faster computational time, a phase pattern that varies as a function of position on the SLM would offer more robust features. For example, a spatially varying phase pattern could correct for off-axis aberration (due to optical elements and non-ideal off-axis behavior of the SLM or to correct for the user's eye prescription) for virtual images produced at large scanning angles of the laser beam. Alternatively, having phase patterns with high spatial frequency modulation at the edge of the SLM could increase the field of view (FoV) of the image.
[0100] The beam converging element 11 in a preferred embodiment is configured as a curved mirror where one side is coated with a high reflectivity material. One possible shape of this mirror would be a section of an ellipsoid as shown in
[0101] Generally, the beam converging element could be a general free form element of any shape optimized for focusing one point (the light source) to another (the eye). Due to the finite area of the pupil 3 and the segmentation of the mirror leading to offset in centers of curvature in each Fresnel zone, the optimal shape of the element 11 could be some free form shape perturbed from an ellipsoid. Such free form surface could be designed by numerical optimization in optical modelling software.
[0102] It is possible for the convergence point for beams/rays 207 at a higher or wider angle to converge at a different location than beams/rays 206 that are paraxial (at small angles) from the optical axis. As the eye moves in order to view wider angle areas at high resolution, the pupil 3 would shift with this eye motion.
[0103] Having rays 207 at wide angles converging further back closer to the pivot at which the eye rotates would allow the pupil to intercept this beam directed near the fovea. Other rays 208 directed far away from the fovea are generally less important would have less impact on the user's viewing experience if they are obstructed (dashed line) by the iris of the eye. This can be a point of calibration that can be incorporated into the creation of the holograms or by mechanical setting through the design of the mirror 11.
[0104] Although the beam converging element is drawn to include a single reflective surface, such element, without a loss of generality, can also be configured as a flat element utilizing a waveguide/light guide type backlight with the use of known extraction methods to produce a converging/directional/collimated beam. The flat element can be illuminated with a fixed laser or LED light source or projection system for time sequential operation. The backlight and SLM panels can form the basis of a flat modular arrangement, in which each component consists of a layer of a stack. The advantage of this approach is that the display is then thin and lightweight and could be included into an eye unit no larger than a pair of spectacles.
[0105] Subsequent embodiments in this description will be made in reference to the first embodiment and only the differences between the subsequent embodiments and the first embodiments will be discussed.
2.SUP.nd .Embodiment
[0106] The second embodiment is shown in
[0107] The resultant diverging beam wave front 22 emerges at a large angle which fills up beam converging element 11. The beam 22 could either overfill or under-fill the beam converging element 11. A beam that overfills may provide a hologram image with better brightness uniformity across the whole image; whereas a beam that under-fills may allow a more energy efficient device. The wave front 23 emerging from the beam converging element 11 converges towards the eye 2. Unlike the first embodiment where the converging angle of the scanning beam axis determines the FoV, here the convergence angle of the wave front determines the FoV of the hologram.
[0108] The beam passes through a spatial light modulator 12 which displays a holographic phase mask, producing a wide FoV hologram. The phase mask required here differs from the first embodiment in the sense that it needs to construct a hologram from a large converging beam. The size of the viewing zone is approximately determined by the beam waist at the pupil of the eye. This configuration offers advantages as it has lower fabrication cost and fewer components compared to the first embodiment.
3.SUP.rd .Embodiment
[0109]
4.SUP.th .Embodiment
[0110]
5.SUP.th .Embodiment
[0111]
[0112] The use of LEDs could eliminate problems specific to lasers such as the presence of speckles. An ideal LED would have a narrow color spectrum since the hologram may introduce dispersion. However, if the phase pattern/kernels displayed on the SLM 12 are rotationally symmetrical about each holographic point image, narrow spectrum may not be critical as all point images produced by varying wavelengths would lie along the same line of sight.
6.SUP.th .Embodiment
[0113]
7.SUP.th .Embodiment
[0114]
8.SUP.th .Embodiment
[0115]
9.SUP.th .Embodiment
[0116]
10.SUP.th .Embodiment
[0117]
[0118] An aspect of the invention is a head mounted display device. In exemplary embodiments, the head mounted display device includes a light source that emits a high coherence light beam, a beam expansion/diverging element that expands the light beam emitted by the light source, a beam converging element that converges the expanded light beam into a viewing zone, and a spatial light modulator (SLM) onto which the light beam from the beam converging element is incident. The SLM is configured to add a phase pattern and/or an amplitude pattern to the light beam to generate a holographic virtual image that is visible to a user wearing the head mounted display device. The head mounted display device may include one or more of the following features, either individually or in combination.
[0119] In an exemplary embodiment of the head mounted display device, the light source comprises a scanning projector that emits modulated laser beams that are rasterized angularly by a scanning mirror.
[0120] In an exemplary embodiment of the head mounted display device, the scanning projector includes a two axis micro-electromechanical system (MEMS) mirror.
[0121] In an exemplary embodiment of the head mounted display device, the light source comprises a static non-scanning light source including a plurality of laser elements that are switchable sequentially in synchronization with the SLM to superpose different holographic virtual images.
[0122] In an exemplary embodiment of the head mounted display device, the light source comprises one or more light emitting diodes (LEDs) that each respectively produces a holographic virtual image, wherein positions of the LEDs generates different viewing zones or positions of holographic virtual images.
[0123] In an exemplary embodiment of the head mounted display device, the light source comprises a scanning laser, and a scanning along a y-axis perpendicular to the light path is offset by an amount defined by a beam waist of the laser beam.
[0124] In an exemplary embodiment of the head mounted display device, the SLM is a transparent liquid crystal display panel.
[0125] In an exemplary embodiment of the head mounted display device, the beam expansion element is configured to generated an expanded beam wavefront of the light beam generated by the light source, the beam converging element is configured to converge the scanning beam axis and the SLM is configured to display a phase pattern and/or amplitude pattern t generate the holographic virtual image, wherein at the user's eye a spatial extent of a beam waist of the beam wavefront defines the viewing zone of the holographic virtual image.
[0126] In an exemplary embodiment of the head mounted display device, the beam converging element is a curved mirror with a reflective coating on one curved side.
[0127] In an exemplary embodiment of the head mounted display device, the beam converging element is configured as a Fresnel lens.
[0128] In an exemplary embodiment of the head mounted display device, the beam converging element comprises a transparent substrate and a curved element with a reflective coating.
[0129] In an exemplary embodiment of the head mounted display device, the SLM is curved.
[0130] In an exemplary embodiment of the head mounted display device, the beam converging element is astigmatic to converge the light beam towards two orthogonal astigmatic lines.
[0131] In an exemplary embodiment of the head mounted display device, the SLM is a reflective SLM.
[0132] In an exemplary embodiment of the head mounted display device, the device further includes a beam splitter for directing light from the SLM to the viewing zone.
[0133] In an exemplary embodiment of the head mounted display device, the beam converging element includes a refractive lens.
[0134] In an exemplary embodiment of the head mounted display device, the device includes a single beam converging element in combination with a plurality of SLMs and/or a plurality of light sources.
[0135] In an exemplary embodiment of the head mounted display device, the device further includes an optical element configured to reflect the beam from the
[0136] SLM into the viewing zone.
[0137] In an exemplary embodiment of the head mounted display device, the optical element is partially transparent.
[0138] In an exemplary embodiment of the head mounted display device, the device further includes viewing zone steering element configured to move the viewing zone in accordance with an eye position of the user.
[0139] Although the invention has been shown and described with respect to a certain embodiment or embodiments, equivalent alterations and modifications may occur to others skilled in the art upon the reading and understanding of this specification and the annexed drawings. In particular regard to the various functions performed by the above described elements (components, assemblies, devices, compositions, etc.), the terms (including a reference to a means) used to describe such elements are intended to correspond, unless otherwise indicated, to any element which performs the specified function of the described element (i.e., that is functionally equivalent), even though not structurally equivalent to the disclosed structure which performs the function in the herein exemplary embodiment or embodiments of the invention. In addition, while a particular feature of the invention may have been described above with respect to only one or more of several embodiments, such feature may be combined with one or more other features of the other embodiments, as may be desired and advantageous for any given or particular application.
INDUSTRIAL APPLICABILITY
[0140] Industrial application will be mainly for wearable displays, in particular for achieving light weight Head Mounted Displays (HMD). The principal advantage of using a holographic type HMD is the manifestation of all 3D optical depth cues in the generated image content, and the possibility of allowing a light weight HMD device to be made without compromising on FoV and resolution. The system is light weight as no large eyepiece lenses are required. A large FoV hologram is achieved by using an optical element before a spatial light modulator to create either scanning beam axis or a wave front which converges towards the eye. Hardware manufactured using this invention may be useful in the fields of virtual reality (VR) and augmented reality (AR) for both consumer and professional markets. HMD manufactured by this invention could have applications including everyday use, gaming, entertainment, task support, medical, industrial design, navigation, transport, translation, education, and training.