System and method for optically combining virtual images into real world scenery
20230152588 · 2023-05-18
Inventors
- Shoam SHWARTZ (Hod Hasharon, IL)
- Omri BARLEV (Tel Aviv-Yafo, IL)
- Asaf Akiva CARMEL (Zichron Yaakov, IL)
- Igor TIKHONENKOV (Kiriat Motskin, IL)
- Uri KOROGODSKY (Ramat Gan, IL)
Cpc classification
G02B5/1814
PHYSICS
G02B5/1866
PHYSICS
G02B27/0081
PHYSICS
International classification
Abstract
An optical system is presented for use in a near-eye mixed reality system. The system comprises a relay system defining an eyebox of the optical system, said relay system being configured and operable to relay a virtual image light field from a light-engine onto an eye pupil plane while combining said virtual image with real-world light field. The relay system is configured as a free space relay system configured for free space propagation of said virtual image light field being relayed, said free space relay system comprising at least one off-axis 4f-system. Each of said at least one off-axis 4f-system comprises at least one lens formed from at least one resonance-domain surface relief diffractive optical element (SRDOE) operable for combining said virtual image light field with the real-world light field, said at least one SRDOE being configured with a predetermined global surface relief pattern characterized by global variation of at least some of pattern parameters across said SRDOE.
Claims
1. An optical system for use in a near-eye mixed reality system, comprising a relay system defining an eyebox of the optical system, said relay system being configured and operable to relay a virtual image light field from a light-engine onto an eye pupil plane while combining said virtual image with real-world light field, wherein said relay system is configured as a free space relay system configured for free space propagation of said virtual image light field being relayed, said free space relay system comprising at least one off-axis 4f-system, wherein each of said at least one off-axis 4f-system comprises at least one lens formed from at least one resonance-domain surface relief diffractive optical element (SRDOE) operable for combining said virtual image light field with the real-world light field, said at least one SRDOE being configured with a predetermined global surface relief pattern characterized by global variation of at least some of pattern parameters across said SRDOE.
2. The system according to claim 1, wherein said at least some parameters of the SRDOE comprise two or more of the following: period, line width, etching depth, slant angle, and side wall angle.
3. The system according to claim 1, wherein each of said at least one SRDOE is configured to be operable in a Bragg regime with first and second dominant diffraction orders, wherein the first dominant diffraction order is a first diffraction order, and the second dominant diffraction order is a zeroth diffraction order for which the SRDOE is substantially transparent.
4. The system according to claim 3, wherein the SRDOE operable for combining said virtual image light field with the real-world light field is configured with the first and second dominant diffraction orders for, respectively, the virtual light field and the real-world light field.
5. The system according to claim 1, wherein each of said at least one SRDOE is configured as a wavelength and polarization selective lens for each of at least one selected wavelength and selected polarization state.
6. The system according to claim 3, wherein the SRDOE is configured such that said first and second dominant diffraction orders correspond to ranges of polar (θ_diff) and azimuthal (ϕ_diff) diffraction angles, each of said ranges being 10-80 degrees.
7. The system according to claim 1, wherein the global surface relief pattern is formed from a continuous two-dimensional arrangement of unit cells, each unit cell being configured as a surface relief diffraction grating (SRDG) having locally unchanged values of said at least some parameters across the SRDG.
8. The system according to claim 5, wherein said SRDOE is configured such that one of said first and second dominant diffraction orders thereof diffracts more than 90% of the light field at each of said at least one selected wavelength and selected polarization state.
9. The system according to claim 8, characterized by at least one of the following: (i) said second dominant diffraction order, being the zeroth order, is said one of the first and second dominant diffraction orders diffracting more than 90% of the light field; and said SRDOE is configured such that diffraction efficiencies of said first dominant diffraction order and said second dominant diffraction order, being the zeroth diffraction order, are, respectively, 10% and 90%, thereby providing high transparency of the SRDOE.
10. (canceled)
11. The system according to claim 3, characterized by at least one of the following: (a) said SRDOE is configured such that diffraction efficiencies of said first and second dominant diffraction orders are substantially the same, each being about 50% for the light field at each of the at least one selected wavelengths and selected polarization state; and (b) said SRDOE is configured such that the second dominant diffraction order, being zeroth diffraction order, is essentially transmitting for the light field incident thereon having light components other than said at least one selected wavelength and selected polarization state.
12. (canceled)
13. The system according to claim 1, wherein said lens, formed from the at least one SRDOE is made of one of the following materials: fused silica (FS), silicon nitride (Si3N4), titanium dioxide (TiO2), Epoxy resins, glass, plastic.
14. The system according to claim 1, wherein the SRDOE is located on a surface of a substrate made of fused silica (FS).
15. The system according to claim 1, wherein said at least one lens formed from the at least one SRDOE comprises a stack of two or more SRDOEs configured for selected two or more different wavelengths of a visible spectral range.
16. The system according to claim 15, wherein the stack of SRDOEs comprises three SRDOEs configured for selected wavelengths of red, green, and blue spectra, respectively.
17. The system according to claim 15, wherein said stack comprises an additional SRDOE configured for a selected wavelength in an infrared spectral region.
18. The system according to claim 1, wherein said at least one off-axis 4f-system comprises the off-axis 4f-system having a first lens exposed to the light field from the light engine and a second lens combining the virtual light field and the real world light field to propagate to the eyebox, wherein said second lens is said at least one lens formed by the at least one SRDOE being at least one second SRDOE.
19. The system according to claim 18, characterized by one of the following: (1) the first lens of the off-axis 4f-system is configured as a mirror with converging optical power; (2) the first lens of the off-axis 4f-system is formed by at least one second SRDOE having a second predetermined global surface relief pattern different from the predetermined global surface relief pattern of the at least one first SRDOE.
20. The system according to claim 18, wherein the first lens of the off-axis 4f-system is formed by at least one second SRDOE having a second predetermined global surface relief pattern different from the predetermined global surface relief pattern of the at least one first SRDOE, the system further comprising a polarization control assembly comprising a quarter waveplate accommodated in an optical path of light transmitted by the first lens, and a reflector redirecting light output of the quarter waveplate to pass back therethrough, thereby providing 90-degree polarization rotation of the virtual light field propagating back to be diffracted by the first lens.
21. (canceled)
22. The system according to claim 18 wherein the first lens of the off-axis 4f-system is formed by at least one second SRDOE having a second predetermined global surface relief pattern different from the predetermined global surface relief pattern of the at least one first SRDOE, said first and second lenses of the off-axis 4f-system comprising, respectively, first and second stacks of the first and second SRDOEs, each of the first and second stacks comprising two or more SRDOEs configured for selected two or more wavelengths of a visible spectral range.
23. The system according to claim 22, wherein each of said first and second stacks further comprises an additional SRDOE configured for a selected wavelength in an infrared spectral region.
24. The system according to claim 1, wherein said at least one off-axis 4f-system comprises the off-axis 4f-system comprising an optical element accommodated in an intermediate image plane of the off-axis 4f-system.
25. The system according to claim 24, wherein said optical element is configured as at least one of the following: an aberration corrector, a beam expander, and a beam reflector.
26. The system according to claim 25, wherein said optical elements is configured as a dispersion corrector.
27. The system according to claim 24, wherein said optical element comprises a light interacting surface configured as any one of: Metasurface, diffractive or refractive element.
28. The system according to claim 18, wherein the relay system comprises two of said off-axis 4f-systems, wherein first lenses of the two 4f-systems receive virtual light fields from two, respective light engines, and second lenses of the two 4f-systems define the eyebox of the relay system.
29. The system according to claim 1, wherein said free space relay system comprises an additional off-axis 4f-system, said relay system thereby defining an off-axis 8f-system.
30. A near-eye mixed reality system comprising: a projector unit comprising at least one light engine and at least one scanner; and the optical systems configured according to claim 1.
31. An augmented reality system comprising a pair of near-eye mixed reality systems in association with left and right eyes of a user, each of the near-eye mixed reality systems configured according to claim 30.
32. Augmented reality glasses comprising left and right glass lenses within a glasses frame, and comprising first and second near-eye mixed reality systems associated with the left and right glass lenses, each of the first and second near-eye mixed reality systems being configured according to claim 30.
33. The glasses according to claim 32, characterized by at least one of the following: at least a part of each of first and second relay systems of the first and second near-eye mixed reality systems, respectively, is integral with a respective one of the left and right glass lenses; each of first and second projector units of the first and second near-eye mixed reality systems, respectively, is located on a part of the glasses frame or on a glasses temple in a vicinity of a respective one of the left and right glass lenses.
34. (canceled)
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0045] The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawings will be provided by the Office upon request and payment of the necessary fee.
[0046] In order to better understand the subject matter that is disclosed herein and to exemplify how it may be carried out in practice, embodiments will now be described, by way of non-limiting examples only, with reference to the accompanying drawings, in which:
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
[0065]
[0066]
[0067]
[0068]
[0069]
DETAILED DESCRIPTION OF EMBODIMENTS
[0070] Reference is made to
[0071] The near-eye mixed reality system 102 includes inter alia the light engine 110 which operates to project the virtual image light field LF1 onto a light receiving element of the optical system 100 (i.e., relay system). The light engine system 110 includes a light source unit 112 which is in data communication with a virtual image generator (not shown) and creates the corresponding light field LF1. This can be implemented by generating light beams indicative of data provided by the image generator and using a scanner unit 114 which scans this light beam to create the output light field LF1. The light engine system 110 is thus capable of creating the virtual image light field, e.g., by scanning a laser beam with a scanning mirror. The construction and operation of the light engine system may be of any known suitable type, and does not form part of the present disclosure, and therefore need not be described in more details.
[0072] The relay system 100 is configured according to the present disclosure as a free space relay system configured for free space propagation of the virtual image light field LF1 while combining the virtual image light field LF1 with real world light field LF2 providing thus a mixed reality experience to the viewer. The relay system 100 includes at least one off-axis 4f-system 120 providing two main functionalities: (i) optical relay and (ii) optical combiner.
[0073] The off-axis 4f-system 120 includes first and second lenses Lens 1 and Lens 2. In this connection, the following should be noted.
[0074] Typical 4f-system is an essence of optical relay and usually consists of two lenses, where the input plane of the 4f-system is one focal length in front of Lens 1 while the output plane is located one focal length after Lens 2. An intermediate image plane between the two lenses is a Fourier plane FP. The use of 4f-system advantageously relays complex wavefront information, meaning that not only the amplitude but also phase information of the light field is relayed. Relaying such information enables relaying diverging and converging beams into the pupil which beams correspond to virtual images at different focal locations, which alleviates such critical phenomenon in mixed-reality systems as Vergence-Accommodation Conflict (VAC), which is a visual phenomenon that occurs when the brain receives mismatching cues between vergence and accommodation of the eye (effect that is unpleasant and causes eye strain). Also, the use of such 4f system relay is suitable for pupil steering.
[0075] The 4f-system 120 used in the relay system of the present disclosure is configured as off-axis system, i.e., in which optical axes OA1 and OA2 of the lenses do not coincident with light propagation paths on and through said lenses. This provides more flexibility of orientation of light propagation paths and thus more compact design of the optical system.
[0076] Further, in such off-axis 4f-system 120, configured according to the present disclosure, at least one of the lenses, being the lens defining the output aperture of the system 120, and thus defining the eyebox of the relay system 100, is formed from at least one resonance-domain surface relief diffractive optical element (SRDOE). Thus, in the illustration in the figure, at least Lens 2 is formed of at least one SRDOE 140. As also exemplified in the figure, the other lens, Lens 1 (i.e., input aperture of the system 120), may also be formed of at least one SRDOE 130.
[0077] The SRDOE 140 (and possibly also 130) has a predetermined global surface relief pattern with global variation of at least some of pattern parameters across the SRDOE. The pattern is selected (optimized) in order to enable significantly increase numerical aperture of light collection by the lens of a given size (without a need to increase the number of lenses and their thicknesses). It should be noted that such features are important for near-eye mixed reality system, in particular incorporated in glasses.
[0078] The SRDOE is configured and operable for optimizing the optical combining of the virtual image light field LF1 with the real-world light field LF2. According to the technique of the present disclosure, the SRDOE 140 (130) is configured with first and second dominant diffraction orders, being respectively the first diffraction order and the zeroth diffraction order.
[0079] The SRDOE is generally operable in a Bragg regime. However, the SRDOE is not configured as a typical Bragg grating. In this connection, the following should be noted. Bragg grating configuration and operation are well defined by grating diffraction theory (represented by the well-known equation of Bragg angle).
[0080] The term “Bragg regime” used herein to describe the operational principles of the SRDOE's pattern relates to diffraction by a relatively “thick” and “volumetric” grating structure, i.e., presence of first and second dominant diffraction orders being respectively the first diffraction order and the zeroth diffraction order (representing the entirely transmitted light field), while the pattern of the SRDOE of the present disclosure is actually a surface relief (being neither thick nor volumetric) in the resonance domain. Specifically, the surface relief grating in the resonance domain behaves similarly to a volume grating with graded refractive index, where certain degree of Bragg conditions is satisfied. Hence, the term “Bragg regime” in relation to the SRDOE of the present disclosure should be interpreted correctly and not confused with a Bragg grating.
[0081] The SRDOE described above is formed from a continuous two-dimensional arrangement of unit cells, where each unit cell presents a local surface relief pattern, such that the entire arrangement of the unit cells forms the global surface relief pattern of the SRDOE. As indicated above, the SRDOE has the predetermined global surface relief pattern with global variation of at least some of pattern parameters across the SRDOE. The unit cell (being a cell or basic block of the global surface relief pattern) is configured as a resonance-domain surface relief diffraction grating (SRDG) having locally unchanged values of said at least some of the pattern parameters across the unit cell.
[0082] In contrast to scalar domain gratings, which suffer from higher diffraction orders accompanying the first diffraction order which unavoidably results in ghost images being formed, the SRDOE configured according to the principles of the present disclosure is configured with only two dominant diffraction orders, as described above. The scalar domain is also restricted to low spatial frequency of pattern features and small diffraction angles, leading to low numerical aperture (NA) of available diffractive lenses. In the resonance domain, where the grating period is comparable to the wavelength, high diffraction angles may be achieved, as will be described in detail below. It is noted that for surface relief gratings in the resonance domain, the diffraction efficiency of the first diffraction order can reach 100%.
[0083] Hence, implementing the off-axis 4f-system based relay with at least one lens being formed from at least one resonance domain SRDOE provides for significantly improving the relay operational properties which are important for near-eye mixed reality applications.
[0084] Reference is made to
[0085] The surface relief pattern of the SRDOE is in the form of spaced-apart features (generally termed “grating lines”) and is typically characterized by such parameters as period, line width, fill factor (ratio between the line width and period), height, slant angle, grating vector and side wall angle. The global surface relief pattern of the SRDOE is characterized by global variation of at least some of the pattern parameters.
[0086] As shown in
[0087]
[0088]
[0089] The figures exemplify unit cells (SRDGs), which in these non-limiting examples, have a binary pattern configuration (including straight side walls as in
[0090] The SRDG 200 is characterized by such pattern parameters as a period A, line width D, fill factor
etching height (depth) h, slant angle α, side wall angle γ, and grating vector
[0091] Thus the SRDOE parameters may include the following: fill factor (x.sub.SRDOE,y.sub.SRDOE), h(x.sub.SRDOE,y.sub.SRDOE), Λ(x.sub.SRDOE,y.sub.SRDOE) grating vector
[0092] The grating vector
[0093] The SRDOE (and thus SRDG 200) is typically formed on a surface of an optically transparent, dielectric substrate as indicated in
[0094] The substrate material is characterized by its refractive index no, media (background) between the substrate and the pattern features (grating lines) has refractive index n.sub.1, and material of the pattern features (grating lines) has refractive index n.sub.2. Thus, the materials of the substrate, background, and grating lines defining properties of the SRDG are characterized by refractive indices n.sub.0, n.sub.1, n.sub.2, respectively.
[0095] As shown in
[0096] Each of
[0097] The Bragg phenomena of peak diffraction efficiency occurs when
where λ is the illuminating wavelength, and Λ is the grating period.
[0098] As will be described below, the inventors have found that “Out of Bragg” diffraction efficiency (i.e., diffraction not satisfying Eq. (1)) can remain relatively high (close to 90%) by properly selecting the fill factors, each being determined as
(where Λ is the period, and D is the line width). The inventors have also found that a proper selection of grating vector
[0099] It should be understood that the diffracted ray
[0100] The direction of the diffracted ray
where v.sub.x and v.sub.y are given by
λv.sub.x={circumflex over (x)}.Math.(
λv.sub.y=ŷ.Math.(
The grating vector
Λ=|v|.sup.−1,|v|=√{square root over (v.sub.x.sup.2+v.sub.y.sup.2)}
The grating vector direction with respect to the SRDOE's coordinate x constitutes the grating orientation δ according to:
cos(δ)=
[0101] Reference is made to
[0102] Tables 1 and 2 present data in relation to unit cells A to C and D to F of the SRDOEs 140 and 130, respectively. More specifically, this data includes the various structural parameters of exemplary unit cells (SRDGs) obtained from RCWA calculation after optimization. Typical sizes of the SRDOE 140, 130 and the unit cell (each of the cells A to F) may be about 10×10 mm and 5×5 μm, respectively.
[0103] The center of the global coordinate system ({circumflex over (x)}.sub.SRDOE,ŷ.sub.SRDOE) of SRDOE 140, 130 is defined in the center of the element, and the coordinates ({circumflex over (x)}.sub.SRDOE,ŷ.sub.SRDOE) corresponding to respective centers of the unit cells are indicated in the figure in units of mm as follows: unit cell A—(0,1) mm, unit cell B—(−5, −4) mm, and unit cell C—(−5.6,2) in
[0104] Table 1 and Table 2 indicate that each one of the unit cells A, B, and C has a different direction of the grating lines (grating vector {right arrow over (v)}) in the SRDOE 140 defined by the different value of orientation angle δ; and similarly each one of the unit cells D, E, and F has a different direction of the grating lines (grating vector
[0105] It should be noted that since the location of each SRDOE within the 4f-system 120 is fixed, the ranges of polar and azimuthal incidence angles, θ.sub.inc and ø.sub.inc, on each (center of) unit cell is known, so that this information is used in the optimization of the structural parameters of the SRDOE.
[0106] It should be understood that each SRDOE includes a high number of unit cells (SRDGs), e.g. approximately millions unit cells, while in the example presented here only 3 unit cells are considered located at different regions of the SRDOE.
[0107] In addition to angle δ, each unit cell (e.g., A, B, and C of SRDOE 140 of
[0108] In Tables 1 and 2, λ.sub.0 is the wavelength for which the exemplary SRDOE 140 (and thus the selected unit cells (SRDGs)), is designed for, e.g. 450 nm and 637 nm, respectively (as indicated above); and 2 is the wavelength of incident illumination used in the simulations.
[0109] It should be noted that the grating orientation of the unit cell, as well as ray polar and/or ray azimuthal angles may or may not be same, and can be entirely different in different locations of the SRDOE.
TABLE-US-00001 TABLE 1 Line Etching λ, λ.sub.0, width depth, Period δ θ.sub.inc ∅.sub.inc SRDG nm nm nm nm nm deg deg deg S_amp P_amp A 450 450 176 729 324 0 44.9 0 0 −0.32 + 0.94j B 172 729 294 10 47 10 −0.015 + 0.45j −0.015 + 0.45j C 180 729 330 18 46 18 −0.47 + 0.58j −0.45 − 0.47j
TABLE-US-00002 TABLE 2 Line Etching λ, λ.sub.0, width depth, Period δ θ.sub.inc ∅.sub.inc SRDG nm nm nm nm nm deg deg deg S_amp P_amp D 637 637 177 552 416 13 56 9 0.56 + 0j −0.83 + 0j E 181 552 450 0 45 0 0 + 0j −1 + 0j F 186 552 483 −2.7 36 −4.3 −0.16 + 0j −0.9859 + 0j
[0110] As stated above, the SRDOE of the present disclosure is wavelength and polarization sensitive element. The SRDOEs 140 and 130 of
[0111] As already mentioned above, the configuration of the SRDOE of the present disclosure provides that most of the intensity of the diffracted incident beam is converted into a single diffraction order, typically the first diffraction order. The SRDOE of the present disclosure may as well be configured to diffract most of the incident light field intensity into the zeroth diffraction order, as described above. The diffraction efficiency is defined as:
where P.sub.diff.sup.1st is the light power diffracted into the first diffraction order, P.sub.in, is the power of the incident light ray, and η.sub.diff.sup.1st is the diffraction efficiency of the first diffraction order.
[0112] The SRDOEs according to the principles of the present disclosure can be configured to diffract the incident light ray 210 to a wide range of angles, θ.sub.diff, ϕ.sub.diff of the diffracted ray
[0113] As mentioned above, the inventors have shown that “Out of Bragg” diffraction efficiency (i.e. diffraction not satisfying Eq. (1) above) can remain relatively high (up to 90% and higher) by properly selecting such pattern parameter as the fill factor, and have also shown that a proper selection of grating vector can maintain Bragg condition for large azimuthal diffraction angles.
[0114] In this connection, reference is made to
[0115] Rigorous coupled-wave analysis (RCWA) is a rigorous method for analyzing diffraction efficiencies in periodic structures. The calculation parameters are for wavelength λ=632 nm, β=90°, ϕ=0°, α=0° with different values of period, Λ, and fill factor,
[0116]
The results indicate that diffraction efficiency higher than 80% can be obtained over a range of about 30 degrees of the polar diffraction angle θ.sub.diff (from about 20 deg to about 50 deg).
[0117] The black solid curve in
for different grating periods Λ. In the same figure, the distribution of the diffraction efficiency of the first order, η.sub.diff.sup.1st is shown for the full range of calculated grating periods and fill factors (i.e., a 2D map of the diffraction efficiency as function of the grating period and fill factor). The dashed curve in
chosen for the calculations shown in
[0118]
[0119] The results show that a proper selection (according to the values on the black solid line in
[0120]
[0121] As described above, the SRDOE of the present disclosure is a wavelength and polarization selective element and may be configured for each of at least one selected wavelength and selected polarization state. When the SRDOE is illuminated with its designated wavelength and polarization, it diffracts most of the energy into the first diffraction order. Alternatively, when the SRDOE is illuminated with wavelengths and/or polarizations other than the designated one, most of the light field intensity is transmitted through the zeroth diffraction order. Each SRDOE of the present disclosure is formed by the arrangement of SRDGs as described above, and each SRDG may be configured to diffract the incident light field into one of two dominant diffraction orders with high efficiency at certain discrete selective wavelength(s) only.
[0122] Reference is made to
[0123]
η.sub.diff.sup.1st(λ1=632 nm,β==0°)=0.98
η.sub.diff.sup.1st(λ2,3=520,450 nm,β=90°)˜0.03
[0124]
η.sub.diff.sup.1st(λ1=632 nm,β=0°)=0.06
η.sub.diff.sup.1st(λ2=520,β=90°)˜0.55
η.sub.diff.sup.1st(λ3=450,β=90°)˜0.65
[0125] Therefore, in some embodiments, the lens of the present disclosure may be formed from a stack of two or more adjacent SRDOEs configured for two or more different wavelengths. For example, in a stack of two adjacent SRDOEs, the first SRDOE may be configured with grating parameters described above with reference to
[0126] The SRDOE configured according to the present disclosure, e.g., as described in
[0127] The local (i.e., in ({circumflex over (x)}.sub.SRDG,ŷ.sub.SRDG) coordinates) spatial frequency vector
where ∇.sub.⊥φ(x, y) is the gradient of the locally varying phase function φ(x, y) of the SRDG.
[0128] The grooves defined by the surface relief pattern of the SRDG constitute groove lines according to
φ(x,y)=2π.Math.n
From the desired imposed phase on the first diffraction order, the grating vector can be calculated which in turn dictates grating orientation and period for the entire arrangement of unit cells (SRDGs) of the SRDOE.
[0129] As described and shown above, the lens formed by at least one SRDOE of the present disclosure is designed for at least one selected wavelength and specific polarization. As also described above, the lens may be formed by a stack of SRDOEs (e.g. implemented as a stack of layers), each SDROE configured for designated wavelength and polarization. When the SRDOE is illuminated with its designated wavelength and polarization, it diffracts most of the energy into the first diffraction order. Alternatively, when the SRDOE is illuminated with wavelengths and/or polarizations other than the designated one, most of the light field intensity is transmitted through the zeroth diffraction order.
[0130] The k.sup.th diffraction order efficiency of the i.sup.th SRDOE is denoted as η.sub.i.sup.k(λ.sub.i), where λ.sub.j is the illuminating wavelength. Accordingly, in an ideal SRDOE-based lens,
[0131] Each SRDOE can impose any phase functions of the designated incident wavelength [7.8].
[0132] Reference is made to
[0133] In these examples, the stacked SRDOEs of lens 700 in
[0134] In the following, two examples of lens without slant angle in the SRDGs patterns, i.e., α=0° (lens 700 of
[0135] Tables 3 and 4 below show numerically calculated η.sub.ij.sup.1 and η.sub.ij.sup.0 for a lens made from, respectively, fused silica (FS) with n.sub.0=n.sub.1, n.sub.2˜1.457, and Si3N4 with n.sub.0=n.sub.1, n.sub.2˜2.06. The results in both tables demonstrate that with proper selection of such pattern parameters as grating line width D and etch depth h, each SRDOE layer can provide wavelength selectivity and achieve η.sub.ij.sup.1, η.sub.ij.sup.0 close to an ideal (˜100%).
TABLE-US-00003 TABLE 3 η.sup.1 η.sup.0 j = λ, nm 637 520 450 637 520 450 Etch Line β 90° 0° 90° 90° 0° 90° depth, nm width, nm Period, nm Element 637 0.95 0.00 0.03 0.04 0.93 0.84 1250 100 450 (i) 520 0.00 0.91 0.00 0.84 0.00 0.99 1590 227 370 450 0.00 0.03 0.99 0.93 0.95 0.02 733 164 320
TABLE-US-00004 TABLE 4 η.sup.1 η.sup.0 j = λ, nm 637 520 450 637 520 450 Etch Line β 90° 0° 90° 90° 0° 90° depth, nm width, nm Period, nm Element 637 0.95 0.16 0.02 0.04 0.85 0.94 1157 140 450 (i) 520 0.00 0.99 0.03 0.96 0.00 0.95 628 146 370 450 0.00 0.04 0.95 0.84 0.94 0.02 277 100 320
[0136] Thus, the above describes lenses formed from SRDOEs, serve as building blocks in 4f-system based relay configuration for use in a near-eye mixed reality system provided by the present disclosure. The optical systems described below exemplify implementation of off-axis 4f systems in which at least one of the two lenses is formed of at least one resonance domain SRDOE configured as described above.
[0137] In some embodiments, the SRDOEs are designed and produced to function as an f-theta lens [6], i.e., SRDOE whose lensing effect provides for focusing a laser beam onto a planar image plane, which facilitates its use in a scanning system. The off-axis 4f system can include two such f-theta lenses and operate as a relay system. As described above, such 4f system based relay system operates to relay relevant light information (virtual light field) from the light engine onto the eye pupil plane (eyebox). The systems exemplified below vary in the number of wavelengths they support, form factor, and number of SRDOEs. The systems are designed using raytracing and RCWA methods. An optimizer is provided with a cost function, and the grating parameters are selected to minimize the cost function. Once the raytracing has reached an acceptable cost, the RCWA is optimized to find the best efficiency, transparency and wavelength and polarization orthogonality (i.e., wavelength and polarization selectivity).
[0138]
[0139] The first lens 130 may or may not include any SRDOE, and if it does this a single SRDOE 600. The first lens 130 is preferably configured to utilize the principles off-theta lens, and also operates as a folding element for bending light propagation path of light beam interacting therewith. This lens 130 relays the virtual light filed LF1 from the light engine 110 towards the second lens 140. The second lens is formed of the single SRDOE 600. In case both lenses 130 and 140 include SRDOEs, the surface relief patterns of these SRDOEs are different from one another.
[0140] The second lens (it's SRDOE) 140 is configured as a f-theta lens, and as a folding element (for bending light propagation path of light beam interacting therewith) and is also configured as a combiner for combining the virtual light field LF1 and the real-world light field LF2 as will be described further below. It should be understood that the lens 140 is configured as an f-theta lens, folding element, and is characterized by transparency in angles of incidence of light field LF2 from the real-world scenery.
[0141] The beam expander 150 accommodated in the intermediate image plane is configured to expand the light field interacting therewith and accordingly expands the eyebox, and is also configured to correct most dominant aberrations known for this type of system, such as field curvature and astigmatism known to occur in off-axis configurations. The beam expander has a light interacting surface configured as Metasurface or freeform surface, and/or diffractive or refractive element.
[0142] The SRDOE 600 of the second lens 140 is configured to divide intensity of the light field incident thereon into two dominant diffraction orders being the first diffraction order and the zeroth diffraction order. The zeroth diffraction order allows light field LF2 from the environment to pass through the lens 140 to the eye pupil, whereas the first diffraction order relays the light field LF1 coming from the first lens 130 to the pupil.
[0143] The SRDOEs 600 forming the lens 140 and also that forming the lens 130, as the case may be, is configured as a resonance-domain diffraction grating as described above having the predetermined global surface relief pattern with global variation of at least some of pattern parameters across said SRDOE. However, in case the first lens is also formed of the SRDOE, the patterns of the SRDOEs of lenses 130 and 140 are different from one another because these lenses have different functions, i.e. differently affect the propagation of light field(s) interacting therewith.
[0144] Since the SRDOE of the second lens 140 is to be, at the same time, transparent to light field LF2 from the environment being transmitted through its zeroth order and to relay (i.e., diffract) light field LF1 from the first lens 130, the SRDOE of the second lens 140 is configured with about 10%-50% diffraction efficiency (it should be understood that in some applications the efficiency is not as important as the transparency) for the designed discrete wavelength in the first (i.e., the first diffraction order) and the second (i.e., the zeroth diffraction order) dominant diffraction orders. It is to be noted that the fact that the SRDOE of the second lens 140, functioning as a combiner, transmits only about 50% of the intensity of the light field LF2 from the environment at the designed discrete wavelength does not affect the quality of the viewed external scene, since this lowered (to about 50%) transmission is effective only for a specific polarization of light and, typically, light from the environment is unpolarized.
[0145] Since the first lens 130 has no combiner functionality in the system, it may be formed of an SDROE or may generally be implemented with Metasurface, a freeform, or a mirror.
[0146] Reference is made to
[0147] Each of the lenses 130 and 140 is formed of a single SRDOE (not a stack of two or more SRDOEs) configured to diffract light into the first diffraction order at two discrete wavelengths λ1 and λ2 only while transmitting any other colors through the zeroth diffraction order. For example, the SRDOE diffracts blue and green light only into the first diffraction order, e.g., is similar to the SRDOE having configuration/parameters as described above with reference to
[0148] The beam expander 150, placed in the intermediate image plane between lenses 130 and 140 is configured to expand the light field interacting therewith (and thus expand eyebox) and correct dispersion. Dispersion, as used here, is the change in light diffraction direction due to illumination at a wavelength different than the designed one. The wavelength components LF1(λ1) and LF1(λ2) of the virtual light field LF1 are diffracted by SRDOE of lens 130 and, due to dispersion, are focused separately (along spaced-apart propagation paths) on the beam expander 150. Therefore, the beam expander is configured with two different regions (patterned regions) dedicated to different wavelengths, respectively, to thereby correct dispersion by combining them to propagate along common propagation path.
[0149] Reference is made to
[0150] The relay system 850 is transparent to wavelengths other than the designed wavelength, i.e., these other wavelengths are transmitted (with nearly 100% efficiency) through the zeroth diffraction order. Each one of the lenses 130 and 140 implements a computer-generated (calculated desired phase) for the selected operative wavelength, where the phase was calculated through optimization using ray tracing. The lenses impose that phase through diffraction in the first order.
[0151] In the following, several additional examples of the relay system of the present disclosure are exemplified which are configured for use in augmented reality (AR) head mounted displays (HMD) and augmented reality glasses. To facilitate understanding, in all the examples, functionally similar elements/parts of the system are identified by the same reference numbers.
[0152] Thus, each of the optical systems described below is configured as a relay system 100 which includes at least one off-axis 4f-system 120 where one or both of the lenses is/are formed of at least one SRDOE configured as described above. The off-axis 4f-system 120 is associated with (is exposed to) a virtual light field LF1 from a light (laser) engine 110. The relay system 120 is configured (i) to relay the virtual image light field LF1 from the light engine 110 onto the eyebox 170 in the proximity to the eye pupil plane and (ii) to combine the virtual image LF1 with the real-world light field (not shown).
[0153] The light engine 110 typically includes a light source unit 112 configured to produce red (R), green (G), and blue (B) light components combined to a single collimated beam LF1, and a scanning mirror 114. The size of the output aperture of the light engine, e.g., size of scanning mirror 114, defines the entrance pupil size of the relay system 100.
[0154] The size of the eyebox 170 is defined by the beam width emerging from the light engine 110 (i.e. defined by the scanner 114) can be increased by using an expander 150 in the intermediate Fourier plane of the 4f-system. In all these examples, the SRDOE-based lens 140, and possibly also lens 130, is formed by stacked SRDOEs. These SRDOEs feature polarization, wavelength, and angular selectivity. They can be designed for diffraction of the RGB wavelengths, and are entirely transparent for all other wavelengths.
[0155]
[0156]
[0157] In the example of
[0158]
[0159]
[0160] The addition of such polarization control assembly might be associated with a need of placing the light engine unit 110 at the same side as the eyebox created by the system (i.e. at the same side as user's eye). Thus, in such configuration, the lens 130 is configured for diffraction of selected polarization, s-polarization. P-polarized components of the input light field, LF1p are thus not diffracted by the lens 130 but transmitted therethrough (through the zeroth order) and thus interact with the assembly 915. The latter includes a polarization rotator 917 implemented as a quarter wave plate (QWP) and a reflector 916. Thus, the p-polarized light LF1p from the light engine 110 passes through the first lens 130 of the 4f-system (through the zeroth order of lens), and then passes once through the QWP 917; the so-produced circularly polarized light is reflected from the mirror 916 to pass back through the QWP 917 and again undergo polarization rotation, thus producing 90-degree polarization rotated light, i.e. s-polarized light LF1s, which is finally diffracted by the first lens 130.
[0161] As mentioned above, such configuration may be advantageous since it allows placing the light engine 110 on the same side as user's eye, thus providing a compact form factor of the optical system.
[0162] Reference is made to
[0163]
[0164]
[0165] Reference is made to
[0166] Reference is made to
[0167]
[0168] It should be noted, although not specifically, shown that the light engine typically includes a light source unit (e.g. RGB lasers) associated with a beam combiner; and a scanning mirror (e.g. MEMS based scanner). The scanner which defines an entrance pupil of the near-eye mixed reality system (i.e. the output of the scanner is located at the focal plane of the first lens of the relay system) receives the combined beam from the beam combiner and properly performs projection, by scanning, of a 2D image (virtual light field) on the on the relay system.
[0169]
[0170] The elements of each system 102 can be properly distributed between the glasses' lens 1032A, 1032B, temples 1034A, 1034B and frame parts 1036A, 1036B, as well as between the “active” region of the lens, being a central region exposed to eye's pupil, and an “inactive” periphery region of the lens as the case may be.
[0171] The configuration may be such that the light engine 110 and the first lens 130 of the relay system 100 may be is accommodated in/mounted on the frame part of the glasses, the expander 150 if used may be located in periphery region of the glasses' lens, while the second lens 140 is located in/aligned with the central active region of the glasses' lens. This is shown more specifically in
[0172]
[0173] The configuration and operation of such polarization control assembly 915 is described above with reference to the example of
[0174] The system 102 exemplified in
[0175]
[0176]
[0177] The configuration of
[0178]