AUGMENTED REALITY DISPLAY DEVICE
20230152592 · 2023-05-18
Assignee
Inventors
- Jeonggeun Yun (Suwon-si, KR)
- Kyusub KWAK (Suwon-si, KR)
- Kyookeun LEE (Suwon-si, KR)
- Youngmo JEONG (Suwon-si, KR)
Cpc classification
G02B6/0036
PHYSICS
G02B6/0058
PHYSICS
G02B27/0081
PHYSICS
International classification
Abstract
Provided is an augmented reality (AR) display device. The AR display device includes an optical engine configured to output light of a virtual image and a light guide plate including a first region that receives the light of the virtual image, a third region that outputs the light of the virtual image, and a second region that propagates the light of the virtual image input to the first region toward the third region, in which a pupil expansion grating is formed in the second region to duplicate the light of the virtual image incident to the first region into a plurality of beamlets, and in the third region, an output grating array is formed in which a plurality of small diffractive grating regions are arranged at intervals equal to or less than a size of a pupil, in which a diameter of each of the plurality of small diffractive grating regions is equal to or less than the size of the pupil.
Claims
1. An augmented reality (AR) display device comprising: an optical engine configured to output light of a virtual image; and a light guide plate comprising a first region that receives the light of the virtual image, a third region that outputs the light of the virtual image, and a second region that propagates the light of the virtual image input to the first region toward the third region, wherein a pupil expansion grating is formed in the second region to duplicate the light of the virtual image incident to the first region into a plurality of beamlets, and in the third region, an output grating array is formed in which a plurality of small diffractive grating regions are arranged at intervals equal to or less than a first size of a pupil, wherein a diameter of each of the plurality of small diffractive grating regions is equal to or less than the first size of the pupil.
2. The AR display device of claim 1, wherein a small diffractive grating of each of the plurality of small diffractive grating regions comprises one of a diffractive optical element, a surface relief grating, a hologram optical element, or a metasurface.
3. The AR display device of claim 1, wherein each of the plurality of small diffractive grating regions comprises a circular or polygonal boundary.
4. The AR display device of claim 1, wherein a second size of each of the plurality of small diffractive grating regions is equal to or less than about 4 millimeters (mm).
5. The AR display device of claim 1, wherein the plurality of small diffractive grating regions are arranged in a hexagonal array pattern.
6. The AR display device of claim 1, wherein a small diffractive grating of each of the plurality of small diffractive grating regions comprises an identical or different vector.
7. The AR display device of claim 1, wherein an input diffractive grating is formed in the first region to couple a received light of the virtual image to the second region, and a sum of a first grating vector of the input diffractive grating of the first region, a second grating vector of the pupil expansion grating of the second region, and a third grating vector of a small diffractive grating of the plurality of small diffractive grating regions is equal to 0.
8. The AR display device of claim 1, wherein a pitch of the output grating array is uniform.
9. The AR display device of claim 1, wherein a pitch of the output grating array is varied.
10. The AR display device of claim 1, wherein at least some of the plurality of small diffractive grating regions have different diameters.
11. The AR display device of claim 1, wherein the plurality of small diffractive grating regions have larger diameters in an edge of the third region than in a center of the third region.
12. The AR display device of claim 1, wherein at least a part of the third region overlaps with the second region.
13. The AR display device of claim 1, wherein at least a partial region of the light guide plate is formed of a transparent material to pass light of a real scene through the transparent material.
14. The AR display device of claim 1, further comprising a body having the optical engine and the light guide plate installed therein and configured to be wearable on a user.
15. The AR display device of claim 14, wherein the body comprises a glasses frame, a goggles frame, a first main body of a helmet body, and a second main body of a head mounted display (HMD).
16. The AR display device of claim 1, wherein the intervals of the plurality of small diffractive grating regions are arranged to and provide a wide eye motion box with respect to translation of eyes vertically or horizontally.
17. The AR display device of claim 1, wherein a beam width of a plurality of light beams emitted from the plurality of small diffractive grating regions is maintained at less than a diameter of a pupil according to a size of a diameter of each small diffractive grating region of the plurality of small diffractive grating regions, regardless of change in a thickness of a crystalline lens of an eye, such that a virtual image remains in focus regardless of a gaze distance of a user.
18. The AR display device of claim 4, wherein the intervals of the plurality of small diffractive grating regions are arranged to and provide a wide eye motion box with respect to translation of eyes vertically or horizontally.
19. The AR display device of claim 4, wherein a beam width of a plurality of light beams emitted from the plurality of small diffractive grating regions is maintained at less than a diameter of a pupil according to a size of a diameter of each small diffractive grating region of the plurality of small diffractive grating regions, regardless of change in a thickness of a crystalline lens of an eye, such that a virtual image remains in focus regardless of a gaze distance of a user.
20. The AR display device of claim 19, wherein a shape of each small diffractive grating tegion of the plurality of small diffractive grating regions is one of a hexagonal shape, a rectangular shape, or a triangular shape.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
DETAILED DESCRIPTION
[0043] Hereinafter, example embodiments of the disclosure will be described in detail with reference to the accompanying drawings. In the drawings, like reference numerals denote like components, and sizes of components in the drawings may be exaggerated for convenience of explanation. Meanwhile, embodiments of the disclosure to be described are merely examples, and various modifications may be made from such embodiments of the disclosure.
[0044] Although terms used in embodiments of the disclosure are selected with general terms popularly used at present under the consideration of functions in the disclosure, the terms may vary according to the intention of those of ordinary skill in the art, judicial precedents, or introduction of new technology. In addition, in a specific case, the applicant voluntarily may select terms, and in this case, the meaning of the terms may be disclosed in a corresponding description part of an embodiment of the disclosure. Thus, the terms used in herein should be defined not by the simple names of the terms but by the meaning of the terms and the contents throughout the disclosure.
[0045] Singular forms include plural forms unless apparently indicated otherwise contextually. When a portion is referred to as “comprises” a component, the portion may not exclude another component but may further include another component unless stated otherwise.
[0046] In the disclosure, ‘augmented reality (AR)’ means overlaying a virtual image generated on a computer onto a physical real-world environment or a real-world object to display one image.
[0047] In the disclosure, an ‘AR display device’ refers to a device capable of expressing ‘AR’, and may include not only AR glasses in the form of glasses worn on a user, but also a head-mounted display (HMD) or an AR helmet, etc., worn on the user. The AR display device is usefully used in an everyday life such as information search, route guidance, camera photographing, etc. An AR glasses device implementing the AR display device in the form of glasses may be worn as a fashion item and used both in indoor and outdoor activities.
[0048] In the disclosure, a ‘real scene’ refers to a scene of the real world an observer or the user sees through the AR display device, and may include real world object(s). The ‘virtual image’ is an image generated through an optical engine. The virtual image may include both a static image and a dynamic image. The virtual image may be an image which is overlaid on the real scene to show information regarding a real object in the real scene or information or a control menu, etc., regarding an operation of the AR device.
[0049]
[0050] Referring to
[0051] The glasses-type body 110 may include, for example, a frame 111 and temples 119. The frame 111 in which glass lenses 101L and 101R are positioned may have, for example, the shape of two rims connected by a bridge. The glass lenses 101L and 101R are examples, and may have or may not have a refractive power (a power). The glass lenses 101L and 101R may be formed integrally, and in this case, the rims of the frame 111 may not be distinguished from the bridge 112. The glass lenses 101L and 101R may be omitted.
[0052] The temples 119 may be respectively connected to both ends 113 of the frame 111 and extend in a direction. The both ends 113 of the frame 111 and the temples 119 (including 119L on the left and 119R on the right) may be connected by a hinge 115.
[0053] In the glasses-type body 110, the optical engine 120, the light guide plate 130, and electronic parts 190 may be arranged. The electronic parts 190 may be mounted in a part of the glasses-type body 110 or positioned distributed in a plurality of parts thereof, and may be mounted on a printed circuit board (PCB) substrate, a flexible PCB (FPCB) substrate, etc.
[0054] The optical engine 120 may be configured to generate light of the virtual image, and may be an optical engine of a projector, which includes an image panel, an illuminating optical system, a projecting optical system, etc. The optical engine 120 may include a left-eye optical engine 120L and a right-eye optical engine 120R. The left-eye optical engine 120L and the right-eye optical engine 120R may be positioned in both ends 113 of the frame 111. In another example, the left-eye optical engine 120L and the right-eye optical engine 120R may be respectively positioned in a left temple 119L and a right temple 119R. The optical engine 120 may output polarized light or unpolarized light according to a scheme of the image panel or the illuminating optical system. For example, when the image panel is a liquid crystal on silicon (LCoS) panel or other liquid crystal image panel, or when a polarizing beam splitter is used to split/couple beams, the optical engine 120 may output linearly polarized light. In another example, when the image panel is a digital micromirror device (DMD) panel, the optical engine 120 may output unpolarized light.
[0055] The light guide plate 130 may be configured to transmit light of the virtual image generated in the optical engine 120 and light of an external scene to a pupil of the user. The light guide plate 130 may include a left-eye light guide plate 130L and a right-eye light guide plate 130R. The left-eye light guide plate 130L and the right-eye light guide plate 130R may be respectively attached to the left glass lens 101L and the right glass lens 101R. Alternatively, the left-eye light guide plate 130L and the right-eye light guide plate 130R may be fixed on the frame 111 separately from the glass lenses 101L and 101R.
[0056]
[0057]
[0058] The processor 200 may control the overall operation of the AR display device 100 including the optical engine 120 by driving an operating system or an application, and perform various data processing and operations including image data. For example, the processor 200 may process image data including a left-eye virtual image and a right-eye virtual image that are rendered to have binocular disparity. The processor 200 may include, for example, at least one hardware among a central processing unit (CPU), a microprocessor, a graphic processing unit (GPU), application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), or field programmable gate arrays (FPGAs), without being limited thereto.
[0059] Data or a manipulation command is input to or output from an outside through the interface 210 which may include a user interface, for example, a touch pad, a controller, a manipulation button, etc., which may be manipulated by the user. In an embodiment of the disclosure, the interface 210 may include a wired communication module, such as a universal serial bus (USB) module, and a wireless communication module, such as Bluetooth, through which manipulation information of the user or data of a virtual image, transmitted from an interface included in an external device, may be received.
[0060] The memory 220 may include an internal memory such as volatile memory or nonvolatile memory. The memory 220 may store various data, programs, or applications for driving and controlling the AR display device 100 and input/output signals or data of a virtual image, under control of the processor 200.
[0061] The optical engine 120 may be configured to receive image data generated by the processor 200 and generate light of a virtual image, and may include the left-eye optical engine 120L and the right-eye optical engine 120R. Each of the left-eye optical engine 120L and the right-eye optical engine 120R may include a light source that outputs light and an image panel that forms a virtual image by using the light output from the light source, and may have a function such as a small projector. The light source may be implemented as, for example, a light-emitting diode (LED), and the image panel may be implemented as, for example, a DMD.
[0062] Although left-eye optical parts 130L will be described as an example below, a left-eye part and a right-eye part have structures symmetrical to each other, such that it would be understood by those of ordinary skill in the art that the left-eye optical parts 130L may be applied to right-eye optical parts 130R.
[0063]
[0064] The light guide plate 130 may be mounted on the frame 111 of
[0065] In an embodiment of the disclosure, in the first region 131 of the light guide plate 130, an input diffractive grating may be formed to couple incident light Li. When the light guide plate 130 is formed as a single layer, the input diffractive grating of the first region 131 may be formed on a surface facing the display engine 120 or an opposite surface thereto. Alternatively, when the light guide plate 130 is formed as multiple layers, the input diffractive grating of the first region 132 may be formed on each layer or some layers.
[0066] The optical engine 120 may be arranged such that the emitted light Lo is incident perpendicularly or inclinedly at a certain angle with respect to the first region 131.
[0067] The second region 132 may be positioned in a first direction (an X direction in
[0068] When the light guide plate 130 is formed as a single layer, the diffractive grating of the second region 132 may be formed on the same surface as a surface where the diffractive grating of the first region 131 is formed or an opposite surface to the surface. When the light guide plate 130 is formed as multiple layers, the diffractive grating of the second region 132 may be formed on the same surface as the surface where the diffractive grating of the first region 131 is formed or a different surface than the surface. Although it is described in the current embodiment of the disclosure that the second region 132 is a single region, the second region 132 may be divided into a plurality of regions. When the light guide plate 130 is formed as multiple layers, the second region 132 may include a plurality of regions formed on different layers.
[0069] The third region 133 may be positioned on a surface facing eyes of the user when the user wears the AR display device 100. For example, in
[0070]
[0071]
W≈D.sub.g [Equation 1]
[0072] Such an operating principle may operate in the same manner at every angle of light incident to the light guide plate 130. Finally, each small output grating region 310 may be regarded as the optical engine 120 having a beam width of D.sub.g.
[0073]
[0074] To reduce discontinuity of the entire image formed on the pupil, an interval I between the small output grating regions 310 may be approximately equal to or less than a pupil diameter D.sub.P. For example, the interval I between the small output grating regions 310 may be approximately equal to or less than about 4 mm. In other words, a pitch P of an output grating array including the small output grating regions 310 may satisfy the following mathematical relationship with the diameter D.sub.g of the small output grating region 310 and the pupil diameter D.sub.P.
D.sub.p≤P≤D.sub.g+D.sub.P [Equation 2]
[0075] The pitch P of the output grating array may be uniform across the entire third region 133, without being limited thereto.
[0076]
[0077]
[0078]
[0079]
[0080]
[0081] In addition, each circular diffractive element projects the same virtual image to form a focus at all times in spite of eye movement, and allows watching of the same image to provide a large eye box.
[0082] While the AR display device according to the disclosure has been shown and described in connection with the embodiments of the disclosure to help understanding of the disclosure, it will be apparent to those of ordinary skill in the art that modifications and variations may be made. Therefore, the true technical scope of the disclosure should be defined by the appended claims.