Display apparatus capable of laterally shifting image
11682104 · 2023-06-20
Assignee
- Samsung Electronics Co., Ltd. (Suwon-si, KR)
- MYONGJI UNIVERSITY INDUSTRY AND ACADEMIA COOPERATION (Yonsin-si, KR)
Inventors
- Bongsu Shin (Seoul, KR)
- Woojun Han (Yongin-si, KR)
- Jaisoon Kim (Yongin-si, KR)
- Sunil Kim (Seoul, KR)
- Geeyoung Sung (Daegu, KR)
Cpc classification
G02B27/126
PHYSICS
G06F3/011
PHYSICS
G02F1/29
PHYSICS
G06T3/20
PHYSICS
G02B2027/0187
PHYSICS
G02B27/64
PHYSICS
G02B27/0075
PHYSICS
G02B27/0179
PHYSICS
G02B27/0081
PHYSICS
International classification
G06T3/20
PHYSICS
G02B27/00
PHYSICS
G02F1/29
PHYSICS
G06T19/00
PHYSICS
Abstract
Provided is a display apparatus including an image forming optical system configured to form an image to be displayed, an eyepiece optical system configured to provide the image formed by the image forming optical system to a pupil of an observer, and an image shifting optical system disposed on an optical path between the image forming optical system and the eyepiece optical system, the image shifting optical system being configured to shift the image formed by the image forming optical system in a direction perpendicular to an optical axis, wherein the image shifting optical system includes a first optical member having a first focal length and a second optical member having a second focal length, and wherein a distance between the first optical member and the second optical member along the optical axis is equal to a sum of the first focal length and the second focal length.
Claims
1. An augmented reality (AR) apparatus comprising: an image forming optical system configured to form an image to be displayed; an eyepiece optical system configured to provide the image formed by the image forming optical system to a pupil of an observer; an image shifting optical system disposed on an optical path between the image forming optical system and the eyepiece optical system, the image shifting optical system being configured to move in a direction perpendicular to an optical axis to shift the image formed by the image forming optical system in the direction perpendicular to the optical axis, an eye tracker comprising at least one processor configured to track a position of the pupil of the observer; a controller comprising at least one processor configured to control a position of the image shifting optical system based on a change of the position of the pupil of the observer provided from the eye tracker; and an actuator configured to move the image shifting optical system in the direction perpendicular to the optical axis based on a control of the controller, wherein, when the image shifting optical system moves by a first distance in the direction perpendicular to the optical axis, the image is shifted by a second distance in the direction perpendicular to the optical axis, wherein, when δ denotes the second distance, Δ denotes the first distance, and M.sub.A denotes the magnification of the image shifting optical system, δ satisfies δ=−Δ(1/M.sub.A−1).
2. The AR apparatus of claim 1, wherein the image shifting optical system comprises a first optical member having a first focal length and a second optical member having a second focal length; wherein a distance between the first optical member and the second optical member along the optical axis is equal to a sum of the first focal length and the second focal length, and wherein the actuator is configured to simultaneously move the first optical member and the second optical member by a same distance in a same direction.
3. The AR apparatus of claim 2, wherein the first focal length of the first optical member and the second focal length of the second optical member are equal to each other.
4. The AR apparatus of claim 2, wherein the first optical member is spaced apart by the first focal length along the optical axis toward an image side from a first pupil on which the image is focused between the image forming optical system and the first optical member.
5. The AR apparatus of claim 4, wherein the second optical member is spaced apart by the second focal length along the optical axis toward an object side from a second pupil on which the image is focused between the image shifting optical system and the eyepiece optical system.
6. The AR apparatus of claim 2, wherein the first optical member and the second optical member respectively comprise a convex lens.
7. The AR apparatus of claim 2, wherein the first optical member comprises a convex lens, and the second optical member comprises a concave lens.
8. The AR apparatus of claim 7, wherein the image shifting optical system further comprises a beam splitter configured to transmit light incident from the first optical member and to reflect light incident from the second optical member.
9. The AR apparatus of claim 7, wherein the image shifting optical system further comprises a beam splitter configured to reflect light incident from the first optical member and to transmit light incident from the second optical member.
10. The AR apparatus of claim 2, wherein the first optical member comprises a concave lens, and the second optical member comprises a convex lens.
11. The AR apparatus of claim 10, wherein the image shifting optical system further comprises a beam splitter configured to reflect light incident from the image forming optical system and to transmit light incident from the first optical member toward the second optical member.
12. The AR apparatus of claim 1, wherein a movement distance δ.sub.P of an exit pupil in the direction perpendicular to the optical axis satisfies δ.sub.P=M.sub.P×δ, M.sub.P being a magnification of the eyepiece optical system.
13. The AR apparatus of claim 1, wherein the image forming optical system comprises: a light source configured to emit illumination light; a spatial optical modulator configured to form the image by reflecting and modulating the illumination light; and a beam splitter configured to transmit the illumination light to the spatial optical modulator and transmit the image formed by the spatial optical modulator to the image shifting optical system.
14. The AR apparatus of claim 13, wherein the image forming optical system further comprises an objective lens configured to collimate the illumination light emitted from the light source to the spatial optical modulator and focus the image formed by the spatial optical modulator on a first pupil between the image forming optical system and the image shifting optical system.
15. The AR apparatus of claim 14, wherein the image forming optical system further comprises a spatial filter configured to remove light other than the image focused by the objective lens.
16. The AR apparatus of claim 14, wherein the image forming optical system further comprises a folding mirror configured to bend a travel path of the image by reflecting the image focused by the objective lens.
17. The AR apparatus of claim 1, wherein the image forming optical system comprises: a light source configured to emit illumination light; a collimating lens configured to collimate the illumination light into parallel light; a spatial optical modulator configured to form the image by transmitting and modulating the illumination light that is collimated; and an objective lens configured to focus the image formed by the spatial optical modulator on a first pupil that is located between the image forming optical system and a first optical member.
18. The AR apparatus of claim 1, wherein the eyepiece optical system comprises: a first beam splitter configured to reflect light incident from a first surface of the first beam splitter and to transmit light incident from a second surface of the first beam splitter; a first mirror disposed on the second surface of the first beam splitter and configured to reflect light; a second mirror configured to focus the image on the pupil of the observer; and a second beam splitter configured to reflect light incident from the first mirror to the second mirror and to transmit light incident from the second mirror.
19. The AR apparatus of claim 1, wherein the eyepiece optical system comprises: a first beam splitter configured to reflect light incident from a first surface of the first beam splitter and to transmit light incident from a second surface of the first beam splitter; a first mirror disposed on the second surface of the first beam splitter and configured to reflect light; a second mirror configured to focus the image on the pupil of the observer; and a second beam splitter configured to transmit light coming from the first mirror to the second mirror and to reflect light coming from the second mirror.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and/or other aspects will become apparent and more readily appreciated from the following description of example embodiments, taken in conjunction with the accompanying drawings in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
DETAILED DESCRIPTION
(16) Reference will now be made in detail to example embodiments of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. In this regard, example embodiments may have different forms and should not be construed as being limited to the descriptions set forth herein. Accordingly, the example embodiments are merely described below, by referring to the figures, to explain aspects. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. Expressions such as “at least one of,” when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list. For example, the expression, “at least one of a, b, and c,” should be understood as including only a, only b, only c, both a and b, both a and c, both b and c, or all of a, b, and c.
(17) An expression used in the singular encompasses the expression of the plural, unless it has a clearly different meaning in the context. In addition, unless explicitly described to the contrary, the word “comprise” and variations such as “comprises” or “comprising” will be understood to imply the inclusion of stated elements but not the exclusion of any other elements.
(18) Hereinbelow, referring to the attached drawings, a display apparatus capable of laterally shifting an image will be described in detail. In the drawings, a size of each element may be exaggerated for clarity and convenience of a description. Meanwhile, the following example embodiments described below are merely illustrative, and various modifications may be possible from the example embodiments. In a layer structure described below, when a position of an element is described using an expression “above” or “on”, the position of the element may include not only the element being “immediately on/under/left/right in a contact manner” but also being “on/under/left/right in a non-contact manner”.
(19)
(20) The image forming optical system 110 may include an illuminating device 111 that provides illumination light, a spatial optical modulator 114 that forms an image by reflecting and modulating the illumination light, a beam splitter 112 configured to deliver the illumination light to the spatial optical modulator 114 and to deliver the image formed by the spatial optical modulator 114 to the image shifting optical system 120, and an objective lens 113 disposed between the spatial optical modulator 114 and the beam splitter 112. Although the objective lens 113 is illustrated as one lens element in
(21) The illuminating device 111 may include, for example, an array of a plurality of light-emitting diodes (LEDs) that emit red light, green light, and blue light, but example embodiments are not limited thereto. The illumination light emitted from the illuminating device 111, after being reflected by the beam splitter 112, may become parallel light by passing through the objective lens 113, and may be incident on the spatial optical modulator 114. Thus, the objective lens 113 may serve as a collimating lens that collimates the illumination light delivered from the illuminating device 111 to the spatial optical modulator 114.
(22) The spatial optical modulator 114 may form an image by modulating the incident light based on an image signal provided from a signal processor. The spatial optical modulator 114 may include, for example, a liquid crystal on silicon (LCoS) panel, a digital light projection (DLP) panel, or a digital micromirror device (DMD) panel. The spatial optical modulator 114 may form the image by changing a reflectivity according to a position of the incident light on a surface of the spatial optical modulator 114.
(23) The image formed by reflection of the illumination light through the spatial optical modulator 114 may pass through the objective lens 113. The objective lens 113 may focus the image formed by the spatial optical modulator 114 to a first pupil P1 between the image forming optical system 110 and the image shifting optical system 120.
(24) The image shifting optical system 120 may be disposed on a light path between the image forming optical system 110 and the eyepiece optical system 130, and relay the image to the eyepiece optical system 130 and at the same time, shift the image in a direction perpendicular to the optical axis OX. In particular, the image shifting optical system 120 may shift the image under control of the controller 140 to more accurately provide the image to the pupil of the observer in response to the change of the position of the pupil of the observer provided from the eye tracker 150. To this end, the image shifting optical system 120 may include a first optical member 121, a second optical member 122, and an actuator 123 that moves the image shifting optical system 120 in the direction perpendicular to the optical axis OX under control of the controller 140. The actuator 123 may be configured to move the first optical member 121 and the second optical member 122 perpendicularly to the optical axis OX at the same time.
(25)
(26) The first optical member 121 and the second optical member 122 may relay the image focused on the first pupil P1 between the image forming optical system 110 and the image shifting optical system 120 and focus the image to a second pupil P2 between the image shifting optical system 120 and the eyepiece optical system 130. To this end, the first optical member 121 and the second optical member 122 may be spaced apart from each other by a sum of the first focal length f.sub.A and the second focal length f.sub.B. That is, a distance between the first optical member 121 and the second optical member 122 on the optical axis OX is equal to the sum f.sub.A+f.sub.B of the first focal length f.sub.A and the second focal length f.sub.B. Herein, the distance between the first optical member 121 and the second optical member 122 may be measured with respect to a central point of the first optical member 121 and a central point of the second optical member 122 on the optical axis OX.
(27) The first optical member 121 may be disposed to be spaced apart by the first focal length f.sub.A along the optical axis OX toward an image side, from a plane perpendicular to the optical axis OX on which the first pupil P1 to which the image is focused is located between the image forming optical system 110 and the first optical member 121. The second optical member 122 may be disposed to be spaced apart by the second focal length f.sub.B along the optical axis OX, toward an object side from a plane perpendicular to the optical axis OX on which the second pupil P2 to which the image is focused is located between the second optical member 122 and the eyepiece optical system 130. Then, the image shifting optical system 120 may satisfy an afocal condition and a telecentric condition, thus delivering the image on the first pupil P1 to the second pupil P2. The image shifting optical system 120 may shift the image of the first pupil P1 on the optical axis OX, in the direction perpendicular to the optical axis OX along the plane perpendicular to the optical axis OX on which the second pupil P2 is located.
(28) For example,
(29)
(30) In Equation 1, M.sub.A indicates a magnification of the image shifting optical system 120. The magnification M.sub.A of the image shifting optical system 120 may be expressed by Equation 2.
(31)
(32) Referring to
(33) Referring back to
(34) In the direction perpendicular to the optical axis OX, the position of the exit pupil of the eyepiece optical system 130 is opposite to the position of the second pupil P2. For example, when the second pupil P2 is formed on the optical axis OX, the exit pupil of the eyepiece optical system 130 is located on the optical axis OX. When the second pupil P2 is formed above the optical axis OX, the exit pupil of the eyepiece optical system 130 is formed under the optical axis OX, whereas when the second pupil P2 is formed under the optical axis OX, the exit pupil of the eyepiece optical system 130 is formed above the optical axis OX.
(35)
(36)
δ.sub.P=M.sub.P×δ [Equation 3]
(37) In Equation 3, M.sub.P indicates a magnification of the eyepiece optical system 130.
(38) As described above, by moving the image shifting optical system 120 in the direction perpendicular to the optical axis OX, the image may be moved in the direction perpendicular to the optical axis OX. Thus, a change of the position of the pupil of the observer may be more readily responded. According to the above-described example embodiments, the image shifting optical system 120 may use the two optical members 121 and 122, which may contribute to miniaturization of the display apparatus 100. Moreover, based on the image being shifted in the direction perpendicular to the optical axis OX without being shifted in a direction parallel with the optical axis OX, a more accurate image may be provided to the pupil of the observer. In addition, even when the image is shifted, the image is not inclined. Thus, a more accurate image that is not distorted may be provided to the observer.
(39) In the example embodiment illustrated in
(40) Meanwhile, an effective focal length of the entire optical system of the display apparatus 100 may be determined by a size h and a viewing angle θ of the spatial optical modulator 114 as in Equation 4.
Effective focal length of system=h/tan θ [Equation 4]
(41) An effective focal length of the objective lens 113 of the image forming optical system 110 may be defined by Equation 5.
(42)
(43) According to Equation 1, as the magnification M.sub.A of the image shifting optical system 120 is small, the second pupil P2 may move more even when the image shifting optical system 120 moves less. However, according to Equation 5, as the magnification M.sub.A of the image shifting optical system 120 is small, the effective focal length of the objective lens 113 may decrease and a diameter of the objective lens 113 may increase. In this regard, the magnification M.sub.A of the image shifting optical system 120 may be set, for example, to be −1 (M.sub.A=−1). In other words, the first focal length f.sub.A of the first optical member 121 and the second focal length f.sub.B of the second optical member 122 may be equal to each other. However, example embodiments are not limited thereto. For example, the first focal length f.sub.A of the first optical member 121 and the second focal length f.sub.B of the second optical member 122 may be set differently, based on the size and performance of the entire optical system of the display apparatus 100.
(44)
(45) The display apparatus 100 may be included in a smart phone that may be used as a multi-image display apparatus. For example, the display apparatus 100 may be applied in a small-size electronic device, such as a mobile electronic device, as well as the wearable device illustrated in
(46) When the display apparatus 100 is applied to the wearable device illustrated in
(47) Among components of the image forming optical system 210 illustrated in
(48) The image shifting optical system 220 may include a first optical member 221 and a second optical member 222. Structures and operations of the first optical member 221 and the second optical member 222 of the image shifting optical system 220 may be the same as those described above. The first optical member 221 and the second optical member 222 may be disposed, for example, inside the temple of the wearable device.
(49) The eyepiece optical system 230 may include a second beam splitter 231, a first mirror 232, a third beam splitter 233, and a second mirror 234, which are disposed sequentially along the optical path. The second beam splitter 231 may be disposed on the same layer as the image forming optical system 210 and the image shifting optical system 220. For example, the second beam splitter 231 may be disposed in a position adjacent to the glasses screen inside the temple of the wearable device. The first mirror 232 may be disposed on the second beam splitter 231. The third beam splitter 233 and the second mirror 234 may be disposed under the beam splitter 231. For example, the third beam splitter 233 and the second mirror 234 may be disposed in the glasses screen of the wearable device. The first mirror 232 may be a simple plane mirror. Instead, the first mirror 232 may be a concave mirror that is configured to operate optically equivalent to a convex lens. The second mirror 234 may be a concave mirror for focusing an image on the exit pupil.
(50)
(51) The image forming optical system 210 may further include a spatial filter 215 that removes light other than the image focused by the objective lens 213. While the spatial filter 215 is illustrated in
(52) In the eyepiece optical system 230, the image may travel along a complex path. For example,
(53) The first mirror 232 may be disposed on the second surface 231b of the second beam splitter 231. The first mirror 232 reflects the image toward the inclined surface 231c. The image incident on the second surface 231b is reflected by the first mirror 232 and then passes through the inclined surface 231c. The inclined surface 231c may be a half mirror. For example, the inclined surface 231c may reflect 50% of incident light and transmit the remaining 50% of the incident light, but example embodiments are not limited thereto. For example, the inclined surface 231c may reflect light coming in a direction from the first surface 231a and transmit light coming in a direction from the second surface 231b.
(54)
(55) As illustrated in
(56) While
(57) The collimating lens 217 may be disposed to face a first surface 212a of the first beam splitter 212. After the illumination light is incident on the first surface 212a of the first beam splitter 212, the illumination light may be reflected by an inclined surface 212d of the first beam splitter 212 and may be incident on a second surface 212b of the first beam splitter 212. On the second surface 212b of the first beam splitter 212, the spatial optical modulator 214 may be disposed. Although the spatial optical modulator 214 is illustrated in
(58) While the spatial optical modulators 114 and 214 have been described as a reflective type, the spatial optical modulator may also be of a transmissive type. For example,
(59)
(60) The third beam splitter 233 may be configured to transmit light incident on the first surface 233a and to reflect light incident on the second surface 233b. An image reflected by the first mirror 232 may then arrive at the second mirror 234 by passing through the first surface 233a of the third beam splitter 233. An image reflected by the second mirror 234 may be focused on the pupil of the observer by being reflected by the second surface 233b of the third beam splitter 233. The third beam splitter 233 may be disposed such that the first surface 233a faces the outside. The third beam splitter 233 may then transmit the light L coming from outside without refraction. Thus, the observer may then see a virtual image formed by the spatial optical modulator 214, together with view of the outside.
(61) So far, it has been described that the first optical member 121 and the second optical member 122 of the image shifting optical system 120 and the first optical member 221 and the second optical member 222 of the image shifting optical system 220 include convex lenses. However, a concave mirror that is configured to operate optically equivalent to a convex lens may also be used in place of the convex lens. For example,
(62) Referring to
(63) Referring to
(64) Referring to
(65) The beam splitter 423 may be configured to transmit light coming from the image forming optical system and reflect light coming from the first optical member 421 toward the second optical member 422. In this case, the first optical member 421 and the second optical member 422 may be disposed to face two adjacent surfaces of the beam splitter 423.
(66) In the example embodiments illustrated in
(67) Referring to
(68) It should be understood that embodiments described herein should be considered in a descriptive sense only and not for purposes of limitation. Descriptions of features or aspects within each example embodiment should typically be considered as available for other similar features or aspects in other embodiments.
(69) While example embodiments have been described with reference to the figures, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope as defined by the following claims.