HEAD-MOUNTED DISPLAY APPARATUS
20220146856 · 2022-05-12
Inventors
Cpc classification
H04N13/239
ELECTRICITY
H04N2213/008
ELECTRICITY
International classification
H04N13/239
ELECTRICITY
Abstract
A head mountable imaging apparatus (5) for assisting a user with reduced vision comprises a first display device (20) configured to provide a display to a first eye of the user. A first lens (27) is provided on a user side of the first display device (20). The first lens (27) is configured to form a focused image of the first display device (20). A first camera (25) is configured to provide an output representing a scene in front of the imaging apparatus (5). A processor (40) is configured to receive the output from the first camera (25), to perform one or more image enhancements to improve vision for the user and to provide a processed output to the first display device (20) for display to the user. The first display device (20) is circular or elliptical.
Claims
1. A head mountable imaging apparatus for assisting a user with reduced vision, the apparatus comprising: a first display device configured to provide a display to a first eye of the user; a first lens provided on a user side of the first display device, the first lens configured to form a focused image of the first display device; a first camera configured to provide an output representing a scene in front of the imaging apparatus; and a processor configured to receive the output from the first camera, to perform one or more image enhancements to improve vision for the user and to provide a processed output to the first display device for display to the user, wherein the first display device is circular or elliptical.
2. An apparatus according to claim 1, further comprising a first tubular element which surrounds the first display device and the first lens, with the first lens located at an eye-facing end of the first tubular element.
3. An apparatus according to claim 2, wherein the first tubular element provides a light tight shield.
4. An apparatus according to claim 2, wherein the first lens is supported by the first tubular element.
5. An apparatus according to claim 1, wherein the first lens is circular or round.
6. An apparatus according to claim 1, further comprising an open region adjacent the first lens such that a user is able to view a combination of an image on the first display device and surrounding environment outside the imaging apparatus.
7. An apparatus according to claim 1, wherein the apparatus is configured to display an image having a first angular field of view of the scene on the first display device, and to provide to the user an angular field of view of the first display device which is the same as the first angular field of view.
8. An apparatus according to claim 1, wherein a distance between the first display device and the first lens is less than a diameter or height of the first display device.
9. An apparatus according to claim 1, wherein the first display device is an opaque display device which does not allow a user to see through the display device.
10. An apparatus according to claim 1, wherein the first camera has a first image sensor, and wherein the processor is configured to obtain the output from a selected region of the first image sensor which is a subset of an overall area of the first image sensor.
11. An apparatus according to claim 10, wherein the image sensor has a rectangular shape.
12. An apparatus according to claim 10, wherein the image sensor has an x-axis and a y-axis and wherein the processor is configured to vary the position of the selected region in at least one of the x-axis and the y-axis.
13. An apparatus according to claim 10, wherein the processor is configured to vary a size of the selected region of the overall area of the first image sensor.
14. An apparatus according to claim 1, wherein the first camera is positioned on an outer, forward-facing, side of the imaging apparatus in front of the first display device.
15. An apparatus according to claim 14, wherein the first camera is aligned with a central axis of the first display device.
16. An apparatus according to claim 15, wherein the first camera is substantially aligned with an optical axis of the user's first eye.
17. An apparatus according to claim 1, wherein the first lens is a Fresnel lens, an aspheric lens or a plano convex lens.
18. An apparatus according to claim 1, further comprising a second display device which is circular or elliptical.
19. An apparatus according to claim 1, further comprising a second camera configured to provide an output representing a scene in front of the imaging apparatus.
20. An apparatus according to claim 19, wherein the second camera is positioned on an outer, forward-facing, side of the imaging apparatus in front of the second display device.
21. An apparatus according to claim 20, wherein the second camera is aligned with a central axis of the second display device.
22. An apparatus according to claim 21, wherein the second camera is substantially aligned with an optical axis of the user's second eye.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0038] One or more embodiments of the invention will now be described, by way of example only, with reference to the accompanying figures in which:
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
DETAILED DESCRIPTION
[0049]
[0050] The imaging apparatus 5 provides each eye of the user with an image representing a view of the surrounding environment in front of the apparatus. In particular, the imaging apparatus 5 provides each eye of the user with an image representing a view of the surrounding environment that a user would normally experience with that eye. A display 20, 30 is provided in front of each of the user's eyes. A first display 20 is provided in front of the user's left eye. A second display 30 is provided in front of the user's right eye. Each display 20, 30 is supported by the frame/housing 10. The position of the displays 20, 30 is best seen in
[0051] Each of the displays 20, 30 has a round shape, such as a circular shape or an oval/elliptical shape. In an example, the diameter of the circular OLED display is 35 mm. Other dimensions are possible. The displays 20, 30 may be the type of round displays used in smart watches, or any other suitable display.
[0052] In
[0053] Referring again to
[0054] Each lens 27, 37 is round and advantageously is slightly larger than the display. For example a 40 mm diameter lens may be used with a 35 mm diameter display. Each display 20, 30 is placed within, or near, the focal plane of the lens. This allows the full area of the display to be viewed and results in an image focused far away when placed close to the eye.
[0055] A first tubular element 24 surrounds the display 20 and the lens 27, maintaining the lens 27 at a fixed distance from the display 20. The lens 27 is supported by the first tubular element 24. No other part of the frame 10 or housing is required to support the first lens 27. The display (or the PCB 26 on which the display 20 is mounted) is located at the outward-facing end of the tubular element 24. The fresnel lens 27 is located at, or close to, the eye-facing end of the tubular element 24. A region of empty space separates the display 20 and the lens 27. The first tubular element 24 may also provide a light tight shield between the lens 27 and the display 20. That is, the only optical path to/from the display is via the lens 27. This prevents stray light from reaching the display 20. This can improve readability of the display, especially under bright conditions while avoiding the need to fully isolate the user from the surrounding environment in the manner of a conventional shielded headset. High contrast is important for partially-sighted people due to a degradation in contrast sensitivity. A second tubular element 34 provides the same functions for the right eye display 30 and lens 37.
[0056] The imaging apparatus 5 comprises an open region 16 adjacent to the first lens 27. The open region 16 is to the left hand side of the first lens 27. Similarly, the imaging apparatus 5 comprises an open region 17 adjacent to the second lens 37. The open region 17 is to the right hand side of the first lens 27. Instead of shielding the user from the surrounding environment, the user can view a combination of an image on the first display device (via the lens 27) and the surrounding environment outside the imaging apparatus. Similarly, the user can view a combination of an image on the second display device (via the lens 37) and the surrounding environment outside the imaging apparatus. The open region has an advantage of keeping the periphery clear for general spatial awareness, object location and obstacle avoidance. It has an advantage of reducing the feeling of isolation from the external world that is normally associated with a shielded headset type of imaging apparatus, and can reduce nausea. The open region has an advantage of improving airflow, preventing uncomfortable heat and moisture.
[0057] A prescription lens 28, 38 may also be provided. The prescription lens may compensate for short-sightedness (myopia), far-sightedness (hyperopia) and/or some other condition. In
[0058]
[0059] One possible location for the processing unit 40 is the bridge region 11 of the frame/housing 10. Another possible location for the processing unit 40 is in one, or both, of the arms 12, 13. The imaging apparatus 5 may comprise a local power source, such as at least one battery housed in one, or both, of the arms 12, 13.
[0060]
[0061] For comparison purposes,
[0062]
[0063]
[0064]
[0065]
[0066] Advantageously the display 20, camera 25 and Fresnel lens 27 are all aligned, and are aligned with a main optical axis 21 of the user's eye 2. The Fresnel lens 27 is positioned within a field of view (FOV) of the user's eye. The lens 27 allows the user's eye to form a focused image of the display 20.
[0067] An aim of the imaging apparatus 5 is to appear, to the user, as if there is nothing but an empty glasses frame in front of their eye. To achieve this, the FOV 22 of the lens 27 and display 20 as seen by the user's eye is matched to the FOV 25D of the scene displayed on the display 20. This gives a system magnification of 1× (unity) in terms of angular field of view. The relationship between the FOV 22 and FOV 25D is shown by
[0068] In conventional Virtual Reality (VR)/Augmented Reality (AR) imaging there is often a mismatch between the viewing angle of cameras and the viewing angle of their displays. This provides further difficulties with navigation due to mismatches in the optic flow of the visual scene. Close objects move faster in the visual field than distant objects. When the image on the display is zoomed in, and at a greater size than real life, the increased optic flow makes everything appear to be closer than it is.
[0069] The user typically experiences a discontinuity between their view of the display 20, 30 and their view past the edge of the display 20, 30 due to distortions in the image. The discontinuity in the optic flow may induce nausea and make navigation around the world challenging. It may also make it difficult to perform tasks requiring hand-eye coordination.
[0070] In the imaging apparatus 5, the effects of this optical discontinuity are reduced. A user experiences a system magnification of unity by matching the camera focal length and chip size, to the display size and lens focal length. Fine adjustments to the system magnification are made digitally. This ensures that peripheral vision past the edge of the display and the image on the display are continuous. The user is able to then use peripheral vision with no mismatch in position, scale or flow of objects as they pass the boundary from peripheral vision to the display. The discontinuity at the boundary of the apparatus may be similar to that experienced at a frame of a conventional pair of glasses.
[0071] The user's field of view FOV 22 of the lens 27, and the display 20 beyond the lens 27, is determined by factors such as the size of the lens 27, the size of the display 20 and the distance 50 between the lens 27 and the eye 2. As explained above, the eye 2 has a wider overall FOV than FOV 22. The extent of the wider FOV of the eye is shown by the dashed lines 6, 7. When the eye is located in one of the extreme positions 2B, 2C the user's gaze is directed approximately one third of the way across the display 20. The full display 20 will still be visible within the user's peripheral vision. The world beyond the edge of the lens 27 will also be visible in the user's peripheral vision, assuming the glasses frame does not obstruct this. This is true even when the gaze is directed straight ahead. Rotation of the eye 2 effectively translates the pupil, and the edge of the lens 27 effectively acts as a window that the display 20 is viewed through. This means that as the eye rotates the view of the display 20 will appear to be cropped differently. If the eye is rotated to the left then the display will be cropped on the left hand edge. By configuring the lens 27 with a larger diameter than a diameter the display 20, this effect should be minimised or negligible.
[0072] Referring to
[0073] As explained above, the scene displayed on the display 20 has a FOV 25D. Referring again to
[0074] The circular display 20 displays an image which is selected from a region of the image sensor 25A. Stated another way, the image sensor 25A is cropped to provide the image for display.
[0075]
[0076] In
[0077] A position of the cropped region of the image sensor 25A may be selected by the processing unit 40. For example, the cropped region used for output to the display 20 may be moved in the x-axis and/or y-axis.
[0078] The size of the cropped region may be varied by the processing unit 40. Size may be varied by a digital zoom operation, i.e. a digital domain manipulation of the mapping between the pixels of the image sensor 25A and the pixels of the display 20. A digital zoom in function is shown in
[0079] Position and/or size of the displayed region may be selected by manual control. For example, a user can manually enlarge (zoom in) or shrink (zoom out) the image based on their own needs and the visual experience. A user interface to control the zoom function may be provided on the imaging apparatus 5 (e.g. buttons on arms 12, 13,
[0080] In another situation, the zoom level may be preconfigured for the wearer by a qualified technician or clinician based on factors such as: the shape of the user's face; the distance from the eye to the lens 27 when the imaging apparatus is worn by the user.
[0081] The camera lens 25B is a wide angle lens. This type of lens inevitably has non-ideal optical properties.
[0082] As described above, the imaging apparatus can have a single camera, such as a single camera which is centrally-mounted on the front of the frame 10 or housing. The single camera has a FOV which is sufficient to provide images to each display. For example, to provide a FOV to each eye of 60 degrees, the single camera may have a FOV of 80 degrees. An output of the single camera is processed to provide an image to the left eye display 20 and to the right eye display 30. The images displayed by each display 20, 30 can have the same unity gain factor described above. That is, the left eye display 20 is configured to display an image having a first angular field of view of the scene in front of the left eye on the left eye display device, and the imaging apparatus is configured to provide to the user an angular field of view of the left eye display device which is the same as the first angular field of view. Similarly, the right eye display 30 is configured to display an image having a first angular field of view of the scene in front of the right eye on the right eye display device, and the imaging apparatus is configured to provide to the user an angular field of view of the right eye display device which is the same as the first angular field of view. This gives continuity between the displayed image and the real world, and continuity between the displayed image and the surrounding environment visible through the open regions 16, 17 to the side of the lenses 27, 37.
[0083] Another aspect of the disclosure may be understood with reference to the following numbered clauses. [0084] 1. A head mountable imaging apparatus for assisting a user with reduced vision comprising: [0085] a first display device configured to provide a display to a first eye of the user; [0086] a first lens provided on a user side of the first display device, the first lens configured to form a focused image of the first display device; [0087] a first camera configured to provide an output representing a scene in front of the imaging apparatus; [0088] a processor configured to receive the output from the first camera and to provide an output to the first display device for displaying an image to the user, [0089] wherein the imaging apparatus is configured to display an image having a first angular field of view of the scene on the first display device, and the imaging apparatus is configured to provide to the user an angular field of view of the first display device which is the same as the first angular field of view. That is, the imaging apparatus is configured to provide to the user an angular field of view of the image displayed on the first display device which is the same as the first angular field of view. [0090] 2. An apparatus according to clause 1 comprising an open region adjacent the first lens such that a user is able to view a combination of an image on the first display device and surrounding environment outside the imaging apparatus. [0091] 3. An apparatus according to clause 1 or 2 wherein the first camera is positioned on an outer, forward-facing, side of the imaging apparatus in front of the first display device. [0092] 4. An apparatus according to clause 3 wherein the first camera is aligned with a central axis of the first display device. [0093] 5. An apparatus according to clause 4 wherein the first camera is substantially aligned with an optical axis of the user's first eye in a rest position. [0094] 6. An apparatus according to any one of the preceding clauses wherein the angular field of view of the first display device provided to a user is based on an expected distance between the first lens and a position of a user's eye. [0095] 7. An apparatus according to any one of the preceding clauses wherein the first lens is a Fresnel lens or an aspheric lens. [0096] 8. An apparatus according to any one of the preceding clauses wherein a distance between the first display and the first lens is less than a diameter or height of the first lens. [0097] 9. An apparatus according to clause 8 wherein a distance between the first display and the first lens is between one half and two thirds of the diameter or height of the first display. [0098] 10. An apparatus according to any one of the preceding clauses wherein the first display is circular or elliptical. [0099] 11. An apparatus according to any one of the preceding clauses wherein the first camera has a first image sensor, and wherein the processor is configured to obtain the output from a selected region of the first image sensor which is a subset of an overall area of the first image sensor. [0100] 12. An apparatus according to clause 11 wherein the first image sensor has a rectangular shape. [0101] 13. An apparatus according to clause 11 or 12 wherein the first image sensor has an x-axis and a y-axis and wherein the processor is configured to vary the position of the selected region in at least one of the x-axis and the y-axis. [0102] 14. An apparatus according to clause 14 wherein the processor is configured to vary the position of the selected region based on a user input. [0103] 15. An apparatus according to any one of clauses 11 to 14 wherein the processor is configured to vary a size of the selected region to adjust the first angular field of view of the image displayed on the first display device. [0104] 16. An apparatus according to clause 15 wherein the processor is configured to vary a size of the selected region based on a user input. [0105] 17. An apparatus according to any one of the preceding clauses comprising: [0106] a second display device configured to provide a display to a second eye of the user; [0107] a second lens provided on a user side of the second display device, the second lens configured to form a focused image of the second display device; [0108] a second camera configured to provide an output representing a scene in front of the imaging apparatus; [0109] a processor configured to receive the output from the second camera and to provide an output to the second display device for displaying an image to the user,
wherein the imaging apparatus is configured to display an image having a second angular field of view of the scene on the second display device, and the imaging apparatus is configured to provide to the user an angular field of view of the second display device which is the same as the second angular field of view. [0110] 18. An apparatus according to clause 17 wherein the first angular field of view is equal to the second angular field of view.
[0111] Throughout the description and claims of this specification, the words “comprise” and “contain” and variations of the words, for example “comprising” and “comprises”, means “including but not limited to”, and is not intended to (and does not) exclude other moieties, additives, components, integers or steps.
[0112] Throughout the description and claims of this specification, the singular encompasses the plural unless the context otherwise requires. In particular, where the indefinite article is used, the specification is to be understood as contemplating plurality as well as singularity, unless the context requires otherwise.
[0113] Features, integers or characteristics described in conjunction with a particular aspect, embodiment or example of the invention are to be understood to be applicable to any other aspect, embodiment or example described herein unless incompatible therewith.