Systems, devices, and methods for eyebox expansion in wearable heads-up displays
10274736 ยท 2019-04-30
Assignee
Inventors
- Stefan Alexander (Elmira, CA)
- Matthew Bailey (Kitchener, CA)
- Vance R. Morrison (Kitchener, CA)
- Lloyd Frederick Holland (Kitchener, CA)
- Joshua Moore (Elora, CA)
Cpc classification
G06F3/011
PHYSICS
G03H1/2645
PHYSICS
G09G3/001
PHYSICS
International classification
G03H1/26
PHYSICS
G02B27/00
PHYSICS
Abstract
Systems, devices, and methods for eyebox expansion by exit pupil replication in wearable heads-up displays (WHUDs) are described. A WHUD includes a scanning laser projector (SLP), a holographic combiner, and an optical splitter positioned in the optical path therebetween. The optical splitter receives light signals generated by the SLP and separates the light signals into N sub-ranges based on the point of incidence of each light signal at the optical splitter. The optical splitter redirects the light signals corresponding to respective ones of the N sub-ranges towards the holographic combiner effectively from respective ones of N spatially-separated virtual positions for the SLP. The holographic combiner converges the light signals to respective ones of N spatially-separated exit pupils at the eye of the user. In this way, multiple instances of the exit pupil are distributed over the area of the eye and the eyebox of the WHUD is expanded.
Claims
1. A wearable heads-up display comprising: a support structure that in use is worn on a head of a user; a scanning laser projector carried by the support structure, wherein the scanning laser projector includes a red laser diode, a green laser diode, and a blue laser diode; a holographic combiner carried by the support structure, wherein the holographic combiner comprises a red hologram, a green hologram, and a blue hologram, and wherein the holographic combiner is positioned within a field of view of an eye of the user when the support structure is worn on the head of the user; and an optical splitter carried by the support structure and positioned in an optical path between the scanning laser projector and the holographic combiner, the optical splitter arranged to receive light signals generated by the scanning laser projector and redirect the light signals towards the holographic combiner effectively from N spatially-separated virtual positions for the scanning laser projector, where N is an integer greater than 1, the holographic combiner arranged to receive the light signals from the optical splitter and to converge the light signals to N exit pupils at the eye of the user, a particular one of the N exit pupils to which a light signal is converged determined by a particular virtual position for the scanning laser projector from which the light signal is redirected by the optical splitter, and wherein the red hologram is positioned and oriented to converge red components of the light signals to the N exit pupils, the green hologram is positioned and oriented to converge green components of the light signals to the N exit pupils, and the blue hologram is positioned and oriented to converge blue components of the light signals to the N exit pupils.
2. The wearable heads-up display of claim 1 wherein the scanning laser projector has a total two-dimensional scan range ? and the optical splitter is arranged to separate the total two-dimensional scan range ? of the scanning laser projector into N two-dimensional sub-ranges ?.sub.1, where ?.sub.i=1.sup.N ?.sub.i=?, and wherein each one of the N sub-ranges ?.sub.i corresponds to a respective one of the N spatially-separated virtual positions for the scanning laser projector.
3. The wearable heads-up display of claim 2 wherein the optical splitter is arranged to: receive light signals corresponding to a sweep of the total two-dimensional scan range ? by the scanning laser projector; separate the light signals corresponding to the sweep of the total two-dimensional scan range ? into the N two-dimensional sub-ranges ?.sub.i; and redirect the light signals corresponding to the sweep of the total two-dimensional scan range ? towards the holographic combiner effectively from each of the N spatially-separated virtual positions for the scanning laser projector, a particular virtual position for the scanning laser projector from which each light signal in the sweep of the total two-dimensional scan range ? is redirected by the optical splitter determined by a particular two-dimensional sub-range ?.sub.i to which the light signal corresponds.
4. The wearable heads-up display of claim 1 wherein the scanning laser projector has a total scan range ? in a first dimension, where 0?<?<180?, and the optical splitter is arranged to separate the total scan range ? of the scanning laser projector in the first dimension into X sub-ranges ?.sub.i in the first dimension, where 1<X?N and ?.sub.i=1.sup.X ?.sub.i=?, and wherein each one of the X sub-ranges ?.sub.i corresponds to a different one of the N spatially-separated virtual positions for the scanning laser projector.
5. The wearable heads-up display of claim 4 wherein the optical splitter is arranged to: receive light signals corresponding to a sweep of the total scan range ? in the first dimension by the scanning laser projector; separate the light signals corresponding to the sweep of the total scan range ? in the first dimension into the X sub-ranges ?.sub.i in the first dimension; and redirect the light signals corresponding to the sweep of the total scan range ? in the first dimension towards the holographic combiner effectively from at least X of the N spatially-separated virtual positions for the scanning laser projector, a particular virtual position for the scanning laser projector from which each light signal in the sweep of the total scan range ? in the first dimension is redirected by the optical splitter determined by a particular sub-range ?.sub.i in the first dimension to which the light signal corresponds.
6. The wearable heads-up display of claim 4 wherein the scanning laser projector has a total scan range ? in a second dimension, where 0?<?<180?, and the optical splitter is arranged to separate the total scan range ? of the scanning laser projector in the second dimension into Y sub-ranges ?.sub.i in the second dimension, where 1<Y?N and ?.sub.i=1.sup.Y ?.sub.i=?, and wherein each one of the Y sub-ranges ?.sub.i corresponds to a different one of the N spatially-separated virtual positions for the scanning laser projector.
7. The wearable heads-up display of claim 6 wherein the optical splitter is arranged to: receive light signals corresponding to a sweep of the total scan range ? in the second dimension by the scanning laser projector; separate the light signals corresponding to the sweep of the total scan range ? in the second dimension into the Y sub-ranges ?.sub.i in the second dimension; and redirect the light signals corresponding to the sweep of the total scan range ? in the second dimension towards the holographic combiner effectively from at least Y of the N spatially-separated virtual positions for the scanning laser projector, a particular virtual position for the scanning laser projector from which a light signal in the sweep of the total scan range ? in the second dimension is redirected by the optical splitter determined by a particular sub-range ?.sub.i in the second dimension to which the light signal corresponds.
8. The wearable heads-up display of claim 1 wherein the support structure has a general shape and appearance of an eyeglasses frame.
9. The wearable heads-up display of claim 8, further comprising a prescription eyeglass lens, wherein the holographic combiner is carried by the prescription eyeglass lens.
10. The wearable heads-up display of claim 1 wherein: the holographic combiner is arranged to receive the light signals from the optical splitter and to converge the light signals to respective ones of N exit pupils at the eye of the user, a particular one of the N exit pupils to which a light signal is converged determined by a particular virtual position for the scanning laser projector from which the light signal is redirected by the optical splitter; the red hologram is positioned and oriented to converge red components of the light signals to respective ones of the N exit pupils; the green hologram is positioned and oriented to converge green components of the light signals to respective ones of the N exit pupils; and the blue hologram is positioned and oriented to converge blue components of the light signals to respective ones of the N exit pupils.
11. The wearable heads-up display of claim 1 wherein: the red hologram is positioned and oriented to converge red components of light signals redirected from each respective one of the N spatially-separated virtual positions for the scanning laser projector by the optical splitter to respective ones of the N exit pupils; the green hologram is positioned and oriented to converge green components of light signals redirected from each respective one of the N spatially-separated virtual positions for the scanning laser projector by the optical splitter to respective ones of the N exit pupils; and the blue hologram is positioned and oriented to converge blue components of light signals redirected from each respective one of the N spatially-separated virtual positions for the scanning laser projector by the optical splitter to respective ones of the N exit pupils.
12. The wearable heads-up display of claim 1 wherein the holographic combiner includes an angle-multiplexed holographic combiner that includes at least N angle-multiplexed red holograms, at least N angle-multiplexed green holograms, and at least N angle-multiplexed blue holograms, and wherein each one of the at least N angle-multiplexed red holograms is positioned and oriented to converge red components of light signals redirected from a respective one of the N spatially-separated virtual positions for the scanning laser projector by the optical splitter to a respective one of the N exit pupils, each one of the at least N angle-multiplexed green holograms is positioned and oriented to converge green components of light signals redirected from a respective one of the N spatially-separated virtual positions for the scanning laser projector by the optical splitter to a respective one of the N exit pupils, and each one of the at least N angle-multiplexed blue holograms is positioned and oriented to converge blue components of light signals redirected from a respective one of the N spatially-separated virtual positions for the scanning laser projector by the optical splitter to a respective one of the N exit pupils.
13. The wearable heads-up display of claim 1 wherein at least one of the scanning laser projector and/or the optical splitter is physically movable and/or rotatable on the support structure, and wherein physical movement and/or rotation of the scanning laser projector and/or optical splitter changes a position of at least one of the N exit pupils relative to the eye of the user.
14. The wearable heads-up display of claim 1 wherein each light signal corresponds to a respective pixel of an image.
15. The wearable heads-up display of claim 1 wherein N light signals correspond to N different instances of a same pixel of a same image.
16. The wearable heads-up display of claim 1 wherein the optical splitter comprises a faceted optical structure with at least N facets, and wherein at least one respective facet corresponds to each respective one of the N spatially-separated virtual positions for the scanning laser projector.
17. A wearable heads-up display comprising: a support structure that in use is worn on a head of a user; a scanning projector carried by the support structure and having a total two-dimensional scan range ?; a holographic combiner carried by the support structure, wherein the holographic combiner is positioned within a field of view of an eye of the user when the support structure is worn on the head of the user; an optical splitter carried by the support structure and positioned in an optical path between the scanning projector and the holographic combiner, wherein the optical splitter is arranged to: receive light signals corresponding to a sweep of the total two-dimensional scan range ? by the scanning projector; separate the light signals into N two-dimensional sub-ranges ?.sub.i, where N is an integer greater than 1 and ?.sub.i=1.sup.N ?.sub.i=?; and redirect the light signals towards the holographic combiner, and wherein the holographic combiner comprises: a red hologram positioned and oriented to converge red components of the light signals to respective ones of N exit pupils at or proximate the eye of the user, a particular exit pupil towards which a red component of a light signal is redirected by the red hologram determined by a particular two-dimensional sub-range ?.sub.i into which the red component of the light signal is separated by the optical splitter; a green hologram positioned and oriented to converge green components of the light signals to respective ones of the N exit pupils, a particular exit pupil towards which a green component of a light signal is redirected by the green hologram determined by a particular two-dimensional sub-range ?.sub.i into which the green component of the light signal is separated by the optical splitter; and a blue hologram positioned and oriented to converge blue components of the light signals to respective ones of the N exit pupils, a particular exit pupil towards which a blue component of a light signal is redirected by the blue hologram determined by a particular two-dimensional sub-range ?.sub.i into which the blue component of the light signal is separated by the optical splitter.
18. The wearable heads-up display of claim 17 wherein the total two-dimensional scan range ? of the scanning projector includes a total scan range ? in a first dimension, where 0?<?<180?, and wherein the optical splitter is arranged to: receive light signals corresponding to at least one sweep of the total scan range ? in the first dimension by the scanning projector; separate the light signals into X sub-ranges ?.sub.i in the first dimension, where 1<X?N and ?.sub.i=1.sup.X=?; and redirect the light signals towards the holographic combiner, and wherein: the red hologram is positioned and oriented to converge red components of the light signals to respective ones of at least X of the N exit pupils, a particular exit pupil towards which a red component of a light signal is redirected by the red hologram determined by at least the particular sub-range ?.sub.i in the first dimension into which the red component of the light signal is separated by the optical splitter; the green hologram is positioned and oriented to converge green components of the light signals to respective ones of at least X of the N exit pupils, a particular exit pupil towards which a green component of a light signal is redirected by the green hologram determined by at least the particular sub-range ?.sub.i in the first dimension into which the green component of the light signal is separated by the optical splitter; and the blue hologram is positioned and oriented to converge blue components of the light signals to respective ones of at least X of the N exit pupils, a particular exit pupil towards which a blue component of a light signal is redirected by the blue hologram determined by at least the particular sub-range ?.sub.i in the first dimension into which the blue component of the light signal is separated by the optical splitter.
19. The wearable heads-up display of claim 18 wherein the total two-dimensional scan range ? of the scanning projector includes a total scan range ? in a second dimension, where 0?<?<180?, and wherein the optical splitter is arranged to: receive light signals corresponding to at least one sweep of the total scan range ? in the second dimension by the scanning projector; separate the light signals corresponding to the at least one sweep of the total scan range ? in the second dimension into Y sub-ranges ?.sub.i in the second dimension, where 1<Y?N and ?.sub.i=1.sup.Y ?.sub.i=?; and redirect the light signals corresponding to the at least one sweep of the total scan range ? in the second dimension towards the holographic combiner, and wherein: the red hologram is positioned and oriented to converge red components of the light signals corresponding to the at least one sweep of the total scan range ? in the second dimension to different ones of the N exit pupils at or proximate the eye of the user, a particular exit pupil towards which a red component of a light signal is redirected by the red hologram determined by both the particular sub-range ?.sub.i in the first dimension and the particular sub-range ?.sub.i in the second dimension into which the red component of the light signal is separated by the optical splitter; the green hologram is positioned and oriented to converge green components of the light signals corresponding to the at least one sweep of the total scan range ? in the second dimension to different ones of the N exit pupils at or proximate the eye of the user, a particular exit pupil towards which a green component of a light signal is redirected by the green hologram determined by both the particular sub-range ?.sub.i in the first dimension and the particular sub-range ?.sub.i in the second dimension into which the green component of the light signal is separated by the optical splitter; and the blue hologram is positioned and oriented to converge blue components of the light signals corresponding to the at least one sweep of the total scan range ? in the second dimension to different ones of the N exit pupils at or proximate the eye of the user, a particular exit pupil towards which a blue component of a light signal is redirected by the blue hologram determined by both the particular sub-range ?.sub.i in the first dimension and the particular sub-range ?.sub.i in the second dimension into which the blue component of the light signal is separated by the optical splitter.
20. The wearable heads-up display of claim 17 wherein the scanning projector is a scanning laser projector comprising a red laser diode, a green laser diode, and a blue laser diode.
Description
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
(1) In the drawings, identical reference numbers identify similar elements or acts. The sizes and relative positions of elements in the drawings are not necessarily drawn to scale. For example, the shapes of various elements and angles are not necessarily drawn to scale, and some of these elements are arbitrarily enlarged and positioned to improve drawing legibility. Further, the particular shapes of the elements as drawn are not necessarily intended to convey any information regarding the actual shape of the particular elements, and have been solely selected for ease of recognition in the drawings.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
DETAILED DESCRIPTION
(13) In the following description, certain specific details are set forth in order to provide a thorough understanding of various disclosed embodiments. However, one skilled in the relevant art will recognize that embodiments may be practiced without one or more of these specific details, or with other methods, components, materials, etc. In other instances, well-known structures associated with portable electronic devices and head-worn devices, have not been shown or described in detail to avoid unnecessarily obscuring descriptions of the embodiments.
(14) Unless the context requires otherwise, throughout the specification and claims which follow, the word comprise and variations thereof, such as, comprises and comprising are to be construed in an open, inclusive sense, that is as including, but not limited to.
(15) Reference throughout this specification to one embodiment or an embodiment means that a particular feature, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
(16) As used in this specification and the appended claims, the singular forms a, an, and the include plural referents unless the content clearly dictates otherwise. It should also be noted that the term or is generally employed in its broadest sense, that is as meaning and/or unless the content clearly dictates otherwise.
(17) The headings and Abstract of the Disclosure provided herein are for convenience only and do not interpret the scope or meaning of the embodiments.
(18) The various embodiments described herein provide systems, devices, and methods for eyebox expansion in scanning laser-based wearable heads-up displays (WHUDs). Generally, a scanning laser-based WHUD is a form of virtual retina display in which a scanning laser projector (SLP) draws a raster scan onto the eye of the user. In the absence of any further measure the SLP projects light over a fixed area called the exit pupil of the display. In order for the user to see displayed content the exit pupil typically needs to align with, be encompassed by, or overlap with the entrance pupil of the user's eye. The full resolution and/or field of view of the display is visible to the user when the exit pupil of the display is completely contained within the entrance pupil of the eye. For this reason, a scanning laser-based WHUD typically employs a relatively small exit pupil that is equal to or smaller than the expected size of the entrance pupil of the user's eye (e.g., less than or equal to about 4 mm in diameter).
(19) The eyebox of a scanning laser-based WHUD is defined by the geometry of the exit pupil of the display at or proximate the eye of the user. A scanning laser-based WHUD that employs a small exit pupil in order to achieve maximum display resolution and/or field of view typically has the drawback of having a relatively small eyebox. For example, the exit pupil may be aligned with the center of the user's eye so that the eye's pupil is located within the eyebox when the user is gazing directly ahead but the eye's pupil may quickly leave the eyebox if and when the user glances anywhere off-center. A larger eyebox may be achieved by increasing the size of the exit pupil but this typically comes at the cost of reducing the display resolution and/or field of view. In accordance with the present systems, devices, and methods, the eyebox of a scanning laser-based WHUD may be expanded by optically replicating or repeating a relatively small exit pupil and spatially distributing multiple copies or instances of the exit pupil over a relatively larger area of the user's eye, compared to the area of the single exit pupil on its own. In this way, at least one complete instance of the display exit pupil (either as a single instance in its entirety or as a combination of respective portions of multiple instances) may be contained within the perimeter of the eye's pupil for each of a range of eye positions corresponding to a range of gaze directions of the user. In other words, the present systems, devices, and methods describe eyebox expansion by exit pupil replication in scanning laser-based WHUDs.
(20) Throughout this specification and the appended claims, the term replication is used (e.g., in the context of exit pupil replication) to generally refer to situations where multiple instances of substantially the same thing (e.g., an exit pupil) are produced. The term exit pupil replication is intended to generally encompass approaches that produce concurrent (e.g., temporally parallel) instances of an exit pupil as well as approaches that produce sequential (e.g., temporally serial or repeated) instances of an exit pupil. In many examples, the present systems, devices, and methods provide exit pupil replication by exit pupil repetition or sequential exit pupil tiling. Unless the specific context requires otherwise, references to exit pupil replication herein include exit pupil replication by exit pupil repetition.
(21)
(22) Throughout this specification and the appended claims, the term carries and variants such as carried by are generally used to refer to a physical coupling between two objects. The physical coupling may be direct physical coupling (i.e., with direct physical contact between the two objects) or indirect physical coupling that may be mediated by one or more additional objects. Thus, the term carries and variants such as carried by are meant to generally encompass all manner of direct and indirect physical coupling, including without limitation: carried on, carried within, physically coupled to, and/or supported by, with or without any number of intermediary physical objects therebetween.
(23) SLP 120 may include multiple laser diodes (e.g., a red laser diode, a green laser diode, and/or a blue laser diode) and at least one scan mirror (e.g., a single two-dimensional scan mirror or two one-dimensional scan mirrors, which may be, e.g., MEMS-based or piezo-based). SLP 120 may be communicatively coupled to (and support structure 110 may further carry) a processor and a non-transitory processor-readable storage medium or memory storing processor-executable data and/or instructions that, when executed by the processor, cause the processor to control the operation of SLP 120. For ease of illustration,
(24) Holographic combiner 130 is positioned within a field of view of at least one eye of the user when support structure 110 is worn on the head of the user. Holographic combiner 130 is sufficiently optically transparent to permit light from the user's environment (i.e., environmental light) to pass through to the user's eye. In the illustrated example of
(25) Optical splitter 150 is positioned in an optical path between SLP 120 and holographic combiner 130. Optical splitter 150 comprises at least one optical element (e.g., at least one lens, reflector, partial reflector, prism, diffractor, diffraction grating, mirror, or other optical element, or at least one configuration, combination, and/or arrangement of such) that is arranged to receive light signals generated and output by SLP 120 and redirect each such light signal towards holographic combiner 130 effectively from one of multiple (e.g., N, where N is an integer greater than 1) spatially-separated virtual positions for SLP 120. Advantageously, optical splitter 150 may be a static and passive component that, without power consumption or any moving parts, receives (at a first point of incidence therein or thereon) a first light signal generated by SLP 120 and routes/redirects the first light signal along an optical path towards holographic combiner 130 that traces back to (if optical splitter 150 is ignored during trace back) one of N spatially-separated virtual positions for SLP 120. The particular one of the N spatially-separated virtual positions for SLP 120 from which the first light signal is redirected by optical splitter 150 is determined by the first point of incidence at which the first light signal is received by optical splitter 150. In other words, from the point of view of holographic combiner 130, optical splitter 150 causes at least some light signals generated by SLP 120 to appear to originate (i.e., effectively originate) from N spatially-separated virtual positions for SLP 120 as opposed to from the real position for SLP 120.
(26) Throughout this specification and the appended claims, reference is often made to one or more virtual position(s) such as N spatially-separated virtual positions for a SLP. The real position of an object is its actual position in real, three dimensional space. A virtual position of an object is a position in real space at which the optics of a system cause light from the object to effectively originate even though the real position of the object may be elsewhere. In other words, the optics of the system cause light from the object to follow optical paths that would trace back, if the optics of the system were ignored during the trace back, to a virtual position in space that is spatially-separated from the object's real position in space. As a simple example, an object in front of a planar mirror has a virtual position on the other side of the planar mirror. A virtual position may be a result of one or more intervening optical element(s) in an optical path. When one or more optical element(s) redirects light signals from a SLP, a virtual position for the SLP refers to the position in real space at which the SLP would need to be located in order to provide light signals having that same trajectory without any intervening optics. The optics of the system cause the light signals to follow a trajectory that would correspond to a different point of origin if there were no such optics in the system. The light signals appear to have effectively originated from a different, or virtual, position for the SLP.
(27)
(28) SLP 220 is located at a position 260 (i.e., a real position) relative to holographic combiner 230 and is shown generating (e.g., projecting) a set of light signals 270. Light signals 270 correspond to a first sweep of a total scan range (e.g., a total two-dimensional scan range, with only one dimension visible in the view of
(29) Optical splitter 250 is positioned in an optical path between SLP 220 and holographic combiner 230 such that optical splitter 250 interrupts (e.g., receives) light signals 270 en route from SLP 220 to holographic combiner 230. As previously described, optical splitter 250 includes at least one optical element (e.g., at least one lens, reflector, partial reflector, prism, diffractor, diffraction grating, mirror, or other optical element, or at least one configuration, combination, and/or arrangement of such) that is arranged to redirect light signals 270 towards holographic combiner 230 effectively from N spatially-separated virtual positions 261, 262, and 263 for SLP 220. Particularly, optical splitter 250 separates, divides, branches, furcates, or generally splits light signals 270 into N groups, sets, ranges, or sub-ranges and redirects each sub-range of light signals 270 along a respective range (or sub-range) of optical paths that effectively originates from a respective one of the N spatially-separated virtual positions 261, 262, and 263 for SLP 220.
(30) In operation, scan mirror 222 of SLP 220 projects, guides, directs, or generally sweeps modulated light signals 270 over a range (or combination of ranges) of directions and/or angles in order to define a display image. A single scan mirror 222 is shown in
(31) The total two-dimensional scan range ? of a SLP may be broken down into a total scan range ? in a first dimension corresponding to all available directions and/or angles of light signals in a first dimension (e.g., the horizontal dimension) that the SLP is operative to output during normal use, and a total scan range ? in a second dimension corresponding to all available directions and/or angles of light signals in a second dimension (e.g., the vertical dimension) that the SLP is operative to output during normal use. Generally, 0?<?<180? and 0?<?<180?, although in practice ? and ? may each be within a narrower range, such as 10?<?<60?, and 10?<?<60?. The relative values of ? and ? influence the aspect ratio of the WHUD. In other words, the total two-dimensional scan range ? may be made up of a first one-dimensional component ? and a second (e.g., orthogonal) one-dimensional component ?, as ?=???. Generally, one sweep of a total scan range in a single dimension by a SLP refers to one instance of the scan mirror(s) of the SLP moving through all orientations or configurations that correspond to all available directions/angles for light signals in the dimension associated with that scan range. A sweep of the total scan range ? in the first dimension by the SLP therefore corresponds to a sweep (e.g., by at least one scan mirror of the SLP) over or across all orientations or configurations that correspond to all available directions/angles for light signals in that first dimension and a sweep of the total scan range ? in the second dimension by the SLP therefore corresponds to a sweep (e.g., by at least one scan mirror of the SLP) over or across all orientations or configurations that correspond to all available directions/angles for light signals in that second dimension. A sweep of a total two-dimensional scan range ?, however, may involve multiple sweeps of the total scan ranges ? and ? in each of the first and the second dimensions, respectively. A common mode of operation for a SLP is to perform a respective sweep of the total scan range ? in a first dimension (e.g., the horizontal dimension) at each discrete step or position along a sweep of the total scan range ? in a second dimension (e.g., the vertical dimension). Whether or not a light signal is actually projected at any given direction/angle depends on the modulation pattern for the particular display content being projected at that time.
(32) Returning to
(33) Each of the N=3 virtual positions 261, 262, and 263 for SLP 220 is spatially-separated from real position 260 for SLP 220, so the optical paths between each of virtual positions 261, 262, and 263 for SLP 220 (corresponding to first light signal 271, second light signals 272, and third light signals 273, respectively) and holographic combiner 230 are different from the optical paths between real position 260 for SLP 220 and holographic combiner 230. For example, the optical paths of light signals 271 are different from the optical paths of light signals 272 and the optical paths of light signals 273 are different from the optical paths of both light signals 271 and light signals 272. Advantageously, each of the N=3 virtual positions 261, 262, and 263, for SLP 220 may correspond to a respective position and orientation of SLP 220. In other words, relative to the other ones of the N=3 virtual positions 261, 262, and 263 for SLP 220, each one of the virtual positions 261, 262, and 263 may correspond to a respective displacement and rotation of SLP 220. Such is the case in WHUD 200 for which, as would be apparent to one of ordinary skill in the art, a line connecting each of the N=3 virtual positions 261, 262, and 263 for SLP 220 in
(34) As previously described, holographic combiner 230 includes at least one hologram that is operative (e.g., designed, crafted, encoded, recorded, and/or generally positioned and oriented) to redirect light signals 270 received from optical splitter 250 towards the eye 290 of the user. In the illustrated implementation, the at least one hologram of holographic combiner 230 converges respective ones of light signals 271, 272, and 273 to respective ones of N=3 exit pupils 281, 282, and 283 at or proximate eye 290. The particular exit pupil 281, 282, and 283 to which a light signal is converged by holographic combiner 230 depends on (e.g., is determined by) the particular virtual position 261, 262, and 263 for SLP 220 from which the light signal is redirected by optical splitter 250. Thus, optical splitter 250 splits light signals 270 into N=3 groups (light signals 271, 272, and 273) or sub-ranges (?.sub.1, ?.sub.2, and ?.sub.3) and redirects each group or sub-range to holographic combiner 230 in such a way (e.g., effectively from such a virtual position) that each group or sub-range is converged by holographic combiner 230 to a respective one of N=3 spatially-separated exit pupils 281, 282, and 283 at eye 290. The total eyebox 280 of WHUD 200 encompasses all three spatially-separated exit pupils 281, 282, and 283. If optical splitter 250 was not present then the total eyebox 280 of WHUD 200 would be composed of a single exit pupil (e.g., 282). Optical splitter 250 expands the eyebox 280 of WHUD 200 by breaking up (or splitting) the total scan range ? of SLP 220 into N=3 sub-ranges ?.sub.i and, correspondingly, replicating or repeating a single exit pupil (e.g., 282) as N=3 exit pupils 281, 282, and 283 over a larger spatial area at eye 290. As will be discussed in more detail later on, in order to replicate the same display content at each exit pupil 281, 282, and 283, SLP 220 may re-modulate nominally the same display content N times (e.g., repeated as N instances of nominally the same modulation pattern) in a sweep of the total scan range ? with each respective modulation (e.g., each one of the N instances) corresponding to a respective one of the N sub-ranges ?.sub.i of the total scan range ?. N=3 sub-ranges ?.sub.1, ?.sub.2, and ?.sub.3 and N=3 exit pupils 281, 282, and 283 are used as illustrative examples only in
(35) Generally, a sweep of the total scan range ? by SLP 220 may include more (e.g., significantly more, such as on the order of tens more, hundreds more, thousands more, or even greater) than N light signals. Within such a sweep, at least one optical element of optical splitter 250 may be arranged to receive at least N light signals generated by SLP 220 and redirect at least N light signals towards holographic combiner 230 effectively from respective ones of the N spatially-separated virtual positions for SLP 220. In this case, each one of the N light signals is in a respective one of the N sub-ranges ?.sub.i of the total scan range ?. That is, a first one of the N light signals is in a first one of the N sub-ranges ?.sub.1 (e.g., one of light signals 271) and is redirected by optical splitter 250 to effectively originate from first virtual position 261 for SLP 220, a second one of the N light signals is in a second one of the N sub-ranges ?.sub.2 (e.g., one of light signals 272) and is redirected by optical splitter 250 to effectively originate from second virtual position 262 for SLP 220, and a third one of the N light signals is in a third one of the N sub-ranges ?.sub.3 (e.g., one of light signals 273) and is redirected by optical splitter 250 to effectively originate from third virtual position 263 for SLP 220, and so on as appropriate to the specific implementation (e.g., for all N). The particular virtual position 261, 262, and 263 for SLP 220 from which each one of the N light signals is redirected by optical splitter 250 depends on (e.g., is determined by) the particular point of incidence at which each light signal is received by optical splitter 250. Holographic combiner 230 receives the N light signals from optical splitter 250 and converges each one of the N light signals to a respective spatially-separated exit pupil 281, 282, and 283 at or proximate eye 290. In this example, the N light signals may include, for example, N different instances of a same image (i.e., N repeated or replicated instances of the same image comprising at least two pixels) or the N light signals may include, for example, N different instances of a same pixel of an image (e.g., N repeated or replicated instances of the same pixel in the same image).
(36)
(37)
(38)
(39) Holographic combiner 230 receives light signals 272 in second sub-range ?.sub.2 from optical splitter 250 and converges light signals 272 to second exit pupil 282 at or proximate eye 290. Because second virtual position 262 is spatially-separated from first virtual position 261, second exit pupil 282 is spatially-separated from first exit pupil 281 at or proximate eye 290.
(40)
(41) Throughout this specification and the appended claims, reference is often made to points of incidence of one or more light signal(s) at an optical splitter. Unless the specific context requires otherwise, a point of incidence at an optical splitter generally refers to the position or location on (e.g., at an outer surface of) or in (e.g., within an inner volume of) the optical splitter at which a light signal impinges on and/or first interacts with and/or is first influenced by the optical splitter. For example, an optical splitter as described herein may include one or more optical elements, such as an arrangement of optical elements, and the point of incidence of a light signal at the optical splitter may refer to the position or location (e.g., the spatial point) at which the light signal first impinges on an optical element in the arrangement of optical elements. The term point is used loosely in this context to refer to a general region having a particular spatial position and/or location and may include some dimensional attribute(s) (e.g., a finite length, area, or volume) depending on the spot size and spot geometry of the light signal at the point of incidence. In other words, the term point in this context is not intended to be limited to the mathematical notion of a dimensionless point in space.
(42) In the illustrated examples of
(43) As previously described, over each sub-range ?.sub.i SLP 220 may re-modulate nominally the same pattern or arrangement of light signals. An example of such is now described.
(44) Over a sweep of the total scan range ? by SLP 220, SLP 220 may produce light signals 270. Light signals 270 may comprise first light signals 271, second light signals 272, and third light signals 273.
(45) Over first sub-range ?.sub.1 of total scan range ?, SLP 220 may generate first light signals 271 and first light signals 271 may represent or embody a first set of pixels corresponding to a first image or a first portion of an image. First light signals 271 are redirected by optical splitter 250 towards holographic combiner 230 along optical paths that trace back to effectively originate from first virtual position 261 for SLP 220. Holographic combiner 230 receives first light signals 271 and converges first light signals 271 to first exit pupil 281 at eye 290.
(46) Over second sub-range ?.sub.2 of total scan range ?, SLP 220 may generate second light signals 272 and second light signals 272 may represent or embody nominally the same first set of pixels as first light signals 271 corresponding to the same first image or the same first portion of an image. Second light signals 272 are redirected by optical splitter 250 towards holographic combiner 230 along optical paths that trace back to effectively originate from second virtual position 262 for SLP 220. Holographic combiner 230 receives second light signals 272 and converges second light signals 272 to second exit pupil 282 at eye 290. Because first light signals 271 and second light signals 272 represent or embody nominally the same display content, first exit pupil 281 and second exit pupil 282 each provides a respective instance (e.g., a respective replicated or repeated instance) of the same display content to a different respective position at or proximate eye 290. In this way, eye 290 is able to see the same content regardless of which at least one of first exit pupil 281 and/or second exit pupil 282 aligns with the gaze direction (e.g., pupil position) of eye 290. Rather than comprising a single exit pupil at one location, eyebox 280 of WHUD 200 is expanded to comprise spatially-separated first and second exit pupils 281 and 282.
(47) Over third sub-range ?.sub.3 of total scan range ?, SLP 220 may generate third light signals 273 and third light signals 273 may represent or embody nominally the same first set of pixels as first light signals 271 and second light signals 272 corresponding to the same first image or the same first portion of an image. Third light signals 273 are redirected by optical splitter 250 towards holographic combiner 230 along optical paths that trace back to effectively originate from third virtual position 263 for SLP 220. Holographic combiner 230 receives third light signals 273 and converges third light signals 273 to third exit pupil 283 at eye 290. Because third light signals 273 represent or embody nominally the same display content as first light signals 271 and second light signals 272, third exit pupil 283 provides another instance (e.g., another replicated or repeated instance) of the same display content as that provided by first exit pupil 281 and second exit pupil 282 to another position at or proximate eye 290. In this way, eye 290 is able to see the same content regardless of which at least one of first exit pupil 281, second exit pupil 282, and/or third exit pupil 283 aligns with the gaze direction (e.g., pupil position) of eye 290. Eyebox 280 of WHUD 200 is expanded to comprise spatially-separated first, second, and third exit pupils 281, 282, and 283. As previously described, expansion of eyebox 280 to include three exit pupils 281, 282, and 283 in WHUD 200 is used for illustrative purposes only. The present systems, devices, and methods may be extended to expand the eyebox of a WHUD to include any number N of exit pupils depending on the requirements of the specific application.
(48) Throughout this specification, the expression nominally the same is generally used in reference to certain light signals (e.g., first light signals 271 being nominally the same as second light signals 272) to indicate that those particular light signals are defined to represent the same content when viewed by the user. For example, first light signals 271 and second light signals 272 are nominally the same when first light signals 271 and second light signals 272 are both defined by SLP 220 to represent the same image, or the same portion of an image, or generally the same display content. The term nominally in nominally the same is meant to reflect the fact that, in some situations, even though two light signals (e.g., two sets of light signals, as with first light signals 271 and second light signals 272) may both be defined to represent the same display content the two light signals (or sets of light signals) may not be identical sets of light signals. Such a situation can arise, for example, when the two light signals (e.g., the two sets of light signals) are each exposed to different respective optical distortions.
(49) In the various implementations described herein, multiple (i.e., N) instances of an image are effectively projected from respective ones of multiple (i.e., N) different virtual positions. Each one of the N virtual positions corresponds to a respective range of optical paths through the optical splitter and effectively projects light signals towards or on the holographic combiner over a respective range of optical paths comprising a respective range of directions and/or angles. As a consequence, each one of the N virtual positions may effectively project light signals with a different respective optical distortion profile. For example, a first set of light signals (e.g., representing a first instance of an image) effectively originating from a first virtual position may be subject to a first set of optical distortions (e.g., image skewing, keystoning, aberrations, and so on) resulting from the particular set of optical paths the first set of light signals follows through the optical splitter, from the optical splitter to the holographic combiner, and/or from the holographic combiner to the first exit pupil. Likewise, a second set of light signals (e.g., representing a second instance of the same image) effectively originating from a second virtual position may be subject to a second set of optical distortions (e.g., image skewing, keystoning, aberrations, and so on) resulting from the particular set of optical paths the second set of light signals follows through the optical splitter, from the optical splitter to the holographic combiner, and/or from the holographic combiner to the second exit pupil. The first set of optical distortions and the second set of optical distortions may not be identical. In order to correct for optical distortions, the SLP may be calibrated to apply various offsets, compensations, corrections, or other measures to projected light signals so that the light signals account for the optical distortions and will appear correctly at the eye of the user. Since the first set of optical distortions and the second set of optical distortions may not be identical to one another, the SLP may be calibrated to apply a first image correction profile (e.g., a first set of image correction measures) to the first set of light signals (e.g., representing the first instance of the image) and a second image correction profile (e.g., a second set of image correction measures) to the second set of light signals (e.g., representing the second instance of the same image). Therefore, even though the first set of light signals and the second set of light signals may each be defined by the SLP to represent the same display content, the first set of light signals and the second set of light signals may not be identical to one another. In this example, the first set of light signals and the second set of light signals are not the same but they are said to be nominally the same because they are each defined by the SLP to represent the same display content.
(50) Returning to
(51) In accordance with the present systems, devices, and methods, SLP 220 and optical splitter 250 together separate or split the light signals 270 projected by SLP 220 over the total scan range ? into N=3 sub-ranges ?.sub.1, ?.sub.2, and ?.sub.3 to produce N=3 instances 271, 272, and 273 of the same display content. Because each of these N=3 instances follows a different respective range of optical paths effectively originating from a different respective spatially-separated virtual position 261, 262, and 263 for SLP 220, holographic combiner 230 converges each of these N=3 instances to a respective spatially-separated exit pupil 281, 282, and 283 at or proximate eye 290. Spatially-separated exit pupils 281, 282, and 283 are distributed over an area of eye 290 that covers a wider range of pupil positions (e.g., gaze directions) than a single exit pupil (of the same size as any one of exit pupils 281, 282, and 283) on its own. Thus, eyebox 280 is expanded by exit pupil replication in WHUD 200.
(52) In the illustrated example, each of the N=3 virtual positions 261, 262, and 263 for SLP 220 effectively created or established by optical splitter 250 is different (i.e., spatially-separated) from real position 260. However, in some implementations optical splitter 250 may include a configuration or arrangement of one or more optical element(s) or optical device(s) for which a sub-range ?.sub.i of light signals 270 is directed to holographic combiner 230 effectively from real position 260 rather than from a virtual position.
(53) In
(54) In a virtual retina display such as scanning laser-based WHUD 100 and/or scanning laser-based WHUD 200, there may not be an image formed outside of the eye of the user. There is typically no microdisplay or projection screen or other place where the projected image is visible to a third party; rather, the image may be formed completely within the eye of the user. For this reason, it may be advantageous for a scanning laser-based WHUD to be designed to accommodate the manner in which the eye forms an image.
(55) For a light signal entering the eye (e.g., a light ray, a wavefront, an incident beam from a SLP, or similar), the eye (or more accurately, the combination of the eye and the human brain) may determine where the light signal is positioned in the user's field of view based on the region of the retina that is illuminated by the light signal. Two light signals that illuminate the same region of the retina may appear in the same position in the user's field of view. The particular region of the retina that is illuminated by any given light signal is determined by the angle and not the location at which the light signal enters the eye. Thus, two light signals may appear in the same position in the user's field of view even if they enter different location of the user's pupil provided that the two light signals have the same angle of incidence when they enter the user's eye. The geometry of the eye's lens is such that any two light signals entering the eye at the same angle, regardless of the position/location at which the light signals enter the eye, may generally be directed to the same region of the retina and so may generally appear in the same position in the user's field of view.
(56) In at least some implementations, the scanning laser-based WHUDs described herein project multiple instances of the same image onto the retina of the eye in rapid succession. Even if the multiple instances are temporally-separated, the temporal separation may be small enough to be undetectable by the user. If any two of the multiple instances of the same image do not align/overlap on the eye's retina then those two instances of the image may not align/overlap in the user's field of view and undesirable effects such as ghosting can occur. In order to ensure that multiple instances of the same image (each corresponding to a respective exit pupil) align/overlap on the retina so that multiple instances of the image align/overlap in the user's field of view, a scanning laser-based WHUD may advantageously be configured to direct multiple instances of any given light signal (each corresponding to a respective exit pupil and each representing a respective instance of the same display content) towards the eye spatially in parallel with one another. More specifically and referring to
(57)
(58) In the implementation of
(59) In the implementation of
(60) As previously described, holographic combiner 230 comprises at least one hologram embedded in, encoded in, recorded in, or otherwise carried by at least one layer of holographic film. The holographic film may include, as examples, a photopolymer film such as Bayfol?HX from Bayer MaterialScience AG or a silver halide compound. The nature of the at least one hologram may depend on the specific implementation.
(61) As a first example, holographic combiner 230 may include a single hologram that effectively operates as a fast-converging (e.g., convergence within about 1 cm, convergence within about 2 cm, or convergence within about 3 cm) mirror for light having the wavelength(s) provided by SLP 220. In this first example, the holographic film that carries the first hologram may have a relatively wide bandwidth, meaning the hologram recorded in the holographic film may impart substantially the same optical effect or function on all light signals 270 projected by SLP 220 over a relatively wide range of angles of incidence at holographic combiner 230. For the purpose of the present systems, devices, and methods, the term wide bandwidth in relation to holograms and holographic films means an angular bandwidth that is greater than or equal to the total range of angles of incidence of all light signals received by any given point, region, or location of the hologram or holographic film from an optical splitter. As an example, WHUD 200 may implement a wide bandwidth hologram in holographic combiner 230 having an angular bandwidth of greater than or equal to about 8?. In this case, the spatial separation between virtual positions 261, 262, and 263 may be such that any given point, region, or location of holographic combiner 230 receives light signals (i.e., included in any of light signals 271, 272, and 273) spanning an 8? (or less) range of angles of incidence at holographic combiner 230.
(62) Consistent with conventional mirror behavior, for a single wide-bandwidth fast-converging hologram carried by holographic combiner 230 the angles of incidence for a range of light signals incident on holographic combiner 230 may influence the angles of reflection for that range of light signals redirected by holographic combiner 230. Since holographic combiner 230 is, generally during normal operation of WHUD 200, fixed in place relative to SLP 220, the angles of incidence for a range of light signals are determined, at least in part, by the particular virtual position 261, 262, or 263 for the SLP 220 from which optical splitter 250 causes the range of light signals to effectively originate. The spatial position of the exit pupil 281, 282, or 283 to which the range of light signals is converged by holographic combiner 230 is then determined, at least in part, by the angles of reflection of that range of light signals from holographic combiner 230. Each one of virtual positions 261, 262, and 263 provides light signals over a respective range of angles of incidence (generally but not necessarily with at least some overlap) at holographic combiner 230 and therefore holographic combiner 230 converges light signals from each one of virtual positions 261, 262, and 263 to a respective one of exit pupils 281, 282, and 283. This is why, referring to
(63) As a second example, rather than a single hologram, holographic combiner 230 may instead include any number of multiplexed holograms. Multiplexed holograms may be advantageous when, for example, multiple wavelengths of light signals are used (e.g., red, green, and blue light signals generated by SLP 220) and/or to provide a further means to separate light signals effectively originating from different virtual positions for SLP 220. The single hologram example described above may be suitable for an implementation in which SLP 220 only provides light signals of a single wavelength (e.g., only red light signals, only green light signals, or only blue light signals), but for implementations in which SLP 220 provides light signals of multiple wavelengths it may be advantageous for holographic combiner 230 to include a respective wavelength multiplexed hologram for each respective wavelength of light signals provided by SLP 220 (e.g., each respective nominal wavelength of light signals provided by SLP 220, since a laser diode may generally provide light signals over a narrow waveband). Thus, when SLP 220 includes three different laser diodes each providing light signals of a respective nominal wavelength (e.g., a red laser diode, a green laser diode, and a blue laser diode) it may be advantageous for holographic combiner 230 to include three wavelength-multiplexed holograms (e.g., a red hologram, a green hologram, and a blue hologram) each designed to work (e.g., playback) for light signals having a respective one of the three nominal wavelengths. In this example, at least one red hologram (i.e., at least one hologram that is designed to playback for light signals having a wavelength that corresponds to red light) may converge a respective red component of each of light signals 271, 272, and 273 to a respective one of the N=3 exit pupils 281, 282, and 283, at least one green hologram (i.e., at least one hologram that is designed to playback for light signals having a wavelength that corresponds to green light) may converge a respective green component of each of light signals 271, 272, and 273 to a respective one of the N=3 exit pupils 281, 282, and 283, and at least one blue hologram (i.e., at least one hologram that is designed to playback for light signals having a wavelength that corresponds to blue light) may converge a respective blue component of each of light signals 271, 272, and 273 to a respective one of the N=3 exit pupils 281, 282, and 283. In other words, for a light signal redirected from a particular one of the N spatially-separated virtual positions for the SLP by the optical splitter, the at least one red hologram may converge a red component of the light signal to a particular one of the N exit pupils at or proximate the eye of the user, the at least one green hologram may converge a green component of the light signal to the particular one of the N exit pupils at or proximate the eye of the user, and the at least one blue hologram may converge a blue component of the light signal to the particular one of the N exit pupils at or proximate the eye of the user.
(64) As a third example, either apart from or in addition to multiple wavelength-multiplexed holograms, holographic combiner 230 may include at least N angle-multiplexed holograms. That is, for an implementation with N=3 virtual positions 261, 262 and 263 for the SLP 220 and N=3 exit pupils 281, 282, and 283, holographic combiner 230 may include at least N=3 angle-multiplexed holograms (or N=3 sets of angle-multiplexed holograms when wavelength multiplexing is also employed, as discussed later on). Each of the N=3 angle-multiplexed holograms may be designed to playback for light signals effectively originating from a respective one of the N=3 virtual positions 261, 262, and 263 for SLP 220 and converge such light signals to a respective one of the N=3 exit pupils 281, 282, and 283. That is, a first angle-multiplexed hologram may be designed to playback for light signals 271 effectively originating from virtual position 261 for SLP 220 and converge light signals 271 to first exit pupil 281, a second angle-multiplexed hologram may be designed to playback for light signals 272 effectively originating from virtual position 262 for SLP 220 and converge light signals 272 to second exit pupil 282, and a third angle-multiplexed hologram may be designed to playback for light signals 273 effectively originating from virtual position 263 for SLP 220 and converge light signals 273 to third exit pupil 283.
(65) For implementations that employ angle-multiplexing, it may be advantageous for the holographic film that includes an angle-multiplexed hologram to be of relatively narrow bandwidth. Particularly, it may be advantageous for the holographic film to have an angular bandwidth that is less than or about equal to the minimum difference between the respective angles of incidence of two light signals that are incident on the same point, region, or location of holographic combiner 230 but effectively originate from different virtual positions 261, 262, and 263. As an example, WHUD 200 may implement a narrow bandwidth angle-multiplexed hologram in holographic combiner 230 having an angular bandwidth of less than or equal to about 4?. In this case, the difference between the angle of incidence (at holographic combiner 230) of a light signal 271 that effectively originates from virtual position 261 and is incident at a first point on holographic combiner 230 and the angle of incidence (at holographic combiner 230) of a light signal 272 that effectively originates from virtual position 262 and is incident at the same first point on holographic combiner 230 may be less than or equal to about 4?. In this way, each respective angle-multiplexed hologram in holographic combiner 230 may be designed to substantially exclusively playback for a respective one of light signals 271, 272, or 273 effectively originating from a respective one of virtual positions 261, 262, or 263 for SLP 220 and to substantially not playback (e.g., insubstantially playback) for the other ones of light signals 271, 272, or 273 effectively originating from the other ones of virtual positions 261, 262, or 263 for SLP 220.
(66) Generally, holographic combiner 230 may include at least N multiplexed holograms and each one of the at least N multiplexed holograms may converge light signals corresponding to a respective one of the N spatially-separated virtual positions for SLP 220 to a respective one of N exit pupils at or proximate the eye 290 of the user.
(67) Some implementations may employ both wavelength multiplexing and angle multiplexing. For example, an implementation that employs angle multiplexing and light signals of multiple wavelengths (e.g., a multi-color SLP) may advantageously also employ wavelength multiplexing. In this case, holographic combiner 230 may include a wavelength-multiplexed and angle-multiplexed holographic combiner that includes at least N angle-multiplexed red holograms, at least N angle-multiplexed green holograms, and at least N angle-multiplexed blue holograms. Each one of the at least N angle-multiplexed red holograms may converge red components of light signals (e.g., 271) redirected from a respective one of the N spatially-separated virtual positions (e.g., 261) for SLP 220 by optical splitter 250 to a respective one of the N exit pupils (e.g., 281) at or proximate eye 290. Each one of the at least N angle-multiplexed green holograms may converge green components of light signals (e.g., 271) redirected from a respective one of the N spatially-separated virtual positions (e.g., 261) for SLP 220 by optical splitter 250 to a respective one of the N exit pupils (e.g., 281) at or proximate eye 290. Each one of the at least N angle-multiplexed blue holograms may converge blue components of light signals (e.g., 271) redirected from a respective one of the N spatially-separated virtual positions (e.g., 261) for SLP 220 by optical splitter 250 to a respective one of the N exit pupils (e.g., 281) at or proximate eye 290.
(68) Implementations of holographic combiner 230 that employ multiple multiplexed holograms may include multiple holograms in or on a single layer (i.e., all in or on the same layer) of holographic film or may include multiple layers of holographic film with each layer of holographic film carrying at least one respective hologram. Holographic combiner 230 may or may not comprise at least one volumetric holographic optical element. Generally, holographic combiner 230 may comprise a single layer of holographic film that carries any number of holograms or holographic combiner 230 may comprise multiple layers of holographic film (e.g., multiple layers laminated together) with each respective layer of holographic film carrying any number of respective holograms.
(69) Holographic combiner 230 may be substantially flat or planar in geometry or, as illustrated in
(70) The various embodiments described herein provide systems, devices, and methods for eyebox expansion by exit pupil replication in scanning laser-based WHUDs. Each replicated exit pupil is aligned to a respective spatially-separated position at or proximate the eye of the user because the optical splitter selectively routes the light signals along spatially-separated optical paths that each trace back to (e.g., each appear to effectively originate from) a different spatially-separated virtual position for the SLP. The effect is substantially the same as if multiple SLPs were used instead of the optical splitter, with each SLP positioned in a respective one of the virtual positions and with each SLP projecting a respective instance of a light signal towards the holographic combiner; however, the use of the optical splitter has considerable advantages in terms of power savings and minimizing hardware bulk.
(71) Optical splitter 250 separates or splits light signals 270 into light signals 271, 272, and 273 and redirects light signals 271, 272, and 273 ultimately towards respective ones of exit pupils 281, 282, and 283 at eye 290. SLP 220 may be modulated to repeat nominally the same display content for each of light signals 271, 272, and 273. This redundancy enables WHUD 200 to rapidly display N=3 instances of the same image at N=3 different regions of eye 290 and thereby expand the eyebox 280 of the system to encompass all N=3 exit pupils 281, 282, and 283. However, in some applications or implementations, only one instance of an image may need to be (or want to be) displayed to eye 290 at any given time. Such can simplify the operation of SLP 220 and save the power required to produce multiple potentially redundant instances of the same image. In accordance with the present systems, devices, and methods, a WHUD 200 may include an eye tracker communicatively coupled to SLP 220 (either directly or by common communicative coupling to another element, such as a processor or non-transitory processor-readable storage medium) to determine the pupil position (e.g., gaze direction) of eye 290. Information about the pupil position (or gaze direction) of eye 290 may be used by SLP 220 to determine over which one(s) of the N sub-ranges ?.sub.i of the total scan range ? to modulate light signals in order to provide display content to the user. That is, based on information about the pupil position (or gaze direction) of eye 290, SLP 220 may optionally only generate light signals over the particular sub-range(s) ?.sub.i of the total scan range ? that correspond to the particular exit pupil(s) that align(s) with the current pupil position (or gaze direction) of eye 290. If the gaze direction of eye 290 (as determined by an eye tracker of WHUID 200) is such that the pupil of eye 290 only aligns with one exit pupil (e.g., with exit pupil 283), then SLP 220 may be modulated to only generate light signals during the ?.sub.3 sub-range portion of the total scan range ? so that only light signals 273 are produced and the power associated with generating redundant light signals 271 and 272 may be saved.
(72) An eye tracker included in any of the implementations of WHUDs described herein may employ any of a variety of different eye tracking technologies depending on the specific implementation. For example, an eye tracker may employ any or all of the systems, devices, and methods described in U.S. Provisional Patent Application Ser. No. 62/167,767; U.S. Provisional Patent Application Ser. No. 62/271,135; U.S. Provisional Patent Application Ser. No. 62/245,792; and/or U.S. Provisional Patent Application Ser. No. 62/281,041. As previously described, WHUD 200 may include at least one processor and at least one non-transitory processor-readable storage medium or memory communicatively coupled thereto. The at least one memory may store processor-executable data and/or instructions that, when executed by the at least one processor, cause the at least one processor to control the operation of either or both of SLP 220 and/or an eye tracker.
(73) As described previously, optical splitter 250 includes at least one optical element that is arranged to receive light signals 270 corresponding to a sweep of the total two-dimensional scan range ? by SLP 220, separate the light signals into N two-dimensional sub-ranges ?.sub.i based on the point of incidence of each light signal 270 at optical splitter 250, where ?.sub.i=1.sup.N ?.sub.i=?, and redirect the light signals in each two-dimensional sub-range ?.sub.i towards holographic combiner 230 effectively from a respective one of N spatially-separated virtual positions 261, 262, and 263 for SLP 220. As also described previously, the total two-dimensional scan range ? of a SLP may be broken down into a total scan range ? in a first dimension corresponding to all available directions and/or angles of light signals in a first dimension (e.g., the horizontal dimension) that the SLP is operative to output during normal use, and a total scan range ? in a second dimension corresponding to all available directions and/or angles of light signals in a second dimension (e.g., the vertical dimension) that the SLP is operative to output during normal use. When the total two-dimensional scan range ? of SLP 220 includes a total scan range ? in a first dimension, then at least one optical element of optical splitter 250 may be arranged to receive light signals corresponding to a sweep of the total scan range ? in the first dimension by SLP 220, separate the light signals corresponding to the sweep of the total scan range ? in the first dimension into X sub-ranges ?.sub.i in the first dimension based on point of incidence at optical splitter 250, where 1<X?N and ?.sub.i=1.sup.X ?.sub.i=?, and redirect the light signals corresponding to the sweep of the total scan range ? in the first dimension towards holographic combiner 230 effectively from at least X of the N spatially-separated virtual positions for SLP 220. In this case, each one of the X sub-ranges ?.sub.i may correspond to a different one of the N spatially-separated virtual positions for SLP 220. The particular virtual position for SLP 220 from which each light signal in the sweep of the total scan range ? in the first dimension is redirected by optical splitter 250 may depend on (e.g., may be determined by) the particular sub-range ?.sub.i in the first dimension to which the light signal corresponds. When holographic combiner 230 receives light signals corresponding to the sweep of the total scan range ? in the first dimension, at least one hologram of holographic combiner 230 may converge the light signals to respective ones of at least X of the N exit pupils at or proximate eye 290. The particular exit pupil towards which a light signal in the sweep of the total scan range ? in the first dimension is redirected by holographic combiner 230 may depend on (e.g., may be determined by) at least the particular sub-range ?.sub.i in the first dimension into which the light signal is separated by optical splitter 250.
(74) When the total two-dimensional scan range ? of SLP 220 further includes a total scan range ? in a second dimension, with for example ?=???, then at least one optical element of optical splitter 250 may be arranged to receive light signals corresponding to a sweep of the total scan range ? in the second dimension by SLP 220, separate the light signals corresponding to the sweep of the total scan range ? in the second dimension into Y sub-ranges ?.sub.i in the second dimension based on point of incidence at optical splitter 250, where 1<Y?N and ?.sub.i=1.sup.Y ?.sub.i=?, and redirect the light signals corresponding to the sweep of the total scan range ? in the second dimension towards holographic combiner 230 effectively from at least Y of the N spatially-separated virtual positions for SLP 220. In this case, each one of the Y sub-ranges ?.sub.i may correspond to a different one of the N spatially-separated virtual positions for SLP 220. For at least one virtual position for SLP 220, at least one of the X sub-ranges ?.sub.i in the first dimension and at least one of the Y sub-ranges ?.sub.i in the second dimension may both correspond to the same virtual position for SLP 220. The particular virtual position for SLP 220 from which each light signal in the sweep of the total scan range ? in the second dimension is redirected by optical splitter 250 may depend on (e.g., may be determined by) the particular sub-range ?.sub.i in the second dimension to which the light signal corresponds.
(75) When holographic combiner 230 receives light signals corresponding to both a sweep of the total scan range ? in the first dimension and a sweep of the total scan range ? in the second dimension, at least one hologram of holographic combiner 230 may converge the light signals to the N exit pupils at or proximate eye 290. In this case, the particular exit pupil towards which a light signal is converged by holographic combiner 230 may depend on (e.g., may be determined by) both the particular sub-range ?.sub.i in the first dimension and the particular sub-range ?.sub.i in the second dimension into which the light signal is separated by optical splitter 250.
(76) The illustrative examples of the present systems, devices, and methods depicted in
(77)
(78) Exemplary optical splitter 250 in
(79)
(80) Optical splitter 400 represents an example of a configuration of an optical splitter that may be used in conjunction with an accordingly adapted SLP operational mode in order to expand the eyebox of a retinal scanning display system by exit pupil replication.
(81)
(82)
(83) Because the total two-dimensional scan range ? of SLP 520 comprises a total scan range ? in a first (e.g., horizontal) dimension and a total scan range ? in a second (e.g., vertical) dimension, each respective two-dimensional sub-range ?.sub.1, ?.sub.2, ?.sub.3, and ?.sub.4 comprises a respective combination of a sub-range ?.sub.i in the first dimension and a sub-range ?.sub.i in the second dimension. Specifically, first two-dimensional sub-range ?.sub.1 comprises a first sub-range ?.sub.1 in the first dimension and a first sub-range ?.sub.i in the second dimension such that ?.sub.1=?.sub.1? ?.sub.1, second two-dimensional sub-range ?.sub.2 comprises a second sub-range ?.sub.2 in the first dimension and the first sub-range ?.sub.2 in the second dimension such that ?.sub.2=?.sub.2??.sub.1, third two-dimensional sub-range ?.sub.3 comprises the first sub-range ?.sub.1 in the first dimension and a second sub-range ?.sub.2 in the second dimension such that ?.sub.3=?.sub.1? ?.sub.2, and fourth two-dimensional sub-range ?.sub.4 comprises the second sub-range ?.sub.2 in the first dimension and the second sub-range ?.sub.2 in the second dimension such that ?.sub.4=?.sub.2? ?.sub.2. For a rectangular or grid-like arrangement of sub-ranges ?.sub.i, when the total two-dimensional scan range ? of SLP 520 comprises a total scan range ? in a first dimension and a total scan range ? in a second dimension with ?=?? ?, the number of two-dimensional sub-ranges ?.sub.i may be equal to at least the number of sub-ranges w; in the first dimension multiplied by the number of sub-ranges ?.sub.i in the second dimension. However, in other implementations a non-rectangular arrangement of sub-ranges ?.sub.i, such as a triangular, circular, polygonal, or amorphous arrangement of sub-ranges ?.sub.i, may be employed.
(84) In addition to various WHUD systems and devices that provide eyebox expansion by exit pupil replication (e.g., exit pupil repetition), the various embodiments described herein also include methods of expanding the eyebox of a WHUD by exit pupil replication.
(85)
(86) At 601, an SLP of the WHUD generates a first light signal. The first light signal may represent a first instance of an image or a first instance of a portion of an image. For example, the first light signal may represent a first instance of one or more pixel(s) of an image.
(87) At 602, the optical splitter receives the first light signal at a first point of incidence thereon or therein (e.g., at or on an outer surface of the optical splitter or within an inner volume of the optical splitter). Depending on the specific design of the optical splitter in the specific implementation of method 600, the first point of incidence may or may not correspond to a first one of multiple available optical elements (or a first facet of multiple available facets) that make up the optical splitter.
(88) At 603, the optical splitter redirects the first light signal towards the holographic combiner effectively from a first one of N spatially-separated virtual positions for the SLP, where N is an integer greater than 1. The first virtual position for the SLP from which the optical splitter redirects the first light signal may depend on (e.g., may be determined by or in part by) the first point of incidence at which the optical splitter receives the first light signal at 602.
(89) At 604, the holographic combiner redirects the first light signal towards the eye of the user. In particular, the holographic combiner may converge the first light signal to a first one of N exit pupils at or proximate the eye of the user. The first exit pupil to which the holographic combiner converges the first light signal may depend on (e.g., may be determined by) the first virtual position for the SLP from which the optical splitter redirects the first light signal at 603.
(90) In some implementations, the holographic combiner may include a single hologram that converges the first light signal to a first one of N exit pupils at the eye of the user based on the angle of incidence of the first light signal at the particular point or region of the holographic combiner at which the first light signal is received (as determined by, e.g., the first virtual position for the SLP from which the optical splitter redirects the first light signal at 603). Even in such implementations, the holographic combiner may comprise at least two wavelength multiplexed holograms to respectively playback for (e.g., perform the redirecting and/or converging of act 604) at least two components of the first light signal having different wavelengths, such as at least two color components of the first light signal. For example, the SLP may comprise a red laser diode, a green laser diode, and a blue laser diode and the first light signal may comprise a red component, a green component, and a blue component. In this case, the holographic combiner may comprise a red hologram, a green hologram, and a blue hologram and: the red hologram may converge a red component of the first light signal to the first exit pupil at or proximate the eye of the user, the green hologram may converge a green component of the first light signal to the first exit pupil at or proximate the eye of the user, and the blue hologram may converge a blue component of the first light signal to the first exit pupil at or proximate the eye of the user.
(91) In some implementations, the holographic combiner may include N angle-multiplexed red holograms, N angle-multiplexed green holograms, and N angle-multiplexed blue holograms. In this case, a first one of the N angle-multiplexed red holograms may converge the red component of the first light signal to the first exit pupil, a first one of the N angle-multiplexed green holograms may converge the green component of the first light signal to the first exit pupil, and a first one of the N angle-multiplexed blue holograms may converge the blue component of the first light signal to the first exit pupil. The particular ones of the N angle-multiplexed red holograms, the N angle-multiplexed green holograms, and the N angle-multiplexed blue holograms may depend on (e.g., may be determined by) the first virtual position for the SLP from which the optical splitter redirects the first light signal at 603.
(92) Method 600 may be extended in various ways. For example, the SLP may generate at least a second light signal, the optical splitter may receive the second light signal at a second point of incidence and redirect the second light signal towards the holographic combiner effectively from a second one of the N spatially-separated virtual positions for the SLP, and the holographic combiner may converge the second light signal to a second one of the N exit pupils at or proximate the eye of the user. The second virtual position for the SLP from which the optical splitter redirects the second light signal depends on (e.g., may be determined by) the second point of incidence at which the optical splitter receives the second light signal. When the SLP has a total scan range ?, the optical splitter may receive the first light signal (at 602) at a first point of incidence that is included in a first one ?.sub.1 of N sub-ranges ?.sub.i of the total scan range ? for the SLP, where ?.sub.i=1.sup.N ?.sub.i=?. In this case, the first one of N spatially-separated virtual positions for the SLP from which the optical splitter redirects the first light signal at 603 may depend on (e.g., may be determined by) the first sub-range ?.sub.1 of the total scan range ? for the SLP. Similarly, the optical splitter may receive the second light signal at a second point of incidence that is included in a second one ?.sub.2 of the N sub-ranges ?.sub.i of the total scan range ? for the SLP and the second one of N spatially-separated virtual positions for the SLP from which the optical splitter redirects the second light signal may depend on (e.g., may be determined by) the second sub-range ?.sub.2 of the total scan range ? for the SLP.
(93)
(94) At 701, the SLP generates light signals corresponding to a sweep of the total two-dimensional scan range ? for the SLP. Depending on the specific implementation, the SLP may sweep a total scan range ? in a first dimension at each discrete step along a sweep of a total scan range ? in a second dimension in order to sweep the total two-dimensional scan range ?.
(95) At 702, the optical splitter receives the light signals corresponding to the sweep of the total two-dimensional scan range ? by the SLP at 701. The total two-dimensional scan range ? of the SLP may comprise N two-dimensional sub-ranges ?.sub.i where N is an integer greater than 1 and ?.sub.i=1.sup.N ?.sub.i=?. Each two-dimensional sub-range ?.sub.i may comprise a respective combination of a sub-range ?.sub.i in the first dimension and a sub-range ?.sub.i in the second dimension. The optical splitter may be positioned, oriented, and/or generally arranged so that each two-dimensional sub-range ?.sub.i corresponds to light signals having a respective range of points of incidence at or on the optical splitter.
(96) At 703, the optical splitter splits, divides, furcates, branches, or generally separates the light signals into the N two-dimensional sub-ranges ?.sub.i based on the point of incidence at which each light signal is received by the optical splitter at 702.
(97) At 704, the optical splitter redirects the light signals towards the holographic combiner. The optical splitter may redirect each light signal effectively from a particular one of N spatially-separated virtual positions for the SLP, with the particular virtual position for any given light signal dependent on (e.g., determined by) the particular two-dimensional sub-range ?.sub.i to which the light signal corresponds.
(98) At 705, the holographic combiner converges each light signal to one of N exit pupils at or proximate the eye of the user. The particular one of the N exit pupils to which the holographic combiner converges a light signal may depend on (e.g., may be determined by) the particular two-dimensional sub-range ?.sub.i into which the optical splitter separates the light signal at 703. As previously described, the holographic combiner may comprise any number of holograms including, in some implementations, at least N multiplexed holograms. When the holographic combiner includes at least N multiplexed holograms, each one of the at least N multiplexed holograms may converge light signals to one of the N exit pupils.
(99) In accordance with the present systems, devices, and methods, the eyebox of a retina-scanning projector may be expanded by replication of one or more exit pupils. In this approach, a given exit pupil may have a defined size that is about equal to or smaller than the diameter of the eye's pupil, such as about 4 mm or less (e.g., about 2 mm), so that all light from an image enters the eye when the exit pupil impinges on (e.g., aligns with or overlies) the user's (physical) pupil. However, when the user moves their eye, alignment between the exit pupil and the user's pupil may be lost and the projected image may disappear from the user's field of view. Thus, in the eyebox expansion through exit pupil replication approaches described herein, multiple exit pupils may be projected and tiled over the user's eye so that at least one exit pupil aligns with the user's eye for multiple, many, most, or all eye positions.
(100) Throughout this specification and the appended claims, the term about is sometimes used in relation to specific values or quantities. For example, fast-convergence within about 2 cm. Unless the specific context requires otherwise, the term about generally means?15%.
(101) The optical splitter described herein is an optical device. A first non-limiting example of an optical splitter comprising an arrangement of reflectors is illustrated in (and described with reference to)
(102) A person of skill in the art will appreciate that the present systems, devices, and methods may be applied or otherwise incorporated into WHUD architectures that employ one or more light source(s) other than a SLP. For example, in some implementations the SLP described herein may be replaced by another light source, such as a light source comprising one or more light-emitting diodes (LEDs), one or more organic LEDs (OLEDs), one or more digital light processors (DLPs). Such non-laser implementations may advantageously employ additional optics to collimate, focus, and/or otherwise direct projected light signals. Unless the specific context requires otherwise, a person of skill in the art will appreciate that references to a SLP throughout the present systems, devices, and methods are representative and that other light sources (combined with other optics, as necessary) may be applied or adapted to serve the same general purpose as the SLPs described herein.
(103) A person of skill in the art will appreciate that the present systems, devices, and methods may be applied or otherwise incorporated into WHUD architectures that employ one or more transparent combiner(s) other than a holographic combiner. For example, in some implementations the holographic combiner described herein may be replaced by a non-holographic device that serves substantially the same general purpose, such as prismatic film, a film that carries a microlens array, and/or a waveguide structure. Such non-holographic implementations may or may not employ additional optics. Unless the specific context requires otherwise, a person of skill in the art will appreciate that references to a holographic combiner throughout the present systems, devices, and methods are representative and that other transparent combiners (combined with other optics, as necessary) may be applied or adapted for application to serve the same general purpose as the holographic combiners described herein.
(104) A person of skill in the art will appreciate that the various embodiments for eyebox expansion by exit pupil replication described herein may be applied in non-WHUD applications. For example, the present systems, devices, and methods may be applied in non-wearable heads-up displays and/or in other projection displays, including virtual reality displays, in which the holographic combiner need not necessarily be transparent.
(105) In binocular implementations (i.e., implementations in which display content is projected into both eyes of the user), the total field of view may be increased by deliberately projecting a different field of view to each eye of the user. The two fields of view may overlap, so that both eyes see content at the center of the field of view while the left eye sees more content at the left of the field of view and the right eye sees more content at the right of the field of view.
(106) In some implementations that employ multiple exit pupils, all exit pupils may optionally be active at all times (allowing for temporal separation). Alternatively, implementations that also employ eye-tracking, may activate only the exit pupil that corresponds to where the user is looking (based on eye-tracking) while one or more exit pupil(s) that is/are outside of the user's field of view may be deactivated.
(107) In some implementations, the scan range of the projector can be actively changed to increase resolution in the direction the eye is looking or in the occupied exit pupil. Such is an example of heterogeneous image resolution as described in U.S. Provisional Patent Application Ser. No. 62/134,347.
(108) Eyebox expansion may advantageously enable a user to see displayed content while gazing in a wide range of directions. Furthermore, eyebox expansion may also enable a wider variety of users having a wider range of eye arrangements to adequately see displayed content via a given WHUD. Anatomical details such as interpupillary distance, eye shape, relative eye positions, and so on can all vary from user to user. The various eyebox expansion methods described herein may be used to render a WHUD more robust over (and therefore more usable by) a wide variety of users having anatomical differences. In order to even further accommodate physical variations from user to user, the various WHUDs described herein may include one or more mechanical structure(s) that enable the user to controllably adjust the physical position and/or alignment of one or more exit pupil(s) relative to their own eye(s). Such mechanical structures may include one or more hinge(s), dial(s), flexure(s), tongue and groove or other slidably-coupled components, and the like. For example, at least one of the SLP and/or the optical splitter may be physically movable and/or rotatable on the support structure and the user may physically move and/or rotate the SLP and/or the optical splitter to change a position of at least one of the N exit pupils relative to the eye. Alternatively, the approaches taught herein may advantageously avoid the need for inclusion of such additional mechanical structures, allowing a smaller package and less weight than might otherwise be obtainable.
(109) In some implementations, one or more optical fiber(s) may be used to guide light signals along some of the paths illustrated herein.
(110) The various implementations described herein may, optionally, employ the systems, devices, and methods for preventing eyebox degradation described in U.S. Provisional Patent Application Ser. No. 62/288,947.
(111) The WHUDs described herein may include one or more sensor(s) (e.g., microphone, camera, thermometer, compass, and/or others) for collecting data from the user's environment. For example, one or more camera(s) may be used to provide feedback to the processor of the WHUD and influence where on the display(s) any given image should be displayed.
(112) The WHUDs described herein may include one or more on-board power sources (e.g., one or more battery(ies)), a wireless transceiver for sending/receiving wireless communications, and/or a tethered connector port for coupling to a computer and/or charging the one or more on-board power source(s).
(113) The WHUDs described herein may receive and respond to commands from the user in one or more of a variety of ways, including without limitation: voice commands through a microphone; touch commands through buttons, switches, or a touch sensitive surface; and/or gesture-based commands through gesture detection systems as described in, for example, U.S. Non-Provisional patent application Ser. No. 14/155,087, U.S. Non-Provisional patent application Ser. No. 14/155,107, PCT Patent Application PCT/US2014/057029, and/or U.S. Provisional Patent Application Ser. No. 62/236,060, all of which are incorporated by reference herein in their entirety.
(114) The various implementations of WHUDs described herein may include any or all of the technologies described in U.S. Provisional Patent Application Ser. No. 62/117,316, U.S. Provisional Patent Application Ser. No. 62/156,736, and/or U.S. Provisional Patent Application Ser. No. 62/242,844.
(115) Throughout this specification and the appended claims the term communicative as in communicative pathway, communicative coupling, and in variants such as communicatively coupled, is generally used to refer to any engineered arrangement for transferring and/or exchanging information. Exemplary communicative pathways include, but are not limited to, electrically conductive pathways (e.g., electrically conductive wires, electrically conductive traces), magnetic pathways (e.g., magnetic media), and/or optical pathways (e.g., optical fiber), and exemplary communicative couplings include, but are not limited to, electrical couplings, magnetic couplings, and/or optical couplings.
(116) Throughout this specification and the appended claims, infinitive verb forms are often used. Examples include, without limitation: to detect, to provide, to transmit, to communicate, to process, to route, and the like. Unless the specific context requires otherwise, such infinitive verb forms are used in an open, inclusive sense, that is as to, at least, detect, to, at least, provide, to, at least, transmit, and so on.
(117) The above description of illustrated embodiments, including what is described in the Abstract, is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. Although specific embodiments of and examples are described herein for illustrative purposes, various equivalent modifications can be made without departing from the spirit and scope of the disclosure, as will be recognized by those skilled in the relevant art. The teachings provided herein of the various embodiments can be applied to other portable and/or wearable electronic devices, not necessarily the exemplary wearable electronic devices generally described above.
(118) For instance, the foregoing detailed description has set forth various embodiments of the devices and/or processes via the use of block diagrams, schematics, and examples. Insofar as such block diagrams, schematics, and examples contain one or more functions and/or operations, it will be understood by those skilled in the art that each function and/or operation within such block diagrams, flowcharts, or examples can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or virtually any combination thereof. In one embodiment, the present subject matter may be implemented via Application Specific Integrated Circuits (ASICs). However, those skilled in the art will recognize that the embodiments disclosed herein, in whole or in part, can be equivalently implemented in standard integrated circuits, as one or more computer programs executed by one or more computers (e.g., as one or more programs running on one or more computer systems), as one or more programs executed by on one or more controllers (e.g., microcontrollers) as one or more programs executed by one or more processors (e.g., microprocessors, central processing units, graphical processing units), as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of ordinary skill in the art in light of the teachings of this disclosure.
(119) When logic is implemented as software and stored in memory, logic or information can be stored on any processor-readable medium for use by or in connection with any processor-related system or method. In the context of this disclosure, a memory is a processor-readable medium that is an electronic, magnetic, optical, or other physical device or means that contains or stores a computer and/or processor program. Logic and/or the information can be embodied in any processor-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions associated with logic and/or information.
(120) In the context of this specification, a non-transitory processor-readable medium can be any element that can store the program associated with logic and/or information for use by or in connection with the instruction execution system, apparatus, and/or device. The processor-readable medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device. More specific examples (a non-exhaustive list) of the computer readable medium would include the following: a portable computer diskette (magnetic, compact flash card, secure digital, or the like), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM, EEPROM, or Flash memory), a portable compact disc read-only memory (CDROM), digital tape, and other non-transitory media.
(121) The various embodiments described above can be combined to provide further embodiments. To the extent that they are not inconsistent with the specific teachings and definitions herein, all of the U.S. patents, U.S. patent application publications, U.S. patent applications, foreign patents, foreign patent applications and non-patent publications referred to in this specification and/or listed in the Application Data Sheet which are owned by Thalmic Labs Inc., including but not limited to: U.S. Non-Provisional patent application Ser. No. 15/046,254, U.S. Provisional Patent Application Ser. No. 62/214,600, U.S. Provisional Patent Application Ser. No. 62/268,892, U.S. Provisional Patent Application Ser. No. 62/167,767, U.S. Provisional Patent Application Ser. No. 62/271,135, U.S. Provisional Patent Application Ser. No. 62/245,792, U.S. Provisional Patent Application Ser. No. 62/281,041, U.S. Provisional Patent Application Ser. No. 62/134,347, U.S. Provisional Patent Application Ser. No. 62/288,947, U.S. Non-Provisional patent application Ser. No. 14/155,087, U.S. Non-Provisional patent application Ser. No. 14/155,107, PCT Patent Application PCT/US2014/057029, U.S. Provisional Patent Application Ser. No. 62/236,060, U.S. Provisional Patent Application Ser. No. 62/117,316, U.S. Provisional Patent Application Ser. No. 62/156,736, and U.S. Provisional Patent Application Ser. No. 62/242,844, are incorporated herein by reference, in their entirety. Aspects of the embodiments can be modified, if necessary, to employ systems, circuits and concepts of the various patents, applications and publications to provide yet further embodiments.
(122) These and other changes can be made to the embodiments in light of the above-detailed description. In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but should be construed to include all possible embodiments along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.