METHOD AND SYSTEM FOR APPLYING ADAPTED COLOUR RENDERING ON A DISPLAY
20230013533 · 2023-01-19
Inventors
Cpc classification
A61M21/00
HUMAN NECESSITIES
G09G2320/0666
PHYSICS
G09G3/002
PHYSICS
International classification
A61M21/00
HUMAN NECESSITIES
Abstract
A method for applying adapted colour rendering in relation to intensity of light of wavelengths relevant to the circadian rhythm of a user, a computer program, a carrier, a system and a head-mounted device is disclosed. The method comprises receiving gaze tracking information identifying a gaze vector of the user of the system, and determining a respective location of a first area of the display and a second areas of the display based on the identified gaze vector. A first colour rendering mode is applied in the first area of the display, and a second colour rendering mode is applied in the second area of the display. The first colour rendering mode and the second colour rendering mode differ in relation to a degree of selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm of the user.
Claims
1. A method in a system comprising a display for applying adapted colour rendering in relation to intensity of light of wavelengths relevant to the circadian rhythm of a user of the system, the method comprising: receiving gaze tracking information identifying a gaze vector of the user of the system; determining a respective location of a first area of the display and a second area of the display based on the identified gaze vector; applying a first colour rendering mode in the first area of the display; and applying a second colour rendering mode in the second area of the display, wherein the first colour rendering mode and the second colour rendering mode differ in relation to a degree of selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm of the user, wherein the first area of the display is located inside a border angle from the gaze vector and the second area of the display is located outside the border angle from the gaze vector, and wherein the second colour rendering mode involves a higher degree of selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm than the first colour rendering mode.
2. The method according to claim 1, wherein the respective degree of selective adaptation for the first area and the second area is based on an effect that selective adaptation of light of wavelengths relevant to the circadian rhythm will have on the circadian rhythm when projected on corresponding areas of a retina of an eye of the user.
3. (canceled)
4. The method according to claim 1, wherein the first colour rendering mode involves no selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm.
5. The method according to claim 1, wherein the first area is an entire area of the display inside the border angle from the gaze vector.
6. The method according to claim 1, wherein the second area is an entire area of the display outside the border angle from the gaze vector.
7. The method according to claim 1, wherein the second area is an area of the display outside the border angle from the gaze vector and inside an outer angle from the gaze vector larger than the border angle.
8. The method according to claim 1, wherein the second colour rendering mode involves selective adaptation of the intensity of light of wavelengths relevant to the circadian rhythm to a largest degree at a peak angle from the gaze vector larger than the border angle.
9. The method according to claim 7, wherein the outer angle is within a range of ten to ninety degrees (10-90°).
10. The method according to claim 8, wherein the peak angle is within a range of two to five degrees (2-5°).
11. The method of claim 1, wherein the border angle is within a range of one half to fifteen degrees (0.5-15°).
12. The method according to claim 1, further comprising: on condition that the first area and the second area are adjacent to each other, applying a smooth transition from the first colour rendering mode to the second colour rendering mode along a border between the first area and the second area.
13. The method of claim 1, wherein selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm involves selective increase of intensity during daytime and selective decrease of intensity during nighttime.
14. The method of claim 1, wherein selective adaptation of intensity of light is of wavelengths within a range of 380-500 nanometres.
15. A non-transitory computer-readable medium comprising instructions that, when executed by at least one processor, cause the at least one processor to: receive gaze tracking information identifying a gaze vector of the user of the system; determine a respective location of a first area of the display and a second area of the display based on the identified gaze vector; apply a first colour rendering mode in the first area of the display; and apply a second colour rendering mode in the second area of the display, wherein the first colour rendering mode and the second colour rendering mode differ in relation to a degree of selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm of the user, wherein the first area of the display is located inside a border angle from the gaze vector and the second area of the display is located outside the border angle from the gaze vector, and wherein the second colour rendering mode involves a higher degree of selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm than the first colour rendering mode.
16. (canceled)
17. A system for applying adapted colour rendering in relation to intensity of light of wavelengths relevant to the circadian rhythm of a user of the system, the system comprising: a display; a processor; and a memory, the memory containing instructions executable by the processor, whereby the system is operative to: receive gaze tracking information identifying a gaze vector of the user of the system; determine a respective location of a first area of the display and second area of the display based on the identified gaze vector; apply a first colour rendering mode in the first area of the display; and apply a second colour rendering mode in the second area of the display, wherein the first colour rendering mode and the second colour rendering mode differ in relation to a degree of selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm of the user, wherein the first area of the display is located inside a border angle from the gaze vector and the second area of the display is located outside the border angle from the gaze vector, and wherein the second colour rendering mode involves a higher degree of selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm than the first colour rendering mode.
18. The system according to claim 17, wherein the respective degree of selective adaptation for the first area and the second area is based on an effect that selective adaptation of light of wavelengths relevant to the circadian rhythm will have on the circadian rhythm when projected on corresponding areas of a retina of an eye of the user.
19. The system according to claim 17, wherein the first area of the display is located inside a border angle from the gaze vector and the second area of the display is located outside the border angle from the gaze vector, and wherein the second colour rendering mode involves a higher degree of selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm than the first colour rendering mode.
20 The system of claim 17, wherein the system further comprises a head mounted device, wherein the head mounted device comprises the display, the processor, and the memory.
21. The method of claim 9, wherein the outer angle is within a range of ten to sixty degrees (10-60°).
22. The method of claim 10, wherein the peak angle is three and one half degrees (3.5°).
23. The method of claim 11, wherein the border angle is within a range of one to ten degrees (1-10°).
24. The method of claim 11, wherein the border angle is within a range of two to six degrees (1-6°).
25. The method of claim 14, wherein selective adaptation of intensity of light is of wavelengths within a range of 440-490 nanometres.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0049] The foregoing will be apparent from the following more particular description of the example embodiments, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the example embodiments.
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056] All the figures are schematic, not necessarily to scale, and generally only show parts which are necessary in order to elucidate the respective example, whereas other parts may be omitted or merely suggested.
DETAILED DESCRIPTION
[0057] Aspects of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings. The apparatus and method disclosed herein can, however, be realized in many different forms and should not be construed as being limited to the aspects set forth herein. Like numbers in the drawings refer to like elements throughout.
[0058] The terminology used herein is for the purpose of describing particular aspects of the disclosure only, and is not intended to limit the invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.
[0059] In a retina of a human eye, there are two different types of photoreceptor cells, namely rod cells and cone cells. The rod cells are more sensitive to light than cone cells and are hence relevant in relation to low light (night) vision. Different cone cells are able to react differently to light of different wavelengths and are hence relevant in relation to colour vision.
[0060]
[0061]
[0062] Ganglion cells have a sensitivity that is highest for light of the wavelengths relevant to the circadian rhythm and will affect the circadian rhythm when activated. Furthermore, as can be seen in
[0063] Furthermore, ganglion cells in the retina of the eye affect the circadian rhythm by affecting the production of dopamine and melatonin when exposed to light. Hence, if light of wavelengths relevant to the circadian rhythm is projected on the portion of the retina of the user's eye where the ganglion cells have a higher density, a high effect on the production of dopamine and melatonin can be achieved. At the same time, since the cone cells that register colour of light have a lower density in that portion of the retina, the user will not perceive, or at least perceive to a lower degree, that the light has any particular colour.
[0064] In respect to an eye of a user, projection of light of wavelengths relevant to the circadian rhythm in a portion of a retina of the eye outside an angle from the fovea can be achieved by using eye tracking to identify a gaze vector of the user and then, based on the gaze vector, illuminate the eye in such a way that the light is projected on the portion of the retina outside the angle from the fovea. For example, in a system including a display, an area of the display outside a corresponding angle from the gaze vector can be adapted such that the light of wavelengths relevant to the circadian rhythm is either amplified or suppressed in that area of the display.
[0065] In a typical application, the colour of light in a display is provided to create a desired colour experience for the user. For example, in an image, film or game animation shown on the display, natural colours or colours achieving a particular mood may be desired. If the colour of light is then adapted such that light of wavelengths relevant to circadian rhythm is either increased or decreased, the desired colour experience will typically not be achieved.
[0066] By adapting an area of the display outside a corresponding angle from the gaze vector such that the light of wavelengths relevant to the circadian rhythm is illuminated from that area of the display, the light of the relevant wavelengths can be provided to a higher or lower than nominal intensity. This is due to the fact that the cone cells that register colour of light have a very low density in the portion of the retina onto which the adapted light in relation to the wavelengths relevant to circadian rhythm will be projected. Hence, the user will not perceive that the light has any particular adapted colour.
[0067]
[0068] In addition to the border angle α and the outer angle β, a peak angle can be identified for which light of wavelengths relevant to the circadian rhythm will affect the circadian rhythm the most. This is an angle in relation to the gaze vector 310 from which light is projected in a portion of the retina corresponding to an angle from the fovea where the density of ganglion cells is highest. Generally, the border angle α and the outer angle β will be defined such that the peak angle is between the two angles.
[0069] Light towards the eye 300, e.g. from the display 320, at a given angle from the gaze vector 310 will generally be projected on the retina at a same or similar angle from the fovea. In the present disclosure, the border angle α, the outer angle β and the peak angle are defined in relation to the gaze vector 310 of light towards the eye 300, e.g. from the display 320. To any extent that an angle from the gaze vector 310 of light towards the eye 300 differs from the angle from the fovea on the retina the light is projected, the border angle α, the outer angle β and the peak angle in relation to the gaze vector 310 should be adapted such that light is projected at a desired area of the retina.
[0070] From
[0074] Hence, the selection of the border angle α is a trade-off between affecting as much percentage of the ganglion cells and avoiding or reducing the user's perception of the adaptation by suppression or amplifying of light of wavelengths relevant to the circadian rhythm.
[0075]
[0076] The wavelengths in relation to which selectively adaptation of intensity is applied are within the range 380-500 nanometre, preferably within the range 440-490 nanometre.
[0077] When the intensity of light of wavelengths relevant to the circadian rhythm is selectively adapted, the intensity of light of other wavelengths are typically not adapted. Furthermore, it is not required to adapt intensity of light of all wavelengths relevant to the circadian rhythm. Adaptation of intensity of light of only a subset of the wavelengths relevant to the circadian rhythm could still provide useful results.
[0078] The intensity of light of wavelengths relevant to circadian rhythm is selectively adapted by either being amplified or supressed (increased or decreased) to be higher or lower, respectively, than what it would have been with a colour rendering without adaptation, i.e. in relation to a nominal colour rendering. This is done to a higher degree in the second area 350, 360 than in the first area 340.
[0079] Generally, the respective degree of selective adaptation for the first area 340 and the second area 350, 360, is based on an effect that selective adaptation of light of wavelengths relevant to the circadian rhythm will have on the circadian rhythm when projected on corresponding areas of a retina of an eye of the user. Hence, the adaptation, e.g. by increasing or decreasing the intensity of light of the wavelengths relevant to the circadian rhythm, will be most in an area of the display which will be projected on a corresponding area of the retina of the eye of the user for which illumination or not by light of wavelengths relevant to the circadian rhythm will affect the circadian rhythm the most.
[0080] Typically, selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm involves selective increase or amplification of intensity during daytime and selective decrease or suppressing of intensity during nighttime. This would for example normally be the case to promote the everyday circadian rhythm for a person staying the same time zone.
[0081] Alternative timing of the selective adaptation is also envisaged in order to promote the circadian rhythm. For example, for a person travelling to a time zone which is different form the time zone the person normally lives in, the selective adaptation can be made based on the timing of daytime and nighttime of the time zone the person normally lives in, in order to maintain the normal circadian rhythm. For such a case, selective adaptation may involve selective increase or amplification of intensity during daytime and selective decrease or suppressing of intensity during nighttime in relation to the time zone the person normally lives in and not in relation to the time zone the person is currently in in relation to a travelling.
[0082] As indicated in relation to
[0083] The first area 340 of the display may be located inside the border angle α from the gaze vector and the second area 350, 360 of the display may be located outside the border angle α from the gaze vector 422. Thus, light emitted from the first area 340 of the display will be projected onto the portion of the retina inside the border angle α (this corresponds to the area 340 of
[0084] Although the method does not exclude selective adaptation of intensity of light of wavelengths relevant to the circadian rhythm in the first area 340, typically, the first colour rendering mode involves no such selective adaptation 432. This is because such selective adaptation would be perceptible to a user to a higher extent in the first area 340 since the light from that area will be projected onto the part of the retina the density of cells (cone cells) that register colour of light is highest.
[0085] The first area 340 may for example be the entire area of the display inside the border angle α from the gaze vector 424.
[0086] The second area 350, 360 may for example be the entire area of the display outside the border angle α from the gaze vector 426. In alternative 428, the second area 350 is an area of the display outside the border angle α from the gaze vector and inside the outer angle β from the gaze vector (this corresponds to the area 350 of
[0087] Furthermore 444, in the second colour rendering mode, selective adaptation of the intensity of light of wavelengths relevant to the circadian rhythm may vary with the angle such that it is at a largest degree at a peak angle from the gaze vector larger than the border angle α. The peak angle is within the range 2-5°, more precise about 3.5°.
[0088] Additionally, on condition that the first area 340 and the second area 350, 360 are adjacent to each other, a smooth transition from the first colour rendering mode to the second colour rendering mode along a border between the first area 340 and the second area 350, 360 may be applied 450. In one example, in a border area starting inside the border angle α and ending outside the border angle α, the degree of selective adaptation is gradually increased from the defined degree of selective adaptation according to the first colour rendering mode to the defined degree of selective adaptation according to the second colour rendering mode. The smooth transition may be implemented in many ways. This is intended to make the transition from the first colour rendering mode in the first area 340 of the display and the second colour rendering mode in the second area 350, 360 of the display smoother and less salient.
[0089] When the user looks at another point of the display, the gaze vector of the user changes. When new gaze tracking information identifying a new gaze vector of the user of the system are received 460, the first colour rendering mode is applied 470 in a third area of the display located inside the border angle α from the new gaze vector, and the second colour rendering mode is applied 480 in a fourth area of the display located outside the border angle α from the new gaze vector.
[0090] In a first alternative, the first colour rendering mode and the second colour rendering mode are applied in the third area and the fourth area, respectively, as soon as the third area and the fourth area have been identified. Hence, the area of the display having the first colour rendering mode will be the border area inside the border angle α with the user gaze point in the middle that will follow the user's gaze. The area of the display outside the border angle will have the second colour rendering mode.
[0091] In a second alternative, the first colour rendering mode is applied in the third area as soon as the third area has been identified. Furthermore, the first colour rendering mode is maintained during a predetermined time after receiving the new gaze tracking information in the first area 340 of the display 320, 472 simultaneously with applying the first colour rendering mode in the third area of the display. During that predetermined time, the second colour rendering mode is applied in the portion of the fourth area that does not overlap with the first area 340 (and the third area). When the predetermined time has lapsed after receiving the new gaze tracking information, the first colour rendering mode is applied in the third area of the display and the second colour rendering mode is applied in the fourth area of the display. Hence, the area of the display having the first colour rendering mode will first be the border area inside the border angle α with the user gaze point in the middle. When the user changes gaze point, the border circle A.sub.α will follow the user's gaze with a difference from the first alternative that the previous position of the border circle A.sub.α will still have the first colour rendering mode for the predetermined time.
[0092] The second alternative may be used to reduce the risk that moving the gaze will cause a perceivable effect in the periphery of the user's field of view when an area of the display in which the first colour rendering mode was applied changes such that the second colour rendering mode is applied in it.
[0093] In
[0094] The system 500 as illustrated in relation to
[0095]
[0096] The displaying device 1015 may for example be 3D display, such as a stereoscopic display. The 3D display may for example be comprised glasses equipped with AR functionality. Further, the 3D display may be a volumetric 3D display, being either autostereoscopic or automultiscopic, which may indicate that they create 3D imagery visible to an unaided eye, without requiring stereo goggles or stereo head-mounted displays. Consequently, as described in relation to
[0097]
[0098] A person skilled in the art realizes that the present invention is by no means limited to the embodiments described above. On the contrary, many modifications and variations are possible within the scope of the appended claims.
[0099] Additionally, variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. The terminology used herein is for the purpose of describing particular aspects of the disclosure only, and is not intended to limit the invention. The division of tasks between functional units referred to in the present disclosure does not necessarily correspond to the division into physical units; to the contrary, one physical component may have multiple functionalities, and one task may be carried out in a distributed fashion, by several physical components in cooperation. A computer program may be stored/distributed on a suitable non-transitory medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. The mere fact that certain measures/features are recited in mutually different dependent claims does not indicate that a combination of these measures/features cannot be used to advantage. Method steps need not necessarily be performed in the order in which they appear in the claims or in the embodiments described herein, unless it is explicitly described that a certain order is required. Any reference signs in the claims should not be construed as limiting the scope.