SYSTEM AND METHOD FOR PROVIDING A NOTIFICATION TO AN OCCUPANT OF A VEHICLE

Abstract

A method and a system for enhancing a user experience of an occupant in a vehicle that includes a step of detecting a change of the occupant's line of gaze and a step of outputting a notification, if a change of the occupant's line of gaze is detected or if a predetermined time period has elapsed. The notification is provided on an output device based on the detected occupant's line of gaze.

Claims

1. A method for providing a notification to an occupant of a vehicle, the method comprising: determining a notification to be provided to the occupant of the vehicle; detecting a line of gaze of the occupant at a time t1; detecting the line of gaze of the occupant at a time t2, wherein the time t2 occurs after the time t1; determining whether the line of gaze of the occupant at the time t1 differs from the line of gaze of the occupant at the time t2; and determining whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2.

2. The method of claim 1, wherein determining whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2 includes, in response to a determination that the line of gaze at the time t1 differs from the line of gaze at the time t2, outputting the notification.

3. The method of claim 1, wherein determining whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2 includes, in response to determining that the line of gaze at the time t1 equals the line of gaze at the time t2, determining whether a predetermined time period T between the time t1 and the time t2 has elapsed and, in response to a determination that the predetermined time period T has elapsed, outputting the notification.

4. The method of claim 1, further comprising determining a nearest display of a plurality of output devices with respect to the line of gaze of the occupant at the time t1; and outputting the notification at least via the nearest display.

5. The method of claim 1, wherein determining whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2 includes outputting the notification using at least one output device of a plurality of output devices, the at least one output device corresponding to an area predefined by a plurality of lines of gaze including the line of gaze of the occupant at the time t2.

6. The method of claim 5, wherein outputting the notification using at least one output device of the plurality of output devices includes outputting the notification using at least one further predetermined output device of the plurality of output devices.

7. The method of claim 6, further comprising attributing a priority to the notification; and outputting of the notification based on the attributed priority.

8. The method of claim 7, further comprising allocating a point in time to the notification based on the attributed priority; and outputting the notification based on the allocated point in time.

9. The method of claim 7, further comprising selecting at least one output device of the plurality of output devices based on the attributed priority; and outputting the notification based on the selected output device.

10. A system for providing a notification to an occupant of a vehicle, comprising: a processor; and a memory including instructions that, when executed by the processor, cause the processor to: determine a notification to be provided to the occupant of the vehicle; detect a line of gaze of the occupant at a time t1; detect the line of gaze of the occupant at a time t2, wherein the time t2 occurs after the time t1; determine whether the line of gaze of the occupant at the time t1 differs from the line of gaze of the occupant at the time t2; and determine whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2.

11. The system of claim 10, wherein the instructions further cause the processor to output the notification based on a determination that the line of gaze at the time t1 differs from the line of gaze at the time t2.

12. The system of claim 10, wherein the instructions further cause the processor to output the notification based a determination that the line of gaze at the time t1 equals the line of gaze at the time t2; determine whether a predetermined time period T between the time t1 and the time t2 has elapsed; and, in response to a determination that the predetermined time period T has elapsed, output the notification.

13. The system of claim 10, wherein the instructions further cause the processor to determine a nearest display of a plurality of output devices with respect to the line of gaze of the occupant at the time t1; and output the notification at least via the nearest display.

14. The system of claim 10, wherein the instructions further cause the processor to output the notification using at least one output device of a plurality of output devices, the at least one output device corresponding to an area predefined by a plurality of lines of gaze including the line of gaze of the occupant at the time t2.

15. The system of claim 14, wherein the instructions further cause the processor to output the notification using at least one further predetermined output device of the plurality of output devices.

16. The system of claim 15, wherein the instructions further cause the processor to attribute a priority to the notification; and output the notification based on the attributed priority.

17. The system of claim 16, wherein the instructions further cause the processor to allocate a point in time to the notification based on the attributed priority; and output the notification based on the allocated point in time.

18. The system of claim 16, wherein the instructions further cause the processor to select at least one output device of the plurality of output devices based on the attributed priority; and output the notification based on the selected output device.

19. A system for a vehicle, comprising: a processor; and a memory including instructions that, when executed by the processor, cause the processor to: determine a notification to be provided to an occupant of the vehicle; detect a line of gaze of the occupant at a time t; and output the notification on at least one output device of a plurality of output devices based on a relationship between the line of gaze of the occupant and the plurality of output devices at time t.

20. The system of claim 19, wherein the instructions further cause the processor to determine a first output device of the plurality of output devices, the first output device being within a range of the line of gaze of the occupant at time t; and output the notification using the first output device.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0030] FIG. 1 schematically illustrates a notification management system for a vehicle according to an embodiment.

[0031] FIG. 2 illustrates an example for an output unit.

[0032] FIG. 3 illustrates an example for an occupant's line of gaze detection.

[0033] FIG. 4 shows a process flow schematically illustrating a method according to an embodiment.

[0034] FIG. 5 shows a process flow schematically illustrating a method according to an embodiment.

[0035] FIG. 6 schematically illustrates a notification management system for a vehicle according to an embodiment.

[0036] FIG. 7 shows a process flow schematically illustrating a method according to an embodiment.

[0037] FIG. 8 shows a process flow schematically illustrating a method according to an embodiment.

[0038] FIGS. 9a-9c illustrate an example for providing a notification with usage of the notification management system.

[0039] FIGS. 10a-10c illustrate another example for providing a notification with usage of the notification management system.

[0040] FIGS. 11a-11b illustrate another example for providing a notification with usage of the notification management system.

DETAILED DESCRIPTION OF THE INVENTION

[0041] FIG. 1 shows a schematic illustration of a notification management system of a vehicle according to an embodiment. The notification management system 10 may comprise a determination unit 11, a storage unit 12, a timer 13, a detection unit 14, an examination unit 15 and an output unit 16. The notification management system 10 may be implemented in a vehicle, including cars, trucks, airplanes, drones, ships, boats, for example, and may be implemented as part of an advanced occupant-assistance system (ADAS) comprising a navigation system, a lane keeping system, an automatic cruise control, etc. In some embodiments, the different units of the notification management system 10 may be implemented as software modules running on one or more electronic control units. Further, some units may be grouped to one or more units or provided separately.

[0042] The determination unit 11 may provide a notification, which is to be output to the occupant. The notification may be provided by any other system or component of the vehicle or another vehicle in communication with the vehicle or may be determined by comparing sensor data with nominal values, which may be stored in the notification management system 10. In some embodiments the determination unit 11 may also allocate to each notification a priority, which may represent the importance and urgency of the notification.

[0043] The notification may be stored in the storage unit 12, which may be realized as a queue, a stack, a list, a list of notifications ordered with respect to priority, etc., or any combination of the previous realizations. The storage unit may be a volatile or a non-volatile memory. The notification to be output may be stored in the storage unit 12.

[0044] Output of notifications may be deferred in the storage unit 12 until the examination unit 15 determines a change of the occupant's line of gaze or a predetermined time period T measured by a timer 13 elapses. The occupant's line of gaze 33 may be detected with the detection unit 14. The timer 13 may be activated at the moment when the notification is deferred in the storage unit 12. The timer 13 may be configured with a predefined time period T for all notifications or a predetermined time period T depending on the priority of the notification.

[0045] The examination unit 15 may determine, based on the detection of the occupant's line of gaze by the detection unit 14, that the occupant's line of gaze 33 is directed to a vehicle display. This may cause the notification to be output immediately by the output unit 16, for example.

[0046] FIG. 2 shows a schematic illustration of the output unit 16 in a vehicle according to an embodiment. The output unit 16 may comprise visual output devices, like vehicle displays 21 and 24, a tablet computer 22, a smart phone 23, and acoustical output devices, like vehicle loudspeakers 25, a headset 26, a first headphone 27, and a second headphone 28. The output device to output a notification may be selected based on a change of the occupant's line of gaze and/or on the output device's position in the vehicle with respect to the occupant. The notification may be output with respect to an allocated priority.

[0047] FIG. 3 shows an example of an occupant's line of gaze detection by a detection unit 14. A detection unit 14 may detect the occupant's line of gaze 33, which may be defined as the line between the occupant's pupil 34 and a spot 32, at which the occupant's view is directed to. The detection unit 14 may comprise an evaluation unit in conjunction with a plurality of cameras 35, 36 and 37not limited in their numberpositioned at several positions and detecting the direction of the occupant's pupil 34. The cameras may be infrared cameras, video cameras, etc. The cameras may be mounted and hidden, without obstructing the view of the cameras, in any cladding of a steering wheel, below the ceiling, any control units in the cockpit or in the back of a vehicle. The line of gaze 33 may be finally detected with images from the cameras 35, 36, 37, by signal processing and image analysis. Some steps may be executed with a computer unit comprising input and output interfaces, at least one central processing unit (CPU) and at least one memory. The CPU may be referred to as a processor. The processor may include any suitable processor, such as those described herein. The memory may include Random Access Memory (RAM), a Read-Only Memory (ROM), or a combination thereof. The memory may store programs, utilities, or processes to be executed in by the processor. The memory may provide volatile data storage, and stores instructions related to the operation of the computing device. The memory may include instructions that, when executed by the processor, cause the processor to, at least, perform the methods and/or the functions of the systems described herein. The computer unit may include any suitable computing device. The computer unit may be local (e.g., with in the vehicle) or remote (e.g., in a cloud computing device or other suitable remote computing device).

[0048] FIG. 4 shows a process flow which schematically illustrates a method for operating a notification management system. The method may be carried out by a notification management system as described above with reference to FIG. 1. Further, it may be possible to change the order of single steps, to summarize single steps and/or to add new steps without changing the functionality of the described process. It may be also possible to execute some steps in parallel.

[0049] In a first process step S401, a notification may be determined, which has to be provided to the occupant. This may be done, for example, by comparing sensor data with reference values or by providing a notification of another system of the vehicle as well as another vehicle or a mobile phone.

[0050] In a second process step S408, a timer 13 is activated. In the following steps S403 and S404, the occupant's line of gaze 33 may be detected at a time t1 and at a time t2, respectively, wherein the time t2 is after t1.

[0051] Based on the detections at the times t1 and t2 in the steps S403 and S404, the lines of gaze 33 at the times t1 and t2 may be compared with each other in step S405 and a change of the occupant's line of gaze may be determined. Additionally, a threshold may be introduced, which must be exceeded by the change of the occupant's line of gaze as to be determined as a change of the occupant's line of gaze. This may, for example, ensure that switching the page while reading is detected as maintaining the attentiveness unchanged, whereas looking up from a newspaper is detected as a change of attentiveness. Further, other contextual cues in regards to the occupant, such as whether the occupant is awake, may be considered. The threshold may be optimized with artificial intelligence or any other optimization algorithms with respect to the lines of gaze to improve the determination of natural interruptions of the occupant in his/her work.

[0052] In the step S406, a case decision may be done with respect to the result of the examination of the occupant's lines of gaze in the previous step S405. If there is a change of the occupant's line of gaze determined, the notification may be output and the timer 13 may be deactivated and reset in step S410. However, if no change of the occupant's line of gaze is determined, it may be checked if the timer 13, which has been activated in step S408, has elapsed. In the case the timer 13 has elapsed, the notification determined in step S401 may be output and the timer 13 may be deactivated and reset according to step S410. If the timer 13 has not elapsed, the process flow returns to step S404 and a new detection of the occupant's line of gaze 33 at a time t2 is done. That is, a notification may be output, if a timer 13 elapses, and/or, if a change of the occupant's line of gaze is determined.

[0053] FIG. 5 shows a process flow which schematically illustrates a method for operating a notification management system as shown in FIG. 4, with the additional steps of prioritizing a notification and using the prioritization to manage the output of the notification. The method may be executed by a notification management system as shown in FIG. 1.

[0054] In step S501, attributing a priority to the notification and, in step S502, executing a case decision with respect to the allocated priority of step S501 is executed after the step S401 of determining a notification. If the attributed priority of the notification is high, the notification is output based on the priority of the notification, the timer is deactivated and reset in step S510. In other cases, the process continues with the step S408. Further, the step S410 of outputting the notification after the case decisions in steps S406 and S409 is replaced by a step S510 of outputting the notification with respect to the attributed priority and deactivating and reset of the timer.

[0055] In some embodiments an occupant may predefine and adapt the process of attributing priority to the needs of the occupant, for example, such that some, like non-important and non-urgent notifications are not output. However, the occupant may be restricted from setting the priorities, in particular, of important and urgent notifications to values, whereat no notification is output. As such, the occupant may be restricted from turning notifications completely off.

[0056] In some embodiments an occupant may be able to set a threshold controlling the output of notifications with a certain priority. However, the occupant may be restricted from setting the threshold so high that no information is output. As such, the occupant may be restricted from turning notifications completely off. For example, a notification, that the estimated time of arrival will be later, gets a priority with a value of 2 attributed, whilst the threshold for outputting a notification has been set by the occupant to 3. Thus, only notifications with a value of 3 or higher are output and the notification, that the estimated time of arrival will be later, is not output.

[0057] In one or more embodiments, in a case, when more than one notification has to be output, the order of outputting the notifications may be advantageously amended from a First-In-First-Out order (the first determined notification is output at first) to the attributed priority of the notifications, that means the notification with the highest priority is output at first, then the notification with the second highest priority and so on.

[0058] FIG. 6 shows a schematic illustration of a notification management system of a vehicle according to an embodiment. The notification management system 60 may comprise a determination unit 61, a detection unit 62, an examination unit 63 and an output unit 64. The notification management system 60 may be implemented in a vehicle, including cars, trucks, airplanes, drones, ships, boats, for example, and may be implemented as part of an advanced occupant-assistance system (ADAS) comprising a navigation system, a lane keeping system, an automatic cruise control, etc. In some embodiments, the different units of the notification management system 60 may be implemented as software modules running on one or more electronic control units. Further, some units may be grouped to one or more units and/or may be provided separately.

[0059] The determination unit 61 may provide a notification, which is to be output to the occupant. The notification may be provided by any other system, like a mobile phone, or by any system or component of the own vehicle or another vehicle or may be determined by comparing sensor data with nominal values. In some embodiments the notification unit 61 may also allocate to each notification a priority, which may represent the importance and urgency of the notification.

[0060] The detection unit 62 may detect an occupant's line of gaze 33, which may be used by the examination unit 63 to determine an output device of the output unit 16, with which the output may be output. The examination unit 63 may determine at least one output device of the output unit 16 depending on the occupant's line of gaze 33 and the assignment of the output devices of the output unit 16 to pluralities of lines of gaze.

[0061] The output unit 16 may finally output the notification of the determination unit 61 on the output device determined by the examination unit 63.

[0062] FIG. 7 shows an embodiment of a process flow which schematically illustrates a method for providing a notification to an occupant of a vehicle. The method may be carried out by a notification management system as described above with reference to FIG. 6. Further, it may be possible to change the order of single steps, to summarize single steps and/or to add new steps without changing the functionality of the described process. It may be also possible to execute some steps parallel. In a first step S71 a notification is provided as it is already described in the step S401. In a second step S72, an occupant's line of gaze is detected. In a further step S73, the nearest display with respect to the occupant's line of gaze is determined using a Chebyshev distance. In further embodiments different assignments of the occupant's line of gaze to output devices, like predefined assignments or other methods of distance calculation, may be applied.

[0063] FIG. 8 shows process flow of an embodiment of a method for providing a notification to the occupant of a vehicle. The steps of the method of this embodiment corresponds to the process flow of FIG. 7, wherein the step S71 is replaced by the step S81 of providing a notification with allocated priority. Additionally, the notification may be output in a further step S85 based on its allocated priority. This step S85 may be executed in parallel with the step of outputting a notification on the determined display S64. The method shown in the process flow in FIG. 8 may be executed by a system as described above with reference to FIG. 6.

[0064] FIGS. 9a-9c illustrate an embodiment in practice, where the methods 4 and 7 are applied. In FIG. 9a, an occupant 31 is sitting in his vehicle with several displays 21, 22 and a steering wheel and reading on his tablet computer 22 positioned on his lap. Thus, the occupant's line of gaze 33 is detected on the tablet computer 22. At a certain moment the occupant 31 looks up, as shown in FIG. 9b. This change of the occupant's line of gaze is detected by the detection unit 14 and determined as a change of the occupant's line of gaze by the examination unit 15 and, thus, in this moment a notification, which has been determined by the determination unit 11, is output to the occupant with the output unit 16.

[0065] The determination unit 61 determines the notification to be output. Based on the result of the detection unit 62, the examination unit 63 determines the vehicle display 21 as the nearest display with respect to the occupant's line of gaze 33. As a result, the output unit 16 outputs the notification on the vehicle display 21 and the notification appears serendipitously on the vehicle display 21, as shown in FIG. 9c.

[0066] FIGS. 10a-10c illustrate another embodiment in practice, where the methods 4 and 7 applied. In FIG. 10a an occupant 31 is sitting in his vehicle with his gaze 33 on a tablet computer 22 positioned on his lap. At a certain time, a notification is provided to the determination unit 11 of the notification management system, in order to be provided to the occupant. Thus, a timer 13 is started with an exemplary time period T of 10 minutes as shown in FIG. 10b. After the timer 13 has elapsed, the notification is provided to the occupant 31 with the output unit 16.

[0067] The determination unit 61 determines the notification to be output to the occupant and the detection unit 62 detects the occupant's line of gaze 33. Based on the notification about the occupant's line of gaze, the examination unit determines that the occupant's line of gaze is directed on the tablet computer 22 and thus the output unit 16 outputs the notification on the tablet computer 22 on the occupant's lap.

[0068] FIGS. 11a and 11b illustrate an embodiment in practice, where the methods 5 and 8 are applied. In FIG. 11a, an occupant 31 is working on his tablet computer 22, when a notification of the ADAS with a high priority is provided to the notification management system to be output to the occupant. Due to its high priority, the notification is output immediately to the occupant 31. The detection unit 62 detects the occupant's line of gaze 33 and provides the notification about the occupant's line of gaze to the examination unit 63, which determines that the occupant's line of gaze is directed to the tablet computer 22, which is at the same time the nearest output device with respect to the occupant's line of gaze 33. Thus, the output unit 16 outputs the notification of the ADAS on the tablet computer 22 and, additionally, with the vehicle loudspeakers 25 due to the high priority of the notification of the ADAS.

[0069] In some embodiments, a method for providing a notification to an occupant of a vehicle includes: determining a notification to be provided to the occupant of the vehicle; detecting a line of gaze of the occupant at a time t1; detecting the line of gaze of the occupant at a time t2, wherein the time t2 occurs after the time t1; determining whether the line of gaze of the occupant at the time t1 differs from the line of gaze of the occupant at the time t2; and determining whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2.

[0070] In some embodiments, determining whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2 includes, in response to a determination that the line of gaze at the time t1 differs from the line of gaze at the time t2, outputting the notification. In some embodiments, determining whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2 includes, in response to determining that the line of gaze at the time t1 equals the line of gaze at the time t2, determining whether a predetermined time period T between the time t1 and the time t2 has elapsed and, in response to a determination that the predetermined time period T has elapsed, outputting the notification. In some embodiments, the method also includes determining a nearest display of a plurality of output devices with respect to the line of gaze of the occupant at the time t1; and outputting the notification at least via the nearest display. In some embodiments, determining whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2 includes outputting the notification using at least one output device of a plurality of output devices, the at least one output device corresponding to an area predefined by a plurality of lines of gaze including the line of gaze of the occupant at the time t2. In some embodiments, outputting the notification using at least one output device of the plurality of output devices includes outputting the notification using at least one further predetermined output device of the plurality of output devices. In some embodiments, the method also includes attributing a priority to the notification; and outputting of the notification based on the attributed priority. In some embodiments, the method also includes allocating a point in time to the notification based on the attributed priority; and outputting the notification based on the allocated point in time. In some embodiments, the method also includes selecting at least one output device of the plurality of output devices based on the attributed priority; and outputting the notification based on the selected output device.

[0071] In some embodiments, a system for providing a notification to an occupant of a vehicle includes a processor and a memory. The memory includes instructions that, when executed by the processor, cause the processor to: determine a notification to be provided to the occupant of the vehicle; detect a line of gaze of the occupant at a time t1; detect the line of gaze of the occupant at a time t2, wherein the time t2 occurs after the time t1; determine whether the line of gaze of the occupant at the time t1 differs from the line of gaze of the occupant at the time t2; and determine whether to output the notification based on the result of the determination of whether the line of gaze at the time t1 differs from the line of gaze at the time t2.

[0072] In some embodiments, the instructions further cause the processor to output the notification based on a determination that the line of gaze at the time t1 differs from the line of gaze at the time t2. In some embodiments, the instructions further cause the processor to output the notification based a determination that the line of gaze at the time t1 equals the line of gaze at the time t2; determine whether a predetermined time period T between the time t1 and the time t2 has elapsed; and, in response to a determination that the predetermined time period T has elapsed, output the notification. In some embodiments, the instructions further cause the processor to determine a nearest display of a plurality of output devices with respect to the line of gaze of the occupant at the time t1; and output the notification at least via the nearest display. In some embodiments, the instructions further cause the processor to output the notification using at least one output device of a plurality of output devices, the at least one output device corresponding to an area predefined by a plurality of lines of gaze including the line of gaze of the occupant at the time t2. In some embodiments, the instructions further cause the processor to output the notification using at least one further predetermined output device of the plurality of output devices. In some embodiments, the instructions further cause the processor to attribute a priority to the notification; and output the notification based on the attributed priority. In some embodiments, the instructions further cause the processor to allocate a point in time to the notification based on the attributed priority; and output the notification based on the allocated point in time. In some embodiments, the instructions further cause the processor to select at least one output device of the plurality of output devices based on the attributed priority; and output the notification based on the selected output device.

[0073] In some embodiments, a system for a vehicle includes a processor and a memory. The memory includes instructions that, when executed by the processor, cause the processor to: determine a notification to be provided to an occupant of the vehicle; detect a line of gaze of the occupant at a time t; and output the notification on at least one output device of a plurality of output devices based on a relationship between the line of gaze of the occupant and the plurality of output devices at time t.

[0074] In some embodiments, the instructions further cause the processor to determine a first output device of the plurality of output devices, the first output device being within a range of the line of gaze of the occupant at time t; and output the notification using the first output device.

[0075] The above discussion is meant to be illustrative of the principles and various embodiments of the present disclosure. Numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated.

[0076] The word example is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as example is not necessarily to be construed as preferred or advantageous over other aspects or designs. Rather, use of the word example is intended to present concepts in a concrete fashion. As used in this application, the term or is intended to mean an inclusive or rather than an exclusive or. That is, unless specified otherwise, or clear from context, X includes A or B is intended to mean any of the natural inclusive permutations. That is, if X includes A; X includes B; or X includes both A and B, then X includes A or B is satisfied under any of the foregoing instances. In addition, the articles a and an as used in this application should generally be construed to mean one or more unless specified otherwise or clear from context to be directed to a singular form. Moreover, use of the term an implementation or one implementation throughout is not intended to mean the same embodiment or implementation unless described as such.

[0077] Implementations of the systems, algorithms, methods, instructions, etc., described herein can be realized in hardware, software, or any combination thereof. The hardware can include, for example, computers, intellectual property (IP) cores, application-specific integrated circuits (ASICs), programmable logic arrays, optical processors, programmable logic controllers, microcode, microcontrollers, servers, microprocessors, digital signal processors, or any other suitable circuit. The term processor should be understood as encompassing any of the foregoing hardware, either singly or in combination. The terms signal and data are used interchangeably.

[0078] For example, one or more embodiments can include any of the following: packaged functional hardware unit designed for use with other components, a set of instructions executable by a controller (e.g., a processor executing software or firmware), processing circuitry configured to perform a particular function, and a self-contained hardware or software component that interfaces with a larger system, an application specific integrated circuit (ASIC), a Field Programmable Gate Array (FPGA), a circuit, digital logic circuit, an analog circuit, a combination of discrete circuits, gates, and other types of hardware or combination thereof, and memory that stores instructions executable by a controller to implement a feature.

[0079] Further, in one aspect, for example, systems described herein can be implemented using a general-purpose computer or general-purpose processor with a computer program that, when executed, carries out any of the respective methods, algorithms, and/or instructions described herein. In addition, or alternatively, for example, a special purpose computer/processor can be utilized which can contain other hardware for carrying out any of the methods, algorithms, or instructions described herein.

[0080] Further, all or a portion of implementations of the present disclosure can take the form of a computer program product accessible from, for example, a computer-usable or computer-readable medium. A computer-usable or computer-readable medium can be any device that can, for example, tangibly contain, store, communicate, or transport the program for use by or in connection with any processor. The medium can be, for example, an electronic, magnetic, optical, electromagnetic, or a semiconductor device. Other suitable mediums are also available.

REFERENCE NUMERALS

[0081] T time period for a timer to output a notification [0082] t point in time at which the occupant's line of gaze is detected [0083] t1 point in time at which the occupant's line of gaze is detected [0084] t2 point in time after t1 at which the occupant's line of gaze is detected [0085] 10 system for providing a notification to the occupant of a vehicle [0086] 11 determination unit determining a notification to be output [0087] 12 storage unit storing a notification till the notification is output [0088] 13 timer determining if a time period T has elapsed [0089] 14 detection unit detecting the occupant's line of gaze [0090] 15 examination unit determining a change of the occupant's line of gaze [0091] 16 output unit for outputting a notification [0092] 21 vehicle display [0093] 22 tablet computer [0094] 23 smart phone [0095] 24 vehicle display [0096] 25 vehicle loudspeakers [0097] 26 headset [0098] 27 headphone [0099] 28 headphone [0100] 31 occupant, such as a driver or a passenger [0101] 32 spot of the occupant's line of gaze [0102] 33 occupant's line of gaze [0103] 34 pupil of the occupant [0104] 35-37 cameras of a detection unit detecting the occupant's line of gaze 33 [0105] 61 determination unit determining a notification to be output [0106] 62 detection unit detecting the occupant's line of gaze 33 [0107] 63 examination unit determining the output device of the output unit based on the detected occupant's line of gaze