Multi-sensory attention alert system

Abstract

A multi-sensory attention alert device for a vehicle includes a sensor arrangement, a warning signal emission arrangement for emitting haptic, acoustic and optical warning signals to the vehicle driver, and a control unit for analyzing and assessing the recorded measurement values and for controlling the warning signal emission arrangement. The direction of a potential source of danger can be indicated by emitting warning signals that address multiple sensory organs of the driver, and the direction of an interface can be indicated whose operation, by the driver, constitutes a counter measure for avoiding the dangerous situation.

Claims

1. A multisensory attention alert apparatus (100) for a vehicle, comprising: a sensor arrangement (102) configured to capture measured values; a warning signal output arrangement (106, 107, 108) configured to output haptic, audible and visual warning signals to a driver of the vehicle; and a control unit (101) configured to: analyze the captured measured values, use the captured measured values to assess whether there is a potential hazard situation that emanates from a potential hazard source (201), and control the warning signal output arrangement (106, 107, 108) such that the output warning signals indicate to the driver the direction in which a vehicle control interface that, when operated by the driver, provides a countermeasure to avoid the potential hazard situation is located, wherein the warning signal output arrangement (106, 107, 108) is configured to communicate to the driver a possible countermeasure to be taken by simulating sounds produced by such a countermeasure before the countermeasure is taken.

2. The multisensory attention alert apparatus (100) as claimed in claim 1, wherein the multisensory attention alert apparatus (100) is configured to perform visual marking of the potential hazard source on a head-up display (204) of the vehicle.

3. The multisensory attention alert apparatus (100) as claimed in claim 1, wherein the warning signal output arrangement (106, 107, 108) is configured to output an audible warning signal, which audible warning signal contains a situation-oriented direction information item that suggests to the driver that it comes from the direction in which the potential hazard source or the interface is located.

4. The multisensory attention alert apparatus (100) as claimed in claim 3, wherein the warning signal output arrangement (106, 107, 108) or the control unit (101) has a direction mixer (109) in order to produce the audible warning signal.

5. The multisensory attention alert apparatus (100) as claimed in claim 1, wherein the sensor arrangement (102) has a vehicle sensor system and an ambient sensor system for capturing measured values, wherein the measured values are vehicle data and/or ambient data.

6. A vehicle (401, 402, 403) having a multisensory attention alert apparatus (100) as claimed in claim 1.

7. A method for multisensory alert of the attention of a driver, comprising: capturing measured values; analyzing the captured measured values; using the captured measured values to assess whether there is a potential hazard situation that emanates from a potential hazard source; controlling a warning signal output arrangement (106, 107, 108) such that warning signals are output that indicate to the driver the direction in which a vehicle control interface that, when operated by the driver, provides a countermeasure to avoid the potential hazard situation is located; and controlling the warning signal output arrangement (106, 107, 108) to communicate to the driver a possible countermeasure to be taken by simulating sounds produced by such a countermeasure before the countermeasure is taken.

8. A non-transitory computer-readable medium (105) that stores a computer program that, when executed on a processor of a multisensory attention alert apparatus (100), prompts the multisensory attention alert apparatus (100) to perform the following steps: capturing measured values; analyzing the captured measured values; using the captured measured values to assess whether there is a potential hazard situation that emanates from a potential hazard source; controlling a warning signal output arrangement (106, 107, 108) such that warning signals are output that indicate to the driver the direction in which a vehicle control interface that, when operated by the driver, provides a countermeasure to avoid the potential hazard situation is located; and controlling the warning signal output arrangement (106, 107, 108) to communicate to the driver a possible countermeasure to be taken by simulating sounds produced by such a countermeasure before the countermeasure is taken.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) Exemplary embodiments of the invention are described below with reference to the figures, in which.

(2) FIG. 1 shows a multisensory attention drawing (i.e., alert) apparatus for a vehicle according to an exemplary embodiment of the invention;

(3) FIG. 2 shows the image that a driver can see through the windshield of a vehicle with a head-up display according to an exemplary embodiment of the invention;

(4) FIG. 3 shows devices for a vehicle according to an exemplary embodiment of the invention;

(5) FIG. 4 shows various vehicles according to exemplary embodiments of the invention; and

(6) FIG. 5 shows a flowchart for a method according to an exemplary embodiment of the invention.

DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS

(7) The illustrations in the figures are schematic and not to scale.

(8) Where the same reference symbols are used in different figures in the description of the figures that follows, these denote elements that are the same or similar. Alternatively, elements that are the same or similar may be denoted by different reference symbols.

(9) FIG. 1 shows a multisensory attention drawing apparatus 100 for a vehicle. The apparatus 100 has a control unit 101 in the form of a processor, which control unit is connected to various devices of the vehicle.

(10) At this juncture, it should be pointed out that the communication between selected devices of the vehicle can be effected wirelessly in particular exemplary embodiments of the invention. Similarly, provision may be made for the communication to be effected by wire, wirelessly or exclusively by wire as options.

(11) The multisensory attention drawing apparatus has a vehicle navigation apparatus 104, a vehicle assistance apparatus 103 and a vehicle sensor system 102.

(12) The vehicle sensor system 102 may have both ambient sensors, such as radar sensors or lidar sensors, and vehicle sensors that record vehicle-internal measurement data. Examples thereof are ESP sensors for measuring accelerations, rotation speeds and the current vehicle position and speed.

(13) In addition, a data memory 105 is provided as an example of a non-transitory computer-readable medium that can store the program element for performing the method according to the invention, for example.

(14) Furthermore, the control unit 101 has what is known as a direction mixer 109 that can help to produce the audible warning signals.

(15) For outputting the audible warning signals, a plurality of loudspeakers 113, 114, 115, 116 are provided that are distributed in the vehicle and that form the audible warning signal output unit 107.

(16) What is known as the visual warning signal output unit 108 can be used to output visual warning and information signals by a plurality of visual output apparatuses 117, 118, 119.

(17) The haptic warning signal output apparatus 106 can be used to output haptic warning signals. Examples of such signals are vibrations in the steering wheel by the vibration unit 110, vibrations in the driver's seat by the seat vibration unit 111 and vibrations in one or more of the pedals by the pedal vibration unit 112.

(18) All these different output apparatuses can be addressed and activated by the control unit 101.

(19) The invention now proposes a plurality of measures to allow the driver to sense the situation and corresponding warnings quickly and simply.

(20) By way of example, the natural signals emanating from the hazard source can be amplified or simulated in order to attract the attention of the driver before the actual hazard source has become more of a threat.

(21) By way of example, the navigation 104 provides the control unit 101 with advance notification of a school with the potential hazard of children suddenly crossing the road. As a warning signal, the noise of children is produced and played in the cockpit. In addition, the navigation 104 or the instrument cluster displays the appropriate road warning sign, for example on the head-up display 117.

(22) As a further example, the navigation 104 expects a poor section of road ahead and the current speed of the vehicle is relatively high. As a warning signal, a heavy rolling sound is played. The haptic feedback from the steering wheel and/or seat simulates vibrations with statistics (a frequency pattern) that correspond to those of a poor road.

(23) As a further example, a distance sensor in the sensor system 102 detects that the vehicle ahead is braking sharply. The infotainment system reduces the volume of the current sound source (e.g., radio) and mixes a distinctly audible brake sound into the channels of the front loudspeakers such that the audible location for the brake sound perceived by the driver is a location in front of the automobile.

(24) It is also possible for audible warning signals to be presented such that they draw the attention in the desired direction. To this end, a direction mixing desk 109 is used in order to filter the channels to be reproduced via the loudspeaker channels of the automobile for the warning messages and warning signals such that the driver is provided with the subjective impression that the warning signal is coming from a particular direction. This direction is that direction in which the attention of the driver is intended to be drawn. The particular direction does not need to match the horizontal plane of the vehicle but rather can also run in the direction of the floor or the direction of the headliner of the vehicle.

(25) By way of example, the case may arise that the handbrake of the vehicle is not fully released. An appropriate warning signal, or a warning message, is prefiltered in accordance with the binaural auditory response of the human ear such that the signal sounds as though it were coming from the direction of the handbrake.

(26) It is also possible for the front lidar to detect a screen of fog in advance. The trip assistant 103 outputs the advice: “The switch for the fog lamp and the rear fog lamp is located . . . ”. The advice is prefiltered in accordance with the binaural auditory response of the human ear, so that the signal sounds as though it were coming from the direction of the switch. The illumination of the switch can simultaneously be switched on or flash.

(27) It is also possible for a plurality of arrangements to be used at the same time in order to produce direction-oriented information and to draw the attention of the driver in the desired direction. By way of example, in addition to the noise of children described above from the direction of the school, it is also possible for the head-up display to mark the hazardous area 201 next to the road in the windshield 204. This is shown in FIG. 2, in which the road profile 203 can be seen through the windshield 204. At the left-hand edge of the road, there is a schoolchild 202, who is visually highlighted by the marker 201 that encircles the child in the head-up display.

(28) It is also possible for the output of the rolling sound described above to be simultaneously accompanied by the production of a vibration in the steering wheel and/or seat in order to draw the attention of the driver to the road.

(29) The various warning signals can be linked to one another such that the driver intuitively learns the type, location and hazard potential of the hazard source by virtue of several of his senses being addressed in different ways. The system is also capable of quickly and effectively notifying the driver of countermeasures that he can take in order to avoid the hazard situation.

(30) This can also include drawing the attention of the driver to the button for the hazard warning lights when there is the threat of a queue forming on the freeway.

(31) FIG. 3 shows the steering wheel 301 of a vehicle, the gas pedal 302 of the vehicle and the vehicle seat 303. All three apparatuses can be addressed by vibration sensors and prompted to vibrate, so that the thighs and back, hands and feet of the driver can be provided with vibration information.

(32) By way of example, vibration in the gas pedal could mean that the driver needs to reduce his speed.

(33) Hence, existent weak warning signals that emanate from a potential or actual hazard source can be amplified. It is thus possible for warning signals that the driver expects in conjunction with the corresponding hazard source to be stored and to be reproduced as required.

(34) In particular, the invention proposes not taking individual measures but rather bundling a plurality of arrangements in order to draw attention in a direction-oriented and effective manner. By way of example, spoken messages can be provided in conjunction with direction-oriented binaural processing. It is also possible for a visual signal to be output in conjunction with direction-oriented binaural processing. Visual and/or audible signals can also be output in conjunction with a vibrating steering wheel or a vibrating seat.

(35) Messages or audible warning signals can be produced by a direction mixing desk in order to filter the channels to be reproduced via the loudspeaker channels of the automobile for the warning messages and warning signals such that the driver is provided with the subjective impression that the warning signal is coming from a particular direction (namely the one to which the attention of the driver is intended to be drawn). The particular direction does not need to match the horizontal plane of the vehicle but rather may also point to the floor or the headliner of the vehicle. The signals can be either prefiltered and stored on a multichannel basis or stored on a single-channel basis and conditioned on a multichannel basis depending on direction during reproduction.

(36) FIG. 4 shows a plurality of vehicles according to exemplary embodiments of the invention. By way of example, the vehicle may be a helicopter 401, a motor vehicle 402, a ship 403 or a locomotive 404. All of the vehicles have a multisensory attention drawing apparatus.

(37) FIG. 5 shows a flowchart for a method according to an exemplary embodiment of the invention. In step 501, measured values are captured by the ambient sensor system and the vehicle sensor system. In step 502, the captured measured values are then analyzed and an assessment is made as to whether there is a potential hazard situation. In step 503, the warning signal output arrangement is then actuated, so that it shows the driver the direction in which the potential hazard source is located. In step 504, the driver is further shown where the interface that the driver should operate in order to avoid the potential hazard source is located in the vehicle. By way of example, this is the hazard warning lights or the handbrake. The driver can also be notified, in step 505, of which measure he should take next (brake, swerve, etc.).

(38) The output signals may particularly be a combination of audible, haptic and visual signals in order to draw the attention of the driver quickly and effectively.

(39) In addition, it should be pointed out that “comprising” and “having” do not exclude other elements or steps, and “a” or “an” does not exclude a large number. Furthermore, it should be pointed out that features or steps that have been described with reference to one of the above exemplary embodiments can also be used in combination with other features or steps from other exemplary embodiments described above. Reference symbols in the claims should not be regarded as restrictions.

(40) Thus, while there have been shown and described and pointed out fundamental novel features of the invention as applied to a preferred embodiment thereof, it will be understood that various omissions and substitutions and changes in the form and details of the devices illustrated, and in their operation, may be made by those skilled in the art without departing from the spirit of the invention. For example, it is expressly intended that all combinations of those elements and/or method steps which perform substantially the same function in substantially the same way to achieve the same results are within the scope of the invention. Moreover, it should be recognized that structures and/or elements and/or method steps shown and/or described in connection with any disclosed form or embodiment of the invention may be incorporated in any other disclosed or described or suggested form or embodiment as a general matter of design choice. It is the intention, therefore, to be limited only as indicated by the scope of the claims appended hereto.