METHOD FOR DISPLAYING SAFETY-RELEVANT INFORMATION ON A DISPLAY DEVICE OF A VEHICLE

Abstract

The disclosure relates to a method for displaying safety-relevant information on a display device of a vehicle. A speed of the vehicle, environment data representing an environment of the vehicle, a driver reaction time, and an emergency braking reaction time for an emergency braking driver assistance function are input, and used to superimpose an emergency braking marker and a driver intervention marker on the map representing a lane in which the vehicle is travelling in the display device. The emergency braking marker represents a future point in time and/or future location for an intervention of the emergency braking driver assistance function, and the driver intervention marker represents a future point in time and/or a future location for the latest possible intervention of the driver prior to the intervention of the emergency braking driver assistance function.

Claims

1. A method for displaying safety-relevant information on a display device of a vehicle, the method comprising: inputting a speed of the vehicle, an environment data representing an environment of the vehicle, a driver reaction time that represents a reaction time of a driver of the vehicle determined in a reaction test, and an emergency braking time that represents a reaction time of an emergency braking driver assistance function of the vehicle in response to detection of an emergency braking situation; and superimposing an emergency braking marker and a driver intervention marker on a map in the display device representing a roadway on which the vehicle is travelling, based on the speed, the environment data, the driver reaction time, and the emergency braking reaction time, wherein the emergency braking marker represents at least one of a first future point in time or a first future location for an intervention of the emergency braking driver assistance function, and wherein the driver intervention marker represents at least one of a second future point in time or a second future location for a latest possible intervention of the driver prior to the intervention of the emergency braking driver assistance function.

2. The method according to claim 1, further comprising changing a distance between the driver intervention marker and the emergency braking marker based on a change in a distance between the vehicle and an object in the environment.

3. The method according to claim 1, further comprising superimposing an arrow at least one of parallel to the roadway or pointing toward the emergency braking marker as the driver intervention marker.

4. The method according to claim 1, further comprising superimposing a line crossing the roadway as the emergency braking marker.

5. The method according to claim 1, further comprising adjusting an aspect ratio of the map based on the speed.

6. The method according to claim 1, further comprising determining the emergency braking reaction time by adding the driver reaction time to a vehicle reaction time that represents a reaction time for the vehicle for processing a driver command.

7. The method according to claim 1, further comprising projecting at least one of the emergency braking marker or the driver intervention marker onto a windshield of the vehicle.

8. The method according to claim 1, further comprising highlighting on the map a lane in which the vehicle is travelling.

9. The method according to claim 1, further comprising superimposing on the map at least one object symbol representing an object located on the roadway.

10. The method according to claim 9, wherein a size of the at least one object symbol changes based on a change in a distance between the vehicle and the object.

11. The method according to claim 1, further comprising masking in the map a region of the environment that is not visible to the driver.

12. (canceled)

13. (canceled)

14. A machine-readable storage medium storing thereon a computer program that, when executed by a computing device, causes the computing device to perform a method comprising: inputting a speed of a vehicle, an environment data representing an environment of the vehicle, a driver reaction time that represents a reaction time of the driver of the vehicle determined in a reaction test, and an emergency braking time that represents a reaction time of an emergency braking driver assistance function of the vehicle in response to detection of an emergency braking situation; and superimposing an emergency braking marker and a driver intervention marker on a map in a display device representing a roadway on which the vehicle is travelling, based on the speed, the environment data, the driver reaction time, and the emergency braking reaction time, wherein the emergency braking marker represents at least one of a first future point in time or a first future location for an intervention of the emergency braking driver assistance function, and wherein the driver intervention marker represents at least one of a second future point in time or a second future location for a latest possible intervention of the driver prior to the intervention of the emergency braking driver assistance function.

15. A device for displaying safety-relevant information on a display device of a vehicle, the device comprising: an input unit configured to receive an input of a speed of a vehicle, an environment data representing an environment of the vehicle, a driver reaction time that represents a reaction time of a driver of the vehicle determined in a reaction test, and an emergency braking time that represents a reaction time of an emergency braking driver assistance function of the vehicle in response to detection of an emergency braking situation; and a superimposing unit configured to superimpose an emergency braking marker and a driver intervention marker on a map in the display device representing a roadway on which the vehicle is travelling, based on the speed, the environment data, the driver reaction time, and the emergency braking reaction time, wherein the emergency braking marker represents at least one of a first future point in time or a first future location for an intervention of the emergency braking driver assistance function, and wherein the driver intervention marker represents at least one of a second future point in time or a second future location for a latest possible intervention of the driver prior to the intervention of the emergency braking driver assistance function.

16. The device according to claim 15, wherein the superimposing unit is further configured to change a distance between the driver intervention marker and the emergency braking marker based on a change in a distance between the vehicle and an object in the environment.

17. The device according to claim 15, wherein the superimposing unit is further configured to superimpose an arrow at least one of parallel to the roadway or pointing toward the emergency braking marker as the driver intervention marker.

18. The device according to claim 15, wherein the superimposing unit is further configured to superimpose a line crossing the roadway as the emergency braking marker.

19. The device according to claim 15, wherein the superimposing unit is further configured to adjust an aspect ratio of the map based on the speed.

20. The device according to claim 15, wherein the superimposing unit is further configured to highlight on the map a lane in which the vehicle is travelling.

21. The device according to claim 15, wherein the superimposing unit is further configured to superimpose on the map at least one object symbol representing an object located on the roadway.

22. The device according to claim 21, wherein a size of the at least one object symbol changes based on a change in a distance between the vehicle and the object.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The present disclosure shall be explained in greater detail based on the examples in the attached drawings.

[0024] FIG. 1 shows a schematic illustration of a vehicle that has a device according to an exemplary embodiment;

[0025] FIG. 2 shows a schematic illustration of the vehicle in FIG. 1;

[0026] FIG. 3 shows a schematic illustration of a device according to an exemplary embodiment; and

[0027] FIG. 4 shows a flow chart for a method according to an exemplary embodiment.

DETAILED DESCRIPTION

[0028] In the following description of preferred exemplary embodiments of the present disclosure, the same or similar reference symbols are used for the elements in the figures that have similar functions, wherein the descriptions of these elements shall not be repeated.

[0029] FIG. 1 shows a schematic illustration of a vehicle 100 that has a device 102 according to an exemplary embodiment. The vehicle 100 has a display device 104 configured according to this exemplary embodiment to project safety-relevant information, in this case a virtual map 106 of a roadway on which the vehicle 100 is travelling, onto the windshield 108 of the vehicle 100. By way of example, the display device 104 projects the map 106 in FIG. 1 onto the windshield 108 such that the map 106 appears as a vertical strip on a left-hand lateral edge of the windshield 108 from the driver's perspective. Depending on the exemplary embodiment, the map 106 can also appear at a virtual spacing in front of or behind the windshield 108 from the perspective of the driver, the position of which is indicated schematically in FIG. 1 by a steering wheel, in particular by superimposing it on the actual environment in which the vehicle 100 is located.

[0030] If the vehicle is a right-hand steering vehicle, the display is then superimposed in the strip on the right of the windshield.

[0031] If the steering wheel/control of the seat position for the driver, e.g., is in the center, the display can be, e.g., in the center, or close to the center of the windshield. The driver can thus change the size and position of the display, and also add or remove individual elements.

[0032] The device 102 is configured to input speed data 110 representing a current speed of the vehicle 100, environment data 112 representing an environment of the vehicle 100, a driver reaction time 114 representing a reaction time of the driver determined in a reaction test, and an emergency braking reaction time 116 representing a reaction time of an emergency braking driver assistance function in the vehicle 100 in reaction to an emergency situation, and to use these data to superimpose an emergency braking marker 118 and a driver intervention marker 120 on the map 106. In this case, the emergency braking marker 118, depicted as a line crossing the roadway in this exemplary embodiment, represents a point in time or a location on the roadway shown in the map 106 at which the emergency braking driver assistance function would automatically intervene if another vehicle, such as a vehicle travelling in front of the vehicle 100 in the same lane, is closer than the emergency braking marker 118, without the driver of the vehicle 100 first taking appropriate action. The driver intervention marker 120 appears according to FIG. 1, by way of example, as an arrow parallel to the roadway, pointing toward the emergency braking marker 118, functioning as a vehicle proximity indicator for indicating a point in time, or a location, for the latest possible intervention of the driver prior to the automatic intervention of the emergency braking driver assistance function. The tip of the arrow approaches the emergency braking marker 118 at the rate that the distance between the vehicle 100 and the vehicle in front decreases.

[0033] The reaction time of the driver can also be calculated over time. The system assumes that the reaction time is slow in this case. If it is possible to monitor the driver precisely, the reaction time can be adjusted in real time, if the driver is distracted, for example.

[0034] It is likewise conceivable to adjust the reaction time based on the season, daily travel, etc. This can be taken into account in calculating the display. It is likewise conceivable to calculate the maximum reaction time from the time determined in the test, and the current situation. This maximum reaction time can then be used for the display.

[0035] The device 102 is also configured to highlight a lane in which the vehicle 100 is currently travelling in the map 106 in an appropriate manner, by flashing the current lane, or by superimposing a suitable driving lane marker 124 on the current driving lane.

[0036] The other vehicles in the environment of the vehicle 100 are likewise indicated by the device 102 in the form of corresponding object symbols 122, also superimposed on the roadway in the map 106. The respective size of the object symbol 122 can vary, depending on a respective distance of the vehicle represented by the object symbol 122 to the vehicle 100.

[0037] According to the exemplary embodiment shown in FIG. 1, the device 102 is also configured to appropriately mask a region 126 in the map 106 that the driver of the vehicle 100 cannot see due to poor visibility, in this case by shading the region 126 that is not visible.

[0038] FIG. 2 shows a schematic illustration of the vehicle in FIG. 1. In differing from FIG. 1, the map 106 is projected such that it extends substantially horizontally along a lower edge of the windshield 108 in the field of vision of the driver.

[0039] The object symbols 122 shown in FIG. 2 are different sizes, depending on their respective distances to the vehicle 100. The emergency braking marker 118 is superimposed here as a rectangular outline around one of the object symbols 122, indicating the intervention threshold point for the emergency braking drive assistance system.

[0040] The shape of the outline can depend on which symbols the driver desires to have displayed in the corresponding fields. If they are, e.g., only round symbols, then a round outline is advantageous, because this gives the driver a better overview on the basis of the displayed data than if a circle or hexagon, etc. were shown in a rectangular outline.

[0041] The driver should also have the possibility of modifying the displayed shapes and colors himself. He can make all of the symbols round, for example, but some could have a red outline, and be filled with other colors, or he can place letters inside the various geometric figures, if desired.

[0042] The highlighting of the current lane in which the vehicle 100 is travelling is obtained according to this exemplary embodiment by a grid 200. Additional lane markings 202 are superimposed to the right and left of the current lane in which the vehicle is traveling.

[0043] The device can also be configured to highlight a lane to which the vehicle may change lanes in an appropriate manner, by superimposing a lane change marker 204 on the lane in question, in this case a lane to the left or right of the lane in which the vehicle is currently travelling.

[0044] The approach presented herein shall be described again below with a different formulation.

[0045] By way of example, the vehicle 100 is equipped with a driver assistance function that knows the route the vehicle 100 is travelling. A current position of the vehicle 100 is shown on the map 106 by means of the device 102. The map 106 is shown in a narrow form, for example, such that a tight curve may appear to be a nearly straight line. It is possible to maintain a relatively high speed, even with poor visibility, via a sensor fusion of cloud data containing the individual road users and the respective traffic obstructions, in combination with data from environment sensors, e.g., lidar sensors or infrared cameras. The driver reaction time is calculated, for example, using a reaction test carried out in advance, in order to adapt the system to the respective driver. The reaction time of the driver is then added to a reaction time of the vehicle 100 in reacting to a driver command. This sum then represents one minute of prior warning time. The minimal prior warning period is used as the critical time for the emergency braking driver assistance function. A maximum prior warning period is greater than the minimum prior warning period by a specific factor, e.g., a factor of 10.

[0046] Optionally, the aspect ratio of the map 106 is adjusted in relation to the current speed of the vehicle 100, i.e., the map is distorted by either lengthening or shortening it. By way of example, the system is automatically switched on in fog in order to offer the driver an alternative view. The system can also be always on, or it can be switched on by the driver.

[0047] The display in the form of the map 106 is superimposed vertically on the windshield 108 at the side, over the entire height thereof, such that the individual lanes are shown parallel to one another. The respective lane in which the vehicle is travelling is indicated by a thick frame or a brighter light. At the same time, a vertical line indicating the latest possible intervention of the driver forms the driver intervention marker 120. Another line indicates the point in time for the intervention of the emergency braking driver assistance function, also referred to as the emergency braking marker 118 above. The actual position of the vehicle 100 only moves horizontally in the map 106. The other road users or obstacles approach the vehicle accordingly. The driver intervention marker 120 is superimposed as a vertical arrow parallel to the driving lane. The arrow points downward. As the vehicle 100 approaches an obstacle, the arrow moves down, until reaching the horizontal strip of the emergency braking driver assistance function. The vehicle 100 is automatically braked at this point.

[0048] It is also possible, when approaching a hazard when parking, that the display is either moved slightly, so that it is in the direct line of sight of the driver, and thus becomes clearer, such that the driver can continue to observe the street, and nevertheless remain informed, or the display is enlarged laterally, optionally with different transparencies, depending on the extent of the lateral extension of the display, either directly proportionally or indirectly proportionally thereto, depending on where the hazard is located that the driver must pay attention to. The display advantageously does not obstruct the driver's view.

[0049] Because a vehicle that has such a system can move faster in poor weather conditions, the driver assistance system recommends, for example, that the vehicle travel in a middle lane, because slow vehicles normally travel in the right-hand lane. This has the advantage that the driver does not need to concentrate as much on the speed and the longitudinal guidance. By using the middle lane, the vehicle is less likely to come across obstacles in such weather conditions.

[0050] Optionally, a recommendation to change lanes can be indicated by flashing a lane in the display before the drive can see any obstacles.

[0051] An alternative display is superimposed horizontally to the middle of the windshield 108 on the driver's side, as is shown in FIG. 2. An obstacle is enlarged or reduced in proportion to its distance to the vehicle 100. In contrast to reality, it is superimposed earlier, on the basis of the reaction time. As a result, the object will appear closer than it actually is to the driver. The driver will be able to react more quickly, thus substantially restricting the use of the emergency braking drive assistance system. A premature or unnecessary triggering of the emergency braking driver assistance function can thus be prevented.

[0052] If the vehicle's vision is limited due to sensor failures resulting from extremely poor weather conditions, for example, or due to the topography of the roadway, e.g., in tight curves, or due to a lack of cloud data, e.g., because of the absence of internet service, or because the occupancy of a lane is not reported, an upper part of the map is crossed out in the vertical depiction of the map 106, in order to mask it. As a result, the driver can adjust his speed accordingly, until the masked region of the map partially or entirely disappears.

[0053] The approach presented herein has the advantage that the driver can decide in advance, based on the additional depiction in the map 106, whether a (semi) autonomous vehicle control of the vehicle 100 is useful or not. The driver can thus make corrections at the appropriate time, early enough to avoid an accident.

[0054] The display can also be projected horizontally. A vehicle that may not exist can be shown to the driver at a point where the vehicle's view ends. This allows the driver to anticipate a possible hazard.

[0055] The display that is used should be transparent, so that it does not restrict the driver's view unnecessarily.

[0056] FIG. 3 shows a schematic illustration of a device 102 according to an exemplary embodiment, such as the device described above in reference to FIGS. 1 and 2. The device 102 comprises an input unit 310 for inputting speed data 110, environment data 112, the driver's reaction time 114, and the emergency braking reaction time 116. The input unit 310 inputs the speed data 110 or the environment data 112 via an interface for sensors in or on the vehicle, and/or via a communication interface for communicating with other road users. The device 102 also has a superimposing unit 320 that is configured to superimpose the emergency braking marker and the driver intervention marker 120 on the basis of the data input via the input unit 310, by outputting a corresponding display control signal 322.

[0057] FIG. 4 shows a flow chart for a method 400 according to an exemplary embodiment. The method 400 for displaying safety-relevant information on a display device of a vehicle can be executed using the device described above in reference to FIGS. 1 to 3. The speed of the vehicle, the environment data, the driver reaction time, and emergency braking reaction time are input in step 410. The emergency braking marker and the driver intervention marker are superimposed in step 420, based on the speed, the environment data, the driver reaction time, and the emergency braking reaction time, on the map representing the roadway on which the vehicle is travelling, in the display device in a corresponding manner.

[0058] The exemplary embodiments shown in the figures are selected merely by way of example. Different exemplary embodiments can be combined with one another, either in their entirety or with respect to individual features. An exemplary embodiment can also be supplemented by features of another exemplary embodiment. Furthermore, the method steps according to the present disclosure can be repeated or executed in a sequence other than that described herein.

[0059] If an exemplary embodiment comprises an and/or conjunction between a first feature and a second feature, this can be read to mean that the exemplary embodiment according to one embodiment contains both the first feature and the second feature, and according to another embodiment, contains either just the first feature or just the second feature.

REFERENCE SYMBOLS

[0060] 100 vehicle [0061] 102 device [0062] 104 display device [0063] 106 map [0064] 108 windshield [0065] 110 speed data [0066] 112 environment information [0067] 114 driver reaction time [0068] 116 emergency braking reaction time [0069] 118 emergency braking marker [0070] 120 driver intervention marker [0071] 122 object symbol [0072] 124 lane marking [0073] 126 not visible region [0074] 200 grid [0075] 202 lane marking [0076] 204 lane change marker [0077] 310 input unit [0078] 320 superimposing unit [0079] 322 display control signal [0080] 400 method [0081] 410 input step [0082] 420 superimposing step