METHOD AND DEVICE FOR EVALUATING DRIVING BEHAVIOR

Abstract

A method and apparatus for teaching and/or evaluating driving behavior of a driver of an autonomous-capable vehicle. The vehicle is operated in a manual-control mode wherein a driver has manual control, and a communication device (audio speaker, visual display, etc.) issues an instruction to the driver to perform a task. As the driver is attempting to perform the task, a sensor monitors the driver's behavior. A driver instruction module (that interfaces with the vehicle's autonomous driving module) determines a deviation between the driver's behavior and a desired behavior to perform the task. If the deviation exceeds a permissible amount, the vehicle is placed under autonomous control (control is taken away from the driver) and the task is completed in a manner that is in accordance with the desired behavior.

Claims

1. A method comprising: operating an autonomous-capable vehicle in a manual-control mode wherein a driver controls the vehicle; operating a communication device to issue an instruction to the driver to perform a task; operating a sensor to monitor driver behavior as the driver performs the task; operating a processing unit to determine a deviation between the driver behavior and a desired behavior to perform the task; and if the deviation exceeds a permissible amount, operating the vehicle under autonomous control to complete the task in accordance with the desired behavior.

2. The method of claim 1, wherein communication device comprises an audio speaker operable to deliver an audible instruction.

3. The method of claim 1, further comprising communicating the desired behavior to the driver.

4. The method of claim 3, wherein communicating the desired behavior comprises displaying an ideal driving path on a visual display viewable by the driver.

5. The method of claim 4, wherein the visual display is a head-up display.

6. The method of claim 1, further comprising: operating the vehicle under autonomous control to demonstrate performance of the task in accordance with the desired behavior prior to the driver performing the task.

7. The method of claim 1, wherein operating a sensor to monitor the driver behavior comprises operating a camera to detect a physical action by the driver.

8. A method of operating an autonomous-capable vehicle comprising: instructing a driver to perform a task; operating a sensor to monitor driver behavior as the driver performs the task under manual vehicle control; operating a processor to determine a deviation between the driver behavior and a desired behavior to perform the task; and operating the vehicle autonomously to complete the task if the deviation exceeds a permissible amount.

9. The method of claim 8, further comprising communicating the desired behavior to the driver.

10. The method of claim 9, wherein communicating the desired behavior comprises displaying an ideal driving path on a visual display viewable by the driver.

11. The method of claim 10, wherein the visual display is a head-up display.

12. The method of claim 8, further comprising: operating the vehicle autonomously to demonstrate performance of the task in accordance with the desired behavior prior to the driver performing the task.

13. The method of claim 8, wherein operating a sensor to monitor the driver behavior comprises operating a camera to detect a physical action by the driver.

14. An autonomous-capable vehicle comprises a driving instruction module operative to issue an instruction to a driver to perform a task, put the vehicle under manual control as the driver performs the task, monitor driver behavior during task performance; determine a deviation between the driver behavior and a desired behavior to perform the task, put the vehicle under autonomous control if the deviation exceeds a permissible amount, and complete the task under autonomous control.

15. The vehicle of claim 14, further comprising an audio speaker operable to deliver the instruction to the driver as an audible instruction.

16. The vehicle of claim 14, wherein the driving instruction module is further operative to communicate the desired behavior to the driver.

17. The vehicle of claim 16, further comprising a visual display viewable by the driver and operative to communicate the desired behavior by depicting an ideal driving path.

18. The vehicle of claim 17, wherein the visual display is a head-up display.

19. The vehicle of claim 14, wherein the driving instruction module is further operative to demonstrate performance of the task under autonomous control and in accordance with the desired behavior prior to the driver performing the task.

20. The vehicle of claim 14, further comprising a camera operative to detect a physical action by the driver.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0061] FIG. 1 shows a schematic representation of a vehicle according to the invention;

[0062] FIG. 2 shows a schematic representation of the interaction of features of the device according to the invention in the vehicle according to the invention;

[0063] FIG. 3A shows a first portion (portion 1 of 3) of a flow diagram of an overtaking maneuver according to the method according to the invention;

[0064] FIG. 3B shows a continuation (portion 2 or 3) of the flow diagram of FIG. 3A; and

[0065] FIG. 3C shows a continuation (portion 3 or 3) of the flow diagram of FIGS. 3A and 3B.

DETAILED DESCRIPTION

[0066] As required, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention that may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.

[0067] In the examples explained below, reference is made to the appended drawings, which form part of these examples and in which specific embodiments in which the invention can be performed are shown for purposes of illustration.

[0068] Other embodiments can be used and structural or logical modifications can be made without departing from the protective scope of the present invention. The features of the various embodiments given by way of example and described herein can be combined with one another, unless specifically indicated otherwise. The following description is therefore not to be understood in a restrictive sense, and the scope of protection of the present invention is defined by the appended claims.

[0069] In one exemplary embodiment (FIG. 1), the vehicle 1 is a passenger car, which is equipped with a device according to the invention, i.e. a driving instruction module. The vehicle 1 is suitable in principle for autonomous driving, but can also be controlled manually by a vehicle driver.

[0070] The driving instruction module of the vehicle 1 has a storing unit, on which driving behavior patterns for various vehicle and/or traffic situations have been stored in advance, for example by the vehicle manufacturer.

[0071] In addition, the vehicle 1 has sensors (as indicated in FIG. 2) for detecting the vehicle and traffic situation. For example, it is detected whether the engine is switched on, how many lanes the route being taken has and what obstacles there are in the area surrounding the vehicle. Provided inter alia for this purpose are cameras 2 as image sensors. The situation and the stored driving behavior patterns are then used to infer a number of desired behaviors, i.e. a behavior as to how the vehicle driver should ideally behave in this situation. This may for example be a maximum speed, which results from the presence of obstacles.

[0072] Further sensors 2, in the example likewise formed inter alia as cameras 2, are provided for detecting or monitoring physical movements/behaviors of the vehicle driver, i.e. the vehicle driver is observed. It is for example detected whether the vehicle driver has at least one hand on the steering wheel 4 at all times and is directing his or her view at the traffic situation. It may additionally checked whether the safety belt (not shown) is properly fastened.

[0073] By means of a processing unit of the vehicle 1, the actual behavior is compared with the desired behavior in a computer-aided manner. If it is found, for example, that the engine is switched on and the safety belt is fastened, the actual behavior does not deviate from the relevant desired behavior and a new traffic and/or vehicle situation is detected.

[0074] If, however, the actual behavior deviates from the desired behavior, for example in that the actual speed is greater than the desired speed appropriate for the situation, corresponding corrective instructions are inferred and issued.

[0075] In the case of a minor deviation of the speed, of for example a maximum of 10%, the corrective instructions are issued to the vehicle driver by means of audio speakers 3a as an audible instruction, so that the vehicle driver himself or herself can adapt his or her actual behavior to the desired behavior.

[0076] If, on the other hand, the deviation is too great, i.e. the speed is for example 20% greater than the desired speed, the processor returns the vehicle to autonomous operation so that the corrective instructions are issued directly to the vehicle 1, which correspondingly reduces the speed automatically, i.e. autonomously, since in this case a reaction of the vehicle driver may be likely to take too much time and a dangerous situation could arise.

[0077] FIG. 2 shows the interaction of an autonomous vehicle 1 known from the prior art with the driving instruction module according to the invention.

[0078] The vehicle 1 is equipped with a number of sensors, which make autonomous driving possible, for example radar, lidar and ultrasound sensors, cameras, speed and acceleration sensors and sensors which check the pedal position, the steering wheel angle, the gear selected, the direction indicator status, etc. These sensors may be used for detecting a vehicle and/or traffic situation. The data determined by these sensors are processed by a processing unit of the autonomous vehicle, so that the vehicle is driven by a virtual driver.

[0079] A driving instruction module enhancement enhances the autonomous vehicle by adding further sensors 2, which observe the behavior of the vehicle driver (actual behavior). Such sensors may be for example microphones or image sensors in cameras.

[0080] The processing unit of the autonomous vehicle is likewise enhanced and is then capable of inferring from the detected vehicle and/or traffic situation and the driving behavior patterns one or more desired behaviors, comparing the actual behavior with the desired behavior and, in the case of the actual behavior deviating from the desired behavior, inferring and issuing corresponding corrective instructions for modifying the actual behavior.

[0081] These corrective instructions may for example be issued to the vehicle driver by means of displays 3b, head-up displays 3c, audio speakers 3a, a vibrating steering wheel 4 or a vibrating gas pedal (not shown).

[0082] FIGS. 3A-C show a flow diagram of an overtaking maneuver, which is carried out by means of a method according to the invention in a vehicle 1 with a driving instruction module that is suitable for autonomous driving and has a storing unit, in which driving behavior patterns for a vehicle driver in various vehicle and/or traffic situations are stored.

[0083] At the beginning, the vehicle 1 is on a freeway with more than two lanes. This traffic situation has been detected by means of sensors. An overtaking maneuver has been inferred as the task to be practiced, which tasking is issued to the vehicle driver, i.e. the vehicle driver receives the instruction that an overtaking maneuver is to be practiced. If the vehicle driver is not ready for this, the driving instruction module abandons the process and begins again after some time.

[0084] If the vehicle driver is ready, the driving instruction module checks by means of sensors whether the traffic situation allows an overtaking maneuver. This check is continued until an overtaking maneuver is possible.

[0085] If this is the case, the vehicle driver receives instructions to check whether the adjacent lane is free, in that the driver looks in the rearview mirrors and checks the dead spot by looking over his or her shoulder. The driving instruction module detects this actual behavior by means of cameras as sensors 2 and checks whether the vehicle driver has checked the adjacent lane.

[0086] Once this task has been performed, the driving instruction module checks once again whether the traffic situation allows an overtaking maneuver. If this is not the case, the vehicle driver receives information as to why the overtaking maneuver is not possible. The maneuver is abandoned and carried out once again at a later time.

[0087] If the overtaking maneuver is possible, the vehicle driver receives the instruction to indicate, i.e. use the direction indicator. This actual behavior is likewise checked by the driving instruction module by means of sensors. If the indicator has not been used correctly, i.e. the actual behavior deviates from the desired behavior, the vehicle driver receives corresponding information as a corrective instruction and the maneuver is abandoned.

[0088] If the indicator has been used correctly, the driving instruction module checks once again whether the traffic situation allows an overtaking maneuver. If this is not the case, the vehicle driver receives information as to why the overtaking maneuver is not possible. The maneuver is abandoned and carried out once again at a later time.

[0089] If the overtaking maneuver is possible, the vehicle driver receives the instruction to turn the steering wheel 4 in order to change lane. The driving instruction module shows the ideal driving path, i.e. the desired behavior, in a head-up display 3c as communication device and checks whether the vehicle 1 follows this ideal driving path.

[0090] If the comparison of the actual behavior and the desired behavior finds that the deviation from the ideal driving path lies outside a tolerance range, the driving instruction module instructs the virtual driver to take over driving of the vehicle and to complete the overtaking maneuver. The vehicle driver receives corresponding information as to why the virtual driver has taken over. The overall process is abandoned and carried out once again at a later time.

[0091] If the deviation from the ideal driving path lies within the tolerance range, the vehicle driver receives the information that the overtaking maneuver has been carried out successfully, the maneuver is completed and a new vehicle and/or traffic situation can be detected.

[0092] While exemplary embodiments are described above, it is not intended that these embodiments describe all possible forms of the invention. Rather, the words used in the specification are words of description rather than limitation, and it is understood that various changes may be made without departing from the spirit and scope of the invention. Additionally, the features of various implementing embodiments may be combined to form further embodiments of the invention.