ADAPTIVELY STEERED VEHICLE HEADLAMPS USING DRIVER GAZE DIRECTION AND HEAD DIRECTION

Abstract

A vehicle for travelling on a roadway with a driver has a driver monitor, a head lamp system, and a controller. The driver monitor senses a driver gaze angle relative to a vehicle heading along the roadway and senses a driver head angle relative to the vehicle heading. The a headlamp system has a steerable headlamp configured to illuminate the roadway with a light beam along a selectable projection angle. The controller is configured to compare the driver gaze angle to a first threshold angle, determine a difference between the driver gaze angle and the driver head angle, and when the driver gaze angle is greater than the first threshold angle and the difference is less than a second threshold angle, then adjust the projection angle to a target angle based on the driver gaze angle.

Claims

1. A vehicle for travelling on a roadway with a driver, comprising: a driver monitor sensing a driver gaze angle relative to a vehicle heading along the roadway and sensing a driver head angle relative to the vehicle heading; a headlamp system having a steerable headlamp configured to illuminate the roadway with a light beam along a selectable projection angle; and a controller configured to: compare the driver gaze angle to a first threshold angle; determine a difference between the driver gaze angle and the driver head angle; and when the driver gaze angle is greater than the first threshold angle and the difference is less than a second threshold angle, then adjust the projection angle to a target angle based on the driver gaze angle.

2. The vehicle of claim 1 wherein the controller is further configured to maintain the projection angle at the target angle for a predetermined delay regardless of a change in the driver gaze angle or the driver head angle.

3. The vehicle of claim 1 wherein the controller is further configured to: detect a succeeding sightline when the driver gaze angle and the driver head angle move away from the target angle by at least a predetermined angle; determine whether the driver gaze angle and the driver head angle return to the target angle within a predetermined time; and terminate the adjusting of the projection angle to the target angle if the driver gaze angle and the driver head angle do not return to the target angle within the predetermined time.

4. The vehicle of claim 3 wherein the succeeding sightline is comprised of a driver gaze angle and a driver head angle coinciding with the vehicle heading.

5. The vehicle of claim 3 wherein terminating the adjusting of the projection angle is comprised of restoring the projection angle to an angle it had prior to the adjusting.

6. The vehicle of claim 1 wherein the controller is further configured to adjust the projection angle only when the driver gaze angle coincides with the driver looking within a predetermined elevation of the roadway.

7. The vehicle of claim 1 wherein the vehicle heading is comprised of an instantaneous steering trajectory in which the vehicle is travelling on the roadway.

8. The vehicle of claim 1 wherein the driver gaze angle and the driver head angle are determined as respective azimuth angles.

9. A method of steering a projection angle of a light beam of a headlamp of a vehicle travelling on a roadway with a driver, the method comprising the steps of: sensing a driver gaze angle relative to a vehicle heading along the roadway; sensing a driver head angle relative to the vehicle heading; comparing the driver gaze angle to a first threshold angle; determining a difference between the driver gaze angle and the driver head angle; and when the driver gaze angle is greater than the first threshold angle and the difference is less than a second threshold angle, adjusting the projection angle to a target angle based on the driver gaze angle.

10. The method of claim 9 wherein the projection angle is maintained at the target angle for a predetermined delay regardless of a change in the driver gaze angle or the driver head angle.

11. The method of claim 9 further comprising the steps of: detecting a succeeding sightline when the driver gaze angle and the driver head angle move away from the target angle by at least a predetermined angle; determining whether the driver gaze angle and the driver head angle return to the target angle within a predetermined time; and terminating the adjusting of the projection angle to the target angle if the driver gaze angle and the driver head angle do not return to the target angle within the predetermined time.

12. The method of claim 11 wherein the succeeding sightline is comprised of a driver gaze angle and a driver head angle coinciding with the vehicle heading.

13. The method of claim 11 wherein terminating the adjusting of the projection angle is comprised of restoring the projection angle to an angle it had prior to the adjusting.

14. The method of claim 9 wherein the projection angle is adjusted only when the driver gaze angle coincides with the driver looking within a predetermined elevation of the roadway.

15. The method of claim 9 wherein the vehicle heading is comprised of an instantaneous steering trajectory in which the vehicle is travelling on the roadway.

16. The method of claim 9 wherein the driver gaze angle and the driver head angle are determined as respective azimuth angles.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0013] FIG. 1 is a schematic, block diagram showing a vehicle with adaptive headlamp steering which follows a driver gaze angle contingent on a driver head angle.

[0014] FIG. 2 depicts a front image of a driver in which a driver gaze angle and a driver head angle diverge from each other.

[0015] FIG. 3 is a top, schematic view showing a head of a driver with a driver gaze angle and a driver head angle both aligned with a vehicle heading.

[0016] FIG. 4 is a top, schematic view showing a head of a driver with a driver gaze angle divergent from a vehicle heading and a driver head angle aligned with a vehicle heading.

[0017] FIG. 5 is a top, schematic view showing a head of a driver with a driver gaze angle aligned with a vehicle heading and a driver head angle divergent from a vehicle heading.

[0018] FIG. 6 is a top, schematic view showing a head of a driver with a driver gaze angle and a driver head angle both divergent from a vehicle heading.

[0019] FIG. 7 is a schematic diagram showing projections of a driver gaze angle and a driver head angle in three dimensions.

[0020] FIG. 8 depicts two-dimensional gaze and head angles relative to a vehicle heading.

[0021] FIGS. 9 and 10 show a flowchart according to one preferred method of the invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

[0022] In order to provide more illumination where the attention of the driver is focused, the preferred embodiments combine eye tracking (i.e., gaze determination) with head tracking according to a process which mitigates erratic headlamp movements. In an initial step, there is a detection that the driver's eyes are not looking straight ahead, but to one side or the other. In addition to looking to one side, the eye tracking will preferably also ensure that the gaze direction is generally horizontal through the windshield and towards the roadway (e.g., not looking up at billboards or looking down at something in the interior of the passenger cabin). Thus, the gaze direction should coincide with the driver looking within a predetermined elevation of the roadway. In a succeeding step, it is determined whether the driver's head orients toward the direction of the gaze, which is considered to be an indicator that an area outside the default headlamp projection pattern has captured the main attention of the driver. In response, a light beam projecting from the headlamp on the corresponding side of the vehicle may be steered toward the area of interest (provided the change is not prohibited by other factors such as potential for glare to other drivers).

[0023] Preferably, the redirection of the light beam may occur immediately once both the gaze direction and the head direction are aligned with a side target. This can help ensure that the driver can more easily detect an object of interest as soon as it is first noticed. To further reduce erratic movement of the light beam, the redirected light beam may be preferably held in the modified state for a predetermined delay even if the gaze direction and/or the head direction move away. Thus, the driver's eyes may continue to scan the general environment without terminating the redirected illumination since the side target may still be the main focus of their attention. The timing of the delay may begin only once the gaze direction and head direction have returned to looking straight ahead on the roadway or both toward some other position (e.g., toward a spot within an upcoming curve in the roadway). After expiration of the delay, the light beam may return to a default state.

[0024] Referring to FIG. 1, a vehicle 10 includes a headlamp system having headlamps 11 and 12 configured to illuminate a roadway 13 in a forward travelling direction of vehicle 10. Headlamps 11 and 12 provide illumination patterns projecting generally along default directions 14 and 15. Beam adjusters 16 and 17 are coupled to headlamps 11 and 12, respectively, for adjusting the respective light beams along selectable projection angles. For example, a light beam from headlamp 12 can be steered to a modified projection angle 18 to increase illumination of a target area (e.g., object) 19. Beam adjusters 16 and 17 can be comprised of a mechanical or electronic adjuster as known in the art, and they are controlled by a controller 20 which is configured according to an embodiment of the invention disclosed herein.

[0025] Vehicle 10 further includes a driver monitor including cameras 21 and 22 with fields of view for monitoring a driver in a driver seat 23. Camera 21 may be mounted on a dashboard or steering wheel, and camera 22 may be mounted on a rearview mirror assembly 24. Cameras 21 and 22 may comprise visible and/or infrared devices for monitoring pupils of the driver's eyes and structures of the head, with resulting camera data provided to controller 20 to determine a driver gaze angle relative to a vehicle heading along the roadway and determining a driver head angle relative to the vehicle heading according to methods known in the art.

[0026] Vehicle 10 may also include forward looking sensors such as a camera 25 and a radar 26 to detect and characterize an exterior environment and objects in connection with conventional adaptive headlamp steering, for example.

[0027] As described in greater detail below, controller 20 may be configured to compare a driver gaze angle to a first threshold angle. Controller 20 then determines a difference between the driver gaze angle and a driver head angle. When the driver gaze angle is greater than the first threshold angle and the difference is less than a second threshold angle, then controller 20 adjusts the projection angle to a target angle (e.g., along projection angle 18) based on the driver gaze angle. The target angle may be equal to the driver gaze angle or may be adjusted to a maximum permitted angle toward the driver gaze angle due to limitations of the headlamp system or due to other factors such as potential glare.

[0028] FIG. 2 shows a head 30 of a driver and eyes 31 and 32. Based on analysis of the positions of eye structures such as the pupils, a gaze angle 33 can be inferred using well known techniques or other methods. Based on analysis of the positions of eyes 31 and 32, a driver's nose 34, and/or other anatomical head structures, a driver head angle 35 can be inferred using well known techniques or other methods. As shown in FIGS. 3-6, the driver gaze angle and the driver head angle are determined relative to a vehicle heading 36. Vehicle heading 36 may be comprised of a fixed forward direction of the vehicle chassis or may be determined dynamically according to a steering direction of the vehicle (e.g., detected as a steering wheel angle). In particular, vehicle heading 36 may be comprised of an instantaneous steering trajectory in which the vehicle is travelling on the roadway.

[0029] FIG. 3 depicts a driver looking forward with driver gaze angle 33 and driver head angle 35 matching vehicle heading 36. FIG. 4 depicts a driver holding the driver head angle 35 along vehicle heading 36 while the driver gaze angle 33 diverges to one side during visual scanning, for example. FIG. 5 depicts a driver holding the driver gaze angle 36 along vehicle heading 36 while the driver head angle 35 diverges to one side. None of the situations in FIGS. 3-5 would necessitate adjustment of a headlamp projection angle.

[0030] FIG. 6 depicts driver gaze angle 33 and driver head angle 35 diverging from vehicle heading 36 in a manner consistent with the driver's main attention being directed away from the forward direction of the vehicle. With driver gaze angle 33 and driver head angle 35 being substantially the same and diverging from vehicle heading 36 by at least a predetermined angle, it depicts a situation which can potentially benefit from redirecting a light beam of a headlamp toward gaze angle 33.

[0031] FIG. 7 shows a visual plane 37 onto which driver gaze angle 33 and driver head angle 35 are projected. Accordingly, driver gaze angle 33 and driver head angle 35 can be defined according to at least two-dimensional coordinates (x, y). In other words, a gaze direction and a head direction can vary both horizontally (i.e., left-right) and vertically (i.e., up-down), and embodiments of the invention can evaluate the driver's situation using two-dimensional analysis. However, acceptable results may also be obtained more simply by evaluating the angles as projected onto a horizontal plane or other plane as shown in FIG. 8 (e.g., evaluating them as azimuth angles). In a preferred embodiment, a situations for a potential adjustment of a headlamp projection angle may be detected according to an initial determination that driver gaze angle 33 diverges from vehicle heading 36 by at least a first threshold angle ?.sub.1 (e.g., a predetermined value selected between about 15? and about 45?, such as a predetermined value of about 20?). When a difference between driver head angle 35 (projected onto the same plane) and driver gaze angle 33 is less than a second threshold angle ?.sub.2 (e.g., a predetermined value such as about 10?), then a situation is detected in which the projection angle of the light beam can be steered to a new target angle which is based on the driver gaze angle. The target angle (i.e., illumination pattern of a headlamp) may be equal to the driver gaze angle (coinciding with the exact spot where the driver is looking) or may be a smaller angle based on a maximum amount of steering for which the headlamp system is capable or on an imposed limitation by regulation or otherwise.

[0032] A predetermined method of the invention shown in FIGS. 9 and 10 begins with a check in step 40 to determine whether the making of changes to the headlamp illumination is currently overridden (i.e., prohibited) due to regulations and/or the state of the vehicle and any surrounding traffic. If it is true that headlamp adjustments are not allowed, then the method completes. Otherwise, driver monitoring is activated and a check is performed in step 41 to determine whether the driver's gaze is directed to a side of the vehicle heading and is nearly horizontal (e.g., is directed through the windshield and at an elevation matching the level of the roadway or the surrounding ground. If not, then the driver's gaze angle continues to be monitored in step 41. When a gaze is found which is directed to a side of the vehicle heading and is nearly horizontal, then a check is performed in step 42 to determine whether the driver head angle sufficiently matches the driver gaze angle (e.g., the difference in angles is less than a threshold angle). If not, then a return is made to step 41. Otherwise, a check is performed in step 43 to determine whether adjustment of the corresponding headlamp light beam toward the direction of the gaze angle is allowed (e.g., not prohibited by regulations or other factors). If not allowed, then a return is made to step 41. If allowed, then the light beam is redirected to a target angle in step 44 based on its closest allowed adjustment approaching or equaling the gaze angle. Once the light beam is redirected, it is maintained at the target angle for at least a predetermined fixed delay (e.g., 5 seconds).

[0033] After the predetermined fixed delay expires, the method may continue with step 46 in FIG. 10 wherein a check is performed to determine whether the driver gaze angle moves away from the targeted spot (e.g., moves by at least a predetermined angle). Once the driver gaze angle does move away, a check is performed in step 47 to determine whether the driver gaze angle and driver head angle together establish a new sightline away from the old targeted spot. For example, both angles may be restored to values which correspond to the driver looking in the direction of the vehicle heading, which would show that the driver's main attention has shifted from the old target back to the main roadway. If this has not happened, then a return is made to step 46.

[0034] Once a new sightline is established based on the gaze angle and head angle having moved away to a different location, the adjustment to the light beam projection angle can be terminated in some embodiments. However, it may be possible that the driver will again turn to the old targeted area for a second look after a brief interval. Therefore, in some embodiments, the redirection to the old target area can be initially retained. This will allow the driver to keep the extra light on the side of the road while glancing over to check traffic conditions and then resume looking for the object or area of interest. Thus, another delay is initiated by starting a timer (e.g., a 10 second timer) in step 48, and then a check is performed in step 49 to determine whether the driver gaze angle returns to the previous targeted area. If so, then a return is made to step 46 and the redirected target projection angle is maintained indefinitely. If the gaze angle has not returned, then a check is performed in step 50 to determine whether the timer has expired. If not, then a return is made to step 49. If the timer has expired, then the redirection of the projection angle is ended in step 51. The termination of the adjustment of the projection angle may be comprised of restoring the projection angle to an angle it had prior to the adjusting.