USING VISION DEVICES AND TECHNIQUES TO CONTROL SUNLIGHT BLOCKING DEVICES FOR VEHICLES

Abstract

A motor vehicle includes an inside camera capturing images of a passenger compartment of the motor vehicle. An outside camera captures images of an environment outside of the motor vehicle. A movable sunblock device blocks sunlight from impinging upon a portion of the passenger compartment. An electrically powered actuator is coupled to the sunblock device and moves the sunblock device. An electronic processor is communicatively coupled to each of the inside camera, the outside camera, and the actuator. The electronic processor receives images captured by each of the inside camera and the outside camera. The electronic processor transmits control signals to the actuator dependent upon the images captured by each of the inside camera and the outside camera.

Claims

1. A motor vehicle, comprising; an inside camera configured to capture images of a passenger compartment of the motor vehicle; an outside camera configured to capture images of an environment outside of the motor vehicle; a movable sunblock device configured to block sunlight from impinging upon a portion of the passenger compartment; an electrically powered actuator coupled to the sunblock device and configured to move the sunblock device; and an electronic processor communicatively coupled to each of the inside camera, the outside camera, and the actuator, the electronic processor being configured to; receive images captured by each of the inside camera and the outside camera; and transmit control signals to the actuator dependent upon the images captured by each of the inside camera and the outside camera.

2. The motor vehicle of claim 1 wherein the inside camera is configured to capture images of a human passenger within the passenger compartment of the motor vehicle.

3. The motor vehicle of claim 2 wherein the electronic processor is configured to determine whether sunlight is impinging upon an eye of the human passenger, the determining being based on the captured images of the human passenger.

4. The motor vehicle of claim 2 wherein the electronic processor is configured to determine a facial expression of the human passenger, the determining being based on the captured images of the human passenger.

5. The motor vehicle of claim 1 wherein the electronic processor is configured to determine a position of the sun relative to the motor vehicle, the determining being based on the captured images of the outside environment.

6. The motor vehicle of claim 1 wherein the sunblock device comprises a visor.

7. The motor vehicle of claim 1 wherein the electronic processor is configured to determine whether direct sunlight is impinging upon the motor vehicle, the determining being based on the captured images of the outside environment.

8. A method of operating a motor vehicle, the method comprising: capturing images of a passenger compartment of the motor vehicle; capturing images of an environment outside of the motor vehicle; using a movable sunblock device to block sunlight from impinging upon a portion of the passenger compartment; coupling an electrically powered actuator to the sunblock device such that the actuator may move the sunblock device; and controlling the actuator dependent upon the images captured of the passenger compartment and of the outside environment to thereby control a position of the sunblock device.

9. The method of claim 8 wherein the capturing of images of the passenger compartment includes capturing images of a human passenger within the passenger compartment of the motor vehicle.

10. The method of claim 9 further comprising determining whether sunlight is impinging upon an eye of the human passenger, the determining being dependent upon the captured images of the passenger compartment of the motor vehicle, the controlling being dependent upon the determining step.

11. The method of claim 9 further comprising determining a facial expression of the human passenger, the determining being based on the captured images of the human passenger, the controlling being dependent upon the determining step.

12. The method of claim 8 further comprising determining a position of the sun relative to the motor vehicle, the determining being based on the captured images of the outside environment, the controlling being dependent upon the determining step.

13. The method of claim 8 wherein the sunblock device comprises a visor.

14. The method of claim 8 further comprising determining whether direct sunlight is impinging upon the motor vehicle, the determining being based on the captured images of the outside environment, the controlling being dependent upon the determining step.

15. A motor vehicle, comprising: a camera configured to capture images of a human passenger within a passenger compartment of the motor vehicle; a movable sunblock device configured to block sunlight from impinging upon the passenger; an electrically powered actuator coupled to the sunblock device and configured to move the sunblock device; and an electronic processor communicatively coupled to the camera, the electronic processor being configured to: receive images captured by the camera; and transmit control signals to the actuator dependent upon the images captured by the camera.

16. The motor vehicle of claim 15 wherein the electronic processor is configured to determine whether sunlight is impinging upon an eye of the human passenger, the determining being based on the captured images of the human passenger, the control signals being dependent upon whether sunlight is impinging upon an eye of the human passenger.

17. The motor vehicle of claim 15 wherein the electronic processor is configured to determine a facial expression of the human passenger, the determining being based on the captured images of the human passenger, the control signals being dependent upon the facial expression of the human passenger.

18. The motor vehicle of claim 15 wherein the sunblock device comprises a visor.

19. The motor vehicle of claim 15 further comprising a sensor configured to detect direct sunlight, the control signals being dependent upon the detection of direct sunlight by the sensor.

20. The motor vehicle of claim 15 further comprising a sensor configured to detect a position of the sun in the sky, the control signals being dependent upon the detected position of the sun in the sky.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0014] A better understanding of the present invention will be had upon reference to the following description in conjunction with the accompanying drawings.

[0015] FIG. 1 is a block diagram of one embodiment of a vehicular sunlight blocking control arrangement of the present invention.

[0016] FIG. 2A is a schematic diagram of a vehicle including a sunblock device positioned to block the sun.

[0017] FIG. 2B is another schematic diagram of the vehicle of FIG. 2a including the sunblock device positioned to block the sun.

[0018] FIG. 3 is a flow chart of one embodiment of a sunblock device positioning method of the present invention.

[0019] FIG. 4 is a flow chart of one embodiment of a method of the present invention for operating a motor vehicle.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] FIG. 1 illustrates one embodiment of a vehicular sunlight blocking control arrangement 10 of the present invention, including vision devices 12, vision algorithms 14, and a decision and control block 16. FIG. 1 is a high-level block diagram of arrangement 10. Vision devices 12 may include cameras, image-capturing devices, and sensors, such as light sensors. Decision and control block 16 performs decision making regarding whether to activate/deactivate sunblock device(s) and how the sunblock device(s) should be positioned. Decision and control block 16 may also include actuators for moving sunblock devices into position.

[0021] The combination of status information can be used to activate/deactivate the sunblock device(s). In the case of the activation, if the vision algorithm(s) can confidently determine that the person is having a difficult time looking at the road because of the sun (status of the person), then decision and control block 16 can use that information to automatically activate the sunblock device(s). However, if that information alone is not enough to make a confident decision regarding whether the sunblock device(s) should be activated, then control block 16 can use other information (if available), such as whether the sun is above the horizon, whether the sun is being blocked by clouds, and the location of the sun relative to the eyes of the passengers, to increase the confidence about the issue and use that other information in making the decision about whether to activate the device(s). Similarly, in the case of the deactivation, if algorithm 14 can confidently determine that there is no bright sunlight, then decision and control block 16 can automatically deactivate the sunblock device(s). If, however, algorithm 14 cannot confidently determine that there is no bright sunlight, then decision and control block 16 may also use other available information, such as the location information, to increase the confidence level and use that other available information in making the decision about whether to deactivate the sunblock device(s).

[0022] The location information (for the sun and people) may be used to position the sunblock device correctly, as shown in FIGS. 2A-B. These FIGS. 2A-B illustrate an example of positioning the sunblock device based on the location of the sun and the locations of the person's eyes. Sunblock device 18 may be movable between the position shown in FIG. 2A and the position shown in FIG. 2B in order to intercept and block the sunlight from impinging on the passenger's eyes, depending upon the position of the sun in the sky relative to the heading direction of the vehicle. An electrically powered actuator 20 may he coupled to sunblock device 18 such that actuator 20 may move sunblock device 18, such as between the positions shown in FIGS. 2A and 2B. Actuator 20 may be controlled by an electronic processor, such as decision and control block 16.

[0023] Non-location information can also be used to position sunblock device(s). For example, the status of the person, such as whether the person is being adversely affected by the sunlight, can be used to determine Whether the current positioning of the sunblock device(s) is adequate. If the current positioning of the sunblock device(s) is not adequate, then the position of the sunblock device(s) may be adjusted until it is determined that the person is no longer being adversely affected by the sunlight.

[0024] FIG. 3 illustrates a method 300 including providing a feedback loop to control the sunblock device until the person is no longer being adversely affected by the sunlight. In a first step 302, a target person's status information is obtained. For example, in-vehicle cameras and facial recognition software may capture images of the person and determine therefrom whether the sunlight is directly impinging on the person's eyes, whether the person is squinting, grimacing or frowning, or whether the person has moved his eyes to an unusual position in order to position his eyes out of direct sunlight.

[0025] Next, in step 304, it is determined whether the current positioning of the sunblock device(s) is adequate. For example, the images captured by the in-vehicle cameras and the output of the facial recognition software may be quantified and compared to one or more thresholds in order to determine whether the sunlit is causing an unacceptable level of difficulty for the target person. If not, then no action is required (step 306). However, if the sunlight is causing an unacceptable level of difficulty for the target person, then operation proceeds to step 308 wherein the position of the sunblock device is adjusted. For example, sunblock device 18 may be moved from the position shown in FIG. 2A to the position shown in FIG. 2B, or vice versa. The sunblock device may be in the form of a visor which may be swung up or down or from side to side. The sunblock device may also be in the form of a window shade which may be pulled down and unrolled to block the sunlight, or rolled back up to expose more window area. After step 308, operation returns to step 302.

[0026] FIG. 4 illustrates one embodiment of a method 400 of the present invention for operating a motor vehicle. In a first step 402, images of a passenger compartment of the motor vehicle are captured. For example, vision devices 12 may capture images of the passenger compartment of a motor vehicle, and of occupants of the vehicle.

[0027] Next, in step 404, images of an environment outside of the motor vehicle are captured. For example, vision devices 12 may also capture images of the scene, sky, and lighting conditions surrounding the motor vehicle.

[0028] In a next step 406, a movable sunblock device is used to block sunlight from impinging upon a portion of the passenger compartment. For example, sunblock device 18 may be moved from the position shown in FIG. 2A to the position shown in FIG. 2B in order to intercept and block the sunlight from impinging on the passenger's eyes within the passenger compartment.

[0029] In step 408, an electrically powered actuator is coupled to the sunblock device such that the actuator may move the sunblock device. For example, actuator 20 may be coupled to sunblock device 18 such that actuator 20 may move sunblock device 18.

[0030] In a final step 410, the actuator is controlled dependent upon the images captured of the passenger compartment, and of the outside environment, to thereby control a position of the sunblock device. For example, actuator 20 may be controlled based on images captured of the passenger compartment and of the ambient environment to thereby control a position of sunblock device 18.

[0031] The activation and/or deactivation of the sunblock device can be fully automatic or manual. When in the fully-automated mode, the activation and/or deactivation may be decided upon automatically based on the combination of status information described above the manual activation/deactivation mode, the user makes the activation/deactivation decision based upon the sunlight causing him difficulty or not, respectively. There are many ways of implementing the manual activation/deactivation, including buttons and voice commands, for example. Once activated, the positioning of the sunblock device(s) may be automatic, which again may he based on the status information described above. Of course, the user can also manually position the sunblock device, if required. If the sunblock device cannot be positioned automatically due to a lack of information or some other failures, the user may be notified and/or the arrangement may be deactivated.

[0032] In one embodiment, through machine learning, decision and control block 16 continuously evolves and learns to quickly find the optimal position of the sunblock device given various situations and inputs.

[0033] The foregoing description may refer to motor vehicle, automobile, automotive, or similar expressions. It is to be understood that these terms are not intended to limit the invention to any particular type of transportation vehicle. Rather, the invention may be applied to any type of transportation vehicle whether traveling by air, water, or ground, such as airplanes, boats, etc.

[0034] The foregoing detailed description is given primarily for clearness of understanding and no unnecessary limitations are to be understood therefrom for modifications can be made by those skilled in the art upon reading this disclosure and may be made without departing from the spirit of the invention.