CONTROLLING A PIXEL LAMP OF A MOTOR VEHICLE ARRANGED ON A ROUTE

20210162913 · 2021-06-03

Assignee

Inventors

Cpc classification

International classification

Abstract

A pixel lamp of a motor vehicle emanates light based on a control signal that represents an image sequence. A respective individual image from the image sequence corresponds to a respective light distribution currently needing to be provided by the pixel lamp. The route is captured by use of a vehicle camera, and the camera data are evaluated and the control signal is provided based on an ascertained advisory route accoutrement. The image sequence is provided at an image sequence frequency of greater than 24 Hz and includes at least one reference image for uniformly lighting the route, the vehicle camera is synchronized to the reference image, the advisory route accoutrement and information data associated with the advisory route accoutrement are ascertained from the provided camera data, the associated information data are compared with data of a database, and the control signal is ascertained based on the comparison.

Claims

1.-10. (canceled)

11. A method for controlling a pixel lamp of a motor vehicle, comprising: controlling the pixel lamp to emit light based on a control signal that represents an image sequence, to light at least part of a route on which the motor vehicle travels, a respective individual image from the image sequence corresponding to a respective light distribution currently needing to be provided by the pixel lamp, the image sequence being provided at an image sequence frequency of greater than 24 Hz, and the image sequence including at least one reference image for uniformly lighting the at least part of the route; receiving camera data of the at least part of the route lit by the pixel lamp, the camera data having been captured by a vehicle camera synchronized to the at least one reference image during the capturing; evaluating the camera data to determine at least one advisory route accoutrement and information data associated with the at least one advisory route accoutrement, with reference to the at least one reference image; comparing the information data associated with the at least one advisory route accoutrement with data of a database; determining the control signal based on the comparison; and providing the control signal for controlling the pixel lamp based on the at least one advisory route accoutrement.

12. The method according to claim 11, further comprising, when the information data differ from the data of the database, determining images of the image sequence such that an advisory route accoutrement corresponding to the data of the database is projected in a visually discernible fashion by use of the pixel lamp.

13. The method according to claim 12, further comprising overlaying at least part of the advisory route accoutrement with the projected advisory route accoutrement in a visually discernible fashion.

14. The method according to claim 12, further comprising embedding at least part of the advisory route accoutrement into the projected advisory route accoutrement.

15. The method according to claim 11, further comprising, when the information data differ from the data of the database, determining images of the image sequence such that at most part of the advisory route accoutrement is lit.

16. The method according to claim 11, further comprising providing the at least one reference image by use of a reference control signal that controls the pixel lamp.

17. The method according to claim 11, wherein the image sequence includes a plurality of reference images, and successive reference images are provided at intervals of time of at least 0.5 s from one another.

18. The method according claim 11, wherein the at least one reference image is provided by use of the pixel lamp for a duration of less than 0.033 s.

19. A control device for controlling a pixel lamp of a motor vehicle, comprising: a control signal unit, comprising a processor, configured to provide a control signal, which represents an image sequence, to the pixel lamp to light at least part of a route on which the motor vehicle travels, so that the pixel lamp emits light to light at least part of the route, a respective individual image from the image sequence corresponding to a respective light distribution currently needing to be provided by the pixel lamp, the image sequence being provided at an image sequence frequency of greater than 24 Hz, and the image sequence including at least one reference image for uniformly lighting the at least part of the route; a receiver to receive camera data of a vehicle camera that captures the at least part of the route lit by the pixel lamp, the camera data having been captured by a vehicle camera synchronized to the at least one reference image during the capturing by the control signal unit; and an evaluation unit, comprising a processor, connected to the control signal unit and the receiver, to: receive the camera data from the receiver, evaluate the camera data to determine at least one advisory route accoutrement and information data associated with the at least one advisory route accoutrement, with reference to the at least one reference image, and compare the information data associated with the at least one advisory route accoutrement with data of a database, and the control signal unit is further configured to determine the control signal based on the comparison and to provide the control signal to the pixel lamp based on the at least one advisory route accoutrement determined by the evaluation unit.

20. The control device according claim 19, wherein the at least one advisory route accoutrement is at least one of a road marking on the route and road signage along the route.

21. The control device according claim 20, wherein when a result of the comparison indicates the at least one advisory route accoutrement is inconsistent with the data of the database, the control signal unit is configured to determine the control signal by providing an image in the image sequence to alter a visual perception of the at least part of the route for a driver of the motor vehicle.

22. The control device according claim 21, wherein the image in the image sequence to alter the visual perception of the at least part of the route for the driver of the motor vehicle, includes at least one of a mask which obscures the at least one advisory route accoutrement and a projection which projects a symbol on the at least part of the route.

23. The control device according claim 21, wherein the image in the image sequence to alter the visual perception of the at least part of the route for the driver of the motor vehicle, alters the at least one advisory route accoutrement so as to visually appear consistent with the data of the database.

24. The control device according claim 21, wherein when a result of the comparison indicates the at least one advisory route accoutrement is consistent with the data of the database, the control signal unit is configured to determine the control signal by providing an image in the image sequence which provides a contrast for the at least one advisory route accoutrement by decreasing lighting of areas around the at least one advisory route accoutrement, or by providing an image in the image sequence which increases lighting of the at least one advisory route accoutrement relative to areas around the at least one advisory route accoutrement.

25. A motor vehicle, comprising: a pixel lamp to emit light based on a control signal that represents an image sequence, to light at least part of a route on which the motor vehicle travels, a respective individual image from the image sequence corresponding to a respective light distribution currently needing to be provided by the pixel lamp, the image sequence being provided at an image sequence frequency of greater than 24 Hz, and the image sequence including at least one reference image for uniformly lighting the at least part of the route; a vehicle camera, synchronized to the at least one reference image, to capture camera data of the at least part of the route lit by the pixel lamp; and a controller configured to: evaluate the camera data to determine at least one advisory route accoutrement and information data associated with the at least one advisory route accoutrement, with reference to the at least one reference image, compare the information data associated with the at least one advisory route accoutrement with data of a database, determine the control signal based on the comparison, and provide the control signal to control the pixel lamp based on the at least one advisory route accoutrement.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0055] These and other aspects and advantages will become more apparent and more readily appreciated from the following description of the example embodiments taken in conjunction with the accompanying drawings of which:

[0056] FIG. 1 schematically illustrates a first configuration of a pixel lamp;

[0057] FIG. 2 schematically illustrates a second configuration of a pixel lamp;

[0058] FIG. 3 is a schematic depiction of an emanated light when the pixel lamp shown in FIG. 1 or 2 is actuated with a reference image;

[0059] FIG. 4 is a schematic depiction of an emanated light when the pixel lamp shown in FIG. 1 or 2 is actuated with an image from an image sequence;

[0060] FIG. 5 is a schematic depiction of a portion of an image sequence for actuating the pixel lamp shown in FIG. 1 or 2;

[0061] FIG. 6 includes schematic depictions according to an example;

[0062] FIG. 7 includes schematic depictions according to an example;

[0063] FIG. 8 includes schematic depictions according to an example;

[0064] FIG. 9 includes schematic depictions according to an example;

[0065] FIG. 10 is a block diagram of a controller, according to an example; and

[0066] FIG. 11 is a block diagram of a motor vehicle having the controller of FIG. 10, according to an example.

DETAILED DESCRIPTION

[0067] Reference will now be made in detail to examples which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout.

[0068] In the embodiments described below, the described components of the embodiments are each individual features that may be considered independently of one another and each also develop the disclosure independently of one another, and hence can also be regarded as part of the disclosure individually or in a combination other than that shown. In addition, the described embodiments are also able to have further already described features added to them.

[0069] In the drawings, elements having the same function are each provided with the same reference signs.

[0070] FIG. 1 uses a schematic depiction to show a first configuration for a pixel lamp 10 by use of which the method can be carried out. The pixel lamp 10 includes a light source 28, which can be formed by a gas discharge lamp, for example. Alternatively, there may naturally also be provision for a laser light source, an appropriately powerful light emitting diode, an incandescent lamp or the like. The light source 28 emits light 36, which is supplied to a matrix 34. The matrix 34 has individual elements 38 that can be individually switched to transparent or nontransparent. This provides individual pixels for the pixel lamp 10. A lower enlarged depiction 30 depicts a schematic plan view of the matrix 34, in which the individual elements 38 are identifiable. On the basis of a respective actuation of the pixel lamp 10 by use of a control signal, the applicable elements 38 are switched to transparent or to nontransparent, so that an appropriate light pattern or a light distribution is provided, according to which light 40 is emanated. An emanated light from the light 40 is depicted by 32 and is provided when all of the elements 38 of the matrix 34 are switched to transparent.

[0071] FIG. 2 shows a second configuration for a pixel lamp 12 by use of which the method can be implemented. The pixel lamp 12, like the pixel lamp 10 shown in FIG. 1, has the light source 28, which emits light 36. In FIG. 2, the light 36 is supplied to a mirror matrix 42, which is divided into individual parts that can be individually actuated. Depending on the actuation, the light 36 is deflected in a direction corresponding to the individual actuation. The mirror matrix 42 is therefore used to provide the individual pixels of the pixel lamp 12. A current setting for the mirror matrix 42 is depicted in enlarged fashion by 48. This setting of the mirror matrix 42 results in the mirror matrix 42 reflecting part of the light 36 and emanating it as light 40 that has a light distribution according to the depiction 48. The other elements 46 of the mirror matrix 42 are used to deflect the light 36 into a light trap 44. The pixel lamp 12 therefore delivers a light distribution according to the emanated light 40.

[0072] FIGS. 3 to 5 subsequently show a method for lighting vehicle surroundings of a motor vehicle in which the pixel lamp 10, 12 of the motor vehicle, which is not depicted in the drawings, emanates light 40 on the basis of a control signal that represents an image sequence 14, in order to light at least part of the vehicle surroundings.

[0073] A respective single image 20, 22 (FIG. 5) from an image sequence 14 corresponds to a respective light distribution currently needing to be provided by the pixel lamp 10, 12. The lit vehicle surroundings are captured by use of a vehicle camera, not depicted, that provides corresponding camera data 18 (FIG. 4). FIG. 4 depicts an evaluation of the camera data 18, according to which the camera data 18 cover an area 24 in which lighting is excessive, which means that dazzling can occur. Further, the camera data 18 reveal that an area 26 has been ascertained in which lighting is inadequate. As such, contrasts cannot be identified sufficiently in the areas 24, 26. In a remaining area 50, a normal illumination in a permissible area has been captured.

[0074] The camera data 18 are evaluated by use of an evaluation unit, likewise not depicted, by taking into consideration a prescribed light distribution, for example a high beam, in order to ascertain and provide the control signal for controlling the pixel lamp 10, 12.

[0075] The image sequence 14 (FIG. 5) is provided at an image sequence frequency of, for example, approximately 100 Hz. The image sequence 14 includes a reference image 16 (FIG. 3), which is used for uniformly lighting the vehicle surroundings. There may be provision for all of the pixels of the pixel lamp 10, 12 to deliver maximum brightness.

[0076] The vehicle camera captures the vehicle surroundings with reference to the reference image 16 by being synchronized accordingly. The actuating of the pixel lamp 10, 12 by use of the reference image 16 results in the vehicle camera capturing the camera data 18 while the reference image 16 is depicted by use of the pixel lamp 10, 12. The camera data 18 therefore correspond to a recording while the reference image 16 is depicted by use of the pixel lamp 10, 12. The camera data 18 are depicted on the basis of FIG. 4, for example.

[0077] The control signal is then ascertained by use of the evaluation unit on the basis of the camera data 18 captured with reference to the reference image 16.

[0078] FIG. 5 shows a video sequence, or the image sequence 14, that represents the control signal in order to be able to actuate the pixel lamp 10, 12. The order of the individual images in time is from left to right and from top to bottom.

[0079] A first image is formed by the reference image 16. While this reference image 16 is used to control the pixel lamp 10, 12, the vehicle camera captures the vehicle surroundings and supplies camera data 18 (FIG. 4). On the basis of the camera data 18, the subsequent images 20 are ascertained, in which the area 24 has reduced light intensity in order to prevent an oncoming object from being dazzled or to cut out the object. The six images 20, which are immediately successive, therefore control the pixel lamp 10, 12 in consideration of the emanated light for the further six cycles or frames.

[0080] Further evaluation of the camera data 18, for example by taking into consideration the area 26 (FIG. 4), likewise cuts out, or prevents dazzling for, areas 52 in which a reduced lighting is desired in order to reduce dazzling on account of ice or water. This is achieved with the images 22 that follow the images 20. A subsequent image 54 shows that the cutting-out is reduced in the areas 24, 52. In these areas, the pixels are therefore again actuated to partly emanate light.

[0081] The portion of the image sequence 14 that is depicted in FIG. 5 shows the basic procedure. In the configuration, there is provision for 100 images 16, 20, 22, 52 per second to be provided in succession as a control signal. Depending on requirements, there may be provision for additional reference images 16 in the image sequence 14. In the configuration, there is provision for every thirtieth image to be a reference image 16. Naturally, the image rate or the interval of time between the reference images 16 can also be varied according to need in order to be able to adapt the procedure to current requirements in a suitable manner.

[0082] The exemplary configurations described below for controlling a high-resolution lamp such as the pixel lamp 10, 12 permit the generation of patterns in very short intervals. Since the human eye averages the brightness of an observed surface over time, it is possible to introduce individual images such as the reference image 16, which are not detected by the observer.

[0083] The concept involves the image repetition frequency being chosen to be such that it is possible to use the reference image 16 to display a full image without this being noticed by the driver. It is therefore possible to cut out objects, for example by use of matrix beam technology, and still to illuminate the whole road on the route for a very short period.

[0084] The vehicle camera is synchronized to the pixel lamp 10, 12 such that it can record camera data 18 when the road is fully lit in accordance with the reference image 16 and can forward the reference image separately.

[0085] The evaluation unit searches the camera data of the fully lit image for known symbols as advisory route accoutrements such as for example arrows, markings, warnings and/or the like and assigns them defined statements as information data, for example left turn, frost, diverging lane and/or the like. These statements are then compared against a database and examined for inconsistencies.

[0086] The following are examples that may be mentioned:

[0087] In a tunnel, a turn arrow pointing right is painted on the road, but from traffic radio and signs it is known that the exit is closed.

[0088] Repairs to the road mean that parts of the marking are missing, but it is known from GPS and preceding markings where the median strips are supposed to be, for example.

[0089] The road bears a direction indication, for example “Center”, but a diversion means that this road no longer leads to the center but rather leads to the outskirts.

[0090] As a result of renovations, the road bears yellow markings and the white markings are invalid.

[0091] The information on the road is correct and is supposed to be made more clearly visible.

[0092] The evaluation unit then reacts dynamically to the road symbols. To this end, it can include a program-controlled computer unit. The program can perform a suitable algorithm. Since the velocity of the motor vehicle is known and the position of the symbols or markings can be evaluated at a high frequency by use of the images of the image sequence 14 using the vehicle camera, it is possible to follow the movement and outlines of the symbols or markings within the driver's vision. Unwelcome and incorrect information can then be cut out, altered or restricted in the remaining or subsequent images. Useful information can be made clear.

[0093] FIG. 6 shows examples of the use of the method on the basis of a direction arrow 66 on a road on a route. By use of the method for controlling the pixel lamp 10, 12 of a motor vehicle arranged on a route, in which the pixel lamp 10, 12 emanates light 40 on the basis of a control signal that represents an image sequence 14, in order to light at least part of the route. A respective individual image from the image sequence 14 corresponds to a respective light distribution currently needing to be provided by the pixel lamp 10, 12. The lit route is captured by use of a vehicle camera that provides corresponding camera data 18. The camera data 18 are evaluated in order to ascertain an advisory route accoutrement, for example the direction arrow 66, and to provide the control signal for controlling the pixel lamp 10, 12 on the basis of the ascertained advisory route accoutrement.

[0094] According to an example, the image sequence 14 is provided at an image sequence frequency of greater than 100 Hz. The image sequence 14 includes a reference image 16 for uniformly lighting the route. The vehicle camera is synchronized to the reference image 16 for the purpose of capturing the route. The advisory route accoutrement and information data associated with the advisory route accoutrement are ascertained from the provided camera data 18 with reference to the reference image 16. The associated information data are compared with data of a database. The control signal is ascertained on the basis of the comparison.

[0095] FIG. 6 depicts the reference image 16 on the far left. To the right of that, the camera data 18 captured with reference to the reference image 16 by use of the vehicle camera are depicted.

[0096] The depictions 74 and 80 relate to the ascertained arrow 66 being crossed through by use of a projection, provided by the pixel lamp according to an image from the image sequence 14, as emanated light. The image ascertained by use of the control signal unit by taking into consideration the evaluation of the camera data 18 is depicted by 74. The accordingly lit road is depicted by 80. It can be seen that the arrow 66 is not lit. By contrast, a cross 68 is projected brightly. The further area of the image 74 is illuminated according to a normal prescribed light distribution. The depiction 80 shows the projection on the road. The cross 68 is clearly visible. By contrast, the arrow 66 is barely detectable.

[0097] With two further depictions 76, 82 relate to the arrow 66 being cut out. For this purpose, the image 76 depicted by use of the pixel lamp 10, 12 is ascertained from the camera data 18. The accordingly lit road is depicted by 82. Only a substantially uniform lighting of the road is detectable, this being denoted by the reference sign 70. The arrow 66 is no longer visible.

[0098] Two further depictions 78, 84 relate to the arrow 66 being incorporated into the projection. The arrow 66 is supposed to have an arrow 72 overlaid on it, the latter having been ascertained as actual traffic management on the basis of data of a database. The applicable image is denoted by 78. 84 is the accordingly lit road. Only the arrow 72, which completely includes the arrow 66, is detectable. Therefore only the arrow 72 is now visible.

[0099] FIG. 7 shows a further example of the use of the method, specifically the visual projection of absent lateral strips. As in the first case relating to FIG. 6, the reference image 16 permits the capture of camera data 86 for the road. The evaluation reveals that lateral strips 92 are depicted, but parts of the lateral strips are missing. The evaluation of the camera data 86 is used to ascertain an image 88 that is used to control the pixel lamp 10, 12. The already detected markings 92 are bright enough and do not need to be lit further, whereas the rest of the road is lit at average light intensity. Areas having the absent lateral strips 94 are lit to the maximum extent. A continuous pattern of lateral strips is obtained on the road, as depicted by 90.

[0100] FIG. 8 shows a further example of the use of the method, specifically replacement of a road lettering for traffic control. The reference image is again depicted by 16. The associated camera data are denoted by 96. The evaluation reveals that the lettering 98 “Hof” is present on the road. Since the database shows that this road now leads not to Hof but rather to Munich (MUC), a mask is ascertained as image 100, the mask darkening the lettering 102 “Hof” and lighting or projecting a lettering 104 “MUC” more intensely. The impression given on the road is that the only lettering present is “MUC”. This is shown by the depiction 106 of the road.

[0101] It is also possible for invalid markings to be cut out by use of the method. The cutting-out of invalid markings largely corresponds to the configuration shown in FIG. 7, which is why additional reference is made thereto. When the camera data are evaluated with reference to the reference image 16, a distinction is drawn according to the color of the marking. If there are yellow markings present, these are ignored and the white markings are actively cut out as in the case of the configuration shown in FIG. 7. Particularly the yellow markings remain visible to the driver because, unlike the white ones, they continue to be lit by the pixel lamp 10, 12.

[0102] FIG. 9 shows a further example of the use of the method, for example the highlighting of an advisory road accoutrement, for example an exclamation mark 108 on the road. The reference image is again depicted by 16. The associated camera data are denoted by 106. By evaluating the camera data 106, a signal sign, for example the exclamation mark 108, is ascertained. The further evaluation reveals that the database contains data indicating that the exclamation mark 108 is correct. An attempt is therefore made to make the driver aware of this. In a first case, a mask is ascertained as image 110, the mask lighting the road but lighting the exclamation mark 108 to excess. This results in the exclamation mark 108 being highlighted on the road, as shown by the depiction 112. In a second case, an area around the exclamation mark 108 is generated that is darker than the rest of the road lighting and therefore stands out from the rest of the road. An applicable image to be depicted is denoted by 114. The exclamation mark 108 itself is lit especially. This produces a highly lit lettering with a dark border on the road, which is easier for the driver to see on account of the high contrast. This is shown on the basis of the depiction 116.

[0103] FIG. 10 is a block diagram of a controller, according to an example.

[0104] Referring to FIG. 10, the controller 1000 may include an evaluation unit 1001, a control signal unit 1002, a receiver 1003, and a memory 1004. The controller 1000 corresponds to the control device as described herein, the evaluation unit 1001 corresponds to the control signal unit as described herein, and the receiver 1003 corresponds to the receiving unit as described herein. As described above, the evaluation unit 1001 is connected or coupled to the control signal unit 1002 and the receiver 1003, for communication purposes. As described above, the evaluation unit 1001 can include a program-controlled computer unit, i.e., a processor, which executes a program stored in a memory, for example memory 1004 of the controller 1000.

[0105] FIG. 11 is a block diagram of a motor vehicle, according to an example.

[0106] Referring to FIG. 11, the motor vehicle 2000 may include a camera 2010, a pixel lamp 2020, and the controller 1000. The camera 2010 corresponds to the vehicle camera as described herein, the pixel lamp 2020 corresponds to the pixel lamp as described herein, for example, pixel lamp 10, 12, and the controller 1000 corresponds to the control device as described herein. As described above, the receiver 1003 of the controller 1000 receives camera data of the camera 2010. The controller 1000 controls the pixel lamp 2020 by providing a control signal generated by the control signal unit 1002. The control signal unit 1002 generates the control signal according to at least one advisory route accoutrement determined by the evaluating unit 1001. The evaluating unit 1001 determines the at least one advisory route accoutrement according to camera data provided to the evaluating unit 1001 via the camera 2010 directly or via the receiver 1003.

[0107] Overall, the example embodiments show how the method, control device, and motor vehicle can achieve improved lighting of the route, for example of the road, on which the motor vehicle is driven.

[0108] The example embodiments serve merely to explain the disclosure and are not intended to restrict it.

[0109] A description has been provided with reference to embodiments thereof and examples, but it will be understood that variations and modifications can be effected within the spirit and scope of the claims which may include the phrase “at least one of A, B and C” as an alternative expression that means one or more of A, B and C may be used, contrary to the holding in Superguide v. DIRECTV, 358 F3d 870, 69 USPQ2d 1865 (Fed. Cir. 2004).