Method and system for detecting a lane
11598648 · 2023-03-07
Assignee
Inventors
- Christoph Pietruska (Munich, DE)
- Jan-Ullrich Schamburek (Munich, DE)
- Robert Siegl (Mering, DE)
- Michal Siwak (Munich, DE)
Cpc classification
G01C21/3848
PHYSICS
B60W2552/53
PERFORMING OPERATIONS; TRANSPORTING
G01C21/3453
PHYSICS
G06V20/588
PHYSICS
B60W30/18163
PERFORMING OPERATIONS; TRANSPORTING
G01C21/3889
PHYSICS
B60W60/001
PERFORMING OPERATIONS; TRANSPORTING
B60W2556/65
PERFORMING OPERATIONS; TRANSPORTING
B60W2555/60
PERFORMING OPERATIONS; TRANSPORTING
G01C21/3691
PHYSICS
B60W2556/50
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60W60/00
PERFORMING OPERATIONS; TRANSPORTING
G01C21/00
PHYSICS
G06V20/56
PHYSICS
G06V20/58
PHYSICS
Abstract
A method detects a lane for a transverse guidance of a vehicle. The transverse guidance of the vehicle is based on a roadway model. The method has the steps of ascertaining one or more features which are suitable for influencing the detection of the lane; detecting a lane on the basis of a sensor system of the vehicle; and ascertaining the roadway model on the basis of the detected lane and the ascertained one or more features. The method optionally has the steps of additionally receiving navigation data and transversely guiding the vehicle on the basis of the ascertained roadway model.
Claims
1. A method for detecting a lane for transverse guidance of a vehicle, wherein the transverse guidance of the vehicle is based on a road model, the method comprising: determining one or more features, wherein the one or more features are suitable for influencing a detection of the lane; detecting a lane based on a sensor system of the vehicle; determining the road model based on the detected lane and the determined one or more features; and determining a weighting of one or more elements of the lane that are detected by the sensor system of the vehicle, wherein the road model is also determined based on the determined weighting.
2. The method according to claim 1, further comprising: receiving navigation data, wherein the one or more features are determined based on the navigation data.
3. The method according to claim 2, wherein the navigation data comprise one or more of: map data; data based on collective driving behavior of a multiplicity of vehicles; or data based on a detection of road signs.
4. The method according to claim 3, wherein the map data is Advanced Driver Assistance Systems data, and the data based on a detection of road signs is based on an optical detection of road signs.
5. The method according to claim 1, wherein if the one or more features indicate presence of a widening or narrowing on a road section being used by the vehicle, and the widening or narrowing relates to a lane that is beginning or ending, determining the road model comprises: weighting elements present on a side of the lane that is remote from the beginning or ending lane using a first factor; and weighting elements present on a side of the lane that faces the beginning or ending lane using a second factor; wherein the first factor indicates a higher weighting than the second factor.
6. The method according to claim 5, wherein the first and second factors are configured to optionally indicate a weighting in a range from 0% to 100%.
7. The method according to claim 6, wherein the first factor indicates a weighting of 100% and wherein the second factor indicates a weighting of 0%.
8. The method according to claim 1, further comprising: transversely guiding the vehicle based on the determined road model.
9. A method for detecting a lane for transverse guidance of a vehicle, wherein the transverse guidance of the vehicle is based on a road model, the method comprising: determining one or more features, wherein the one or more features are suitable for influencing a detection of the lane; detecting a lane based on a sensor system of the vehicle; and determining the road model based on the detected lane and the determined one or more features, wherein if the one or more features indicate presence of an entry or exit on a road section being used by the vehicle, determining the road model comprises: weighting elements present on a side of the lane that is remote from the entry or exit using a first factor; and weighting elements present on a side of the lane that faces the entry or exit using a second factor; wherein the first factor indicates a higher weighting than the second factor.
10. The method according to claim 9, wherein if the one or more features indicate presence of a widening or narrowing on a road section being used by the vehicle, and the widening or narrowing relates to a lane that is beginning or ending, determining the road model comprises: weighting elements present on a side of the lane that is remote from the beginning or ending lane using a first factor; and weighting elements present on a side of the lane that faces the beginning or ending lane using a second factor; wherein the first factor indicates a higher weighting than the second factor.
11. The method according to claim 9, wherein the first and second factors are configured to optionally indicate a weighting in a range from 0% to 100%.
12. The method according to claim 11, wherein the first factor indicates a weighting of 100% and wherein the second factor indicates a weighting of 0%.
13. A system for detecting a lane for transverse guidance of a vehicle, comprising: a control unit, wherein the control unit is configured to: determine one or more features, wherein the one or more features are suitable for influencing a detection of the lane; detect a lane based on a sensor system of the vehicle; determine a road model based on the detected lane and the determined one or more features; and determine a weighting of one or more elements of the lane that are detected by the sensor system of the vehicle, wherein the road model is also determined based on the determined weighting.
14. A vehicle comprising: the system according to claim 13, wherein the control unit is further configured to carry out: semiautonomous or autonomous control of the vehicle, and transverse guidance of the vehicle.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Exemplary embodiments of the disclosure are depicted in the figures and are described in more detail below. The same reference signs are used hereinbelow for elements that are the same and that have the same effect, unless indicated otherwise.
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION OF THE DRAWINGS
(7)
(8) Normally, the transverse guidance requires information pertaining to the road model of the vehicle's own lane (in this instance lane 82) and, if present, of the left (in this instance lane 81) and right (not present) lanes. The road model is regularly determined substantially from the detected lane markings or structural features, the determined lane center profile and the information from the navigation data. In order to avoid an incorrect road model, the road model and the determination of the route guidance curve need to be adapted in the situations described as problematic.
(9) In the situation shown, the vehicle 100 is in the lane 82 and, beginning at times t0, t1 and t2, passes through the sections 66, 64 and 66. Vehicle 100 detects road marking 88, which separates lanes 81 and 82 from one another, and road boundaries 86, which bound the usable road area at the sides. The usable area can additionally be bounded by the shoulder or a grass verge 87, the vehicle 100 normally not using the area between the road boundary 86 and the boundary 87.
(10) In the section 64, a third lane 83 is supposedly added to the lanes 81 and 82, this third lane likewise being separated from the lane 82 by a road marking 88. This third lane 83 is merely an exit, however, and is not an additional lane following the continuing road profile. Road marking 84 denotes an exemplary road marking that exhibits signs of wear and can therefore be detected by the vehicle 100 only with difficulty or not at all. In some cases, a road marking is missing in the area of the road marking 84 completely, the effect on detection being similar.
(11) In the exemplary first driving situation shown, an additional lane 83 is supposedly added on the right-hand side of the vehicle 100 to the lane 82 being used by the vehicle 100. By default, the vehicle 100 detects its own lane 82 on the basis of the detection of the road marking 88 in the area 88a (see section 66 at the bottom of
(12) At the transition between the area 66 and the area 64 (in the “direction of travel” from bottom to top in
(13) As a result of the detection of the road boundary 86 as the right-hand edge of the lane 82, the vehicle 100 then determines a route guidance curve 68′ that differs from the route guidance curve 68 that is actually correct. On the basis of the route guidance curve 68′, which, as depicted in
(14) According to embodiments of the present disclosure, the driving behavior depicted by vehicle 100′ is effectually prevented.
(15) Navigation data can be used to detect a series of road features, in the present case for example that there is an exit present. Further road features include for example road widenings or narrowings, junctions, forks in the road and mergings, overpasses and underpasses, and hills and valleys. On the basis of the detected road features, specific situations can then be anticipated and the determination of the road model can be adapted.
(16) Navigation data include for example map data available in the vehicle or online (e.g. Advanced Driver Assistance Systems (ADAS) data), data from backend structures (e.g. backend server), data on the basis of collective driving behavior (e.g. evaluations of GPS data from other vehicles) or data captured by the vehicle (e.g. detection of road signs).
(17) In the case depicted in
(18) When considered with respect to time, the following control profile is substantially obtained. At time t0, a scheduled transverse guidance without particular limitations or adaptations takes place. At time t1, navigation data (see above) are taken as a basis for generating an event that indicates the presence of an exit at a specific distance (e.g. in the range up to 500 m, preferably in the range up to 300 m). At time t1, or from time t1 onward, the road model or the determination of the route guidance curve 68 can then be intermittently adapted as described. The feature causing the event (in this instance: exit) can have an extent as well, so that a second event, occurring later in the timing, that indicates the end of the presence can be generated at time t1 already. Optionally, the second event can also be generated at a later time (e.g. time t2 or else later, depending on the extent of the feature). The second event can then (for example at time t2) prompt the scheduled transverse guidance without limitations or adaptations to be resumed.
(19) In some embodiments, rule-based adaptation of the road model or of the determination of the route guidance curve can take place. In the present case, the presence of an exit area can lead, in a rule-based manner, to only those elements of the road markings or road boundaries that are remote from the exit being used to determine the route guidance curve (see previous paragraph).
(20) The presence of an entry can be handled in substantially the same way as the described case of an exit, which means that the concepts and methods described are applicable analogously.
(21)
(22) As in the first exemplary driving situation, the transverse guidance requires information pertaining to the road model of the vehicle's own lane (in this instance lane 82) and, if present, of the left (later on lane 81) and right (in this instance lane 83) lanes. The road model is regularly determined substantially from the detected lane markings or structural features, the determined lane center profile and the information from the navigation data. In order to avoid an incorrect road model, the road model and the determination of the route guidance curve need to be adapted in this driving situation too.
(23) Widenings/narrowings behave in a similar manner to exits and entries. One difference, however, can be that for example in the case of a widening from two to three lanes there is no definition of what side of the road an additional lane appears on. In order to determine which road markings or whether one side of the lane, and if so which one, need(s) to be prioritized, heuristics can be used in order to rate the quality of the lane markings and to compare them with one another. To this end, different influencing factors can be considered, for example the stability of a marking (e.g. similarity to previously observed markings taking into consideration the odometry data), parallelism with other markings, type of marking (e.g. white, yellow) or the like. Each quality feature can be assigned a weight and, on the basis of the heuristics used, the marking that has a predetermined weight (e.g. the highest weight) or exceeds this weight (e.g. is greater than a minimum weight) can be selected.
(24) In the situation shown, the vehicle 100 is in the lane 82 and, beginning at times t0, t1 and t2, passes through the sections 66, 64 and 66. Vehicle 100 detects road marking 88, which separates lanes 82 and 83 from one another, and road boundaries 86, which bound the usable road area at the sides.
(25) In the section 64, a third lane 81 is added to the lanes 82 and 83, this third lane, at least later on, likewise being separated from the lane 82 by a road marking 88. This third lane 81 is, in contrast to the first driving situation, an additional lane that follows the continuing road profile. Furthermore, in contrast to the first driving situation, a road marking separating the lanes 81 and 82 is missing entirely over large parts of the section 64, which is why reliable detection of the left-hand lane boundary is not possible in this section.
(26) In the exemplary second driving situation shown, an additional lane 81 is thus added on the left-hand side of the vehicle 100 to the lane 82 being used by the vehicle 100. By default, the vehicle 100 detects its own lane 82 on the basis of the detection of the road marking 88 in the area 88a (see section 66 at the bottom of
(27) At the transition between the area 66 and the area 64 (in the “direction of travel” from bottom to top in
(28) As a result of the detection of the road boundary 86 as the left-hand edge of the lane 82, the vehicle 100 then determines a route guidance curve 68′ that differs from the route guidance curve 68 that is actually correct, substantially analogously to the first driving situation already described. On the basis of the route guidance curve 68′, which, as depicted in
(29) According to embodiments of the present disclosure, the driving behavior depicted by vehicle 100′ is effectually prevented in the case of a widening of the road too.
(30) In the case depicted in
(31) In a predetermined area 64, which substantially covers the area of the widening, possibly including transitional areas before and after the widening, the determination of the route guidance curve 68 is adapted by virtue of detected road features being weighted in an altered manner. First, or according to schedule, the route guidance curve 68 in the area 66 (see bottom of
(32) When considered with respect to time, the following control profile is substantially obtained. At time t0, a scheduled transverse guidance without particular limitations or adaptations takes place. At time t1, navigation data (see above) are taken as a basis for generating an event that indicates the presence of a widening at a specific distance (e.g. in the range up to 200 m, preferably in the range up to 50 m). At time t1, or from time t1 onward, the road model or the determination of the route guidance curve 68 can then be intermittently adapted as described, and subsequently, for example at time t2, the scheduled transverse guidance without limitations or adaptations can be resumed.
(33) In some embodiments, rule-based adaptation of the road model or of the determination of the route guidance curve can take place. In the present case, the presence of a widening can lead, in a rule-based manner, to only those elements of the road markings or road boundaries that are remote from the widening being used to determine the route guidance curve.
(34) In some embodiments of the present disclosure, the lane center profile can be ignored (weighting zero), the lane markings continuing to be weighted in the same way. The lane center profile (HPP) estimated on the basis of the signals from a camera, for example, is ideally situated centrally between two lane markings (e.g. 86, 88; cf. 68 in
(35)
(36) As in the first and second exemplary driving situations, the transverse guidance requires information pertaining to the road model of the vehicle's own lane (in this instance lane 82) and, if present, of the left (initially lane 81) and right (in this instance lane 83) lanes. The road model is regularly determined substantially from the detected lane markings or structural features, the determined lane center profile and the information from the navigation data. In order to avoid an incorrect road model, the road model and the determination of the route guidance curve need to be adapted in this third driving situation too.
(37) In the situation shown, the vehicle 100 is in the lane 82 and, beginning at times t0, t1 and t2, passes through the sections 66, 64 and 66. Vehicle 100 detects a left-hand road marking 88, which separates the lanes 81 and 82 from one another, and a right-hand road marking 88, which separates the lanes 82 and 83 from one another.
(38) In the section 64, the lane 81, which had initially likewise been separated from the lane 82 by a road marking 88, ends. In contrast to the first driving situation, a road marking separating the lanes 81 and 82 is missing over large parts of the section 64 in the area in which the lane 81 ends, which is why reliable detection of the left-hand lane boundary is not possible in this section.
(39) In the exemplary third driving situation shown, the lane 81 additionally present on the left-hand side of the lane 82 being used by the vehicle 100 thus ends. By default, the vehicle 100 detects its own lane 82 on the basis of the detection of the left-hand road marking 88 in the left-hand area 88a (see section 66 at the bottom of
(40) At the transition between the area 66 and the area 64 (in the “direction of travel” from bottom to top in
(41) As a result of the detection of the road boundary 86 as the left-hand edge of the lane 82, the vehicle 100 then determines a route guidance curve 68′ that differs from the route guidance curve 68 that is actually correct, substantially analogously to the first and second driving situations already described. On the basis of the route guidance curve 68′, which, as depicted in
(42) According to embodiments of the present disclosure, the driving behavior depicted by vehicle 100′ is effectually prevented in the case of a narrowing of the road too.
(43) In the case depicted in
(44) In a predetermined area 64, which substantially covers the area of the narrowing, possibly including transitional areas before and after the narrowing, the determination of the route guidance curve 68 is adapted by virtue of detected road features being weighted in an altered manner. First, or according to schedule, the route guidance curve 68 in the area 66 (see bottom of
(45) When considered with respect to time, the following control profile is substantially obtained. At time t0, a scheduled transverse guidance without particular limitations or adaptations takes place. At time t1, navigation data (see above) are taken as a basis for generating an event that indicates the presence of a narrowing at a specific distance (e.g. in the range up to 200 m, preferably in the range up to 50 m). At time t1, or from time t1 onward, the road model or the determination of the route guidance curve 68 can then be intermittently adapted as described, and subsequently, for example at time t2, the scheduled transverse guidance without limitations or adaptations can be resumed.
(46) In some embodiments, rule-based adaptation of the road model or of the determination of the route guidance curve can take place. In the present case, the presence of a narrowing can lead, in a rule-based manner, to only those elements of the road markings or road boundaries that are remote from the narrowing being used to determine the route guidance curve.
(47)
(48)
(49) Although the invention has been illustrated and explained more specifically in detail by preferred exemplary embodiments, the invention is not restricted by the disclosed examples and other variations can be derived therefrom by a person skilled in the art without departing from the scope of protection of the invention. It is clear, therefore, that a multiplicity of possible variations exist. It is also clear that embodiments mentioned by way of example are really only examples which should not be considered in any way as limiting the range of protection, the possible applications or the configuration of the invention, for example. Instead, the preceding description and the description of the figures enable a person skilled in the art to implement the illustrative embodiments in concrete form, a person skilled in the art, knowing the disclosed concept of the invention, being able to make various changes, for example with regard to the operation or the arrangement of individual elements mentioned in an illustrative embodiment, without departing from the range of protection defined by the claims and the legal equivalents thereof, such as, for instance, further explanations in the description.