Method and Driver Assistance System for Assisting a Driver in Driving Along a Proximity Region of a Trajectory
20240336139 ยท 2024-10-10
Inventors
Cpc classification
B60K2360/188
PERFORMING OPERATIONS; TRANSPORTING
B60K2360/28
PERFORMING OPERATIONS; TRANSPORTING
B60K35/28
PERFORMING OPERATIONS; TRANSPORTING
International classification
Abstract
A driver assistance system assists a driver of a motor vehicle in driving along a trajectory by displaying the trajectory on a display unit. It is identified that the vehicle is approaching a proximity region of the trajectory starting from an actual position on the basis of the fact that a plurality of different segments of the trajectory intersect, are superimposed and/or approach one another. At least one relevant segment which is relevant for the journey starting from the actual position of the vehicle is determined from the plurality of segments. The relevant segment in the display trajectory is highlighted on the display unit relative to one or more other segments of the plurality of segments.
Claims
1-18. (canceled)
19. A driver assistance system of a vehicle, comprising: a controller communicatively coupled to a display unit that displays a display trajectory, wherein the controller is configured to, during a transit of the vehicle along a trajectory corresponding to the display trajectory: determine that the vehicle, starting from an actual position, is approaching a proximity region of the trajectory in which a plurality of different segments of the trajectory intersect, overlap and/or converge on one another, ascertain at least one relevant segment from the plurality of segments that, starting from the actual position of the vehicle, is relevant to the transit, and cause the display unit to highlight the relevant segment in the display trajectory compared with one or more other segments from the plurality of segments.
20. The driver assistance system of claim 19, wherein the trajectory is a first trajectory recorded within the context of a first transit; and wherein the transit is a second transit or the trajectory is a planned driving maneuver.
21. The driver assistance system of claim 19, wherein the controller is further configured to: ascertain the segment from the plurality of segments as the relevant segment on which the vehicle is supposed to drive or will drive through and/or from the proximity region in order to follow the trajectory on the transit.
22. The driver assistance system of claim 19, wherein the controller is further configured to: identify the one or more segments from the plurality of segments of the proximity region as relevant segments that follow the actual position of the vehicle next with regard to a direction of travel of the vehicle on the transit.
23. The driver assistance system of claim 19, wherein the controller is further configured to: ascertain a distance between two different segments of the trajectory; and determine that the two different segments form a proximity region of the trajectory if the ascertained distance is equal to or less than a predefined distance threshold value.
24. The driver assistance system of claim 19, wherein the controller is further configured to: ascertain an angle between two intersecting segments of a proximity region of the trajectory; and to ascertain and/or highlight the relevant segment for this proximity region on the basis of the angle between the two intersecting segments.
25. The driver assistance system of claim 24, wherein the controller is further configured to: ascertain and/or highlight the relevant segment for this proximity region only if the ascertained angle between the two intersecting segments is in a predefined angle range equal to or less than ?20?.
26. The driver assistance system of claim 19, wherein the controller is further configured to: highlight the relevant segment by: hiding or graying out or transparently representing another segment from the plurality of segments, using a different color and/or shading for the relevant segment than for the other segment from the plurality of segments, and/or displaying a symbol that indicates the segment relevant to the transit.
27. The driver assistance system of claim 19, wherein the controller is further configured to: use at least one camera of the vehicle to ascertain image data relating to surroundings of the vehicle that are in front of the vehicle in the direction of travel, and take the image data as a basis for causing the display unit to show a graphical representation that displays the surroundings of the vehicle with the display trajectory overlaid.
28. The driver assistance system of claim 19, wherein the controller is further configured to, repeatedly during the transit: ascertain a respective actual position of the vehicle, ascertain whether or not, starting from the respective actual position, there is, ahead in the direction of travel, a proximity region of the trajectory with a relevant segment, update the display trajectory on the basis of whether or not there is, ahead in the direction of travel, a proximity region of the trajectory with a relevant segment, and cause the respective updated display trajectory to be shown on the display unit.
29. The driver assistance system of claim 19, wherein the control unit is further configured to: ascertain, starting from the actual position of the vehicle, a plurality of proximity regions of the trajectory that are in front of the vehicle in the direction of travel of the vehicle on the transit, ascertain a sequence of successive segments of the trajectory that are driven through in succession on the transit starting from the actual position, identify the first segment from the sequence of segments that first forms a proximity region of the trajectory with a segment from the sequence of segments that is in front of the first segment, and ascertain the at least one relevant segment from a set of segments that are in front of the first segment in the sequence of segments.
30. The driver assistance system of claim 19, wherein the control unit is further configured to: laterally guide the vehicle along the trajectory in at least partially or fully automated fashion on the transit.
31. The driver assistance system of claim 19, wherein the control unit is further configured to: detect that the trajectory has a loop with two segments that intersect at a point of intersection and/or that overlap in an overlap region; wherein a region around the point of intersection and/or the overlap region correspond/s to the proximity region, and select the segment from the two segments that intersect at the point of intersection and/or that overlap in the overlap region as the relevant segment that is closest to the actual position along the trajectory.
32. The driver assistance system of claim 19, wherein the controller is further configured to: detect that the trajectory has two segments with opposite directions of travel and a change of direction of travel of the vehicle takes place at a direction-of-travel change point between the two segments, wherein a region around the direction-of-travel change point corresponds to the proximity region, and select the segment from the two segments as the relevant segment that is closest to the actual position along the trajectory.
33. The driver assistance system of claim 19, wherein the controller is further configured to: (a) at least partially or fully transparently show and/or at least partially or fully hide the one or more other segments from the plurality of segments, and/or (b) at least partially or fully transparently show and/or at least partially or fully hide one or more direction symbols on the one or more other segments from the plurality of segments, in order to highlight the relevant segment in the display trajectory on the display unit compared with the one or more other segments from the plurality of segments.
34. The driver assistance system of claim 19, wherein the controller is further configured to: at least partially or fully transparently show and/or at least partially or fully hide one or more segments of the trajectory that come after the relevant segment, and/or at least partially or fully transparently show and/or at least partially or fully hide one or more direction symbols on the one or more segments of the trajectory that come after the relevant segment.
35. The driver assistance system of claim 19, wherein the controller is further configured to: highlight the relevant segment in the display trajectory on the display unit compared with the one or more other segments from the plurality of segments only while the vehicle is arranged on a segment in front of the relevant segment in the direction of travel or on the relevant segment.
36. A method for the operation of a driver assistance unit of a motor vehicle during a transit of the vehicle along a trajectory corresponding to a display trajectory displayed on a display unit, the method comprising: detecting that the vehicle, starting from an actual position, is approaching a proximity region of the trajectory in which a plurality of different segments of the trajectory intersect, overlap and/or converge on one another; ascertaining at least one relevant segment from the plurality of segments of the proximity region that, starting from the actual position of the vehicle, is relevant to the transit; and causing the relevant segment to be highlighted in the display trajectory on the display unit compared with one or more other segments from the plurality of segments of the proximity region.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
DETAILED DESCRIPTION OF THE DRAWINGS
[0059] As explained at the outset, the present document is concerned with increasing the quality of a driving assistance system, in particular with regard to the display trajectory displayed on a transit. The text below discusses a return transit on the basis of an outward trajectory recorded during an outward transit. It is pointed out that the aspects described can be applied generically to a second transit made on the basis of a trajectory that was recorded during a first transit.
[0060]
[0061] The vehicle 100 further comprises a reversing camera 106 configured to capture image data relating to the surroundings of the vehicle 100 ahead of the vehicle 100 in the direction of travel of the vehicle 100 on a return transit by the vehicle 100. In particular, the camera 106 can capture the surroundings to the rear of the vehicle 100 on a backward transit by the vehicle 100.
[0062] The vehicle 100 may further comprise one or more longitudinal and/or lateral guidance actuators 104 designed to produce at least partially automated longitudinal and/or lateral guidance of the vehicle 100. Illustrative actuators 104 are a drive motor, a steering device and/or a braking device. The (control) device 101 may be configured to control the one or more actuators 104 on a return transit on the basis of the trajectory data relating to the outward transit in order to assist the driver of the vehicle 100 on the return transit.
[0063] In addition, the vehicle 100 comprises a display unit 105 that may be arranged e.g. on the dashboard and/or on the head unit of the vehicle 100. The display unit 105 can comprise a screen (in particular an LCD, LED or OLED screen), a projector and/or a head-up display. The device 101 may be configured to cause the image data from the reversing camera 106 to be displayed on the display unit 105 on a return transit. In particular, the surroundings ahead of the vehicle 100 in the direction of travel can be shown (in the form of a video).
[0064] The device 101 may further be configured to take trajectory data captured during the applicable outward transit as a basis for ascertaining a return trajectory and to graphically represent said return trajectory on the display unit 105, and thus to overlay the image data from the reversing camera 106 on said return trajectory. The return trajectory (which is also referred to as the display trajectory in this document) can thus display to the user, in particular the driver, of the vehicle 100 how the vehicle 100 should be steered on the return transit, in particular in order to take the vehicle 100 back along the outward trajectory. The steering of the vehicle 100 on the return transit can be produced in automated fashion by the vehicle 100 or manually by the driver. If the steering, i.e. the lateral guidance, of the vehicle 100 is produced in automated fashion by the vehicle 100, the return trajectory shown can be an assistance for the driver in monitoring the automated lateral guidance. If the steering is produced manually by the driver, the return trajectory shown can be used by the driver as an indication of the steering that needs to be produced by the driver.
[0065]
[0066]
[0067] The image data 215 from the reversing camera 106 can be overlaid with a (representation of the) return trajectory 210 (generically with the display trajectory) ascertained on the basis of the trajectory data relating to the outward trajectory 200. In particular, a return trajectory 210 (e.g. in the form of a driving path) can additionally be displayed on the image data 215, said return trajectory indicating to the user of the vehicle 100 how the vehicle 100 should be longitudinally and/or laterally guided on the return transit 213 (in order to take the vehicle 100 back to the outward trajectory 200 as appropriate).
[0068] If the outward trajectory 200 has intersecting segments (as depicted by way of illustration in
[0069]
[0070] The trajectory 200 depicted in
[0071] In particular in the case of relatively small angles of intersection 311 (e.g. of 20? or less), a situation may arise in which the display trajectory 210 corresponding to the recorded trajectory has segments 211 at the point of intersection 310 that are at such a small angle with respect to one another that the driver of the vehicle 100 cannot definitely tell which segment 211 is relevant to the lateral guidance of the vehicle 100.
[0072]
[0073]
[0074]
[0075] The (control) device 101 of the vehicle 100 and a driver assistance system comprising the device 101 may be configured to ascertain whether or not the recorded trajectory 200 for a transit, e.g. for a return transit, has a proximity region 310, 320. A proximity region 310, 320 may be a region in which the trajectory 200 has a point of intersection 310. Alternatively, a proximity region 310, 320 may be a convergence region 320 in which different segments 301, 303 of the trajectory 200 are at a distance from one another that is equal to or less than a predefined distance threshold value. The segments 301, 303 may run substantially parallel to one another in the convergence region 320.
[0076] The device 101 and/or the driver assistance system may be configured to ascertain the display trajectory 210 for the recorded trajectory 200. The display trajectory 210 can then be shown on the display unit 105 during the transit. Typically, only the portion of the display trajectory 210 that is in the region of the surroundings of the vehicle 100 that is captured by the camera 106 and reproduced on the display unit 105 is shown.
[0077] If the vehicle 100 gets closer to the proximity region 310, 320 of the recorded trajectory 200 during the transit, it may occur (as depicted by way of illustration in
[0078] The device 101 and/or the driver assistance system may therefore be configured to detect that a plurality of different segments 211 of the display trajectory 200 need to be shown (for a corresponding plurality of segments 301, 303 of the recorded trajectory 200) for the proximity region 310, 320. It is then possible to ascertain which segment 211 from the plurality of different segments 211 has the greatest relevance to the (lateral) guidance of the vehicle 100 (compared with the other one or more segments 211) at the respective time and/or at the respective actual position of the vehicle 100. In particular, it is possible to identify the segment 211 that is being driven through at present and/or will be driven through next.
[0079] The identified segment 211 can then be (visually) highlighted in the graphical representation 205 compared with the one or more other segments 211. This can be achieved e.g. by selecting a specific color and/or by hiding the one or more other segments 211. Highlighting the identified segment 211 allows the convenience and reliability of the driver assistance to be increased.
[0080] The relevant route that the driver assistance system will follow can therefore be displayed to the driver during a transit along a recorded trajectory 200. For this purpose, the system can detect different situations, in particular different proximity regions the 310, 320, and take them into consideration when showing the display trajectory 210. The relevant route can be displayed by hiding and/or by graying out and/or by transparently representing an irrelevant segment 211, by representing the relevant segment in a particular visual manner, by way of a direction arrow, etc.
[0081]
[0082] The angle 311 between the segments 303, 302 at the point of intersection 310 may optionally be taken into consideration. The smaller the angle 311, the more difficult it is for the driver to tell which path is valid. On the other hand, it is obvious which path is being followed if the angle 311 is approximately 90?. It is therefore possible to check an angle condition, and the irrelevant path 303 may optionally be hidden only for relatively small angles 311 (see
[0083] A similar situation exists in the case of an intersection with a relatively large angle 311 (see
[0084] Another situation exists when the paths 302, 303 are relatively close to one another, even if the paths 302, 303 do not intersect (see
[0085]
[0086]
[0087] Alternatively, every segment may optionally be taken into consideration, or it is possible for a specific number of segments (e.g. three segments) that come after starting from the actual position 300 to be taken into consideration. The graduation of the relevance of the segments may optionally be visually represented (e.g. by way of different colors) in this case.
[0088] As already explained earlier on, different representations can be used to visually represent the relevance of the different segments 301-307 of a trajectory 200 in a proximity region 310, 320. Illustrative measures are: hiding and/or graying out an irrelevant segment; fading within a segment or over multiple segments; different visual representation (color/shading) of the segments; and/or use of symbols, such as e.g. arrows or no-entry signs.
[0089]
[0090]
[0091] In the example depicted in
[0092] It is possible to identify the segment 302 that (starting from the actual position 300 of the vehicle 100) is (next and/or first) relevant to the transit 213 of the vehicle 100 through the proximity region 320. In the example depicted in
[0093] It is possible to cause the (second) segment 302 identified as relevant or more relevant to be highlighted compared with the (third) segment 303 identified as irrelevant or as less relevant. This can be achieved in particular by virtue of the third segment 303 being at least partially or fully hidden (and/or transparently represented) and/or by virtue of the one or more arrows 502 on the third segment 303 being partially or fully hidden (and/or transparently represented). It is therefore possible for the highlighting of the second segment 302 to be produced by visually diminishing (e.g. partially or fully hiding) the third segment 303.
[0094]
[0095] In the proximity region 320, the second and third segments 302, 303 converge on one another and run directly beside one another, in particular in direct proximity to the point 515 at which the change of direction of travel takes place, with the result that it may be unclear to the user of the vehicle 100 on which segment 302, 303 the vehicle 100 will travel.
[0096] It is possible for the segment 302 of the display trajectory 210 that is (next) relevant to the second transit 213 in the proximity region 320 to be identified. The relevant segment 302 may be the segment that, starting from the actual position 300, is driven through next. The relevant segment 302 can then be highlighted compared with the one or more other segments 303 in the proximity region 320, this being able to be achieved in particular as a result of the one or more other segments 303 and/or arrows 502 on the one or more segments 303 being at least partially transparently represented (whereas the relevant segment 302 and/or arrows 502 on the relevant segment 302 are non-transparently represented).
[0097] The relevant segment 302 can be highlighted and/or the irrelevant segment 303 can be moderated while the vehicle 100 is travelling on a segment 301 in front of the relevant segment 302 and/or on the relevant segment 302. As soon as the vehicle 100 has left the relevant segment 302, the highlighting of the relevant segment 302 and/or the moderation of the irrelevant segment 303 can be terminated.
[0098] It is therefore possible to cause only the currently relevant path information to be displayed when two trajectories overlap, in particular when two different segments 302, 303 of a trajectory 210 overlap. The path or the path component 303 that will not be taken until later can be represented in a visually different manner (transparently and/or in a different color and/or in a different shape) or not at all. This can be done for all paths or segments 303 that follow the relevant path or the relevant segment 302 (i.e. the overlap), even if they are outside the proximity region 310, 320 (as depicted by way of illustration in
[0099] An overlapping path may exist e.g. after a change of direction (as depicted by way of illustration in
[0100]
[0101]
[0102] The portion of the third (i.e. irrelevant) segment 303 that overlaps the second (i.e. relevant) segment 302 can be at least partially hidden and/or transparently represented. Alternatively or additionally, the direction symbols 502 of the overlapping portion of the third segment 303 can be at least partially hidden and/or transparently represented.
[0103]
[0104] The method 400 comprises, during the second transit 213, detecting 401 that the vehicle 100, starting from the (respective) actual position, is getting closer to a proximity region 310, 320 of the recorded trajectory 200 in which a plurality of different segments 302, 303 of the recorded trajectory 200 intersect, overlap and/or converge on one another. In other words, it is possible to detect that the vehicle 100 is getting closer to a proximity region 310, 320 of the recorded trajectory 200 in which multiple different segments 302, 303 of the recorded trajectory 200 would need to be shown on the display unit 105 (because the segments 302, 303 intersect or because the segments 302, 303 are relatively close together).
[0105] The method 400 further comprises ascertaining 402 at least one relevant segment 302 from the plurality of segments 302, 303 that, starting from the actual position 300 of the vehicle 100, is relevant to the second transit 213. The relevant segment 302 may be in particular the segment 302 via which the vehicle 100, starting from the actual position, will (next) drive through the proximity region 310, 320.
[0106] In addition, the method 400 comprises causing 403 the relevant segment 302 to be highlighted in the display trajectory 210 on the display unit 105 compared with one or more other segments 303 from the plurality of segments 302, 303. This can be achieved e.g. by using a specific color and/or intensity and/or line thickness for the relevant segment 302.
[0107] As already explained earlier on, the method 400 can be applied mutatis mutandis to a generic transit along a generic (optionally planned) trajectory.
[0108] The measures described in this document allow the convenience and reliability of the driver assistance system to be increased.
[0109] The present invention is not limited to the exemplary embodiments shown. In particular, it should be noted that the description and the figures are intended to demonstrate the principle of the proposed methods, devices and systems only by way of illustration.