Vehicle Travelling Control Apparatus
20210291859 · 2021-09-23
Inventors
Cpc classification
B60W2420/50
PERFORMING OPERATIONS; TRANSPORTING
B60W2554/4048
PERFORMING OPERATIONS; TRANSPORTING
B60W2554/00
PERFORMING OPERATIONS; TRANSPORTING
B60W30/095
PERFORMING OPERATIONS; TRANSPORTING
B60W60/001
PERFORMING OPERATIONS; TRANSPORTING
G06V20/58
PHYSICS
B60W2555/60
PERFORMING OPERATIONS; TRANSPORTING
B60W2554/4049
PERFORMING OPERATIONS; TRANSPORTING
B60W50/0097
PERFORMING OPERATIONS; TRANSPORTING
International classification
Abstract
The present subject matter especially relates to a traveling control apparatus, a corresponding traveling control method, an own vehicle including the traveling control apparatus, and a computer program product which is adapted to carry out the traveling control method. The control allows keeping an object, which is located on or close to the driving path/route of the own vehicle, continuously within the field of view of a sensor, a camera or the like which is installed at the own vehicle. This improves the reliability of the traveling control of the own vehicle and the driver can enjoy higher driving comfort and safety.
Claims
1. A vehicle traveling control apparatus configured to be installed at an own vehicle comprising a planning unit that is configured to generate a traveling plan of the own vehicle; a target detection unit which is configured to receive information from a vehicle surroundings observation unit of the own vehicle and to detect an object in the surroundings of the own vehicle based on the received data; and a visibility planning unit which is configured to determine a time during which the detected object will be outside a field of view of the vehicle surroundings observation unit while the own vehicle travels along the traveling plan and to input correction information to the planning unit if the determined time is greater than a preset allowable time.
2. The vehicle traveling control apparatus according to claim 1, wherein the planning unit is configured to adapt the traveling plan to generate an adapted traveling plan based on the correction information provided by the visibility planning unit such that a time during which the detected object will be outside a field of view of the vehicle surroundings observation unit while traveling along the traveling plan is decreased.
3. The vehicle traveling control apparatus according to claim 1, wherein the visibility planning unit includes a visibility prediction unit which is configured to receive information about a configuration of the vehicle surroundings observation unit, including the field of view thereof and to receive information about the detected object, and the visibility prediction unit is configured to predict for a plurality of positions along the route of the traveling plan whether the detected object will be within the field of view.
4. The vehicle traveling control apparatus according to claim 1, wherein the visibility planning unit includes a risk assessment unit which is configured to determine the time the own vehicle will need for traveling along the route of the traveling plan and the time the detected object is not within the field of view of the vehicle surroundings observation unit.
5. The vehicle traveling control apparatus according to claim 4, wherein the risk assessment unit is configured to receive information about an effective area of the detected object generated by an effective area estimation unit of the visibility planning unit, wherein the effective area estimation unit sets a virtual effective area in the vicinity of the detected object in accordance with a predefined pattern and/or based on data retrieved from maps, and the risk assessment unit calculates the time the own vehicle will require for traveling along the traveling plan within the effective area and the time the detected object is not within the field of view of the vehicle surroundings observation unit when the own vehicle travels within the effective area.
6. The vehicle traveling control apparatus according to claim 1, wherein the visibility planning unit includes an acceptable time controller which provides a predefined allowable time for a detected object to be outside of the field of view of the vehicle surroundings observation unit, wherein, if it is determined by the risk assessment unit that the time outside of the field of view is larger than the predefined allowable time, a control value calculation unit is configured to provide the correction information to the planning unit with which the traveling plan is adapted to reduce the time of the detected object outside the field of view to a value that it is equal to or smaller than the predefined allowable time.
7. The vehicle traveling control apparatus according to claim 1, wherein the adaption of the traveling plan is carried out iteratively.
8. The vehicle traveling control apparatus according to claim 1, wherein the control value calculation unit determines correction information including the speed of the own vehicle, the driving direction and planed route of the own vehicle, and/or a stop position of the own vehicle.
9. The vehicle traveling control apparatus according to claim 1, wherein the time during which the detected object is within the field of view of the vehicle surroundings observation unit is in addition maximized by adjusting the field of view of the vehicle surroundings observation unit.
10. The vehicle traveling control apparatus according to claim 1, wherein the detected object includes road objects, such as traffic signs, traffic lights, road markings, and/or other vehicles or other bodies.
11. The vehicle traveling control apparatus according to claim 1, wherein the vehicle traveling control apparatus further includes an arbitration unit which is configured to set priorities for different objects if more than one object is detected by the target detection unit and the target detection unit is configured to select the detected object having the highest priority.
12. The vehicle traveling control apparatus according to claim 1, wherein the planning unit adapts the traveling plan by taking into account safety aspects and driving comfort aspects in addition, wherein safety aspects include an emergency stop of the own vehicle if the detected object is within the traveling plan and an alternative traveling plan for guiding the own vehicle around the detected object is not available, and wherein the driving comfort aspects include avoiding high G forces to the driver of the own vehicle.
13. An own vehicle including a vehicle traveling control apparatus according to claim 1 and a vehicle surroundings observation unit, which is one of or a combination of a lidar unit, a camera unit, a stereo-camera unit, a radar unit, an electromagnetic wave unit.
14. Method of carrying out the adaption of a traveling plan of an own vehicle with a vehicle traveling control apparatus according to claim 1, comprising: generating a traveling plan for the own vehicle, detecting an object within the surroundings of own vehicle the based on data provided by a vehicle surroundings observation unit of the own vehicle, and adapting the traveling plan if the detected object is outside of a field of view of the vehicle surroundings observation unit for a time longer than a predefined allowable time.
15. A computer program product storable in a memory comprising instructions which, when carried out by a computer, cause the computer to perform the method according to claim 14.
Description
[0037] In the following the claimed subject-matter will be further explained based on at least one preferential example with reference to the attached exemplary drawings, wherein:
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045] The own vehicle 100 includes at least one vehicle surroundings observation unit 4 (or sensor) and preferably it includes a plurality of such units 4. The vehicle surroundings observation unit(s) 4 may, e.g., include a camera, a stereo camera, a laser radar, a millimeter wave radar, and/or a lidar. The vehicle traveling control apparatus 1 and/or the control unit 10 may include further subunits for providing driving control functions, such as steering control units, throttle control units, brake control units and the like. Preferably, the own vehicle 100 does not include the control unit 10 and the vehicle traveling control apparatus 1 combines all relevant control functions of the own vehicle 100. Based on the above sketched configuration, it is possible that the own vehicle 100 drives autonomously controlled by the control apparatuses/units, which use information provided by the vehicle surroundings observation unit(s) 4 and further information, e.g. information/data received via optional communication units of the own vehicle 100 which can receive data from a remote data source, such as the Internet, remote servers, and/or GPS. The further information may include map information, traffic information, and the like.
[0046] The vehicle traveling control apparatus 1 is connected to and/or includes a unit which is configured to generate a (vehicle) traveling plan. In the following the respective unit is called “planning unit” 2. The traveling plan, in particular, includes the driving route of the own vehicle 100 which is generated based on input from the vehicle surroundings observation units 4, GPS information and/or map information as well as a driving destination(s) input by the driver. Further relevant information may include obstacles on the road ahead and the like which may be included in the map information or which may be detected by the vehicle surroundings observation units 4.
[0047]
[0048] According to one example of a detection process, the target detection unit 3 may receive images (as information/data from the vehicle surroundings observation unit(s) 4) which were taken by a camera of the own vehicle 100 (the camera being a vehicle surroundings observation unit 4 in this example) and the detection process may include an image evaluation process by which objects within the image, which have a predefined shape or the like, are detected. The predefined object and/or the predefined shapes thereof may be stored in a database which may be connected to the vehicle traveling control apparatus 1 by wire or wireless. Predefined objects may include road markings, traffic signs, other vehicles, other traffic participants, such as pedestrians, cyclists or motorbike riders, as well as obstacles in the driving way and/or other bodies on or in the vicinity of the driving route/way.
[0049] If the target detection unit 3 detects an object, it inputs the respective data/information to a visibility planning unit 5 which includes further subunits that will be described below. The information from the target detection unit 3 is input into a visibility prediction unit 51 that furthermore receives information from a sensor configuration unit 56. The information that is input from the target detection unit 3 preferably includes the position of the detected object, for example relative to the own vehicle 100 and/or in absolute positional coordinates, the type of the detected object, and further optional information such as a condition of the object, and/or whether the object is moving or stationary. The information input from the sensor configuration unit 56 includes configuration information regarding the field of view (range) of the vehicle surroundings observation unit 4 and/or the field of view of each of the vehicle surroundings observation units 4.
[0050] With the above described information, the visibility prediction unit 51 determines, for the actual traveling route, whether the detected object will be continuously within the field of view of the at least one vehicle surroundings observation unit 4 or whether the detected object will be outside of said field of view, temporarily or continuously, when the own vehicle 100 will travel along the (actually used/existing) traveling route of the traveling plan.
[0051] For example, the visibility prediction unit 51 will do the estimation as described above (whether the detected object is within the field of view or not) for a plurality of points in time and/or positions of the traveling route ahead of the own vehicle 100.
[0052] The information determined by the visibility prediction unit 51 is submitted to a risk assessment unit 52. The risk assessment unit 52 further receives data/information from an acceptable time controller 54, and the risk assessment unit 52 calculates the total driving time required to travel along the traveling plan and the accumulated time the object, which was detected by the target detection unit 3, will be outside of the field of view during the traveling on/along the traveling plan. It is noted that the calculation/estimation of the accumulated time that the object, which was detected by the target detection unit 3, will be outside of the field of view during the traveling on/along the traveling plan can also be carried out by the visibility prediction unit 51. And, in this case, said accumulated time is input into the risk assessment unit 52 which then does not need to carry out the respective calculation. Further preferably, the total driving time required to travel along the traveling plan based on the actual driving condition of the own vehicle 100 may also be carried out by a different unit, e.g. the planning unit 2, so that, in this case, the risk assessment unit 52 would not have to calculate said time (either). In a further preferred alternative, the time required for traveling to a set position or to until the end of the traveling plan is not done at all which will be described further below.
[0053] Based on the information input from the acceptable time controller 54, to which, for example, the accumulated time outside of the field of view of the object is compared, the risk assessment unit 52 decides whether the traveling plan has to be adapted/modified or not. In the above example, the risk assessment unit 52 or another unit of the vehicle traveling control apparatus 1 may set a position on the traveling route ahead of the actual position of the own vehicle 100. For example, the set position may be 50 meters, 100 meters or the like ahead of the actual position of the own vehicle 100. The planning unit 2 or the risk assessment unit 52 may then calculate that the own vehicle 100 will arrive at the set position, based on the traveling plan, in, e.g., 1 second, 3 seconds, 6 seconds or the like. The set position may be at the end of the traveling route or it may be at an intermediate position between the actual position of the own vehicle 100 and the (final) end of the traveling route. In the latter case, the above described routine can be carried out repeatedly in a loop-like manner, wherein the set position is newly set for each repetition. The total traveling time determined as described above may be compared to the accumulated time which was determined by the visibility prediction unit 51 or the risk assessment unit 52 and which provides the time period during which the detected object is not visible for the vehicle surroundings monitoring unit(s) 4 until the set position is reached. The relation or the difference between the two times may be compared to the allowable time by the risk assessment unit 4 or the accumulated time during which the object is not visible may be solely compared to the allowable time.
[0054] Furthermore, instead of calculating times and comparing the time(s) to an allowable time, the visibility prediction unit 51 may also calculate the estimated distance for which the detected object will not be within the field of view until the set position or the end of the traveling plan is reached. The risk assessment unit 52 may relate the estimated distance to the total traveling distance to the set position (e.g. by dividing the distances or subtracting one from another) and compare said relation or difference to an allowable distance provided by the acceptable time controller 54 which in this alternative provides an allowable distance.
[0055] The risk assessment of the risk assessment unit 52 may also be carried out by setting an “future evaluation time period”: For example, the risk assessment unit 52 or another unit of the vehicle traveling control apparatus 1 may set a time period for the future traveling of the own vehicle which shall be evaluated by the visibility planning unit 5, i.e. the “future evaluation time period”. Said time period may, e.g., be set to be 5 seconds, 10 seconds, 100 seconds or the like, and it may start at the actual position of the own vehicle 100. Said time period then defines the time interval for which the visibility planning unit 5 calculates the time period the detected object is outside the field of view and for which the acceptable time controller 54 provides an allowable time (period). In other words, if the future evaluation time period was set to 10 seconds, the visibility prediction unit 51 has determined an accumulated time (during the next 10 seconds of the traveling of the own vehicle) during which the detected object is not in the field of view of 3 seconds, and the allowable time is 2 seconds, the risk assessment unit 52 will output a violation of the allowable time maximum after having compared the accumulated time of 3 seconds to the allowable time of 2 seconds.
[0056] Accordingly, the risk assessment unit 52 preferably decides that the traveling plan has to be adapted if the time/time interval of the detected object being outside of the field of view is larger than an allowable time which is input from the allowable time controller 54 (or if the traveling distance with the detected object outside the field of view is larger than the allowable distance). The allowable time (and/or distance) may be predefined and stored within a database of the acceptable time controller 54. The allowable time (distance) may be different for different predefined objects. Using a future evaluation time period allows replacing the step of calculating the traveling time to a set position or to the end of the traveling plan which reduces the computational burden. The future evaluation time period may be used instead of the traveling time to said set position or the like.
[0057] In a further preferred example, the risk assessment unit 52 additionally receives information from an effective area estimation unit 52 which submits information about an effective area of the detected object to the risk assessment unit 52. An effective area of a detected object may be a vicinity/surroundings/periphery of the detected object having a predefined shape, for example a circular, rectangular, or the like. Specifically, for example, if the detected object is a traffic light, the effective area may be a rectangular area which is placed in front of the traffic light covering the street on which the own vehicle 100 will be traveling in accordance with the traveling plan. Taking into account an effective area has the technical advantage that a calculation/determination of the risk assessment unit 52 can be confined to the limited area of the effective area so that the calculation effort is reduced and/or only immediately relevant information is used by the risk assessment unit 52. For example, if the risk assessment unit 52 receives the information about an effective area for the detected object, the above-described calculation/determination of the traveling time along the traveling route and the time during which the detected object is outside of the field of view can be confined to the limited area of the effective area.
[0058] In case the risk assessment unit 52 judges that the traveling plan has to be adapted, it inputs the respective information to a control value calculation unit 55 which determines modification parameters/commands for adapting the traveling plan and submits these to the planning unit 2. The planning unit 2 then modifies the traveling plan to an adapted traveling plan and inputs the adapted traveling plan back to the visibility planning unit 5. Thereby, a feedback control loop is established by which the adaption of the traveling plan can be carried out until the traveling plan fulfills the requirement(s) in view of the determinations of the risk assessment unit 52, e.g. until the time/distance interval of the detected object outside the field of view is equal to or smaller than the allowable time/distance.
[0059] Said above control loop may, in a further example, include an emergency checking unit (not shown) which may require an emergency stop of the own vehicle 100 if it is determined that the situation is too risky. For example, the risk assessment unit 52 may determine that a situation is too risky if the accumulated time of the detected object being outside the field of view is larger than a second allowable time which is greater than the (first) allowable time and/or if the detected object or a further object suddenly appears in front of the own vehicle 100 and the adaption of the traveling plan would take too long.
[0060]
[0061] As described above, as soon as the target detection unit 3 has detected the object, in this example it is the traffic light O, it passes the relevant information to the visibility prediction unit 51. In particular, the target detection unit 3 provides information to the visibility prediction unit 51 that the detected object is a traffic light O, at which position it is placed and which light color it actually shows. The visibility prediction unit 51 will further receive information about the field of view “FOV” from the sensor configuration unit 56 and, based on the received information, the visibility prediction unit 51 will determine or calculate for how long the detected traffic light O will be within the field of view when the own vehicle 100 will travel along the traveling plan route P. Furthermore, the risk assessment unit 52 which receives the information from the visibility prediction unit 51 takes into account information about an effective area received from the effective area estimation unit 53 and an acceptable time for the detected object being outside the field of view received from the acceptable time controller 54.
[0062] In the example of
[0063] In the above-described example of a detected traffic light O two possible scenarios shall be explained in more detail in connection with
[0064] More specifically,
[0065]
[0066] After 5.0 seconds, the own vehicle 100 arrives at the area that is within the effective area but outside the visible area and it then stays for further 5.0 seconds within the “invisible” area, e.g., because it has to wait at the stop line S until the traffic light will turn “green”. Hence, “d” and “dl” are greater than 5.0 seconds for the above example which is greater than the allowable time.
[0067] In the above example, an exemplary measure which may be issued by the control value calculation unit 55 may include that the planning unit 2 makes the own vehicle 100 stop at the red traffic light O at the border of the visible area instead of at the stop line S so that the own vehicle 100 will keep the traffic light O within the field of view during the stop at the red traffic light O. Other possible measures may be to displace the route P laterally on the road or to reduce/increase the traveling speed so that the own vehicle does not have to wait at a red traffic light or at least for a time interval which is shorter than the allowed time. In an alternative preferred example, the control may also include an option to adapt the traveling plan as discussed above, and, in addition, move the vehicle surroundings observation unit(s) 4 or to modify its range/field of view, e.g, when waiting at the stop line of the traffic light so as to maintain the traffic light O in the field of view when standing at the stop line S.
[0068] Again turning to the example of
[0069]
[0070]
[0071] Furthermore, if the vehicle C1 would not be present in the above described example, it would also be possible to set the effective area EA so that it ends at the position of the indicator light IA of the vehicle C2. In this case, the risk assessment unit 52 may decide that the actual traveling plan does not need to be adapted because the overtaking is nearly finished when the indicator light IA is out of the field of view of the own vehicle 100 and, thus, the allowable time may be greater than the time during which the indicator light is outside the field of view.
[0072] Summarizing, the described subject matter allows to take an automated decision based on objective criteria as to when a traveling plan shall be adapted when the target detection unit 3 of the vehicle traveling control apparatus 1 detects an object ahead of the own vehicle 100. Specifically, the control provides an effective means to maintain the detected object within the field of view during the traveling of the own vehicle 100 along a traveling plan/route. Different alternatives for taking the decision and for the configuration of the visibility planning unit 5 and/or the vehicle traveling control apparatus 1 were described above and may be combined and/or modified as far as it is within the expertise of the person skilled in the art.