CONTROL SYSTEM AND CONTROL METHOD FOR A HYBRID APPROACH FOR DETERMINING A POSSIBLE TRAJECTORY FOR A MOTOR VEHICLE
20220032952 · 2022-02-03
Assignee
Inventors
- Christian Lienke (Gelsenkirchen, DE)
- Christian Wissing (Dortmund, DE)
- Manuel Schmidt (Dortmund, DE)
- Andreas Homann (Dortmund, DE)
- Torsten Bertram (Düsseldorf, DE)
- Till Nattermann (Krefeld, DE)
- Martirn Keller (Waltrop, DE)
- Karl-Heinz Glander (Monheim, DE)
Cpc classification
B60W2050/006
PERFORMING OPERATIONS; TRANSPORTING
B60W2554/804
PERFORMING OPERATIONS; TRANSPORTING
B60W2552/53
PERFORMING OPERATIONS; TRANSPORTING
B60W60/0013
PERFORMING OPERATIONS; TRANSPORTING
B60W60/001
PERFORMING OPERATIONS; TRANSPORTING
B60W60/0011
PERFORMING OPERATIONS; TRANSPORTING
B60W30/18163
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60W60/00
PERFORMING OPERATIONS; TRANSPORTING
Abstract
A control system for use in a motor vehicle and configured to monitor a current driving situation of the motor vehicle on the basis of surrounding data of the motor vehicle acquired from at least one surrounding sensor arranged on the motor vehicle in a current driving situation is disclosed. The control system is configured to determine information relating to a current driving situation of the motor vehicle on the basis of the provided surrounding data, to determine information relating to a current driving situation of the motor vehicle and to determine a component of a future driving maneuver for the motor vehicle on the basis of the information relating to the current driving situation of the motor vehicle. Furthermore, the control system is configured to determine a multiplicity of model trajectories for the motor vehicle on the basis of the determined component of the future driving maneuver for the motor vehicle and to determine from the multiplicity of model trajectories a trajectory for the motor vehicle which the motor vehicle is to follow in the further course of its travel. The control system is also configured to update the information relating to the current driving situation of the motor vehicle and/or the supplied surrounding data and to adapt the trajectory for the motor vehicle on the basis of a target function and on the basis of the updated supplied surrounding data and/or on the basis of the updated information relating to the current driving situation of the motor vehicle.
Claims
1. A control system for a motor vehicle which is configured to detect lanes, road boundaries, road markings and/or further motor vehicles in a region adjacent the motor vehicle on the basis of environmental data obtained from at least one environmental sensor arranged on the motor vehicle, wherein the at least one environmental sensor is configured to provide an electronic controller of the control system with the environmental data representing the region adjacent the motor vehicle, and wherein the control system determines information relating to a current driving situation of the motor vehicle based on the environmental data provided by the at least one environmental sensor, determines at least one component of a future driving maneuver for the motor vehicle based on the information relating to the current driving situation of the motor vehicle, determines a plurality of model trajectories for the motor vehicle (12) based on the determined component of the future driving maneuver for the motor vehicle (12), determines a trajectory for the motor vehicle from the plurality of model trajectories for the motor vehicle, which trajectory is intended to be followed by the motor vehicle in a further course of travel of the motor vehicle, updates the information relating to the current driving situation of the motor vehicle and/or the environmental data provided, and adapts the trajectory for the motor vehicle using a target function and based on the updated environmental data provided and/or based on the updated information relating to the current driving situation of the motor vehicle.
2. The control system as claimed in claim 1, which determines the trajectory from the plurality of model trajectories using a target function which is the same as the target function for adapting the trajectory for the motor vehicle.
3. The control system as claimed in claim 1, wherein the information relating to the current driving situation of the motor vehicle comprises at least a lateral distance of the motor vehicle from a currently used lane, and wherein the control system determines the component of the future driving maneuver based on the lateral distance of the motor vehicle from the currently used lane as a lane-keeping or as a lane change.
4. The control system as claimed in claim 3, wherein the information relating to the current driving situation of the motor vehicle also comprises a longitudinal distance of the motor vehicle along its currently used lane from a further motor vehicle, and wherein the control system determines a further component of the future driving maneuver based on the determined component of the future driving maneuver and/or based on the longitudinal distance of the motor vehicle from the further motor vehicle.
5. The control system as claimed in claim 1, which determines the information relating to the current driving situation of the motor vehicle based on the provided environmental data in the form of discrete sampling values.
6. The control system as claimed in claim 5, wherein the control system determines a plurality or all of the discrete sampling values as nodes, and creates a connected graph from the determined nodes.
7. The control system as claimed in claim 6, wherein the control system selects the nodes as stopping points for the trajectory, and calculates the trajectory for the motor vehicle by a spline-based interpolation between the selected stopping points.
8. The control system as claimed in claim 1, wherein the control system determines the updated information and/or the updated environmental data in the form of continuous values.
9. The control system of claim 8, wherein the control system combines the updated information and/or the updated environmental data in the form of continuous values with the information relating to the current driving situation of the motor vehicle in the form of discrete sampling values in order to adapt the trajectory for the motor vehicle.
10. The control system as claimed in claim 9, wherein the combination of the information relating to the current driving situation of the motor vehicle in the form of discrete sampling values with the updated information and/or with the updated environmental data in the form of continuous values at least comprises the control system initializing and/or reinitializing the adaptation of the trajectory for the motor vehicle using the target function.
11. A control method for a motor vehicle, that detects lanes, road boundaries, road markings and/or further motor vehicles in a region adjacent the motor vehicle based on environmental data obtained from at least one environmental sensor arranged on the motor vehicle, wherein the control method comprises the steps of: determining information relating to a current driving situation of the motor vehicle based on the environmental data provided, determining at least one component of a future driving maneuver for the motor vehicle based on the information relating to the current driving situation of the motor vehicle, determining a plurality of model trajectories for the motor vehicle based on the determined component of the future driving maneuver for the motor vehicle, determining a trajectory for the motor vehicle from the plurality of model trajectories for the motor vehicle, which trajectory is intended to be followed by the motor vehicle in a further course of its journey, updating the information relating to the current driving situation of the motor vehicle and/or the environmental data provided, and adapting the trajectory for the motor vehicle using a target function and based on the updated environmental data provided and/or based on the updated information relating to the current driving situation of the motor vehicle.
12. (canceled)
13. The control method of claim 11, wherein the updated environmental data is provided in the form of continuous values.
14. The control method of claim 13, wherein the continuous values are in the form of quasi-continuous values and wherein the method further comprises assigning a measurement of time to each of the values and organizing the quasi-values according to the measurement of time.
15. The control method of claim 11, wherein information related to the current driving situation of the motor vehicle is collected in the form of discrete sampling values.
16. The control method of claim 15, wherein the discrete sampling values are determined as nodes and the nodes are used to determine a connected graph.
17. The control method of claim 11, wherein determining information relating to the current driving situation of the motor vehicle further comprises determining the lateral distance of the longitudinal axis of the motor vehicle from a lane marking.
18. The control method of claim 11, wherein determining information relating to the current driving situation of the motor vehicle further comprises determining the longitudinal distance and/or relative speed between the motor vehicle and a further motor vehicle.
19. The control method of claim 11, wherein the determining at least one component of a future driving maneuver for the motor vehicle involves lane-keeping and/or braking.
20. The control system of claim 1, wherein the at least one environmental sensor comprises a plurality of environmental sensors, a first environmental sensor facing forward in the direction of travel of the motor vehicle, a second environmental sensor facing forward in the direction of travel of the motor vehicle, and a third environmental sensor on one of the side or rear of the motor vehicle.
21. The control system of claim 20, wherein the first environmental sensor is positioned in one of a front fender, front light or a front radiator grille of the motor vehicle.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0056] Further aims, features, advantages and possible uses emerge from the following description of exemplary embodiments, which should not be understood in a restrictive manner, with reference to the associated drawings. In this case, all features described and/or illustrated in the drawing, alone or in any desired combination, show the subject matter disclosed here. The dimensions and proportions of the components shown in the figures are not to scale here. Identical or identically acting components are provided with the same reference signs.
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
DETAILED DESCRIPTION
[0065] Within the scope of the following disclosure, certain aspects are described primarily with reference to an exemplary arrangement of a control system. However, it is understood that the aspects described in connection with the control system are also valid within the scope of exemplary arrangements of a disclosed control method which can be carried out, for example, by a central control apparatus (ECU) of a motor vehicle. The disclosed control method can be carried out by performing suitable read and write access to a memory assigned to the motor vehicle. The control method can be implemented inside the motor vehicle both using hardware and using software as well as a combination of hardware and software. These elements also include digital signal processors, application-specific integrated circuits, field programmable gate arrays and further suitable switching and computing components.
[0066]
[0067]
[0068] At least one additional or alternative environmental sensor 16 which likewise faces forward in the direction of travel of the motor vehicle 12 may be provided. In one exemplary arrangement, environmental sensor 16 is illustrated in the region of a windshield of the motor vehicle 12. For example, this environmental sensor 16 may be arranged between an internal rear-view mirror of the motor vehicle 12 and its windshield. Such an environmental sensor 16 captures a region 24 in front of the motor vehicle 12, wherein, depending on the shape of the motor vehicle 12, a region 24 directly in front of the motor vehicle 12 cannot be captured on account of the front section (or its geometry) of the motor vehicle 12.
[0069] Furthermore, at least one environmental sensor 18 may be arranged on the side and/or on the rear of the motor vehicle 12. This optional environmental sensor 18 captures a region 26 which may be to the side of the motor vehicle 12 and/or behind the motor vehicle 12 in the direction of travel of the motor vehicle 12. For example, the data or signals from this at least one environmental sensor 18 can be used to verify information captured by the other environmental sensors 14, 16 and/or to determine a curvature of a lane being used by the motor vehicle 12.
[0070] The at least one environmental sensors 14, 16, 18 can be implemented in any desired manner and may comprise a front camera, a rear camera, a side camera, a radar sensor, a lidar sensor, an ultrasonic sensor and/or an inertial sensor. For example, the environmental sensor 14 can be implemented in the form of a front camera, a radar sensor, a lidar sensor or an ultrasonic sensor. A front camera, in particular, is suitable for the higher environmental sensor 16, whereas the environmental sensor 18 arranged in the rear of the motor vehicle 12 can be implemented in the form of a rear camera, a radar sensor, a lidar sensor or an ultrasonic sensor.
[0071] The electronic controller ECU processes environmental data obtained from the environmental sensor(s) 14, 16, 18 on the motor vehicle 12 in order to obtain information relating to a static environment (immovable environment objects, for example road boundaries, lane markings, stationary obstacles) and a dynamic environment (movable environment objects, for example other moving motor vehicles or road users) of the motor vehicle 12.
[0072] The electronic controller therefore processes the environmental data obtained from the environmental sensor(s) 14, 16, 18 on the motor vehicle 12 in order to capture a lane which is being used by the motor vehicle 12 and has a first and a second lateral lane boundary in front of the motor vehicle 12. The electronic controller ECU additionally processes the environmental data obtained from the environmental sensor(s) 14, 16, 18 on the motor vehicle 12 in order to capture a lane (which is adjacent to the lane being used by the subject vehicle, wherein adjacent means that there may also be one or more further lanes between the adjacent lanes) being used by a further road user, for example another motor vehicle, and its lateral lane boundary is in front of the motor vehicle 12. The other motor vehicle or the further road user may either be stationary or may be moving in or counter to the direction of travel of the motor vehicle 12.
[0073] For this purpose, the environmental sensors 14, 16, 18 provide the electronic controller ECU with the environmental data representing the region in front of, laterally beside and/or behind the vehicle. For this purpose, the control system 10 is connected to the at least one environmental sensor 14, 16, 18 via at least one data channel or bus (illustrated using dashed lines in
[0074] Alternatively or additionally, the control system 10 or its electronic controller ECU can also receive data from one or more other assistance systems 20 (also called driver assistance system 20 below) or another controller 20 of the motor vehicle 12, which data indicate the lanes being used by the subject motor vehicle 12 and by further road users with the lateral lane boundaries thereof or can be derived therefrom. Data and information already determined by other systems can therefore be used by the control system 10.
[0075] Furthermore, the control system 10 or its electronic controller ECU determines a driving situation using the environmental sensors, that is to say on the basis of the environmental data obtained with the aid of the at least one environmental sensor 14, 16, 18. In this case too, an already existing driver assistance system 20 or an electronic controller 20 can alternatively or additionally provide data and/or information which define a driving situation or from which a driving situation can be quickly derived. Depending on the determined driving situation, at least one possible trajectory is then determined, which trajectory is intended to be followed by the motor vehicle 12 in the further course of its journey. This trajectory is adapted substantially in real time to changes in the current driving situation of the motor vehicle 12; in other words, the trajectory is optimized.
[0076] The driver assistance system 20 or the electronic controller 20 may also be configured and intended to control the motor vehicle in a (partially) autonomous manner. In this case, the control system 10 is configured and intended to output data for autonomous driving to the driver assistance system 20 or the electronic controller 20. In particular, the control system 10 (or its ECU) can output data, which indicates a course of the determined trajectory and/or of the adapted trajectory which is intended to be followed by the motor vehicle 12 in the further course (which, for example, begins immediately after adaptation or with the end of the current driving situation), to the component 20. The data may likewise be transmitted via a data channel or bus in a wired manner or wirelessly.
[0077] The approach to planning and adapting the trajectory for the motor vehicle 12 in real time, as presented within the scope of this disclosure, is based on a combination of discrete (sampling) values and continuous values (or at least quasi-continuous values) of the environmental data made available to the control system 10.
[0078] In the upper image in
[0079] For the convoy of the motor vehicle 12 in the upper illustration in
[0080] Furthermore, the information relating to the current driving situation of the motor vehicle 12 may comprise a distance between the motor vehicle 12 and the motor vehicle 28 and/or a relative speed between the motor vehicle 12 and the motor vehicle 28 and/or a relative acceleration between the motor vehicle 12 and the motor vehicle 28. The distance, the relative speed and the relative acceleration may in turn be lateral and/or longitudinal distances, relative speeds and/or relative accelerations. In order to determine foregoing, the control system 10 can determine lateral and longitudinal distances to the other motor vehicle 28 and lateral and longitudinal speeds and accelerations of the other motor vehicle 28, for example on the basis of the environmental data provided by the at least one environmental sensor(s) 14, 16, 18, and can relate them to the lateral and longitudinal speeds of the motor vehicle 12.
[0081] In the upper image in
[0082] In this case, the selection is made, for example, using a target function, inter alia on the basis of specifications for the driving comfort and safety of the driver of the motor vehicle 12. In the example in the upper illustration of
[0083] For high dimensions of the state space, finding the best possible solution in the current driving situation may result in inefficiently high computing times of the control systems used for this. Therefore, it may be necessary to find a compromise between finding the (globally) best possible solution in the current driving situation of the motor vehicle 12 and the computing time used for this purpose, since an increasing number of discrete sampling values and an increasing number of model trajectories to be determined and finally the selection of the best possible trajectory from these model trajectories increase the necessary computing time. On the other hand, there is the risk of too few resources being available in conventional control systems to actually process such a volume of data or at least to process it efficiently. Furthermore, the consideration of the dynamic vehicle environment and the inclusion of a temporal component can increase the computing complexity and therefore the computing time.
[0084] In order to obtain faster solutions in this respect, continuous planning or optimization approaches can be used, for example. A diagram of such an approach is shown in the lower illustration in
[0085] Within the scope of the present disclosure, the control system 10 is configured and intended to combine the discrete planning and optimization approach presented above with the continuous planning and optimization approach presented above in order to plan and optimize the trajectory which is intended to be followed by the motor vehicle 12 in the further course of its journey. In other words, the control system 10 uses a hybrid planning and optimization approach in order to determine the best possible trajectory for the future course of the journey of the motor vehicle 12 and to adapt it at least substantially in real time (online) to the current driving situation of the motor vehicle 12. The individual discrete and continuous planning and optimization approaches to be combined are not restricted in this case to the examples described above with reference to
[0086]
[0087] If it emerges, for example when analyzing the current driving situation of the motor vehicle 12 by means of the control system 10, that an overtaking operation must be initiated because another motor vehicle driving in front of the motor vehicle 12 brakes severely, the maneuver preselection may involve a lane change. Generally, at least the maneuvers of a lane change and lane-keeping may be included in a set of basic maneuvers, from which the maneuver preselection is made.
[0088]
[0089] On the basis of the lateral maneuver component determined, a longitudinal maneuver or a longitudinal maneuver component is then determined in the present example. However, it is understood that the present disclosure is not restricted thereto. For example, the lateral maneuver component and the longitudinal maneuver component can alternatively also be determined independently of one another by the control system 10. In the present case, however, as illustrated in the right-hand illustration of
[0090] Referring to
[0091] The sampling-based trajectory planner first of all generates discrete sampling states which are composed of discrete longitudinal values (in the direction of travel of the motor vehicle 12) and discrete lateral values (transverse to the direction of travel of the motor vehicle 12). In other words, in this planning phase, the sampling-based trajectory planner of the control system 10 sets lateral and longitudinal states which are then used when generating the trajectories. These lateral and longitudinal states may but need not correspond to the lateral and longitudinal maneuver components described with reference to
[0092] The trajectory processing likewise also takes place on the trajectory planning level. Here, the discrete lateral and longitudinal states or the lateral and longitudinal maneuver components or a combination of these lateral and longitudinal states or maneuver components are used, for example, as stopping points of one or more model trajectories which are generated as part of the trajectory generation in
[0093] Optionally and therefore indicated with a dotted rectangle in
[0094] Finally, as part of the trajectory selection shown in
[0095] Target states which relate to the dynamic environment and the static environment of the motor vehicle 12 in the current driving situation as well as the driving comfort and the feasibility of the model trajectories and/or the trajectory selected therefrom are included in the target function, for example. One or more target states may be, for example, a point on the current road (or in an adjacent lane) of the motor vehicle 12 in the lateral and/or longitudinal direction, possibly paired with one or more time instances.
[0096] As shown in
[0097] The optimization and adaptation data obtained as a result in real time are suitably combined with the data provided by the sampling-based trajectory planner and are checked as part of an evaluated maneuver hypothesis. The latter is enabled by including the data obtained during the online trajectory adaptation. The respective data can also be individually made available to a module of the control system 10 for checking the maneuver hypothesis.
[0098] On the basis of the evaluated maneuver hypothesis, a maneuver selection is made on the decision-making level, for example by a decision-making module of the control system 10. Here, the same maneuvers as already described above with reference to the maneuver preselection can but need not be available for selection. The selected maneuver and the data corresponding to this maneuver are then in turn supplied to the sampling-based trajectory planner on the planning level. In addition, data obtained as part of the maneuver preselection can be included in the maneuver selection here.
[0099] The sampling-based trajectory planner repeats the above-described operations of generating sampling states, including the setting of lateral and longitudinal states and/or lateral and longitudinal maneuver components, and processing the trajectories, including the trajectory selection and possibly the shortened (pre)optimization of the model trajectories and the trajectory selection.
[0100] The selected trajectory (called the starting trajectory in
[0101] The data from the trajectory optimization carried out in real time from
[0102] This optimization operation is now described again with reference to
[0103] As is clear from
[0104] The vehicle state and environmental information relating to the dynamic vehicle environment are then updated, see
[0105] On account of the above-described architecture, in interaction with the discrete and continuous planning and optimization approaches presented, the result is a hybrid planning and optimization approach for the trajectory for the motor vehicle 12, which hybrid planning and optimization approach combines these approaches and combines the advantages of the two approaches and compensates for or at least reduces the disadvantages of the two approaches.
[0106] As shown in
[0107] If a trajectory other than the trajectory 38′ is intended to be adapted to the currently prevailing driving situation with the aid of the continuous optimization approach, there is again a need for initialization, that is to say reinitialization, of the continuous optimization approach on the basis of the data determined for this other trajectory as part of the discrete planning approach. Reinitialization may also be required when a planning and optimization cycle associated with a particular time instance t has ended and the data relating to the system state of the motor vehicle 12 and/or the environmental data have been updated. The reinitialization is then the initialization of the subsequent planning and optimization cycle which begins, for example, at the time t+Δt and takes place in the same manner.
[0108] For example, for the initialization and/or reinitialization, starting states and/or end states for the trajectory 38′ to be adapted, possibly together with temporal information relating to when these starting states and/or end states are reached, are transferred as data to the planning module for carrying out the continuous planning approach. The starting states and/or end states are generally therefore points in the lateral and longitudinal directions on the road 36 relating to a time instance t (starting state) and t+Δt (end state). Within the scope of the optimization, that is to say the adaptation of the trajectory 38′ to the current driving situation of the motor vehicle 12, the control system 10 uses the continuous approach, which is initialized or reinitialized by means of particular data from the discrete approach, to compare, for example, particular (interpolated) points (see the interpolated states in the lower illustration in
[0109] A further exemplary driving situation in which the hybrid planning and optimization approach of the present disclosure is used is now described with reference to
[0110] In the example which is presented here but should not be understood in a restrictive manner, the determination of the trajectories in the upper illustration of
[0111] The scenario taking place in
[0112]
[0113] In a first step S10, information relating to the current driving situation of the motor vehicle 12 is determined.
[0114] This information may be, inter alia, the lateral distance of the longitudinal axis of the motor vehicle 12 from the left-hand lane marking 32 or the right-hand lane marking 30 and/or the longitudinal distance and/or a relative speed between the motor vehicle 12 and the other (further) motor vehicle 28.
[0115] In a second step S12, a component of a future driving maneuver for the motor vehicle 12 is determined on the basis of the information relating to the current driving situation of the motor vehicle 12. If the motor vehicle 12 is approximately in the center of the currently used lane (the right-hand lane of the road 36 from
[0116] In a third step S14, a plurality of model trajectories for the motor vehicle 12 are determined on the basis of the determined component of the future driving maneuver for the motor vehicle 12. The plurality of determined model trajectories are indicated in the upper illustration in
[0117] In a fourth step S16, a trajectory for the motor vehicle 12 is determined from the plurality of model trajectories, which trajectory is intended to be followed by the motor vehicle 12 in the further course of its journey. In this case, certain model trajectories are excluded, for example, on account of dynamic and static collision checks with regard to movable and immovable objects and/or obstacles in the environment of the motor vehicle 12 that are carried out by the control system 10 on the basis of the environmental data provided, and the best possible trajectory for the motor vehicle 12 is therefore determined. It can be seen in the upper illustration in
[0118] It can finally be seen in the lower illustration in
[0119] In a fifth step S18, the information relating to the current driving situation of the motor vehicle and/or the environmental data provided is updated.
[0120] In a sixth step S20, the trajectory for the motor vehicle 12 is adapted using a target function (for example the target function described above) and on the basis of the updated environmental data provided and/or on the basis of the updated information relating to the current driving situation of the motor vehicle 12. Based on the driving situation from
[0121] The planning and optimization approach described above can be used, in particular, within the scope of adapting the trajectory in order to optimize at least the changing part of the trajectory and to find an even more efficient solution for the best possible trajectory which increases the driving comfort and the driving safety of the occupants of the motor vehicle 12 in the current traffic situation.
[0122] Within the scope of this disclosure, combining the discrete, for example graph-based, approach for ascertaining and determining the model trajectories or selecting the trajectory for the further course of the journey of the motor vehicle 12 with the continuous approach for optimizing the selected trajectory makes it possible to at least reduce the inherent disadvantages of the two approaches. For example, the number of required discrete sampling values for determining the model trajectories for the sampling-based trajectory planner can be significantly reduced in comparison with the use of a merely discrete planning and optimization approach on account of the subsequent continuous adaptation which is (re)initialized with the results of one or more model trajectories.
[0123] As a result of the maneuver preselection on the decision-making level before the beginning of the trajectory planning by the sampling-based trajectory planner, the number of discussed discrete sampling values can also be reduced further.
[0124] An efficient (because it can be carried out quickly and saves resources) and robust planning and optimization approach is therefore provided overall for the trajectory which is intended to be followed by the motor vehicle 12 in the further course of its journey.
[0125] Exemplary embodiments explained above are not conclusive and do not restrict the subject matter disclosed here. In particular, a person skilled in the art would understand that the features of the various embodiments may be combined with one another and/or various features of the embodiments may be omitted without departing from the subject matter disclosed here.