CONTROL SYSTEM AND METHOD ADJUSTED TO PERCEPTION
20240010200 · 2024-01-11
Assignee
Inventors
- David GONZALEZ BAUTISTA (Saint Cyr l'école, FR)
- Imane MAHTOUT (Guyancourt, FR)
- Vicente MILANES (Guyancourt, FR)
- Francisco Martin NAVAS MATOS (Vanves, FR)
Cpc classification
B60W30/16
PERFORMING OPERATIONS; TRANSPORTING
B60W2420/403
PERFORMING OPERATIONS; TRANSPORTING
B60W50/06
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60W30/16
PERFORMING OPERATIONS; TRANSPORTING
Abstract
A system controls a vehicle. The vehicle implements at least one control application using a variable measured by at least one sensor of a perception system installed in the vehicle. The control system includes an adaptive controller to dynamically activate one or more elementary controllers of a set of elementary controllers including at least two elementary controllers, each elementary controller can apply a control function of a vehicle parameter acting on actuators of the vehicle, the control functions being separate, based on a precision indicator of the perception system determined according to a real-time value of the variable.
Claims
1-10. (canceled)
11. A control system for controlling a vehicle the vehicle implementing at least one control application using a magnitude measured by at least one sensor of a perception system installed on the vehicle, the control system comprising: an adaptive controller configured to dynamically activate one or more elementary controllers of a set of elementary controllers comprising at least two elementary controllers, each elementary controller being configured to apply a control function for controlling a parameter of the vehicle by acting on actuators of the vehicle, the control functions being separate, based on a precision indicator of the perception system determined according to a real-time value of said magnitude.
12. The control system as claimed in claim 11, further comprising a corrector configured to generate a permutation signal, and a value of the permutation signal varies according to said precision indicator.
13. The control system as claimed in claim 12, wherein the value of the precision signal varies between a first value representing an optimum level of precision of the perception system and a second value representing a minimum level of precision of the perception system.
14. The control system as claimed in claim 13, wherein the first value is equal to one and the second value is equal to zero.
15. The control system as claimed in claim 13, wherein the elementary controllers comprise a first elementary controller and a second elementary controller, and when the precision indicator has the first value then the permutation signal is updated to a first signal value, the first controller being completely activated in response to the update of the permutation signal.
16. The control system as claimed in claim 13, wherein when the precision indicator of the perception system has the second value then the permutation signal is updated to a second signal value, the second elementary controller being completely activated in response to the update of the permutation signal.
17. The control system as claimed in claim 11, wherein the magnitude is a magnitude from among a velocity of the vehicle, an inter-vehicle distance between said vehicle and a head vehicle, and a yaw velocity of said vehicle.
18. The control system as claimed in claim 11, wherein the first controller is a vehicle tracking controller and the second controller is a noise rejection controller.
19. The control system as claimed in claim 11, wherein said control applications use a plurality of magnitudes measured by at least two sensors of the perception system, the control device comprising a switch for selecting a magnitude from among said magnitudes, the adaptive controller being applied to said selected magnitude by using the activated elementary controllers.
20. A control method for controlling a vehicle that is carried out in said vehicle, the vehicle implementing at least one control application using a magnitude measured by at least one sensor of a perception system installed on the vehicle, method comprising: selecting at least one elementary controller from among a set of elementary controllers comprising at least two elementary controllers, each elementary controller being configured to apply a control function for controlling a parameter of the vehicle by acting on actuators of the vehicle, the control functions being separate, based on a precision indicator of the perception system determined according to a real-time value of said magnitude; and activating said at least one selected elementary controller.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0034] Other features, details and advantages of the invention will become apparent on reading the description provided with reference to the appended drawings, which are given by way of example and in which, respectively:
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
DETAILED DESCRIPTION
[0044]
[0045] The control device 11 can be configured to assist the driver in performing complex driving operations or maneuvers, detecting and avoiding dangerous situations and/or limiting the impact of such situations on the vehicle 1. The ego vehicle 1 can detect the environment outside the vehicle by virtue of the data received from the sensors 20 of the perception system 2, on the basis of which it is able to build and update an internal model of the configuration of the environment.
[0046] The control device 11 implements at least one control application 110 using a magnitude G measured by at least one sensor 20 of the perception system 2. The control system 100 is advantageously configured to adapt the response of the vehicle 1 according to the level of precision of the perception system 2.
[0047] The control application 110 may be, for example, a vehicle tracking application configured to control the velocity of the vehicle 1 according to the velocity of the vehicle, the velocity of a vehicle in front and/or the velocity of a vehicle behind.
[0048] The control application 110 may be, for example, a velocity-regulating application ACC. An ACC-type application can use a radar system using radar sensors 20 in order to estimate the velocity difference between two vehicles following one another, the radar being arranged on the front of the ego vehicle 1, for example.
[0049] The control device 11 advantageously comprises an adaptive controller 112 configured to dynamically activate one or more elementary controllers from among a set of elementary controllers 1120 comprising at least two elementary controllers. Each elementary controller 1120 is configured to apply a control function for controlling a parameter by acting on actuators of the vehicle (not shown). The control functions of the various elementary controllers 1120 may be separate. The control function depends on a precision indicator of the perception system determined according to a real-time value of the measured magnitude G used by the control application 110.
[0050] The sensors 20 of the perception system 2 can include various types of sensors, such as for example, and without limitation, one or more lidar (laser detection and ranging) sensors, one or more radar systems, one or more cameras, which may be cameras operating in the visible range and/or cameras operating in the infrared range, one or more ultrasonic sensors, one or more steering wheel angle sensors, one or more wheel speed sensors, one or more brake pressure sensors, one or more yaw velocity and transverse acceleration sensors, etc.
[0051] The perception system 2 can be configured to detect and/or identify, on the basis of the information measured by the sensors 20, objects in the environment of the ego vehicle 1 and pedestrians, vehicles and/or road infrastructures. The objects in the environment of the ego vehicle can comprise fixed or mobile objects. Examples of objects in the environment of the ego vehicle include, without limitation, vertical objects (for example traffic lights, road signs, etc.) and/or horizontal objects (for example road marking lines, signaling marking lines such as stops or yield lines).
[0052] The perception system 20 carries out vehicle perception processing in order to establish spatial and temporal relationships between the vehicle and static and mobile obstacles in the environment. This perception processing can comprise in particular simultaneous localization and mapping (SLAM) methods involving modelling static parts, and/or detection and tracking of moving objects (DATMO) methods involving modelling mobile parts in the environment.
[0053] The perception system 2 can also implement fusion algorithms in order to process the information from the various sensors 20 and implement one or more perception operations, such as for example tracking and predicting the progression of the environment of the ego vehicle 1 over time, generating a map in which the ego vehicle 1 is positioned, locating the ego vehicle on a map, etc.
[0054] Multisensor fusion algorithms can combine information from the various sensors 20 in order to determine one or more magnitudes, of such magnitudes as to then be used by the perception system 2 in order to perform perception methods such as for example detecting and/or tracking obstacles, and/or determining the global localization of the ego vehicle 1 that uses merging of data from a positioning system, such as for example a GNSS (acronym for Global Navigation Satellite System) satellite positioning system.
[0055] The perception system 2 can be associated with perception parameters that can be defined offline by calibrating the performance of the perception system 2 according to the installed sensors 20.
[0056]
[0057] The ego vehicle 1 travels on a road 5 comprising three traffic lanes 50. The vehicle 1 is fitted with a set of sensors 20 belonging to the perception system 2.
[0058] In the environment 300 in
[0059] The ego vehicle 1, the follower vehicle 4 and/or the head vehicle 3 may advantageously be autonomous connected vehicles.
[0060] The control application 110 can thus control the velocity v of the vehicle 1 according to the velocity of the vehicle in front 3 and/or the velocity of the vehicle behind 4, and/or the gap d between the ego vehicle 1 and the vehicle in front 3 and/or the gap between the ego vehicle 1 and the vehicle behind 4.
[0061] A control application 110 of vehicle tracking application type is able, for example, to control the driving of the ego vehicle 1 by comparing the gap d with a minimum inter-vehicle distance (safety gap), and/or comparing the inter-vehicle time, defined as being equal to the ratio between the gap d and the velocity v of the ego vehicle 1, with a minimum inter-vehicle time (also called the reference time). The control application 110 can also regulate the relative velocity between the ego vehicle 1 and the vehicle in front 3 in order to keep it at substantially zero. A control application implementing vehicle tracking can also apply a control law in order to keep the inter-vehicle distance (ego/front) at a target value. The gaps can follow a reference model defined in relation to a predefined collision zone.
[0062] The inter-vehicle distance can, for example, be measured by means of a LIDAR-type sensor 20 (laser telemetry), or by using two cameras installed on either side of the windshield of the vehicle.
[0063] The velocity of the ego vehicle 1 can, for example, be determined by using an odometer-type sensor.
[0064] The longitudinal and lateral accelerations of the vehicle 1 can, for example, be determined by using an inertial measurement unit.
[0065] In some embodiments, the yaw, roll and pitch velocities of the vehicle 1 can be determined using gyroscopes.
[0066] In one embodiment, the magnitude G used by the control application 110 may be a magnitude chosen from among the velocity of the vehicle, the inter-vehicle distance between the ego vehicle 1 and the head vehicle 3, and the yaw velocity of the ego vehicle 1.
[0067]
[0068] In one embodiment, the control device 11 also comprises a corrector 114 configured to generate a permutation signal , the value of which varies according to the precision indicator.
[0069] In one embodiment, the selected elementary controllers comprise a first elementary controller 1120-A and a second elementary controller 1120-B, at least one of the elementary controllers being activated according to the value of the precision indicator.
[0070] In one embodiment, if the precision indicator has a first value representing an optimum perception precision then the permutation signal is updated by the controller 11 to a first signal value and the first elementary controller 1120-A is completely activated in response to the update of the permutation signal.
[0071] Otherwise, if the precision indicator of the perception system has a second value representing imprecise perception then the permutation signal is updated to a second signal value by the controller 114 and the second elementary controller 1120-B is completely activated in response to the update of the permutation signal.
[0072] In one embodiment, the first controller 1120-A (also denoted by CD1) is a vehicle tracking controller and the second controller 1120-B is a noise rejection controller (also denoted by CD2). The noise rejection controller is a controller configured to reject any noise having a frequency exceeding the bandwidth specified for the control system, including perception noise rejection.
[0073] In one embodiment, the control application 110 uses a plurality of N magnitudes G.sub.1, G.sub.2, . . . , G.sub.N measured by at least two sensors 20 of the perception system 2. The control device 11 can then comprise a switch 115 in order to select a magnitude from among the N magnitudes G.sub.1, G.sub.2, . . . , G.sub.N, the adaptive controller 112 being applied to the selected magnitude by using the activated elementary controllers 1120.
[0074]
[0075] In such embodiments, the control device 11 can comprise a calibration unit 113 in order to calibrate the perception parameters. The calibration unit 113 can use a lookup table associating with each object distance a velocity of the vehicle in front 3 and an imprecision parameter representing the level of imprecision of a given measured magnitude G. The magnitude associated with the imprecision parameter may be, for example, a dynamics magnitude relating to the vehicle such as the velocity, the distance, the yaw velocity of the vehicle, etc. The lookup table (also called the calibration table) may be, for example, a three-dimensional (3D) table.
[0076] Offline calibration of the vehicle can be used to define a set of design parameters specific to the performance of the vehicle. Thus, the control system 100 can use a level of imprecision specified at the time of the design of the performance of the vehicle 1.
[0077] In the example in
[0078] Thus, in this exemplary embodiment, the adaptive controller 112 can activate the standard production system elementary controller 1120-A and/or the elementary controller adapted to the control application 1120-B according to the precision indicator.
[0079] For example, it is assumed that the control device 11 comprises a control application 110 controlling velocity changes between two values, for example between 0 and 10 m/s, and that the imprecision of the perception system 2 is similar to that shown in
[0080] At its input, the control device 11 uses the perception magnitude G obtained in real time from the perception system 20, on which the control application 110 depends. For example, in the example in which the control application 110 controls velocity changes between two values, the input perception magnitude G may be the velocity of the vehicle in front in real time. The perception magnitude G can be transmitted to a performance impairment unit 116 configured to determine a state of the installed performance system. The output of the performance impairment unit 116 and the output of the elementary controllers 1120 can then be applied to a real-time vehicle performance adapter 19 configured to apply adaptive control in real time.
[0081] The real-time vehicle performance adapter 19 can comprise a processing unit adapted to perception 112 that is configured to fusion the two output data items from the elementary controllers 1120-A and 1120-B, which provides fusioned control data, into a single stable structure comprising the fusioned control data. The real-time vehicle performance adapter 19 can also comprise a response corrector 114 configured to adapt the performance of the vehicle 1 according to the fusioned control data.
[0082] The control device 11 according to the embodiments of the invention can thus be used to dynamically adapt the response of the vehicle to the impairment of the perception, by maximizing the performance of the vehicle vis--vis the precision of the perception while maintaining stability.
[0083] The control device 11 according to the embodiments of the invention is configured to constantly progress between the different elementary controllers 1120, comprising, in the example, the two elementary controllers 1120-A (C.sub.1) and 1120-B (C.sub.2), each elementary controller being defined according to a specific control design criterion.
[0084] In particular, in one exemplary embodiment, the first elementary controller C.sub.1 (1120-A) can be configured to comply with maximum tracking performance CD1, while the second elementary controller C.sub.2 (1120-B) can be configured to comply with maximum perception noise rejection CD2.
[0085] In one embodiment, the response corrector 114 can be configured to generate a permutation signal , the value of which can vary between zero (0) and one (1) according to the precision indicator, which represents the level of precision of the perception in real time, the precision indicator being determined by the adaptive controller 112. In one embodiment, the precision indicator can take a value between two extreme values comprising a first extreme value, indicating an optimum level of precision (precise perception), and a second extreme value, indicating an impaired level of precision (imprecise perception).
[0086] In one embodiment, when it is determined that the perception magnitude G (which may, for example, be the velocity of the ego vehicle, the inter-vehicle distance, the yaw velocity of the ego vehicle, etc.) has a noiseless value and that the precision indicator of the perception system 2 has the first extreme value indicating an optimum perception precision, the permutation signal can be set to the value zero (=0) and the first elementary controller C.sub.1 (1120-A) is completely activated.
[0087] In one embodiment, it can be determined whether the perception magnitude has a noisy or noiseless value according to the velocity of the vehicle and the gap: the higher the velocity, the noisier the signals. As a variant, it can be determined whether the perception magnitude has a noisy or noiseless value by using the precision indicator relating to perception.
[0088] In other variants still, it is possible to use methods that allow the signals to be analyzed in terms of noise estimation.
[0089] The precision indicator can take values that change continuously over time. They can be represented by a quality value. Thus, the evaluation carried out by the performance impairment unit 116 can comprise determining the level of noise present in the signals, in real time and continuously. The possible values of the precision indicator can depend on the level of noise present in such signals.
[0090] When it is determined that the precision indicator of the perception system 2 has the second extreme value indicating imprecise perception, the permutation signal can be set to the value one (=1), and the second elementary controller C.sub.2 (1120-B) can be completely activated.
[0091] The value of the precision indicator may be binary or non-binary. In one exemplary embodiment, the two extreme values of the precision indicator comprising the first value representing precise perception and the second value representing imprecise perception may be binary, the two values then being linearly interpolated in order to provide intermediate values.
[0092] The permutation signal can gradually progress between the two extreme values of the permutation signal (=0 and =1) according to the values of the perception precision indicator. Thus, the permutation signal can be set to the value between 0 and 1 according to the value of the precision indicator between the two extreme values. The first elementary controller C.sub.1 (1120-A) and the second elementary controller C.sub.2 (1120-B) can then be partially activated according to the value of the perception signal.
[0093] Thus, the controller of the vehicle 112 can adapt to the actual operating conditions in real time.
[0094] It is worth noting that the elementary controllers C1 and C2 (1120-A and 1120-B) can be more generally configured according to predefined control criteria. In the example considered above, the two elementary controllers C1 and C2 are chosen so that the desired precision performance guarantees precise tracking vis--vis noise rejection. The control criteria may also be contradictory, which is not possible with a conventional single controller.
[0095]
[0096]
[0097] In the embodiment shown in
[0100] In this embodiment, the two elementary controllers C1 or C2 have the same number of inputs and outputs. More specifically, each controller has an input corresponding to the output of the vehicle model 120 and an output that can be applied to the input of the vehicle model 120 if it is selected by the switch 115.
[0101] In
[0102] In the parameterized control structure in
[0103] Referring to
[0104] The notations used below are conventional. The matrix forms can vary depending on the controllers involved.
[0105] In the description that follows, X.sub.2 and Y.sub.2 represent the matrices corresponding to C.sub.2, C.sub.2 being represented according to A, B, X.sub.1, Y.sub.1 and Q, which is the parameter of the controller calculated according to X.sub.2 and Y.sub.2.
[0106] Thus, the vehicle model is represented in a matrix form defined by relationship (1):
P.sub.veh=BA.sup.1=.sup.1{tilde over (B)}(1)
[0107] The elementary controller C.sub.1 is represented in a matrix form defined by relationship (2):
C.sub.1=Y.sub.1X.sub.1.sup.1={tilde over (X)}.sub.1.sup.1{tilde over (Y)}.sub.1(2)
[0108] The elementary controller C.sub.1 is represented in a matrix form defined by relationship (3):
C.sub.2=Y.sub.2X.sub.2.sup.1={tilde over (X)}.sub.2.sup.1{tilde over (Y)}.sub.2(3)
[0109] The parameterized adaptive controller 112 can then be represented by C(), defined by equation (4):
C()=(Y.sub.1+AQ).sup.1(X.sub.1+BQ)(4)
[0110] In equation (4), the matrix Q represents a stable adaptive matrix that can be used to change over from the elementary controller C.sub.1 to the elementary controller C.sub.2, and conversely from the elementary controller C.sub.2 to the elementary controller C.sub.1, which allows a stable interpolation between the two controllers by activating a part of each elementary controller according to the value of the permutation signal .
[0111] The stable adaptive matrix Q can be calculated using equation (5) below:
Q={tilde over (X)}.sub.2(C.sub.2C.sub.1)X.sub.1(5)
[0112] It is worth noting that the invention is not limited to the use of two elementary controllers but applies to any number N of elementary controllers Ci (1120) with [i=1; N].
[0113] The embodiments allow a stable interpolation (that is to say a stable transition) between the elementary controllers Ci. The interpolation can be performed using an arbitrary signal adapted for selecting the appropriate controller corresponding to the real-time operating conditions. Thus, the adaptive controller 112 allows the vehicle to be adapted to the operating conditions in real time while maintaining the stability of the system (i.e. the system does not increase the output if the input received is the same or less).
[0114]
[0115]
[0116] It can be seen in
[0117] As shown in
[0120] Adaptive control of this kind compromises tracking performance only very little vis--vis the design, and provides a completely different but stable response.
[0121]
[0122] The advantages of the controller adapted to perception 112 are even more clear at around 72 seconds, where it may be noted that the perception system 2 has significant imprecision when the velocity of the head vehicle is between 6 m/s and 10 m/s (in the tests performed, the velocity of the head vehicle is 8 m/s) within a short period of time. By using a controller C1, such imprecision is reproduced in the performance of the ego vehicle, whereas it is completely absorbed by the perception-based control system according to the embodiments of the invention.
[0123] The embodiments of the invention can thus be used to adapt the performance of the vehicle in real time depending on the imprecisions of the perception system 2, allowing very good control capabilities, such as vehicle tracking capabilities, and good disturbance rejection when required. It is therefore possible to optimize the performance of the vehicle in any situation.
[0124] The embodiments of the invention can thus be used to provide an adaptive control system 112 capable of adapting to various control objectives in real time.
[0125] The adaptive control system 1 can effectively adapt to imprecisions of the perception system (noise rejection) and adjust the response of the vehicle to a given scenario or driver.
[0126] In one exemplary embodiment, the adaptive control device 10 may be multisensor by providing a plurality of elementary controllers 1120 (more than two), each corresponding to a type of target performance, the driver being able to select the target performance according to his preferences, for example.
[0127] A multisensor function can thus be added to an ADAS- or AD-type control system, the invention being able to be used to adapt, change and parameterize the response of the control device 10 whatever the sensors. A plurality of elementary controllers 1120 can be implemented and activated/deactivated according to target criteria relating to driving comfort or user preferences.
[0128] The invention is not limited to one particular type of vehicle and applies to any type of vehicle (vehicle examples include, without limitation, automobiles, trucks, buses, etc.). Although not limited to such applications, the embodiments of the invention have a particular advantage for realization in autonomous vehicles connected by communication networks that allow them to exchange V2X messages.
[0129] A person skilled in the art will understand that the system or some subsystems according to the embodiments of the invention can be realized in different ways by way of hardware, software or a combination of hardware and software, in particular in the form of program code that can be distributed in the form of a program product, in various forms. In particular, the program code can be distributed using computer-readable media, which may include computer-readable storage media and communication media. The methods described in the present description can be in particular implemented in the form of computer program instructions executable by one or more processors in a computer computing device. These computer program instructions can also be stored in a computer-readable medium.
[0130] Moreover, the invention is not limited to the embodiments described above by way of nonlimiting example. It encompasses all realization variants that may be envisaged by those skilled in the art. In particular, a person skilled in the art will understand that the invention is not limited to particular types of sensors of the perception system 20, to a particular number or to particular types of elementary controllers.