Method for detecting an object in a surrounding region of a motor vehicle with the aid of an ultrasonic sensor with improved filtering of ground reflections, control device, ultrasonic sensor apparatus and motor vehicle
10859697 ยท 2020-12-08
Assignee
Inventors
Cpc classification
G06V20/58
PHYSICS
G01S7/53
PHYSICS
G01S15/876
PHYSICS
G06F2218/10
PHYSICS
G06F18/2415
PHYSICS
International classification
G01B17/00
PHYSICS
G01S7/53
PHYSICS
G01C22/00
PHYSICS
Abstract
A method for detecting an object in a surrounding region of a motor vehicle is disclosed. In each of a plurality of temporally sequential measurement cycles a raw signal is received, which describes an ultrasonic signal of an ultrasonic sensor reflected in the surrounding region, the raw signal is compared with a predetermined ground threshold value curve, and a signal component of the raw signal that is to be tracked which exceeds the ground threshold value curve is detected and assigned to the object, and the object is tracked in the measurement cycles on the basis of the detected signal component that is to be tracked, wherein to track the object after recognition of the signal component that is to be tracked, in the subsequent measurement cycles, signal peaks of the raw signal are detected, and an assignment to the object is checked for the detected signal peaks.
Claims
1. A method for detecting an object in a surrounding region of a motor vehicle, comprising: in each of a plurality of temporally sequential measurement cycles, receiving a raw signal that describes an ultrasonic signal of an ultrasonic sensor reflected from the object in the surrounding region; comparing the raw signal with a predetermined ground threshold value curve; detecting a signal component of the raw signal which exceeds the ground threshold value curve and assigning the signal component to the object; and tracking the object in the measurement cycles on the basis of the detected signal component, wherein to track the object after recognition of the signal component, in the subsequent measurement cycles, signal peaks of the raw signal are detected, and an assignment of the detected signal peaks to the object is checked, wherein for each signal peak, a first probability is determined that said each signal peak describes a reflection of the ultrasonic signal at the object, and a second probability is determined that said each signal peak describes an interfering signal, and wherein assignment of said each signal peak to the object is carried out with reference to the first probability and to the second probability.
2. The method according to claim 1, wherein to recognize the signal peaks, regions of the raw signal that exceed a predetermined noise threshold value curve and which exhibit a predetermined rise are determined independently of the predetermined ground threshold value curve.
3. The method according to claim 1, wherein a movement model that describes a movement of the object relative to the motor vehicle is determined, and the first probability is determined depending on the movement model.
4. The method according to claim 1, wherein respective amplitudes of the signal peaks are determined, and the first probability and the second probability are determined depending on the respective amplitudes.
5. The method according to claim 1, wherein the first probability is determined with reference to at least one predetermined probability density function for amplitudes of raw signals that describe reflections of ultrasonic signals at objects.
6. The method according to claim 1, wherein the second probability is determined with reference to at least one predetermined probability density function for amplitudes of raw signals that describe reflections of ultrasonic signals at a ground in the surrounding region.
7. The method according to claim 6, wherein for predetermined distances, the at least one probability density function is predetermined in each case, for said each signal peak a distance assigned to said each signal peak is determined, and the second probability for said each signal peak is determined with reference to the probability density function for the distance.
8. The method according to claim 6, wherein for an asphalted roadway and a gravel road, the at least one probability density function is predetermined in each case, and the second probability is determined depending on the type of the ground in the surrounding region.
9. The method according to claim 8, wherein the type of the ground in the surrounding region is determined in each measurement cycle on the basis of an assignment of the raw signal received to one of the at least one predetermined probability density function.
10. The method according to claim 1, wherein a check is made as to whether one of the signal peaks originates from a second echo of the ultrasonic signal reflected by the object, and when said one of the signal peaks describes the second echo, said one of the signal peaks is tracked as a second echo.
11. The method according to claim 10, wherein said one of the signal peaks is recognized as originating from the second echo when a distance that describes said one of the signal peaks has a predetermined spacing from a distance of the object.
12. A control device for a motor vehicle, the control device being configured to perform the method according to claim 1.
13. An ultrasonic sensor apparatus for a motor vehicle comprising the control device according to claim 12; and the ultrasonic sensor.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1) The invention is now explained in more detail with reference to preferred exemplary embodiments, and also with reference to the appended drawings.
(2) Here:
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
DETAILED DESCRIPTION OF THE INVENTION
(14) The same reference codes are given in the figures to identify elements that are identical and have the same functions.
(15)
(16) The driver assistance system 2 in turn comprises an ultrasonic sensor apparatus 3. The ultrasonic sensor apparatus 3 comprises at least one ultrasonic sensor 4. In the present exemplary embodiment, the ultrasonic sensor apparatus 3 comprises twelve ultrasonic sensors 4. Six ultrasonic sensors 4 are here arranged in a front region 6 of the motor vehicle 1, and six ultrasonic sensors 4 are arranged in a rear region 7 of the motor vehicle 1. The ultrasonic sensors 4 can, in particular, be mounted on the bumper of the motor vehicle 1. The ultrasonic sensors 4 can here, at least in certain regions, be arranged in appropriate recesses or openings in the bumper. It can also be provided that the ultrasonic sensors 4 are arranged hidden behind the bumper. In principle, the ultrasonic sensors 4 can also be arranged at other cladding parts of the motor vehicle 1. The ultrasonic sensors 4 can, for example, also be arranged at or hidden behind the doors of the motor vehicle 1.
(17) Raw signals 10 which describe at least one object 8 in a surrounding region 9 of the motor vehicle 1 can be made available with the aid of the respective ultrasonic sensors 4. An object 8 is illustrated in the present case in the surrounding region 9. An ultrasonic signal can be transmitted by any of the ultrasonic sensors 4 to determine the raw signal 10. After this, the ultrasonic signal reflected by the object 8 can again be received. A distance between the ultrasonic sensor 4 and the object 8 can then be determined on the basis of the transit time between the transmission of the ultrasonic signal and the reception of the ultrasonic signal reflected from the object 8. It can also be provided that the respective distances that are determined with different ultrasonic sensors 4 are taken into account. The relative distance between the motor vehicle 1 and the object 8 can thus be determined by means of trilateration. It can further be provided that the ultrasonic signal that was transmitted from one of the ultrasonic sensors 4 is received by a neighbouring ultrasonic sensor 4. This is also referred to as cross-measurement.
(18) The ultrasonic sensor apparatus 3 furthermore comprises an electronic control device 5 which is connected to the ultrasonic sensors 4 via a data line for data transmission. For the sake of clarity, the data line is not shown in the present case. The raw signals 10 determined with the respective ultrasonic sensors 4 can be transmitted over the data line to the control device 5. It can also be provided that the raw signal 10 is first processed within the respective ultrasonic sensor 4. The control device 5 can check with reference to the raw signals 10 whether the object 8 is located in the surrounding region 9, and at what position the object 8 is located in the surrounding region 9. This information can then be used by the driver assistance system 2 to give an output to the driver of the motor vehicle 1. It can furthermore be provided that the driver assistance system 2 manipulates a steering system, a braking system and/or a drive motor in order to manoeuvre the motor vehicle 1 at least semi-autonomously, depending on the at least one detected object 8.
(19)
(20) In comparison with this,
(21)
(22)
(23) It is thus clear that the recognition of the object 8, or the tracking of the object 8, cannot take place reliably purely on the basis of the comparison of the raw signal 10 with the ground threshold value curve 11. In the present case it is provided that a check is first made as to whether a signal component 14 to be tracked that exceeds the ground threshold value curve 11 is recognized. This signal component 14 to be tracked is then assigned to the object 8. For the further tracking of this object 8 in the subsequent measurement cycles, the raw signal 10 is then employed, independently of the ground threshold value curve 11. In each measurement cycle, the signal peaks 13 in the raw signal 10 can then be determined, and it is possible to check whether these signal peaks 13 can be assigned to the signal component 14 to be tracked or to the object 8.
(24) A so-called Probabilistic Data Association Filter (PDAF) is used in the present case for the assignment of the signal peaks 13 to the object 8. The basic idea behind the PDAF is to view the set of all possible associations as a partition of the universe, and to apply the theory of total probability in order to distribute the probability density function of a state as the weighted sum of the probability density functions of the state conditioned for each possible assignment. Each of these conditioned probability density functions can be estimated with the aid of a Kalman filter. A mixed distribution of probability density functions results from this, wherein, as a simplification which is used by the PDAF to reduce the number of the components of the sum, only the expectation and the covariance of this mixed distribution are tracked.
(25) A state x can here be defined for the tracked object 8. A set A={A.sub.i} of all possible assignments can, furthermore, be defined which also contains the possibility A.sub.0 that no measurement is correct, i.e. that only interfering signals (clutter) are present. These interfering signals can originate from ground reflections of the ultrasonic signal and/or from noise. The mixed distribution can then be determined on the basis of the theorem of total probability:
(26)
(27) In particular here, the state x.sub.i conditioned to A.sub.i can be considered, where the measurement originates from the object 8 and the other measurements are interfering data. The expectation and the covariance of this probability density function can be determined from this:
(28)
P.sub.i=E[(x{circumflex over (x)}.sub.i)(x{circumflex over (x)}.sub.i).sup.T/Z,A.sub.i]
(29) A measurement model can here also be defined:
y=Hx+q,(3)
where q describes a non-correlated noise having a mean value of zero and a known covariance Q. A number of assignments can, further, be made for a set Z={z.sub.i}.sub.i=1.sup.m of measurements m within an assignment window V. Taking a Kalman amplification K into account, this yields:
x.sub.i=x+Kv.sub.i
v.sub.i=Hxz.sub.i(4)
(30) The expectation and the covariance from equation (2) can then be expressed as follows:
(31)
(32) The detection probability P.sub.D and the probability P.sub.G for exceeding a gate are, furthermore, defined. Making the assumption of a diffuse distribution of the interfering signals, the weightings for the mixed distribution can be calculated as follows:
(33)
(34) In addition, amplitude information a.sub.i can be added to the position measurement y.sub.i.
(35)
(36) Here, a first probability P.sub.i.sup.(a.sub.i) describes how probable it is that the measurement with the amplitude a.sub.i, which exceeds the threshold value , is a correct measurement, and a second probability P.sub.0.sup.(a.sub.j) describes how probable it is that the measurement with the amplitude a.sub.j, which exceeds the threshold value , is interfering data. A PDAF which takes additional information related to the amplitude into account is thus used to track the object 8. Such a filter can also be referred to as a PDAFAI. A PDAFAI with the weightings) .sub.i can then be determined from this:
(37)
(38) The PDAFAI can be used to track echoes from the ultrasonic sensor 4. The state x=[d, v].sup.T is defined for this purpose, wherein d is the distance from the object 8, and v describes the speed relative to the object 8. The state then follows the standard movement model:
(39)
(40) Here, U is the variance of the noisy acceleration, and t is the time between two steps. Taking into account the fact that Q is the variance of the noise of the measured distance, the measurement model can be determined as follows:
(41)
(42) Allowance is also made for the fact that the distribution of the interfering signals changes depending on the distance. The ultrasonic sensor 4 scarcely receives any reflections of the ultrasonic signal from the ground at relatively small distances and at relatively large distances. The interfering signals here result from the noise of the electronics of the ultrasonic sensor 4. At a medium distance range, which can have a distance of about 1 m from the ultrasonic sensor 4, the interfering signals are caused by the reflections of the ultrasonic signal from the ground. In the same way the amplitude of the raw signal will fall, depending on the distance. It is therefore provided that P.sub.1.sup.(a.sub.i/y.sub.i) and P.sub.0.sup.(a.sub.j/y.sub.j) are defined, and not P.sub.1.sup.(a.sub.i) and P.sub.0.sup.(a.sub.j). The common distributions P(y.sub.i,a.sub.i/A.sub.i,a.sub.i>)=P(a.sub.i/y.sub.i,A.sub.i,a.sub.i>)P(y.sub.i/A.sub.i)=P.sub.1.sup.(a.sub.i/y.sub.i)P(y.sub.iA.sub.i) should also be determined, and P(y.sub.j,a.sub.j/A.sub.i, a.sub.j>)=P(a.sub.j/y.sub.j,A.sub.i,a.sub.j>)P(y.sub.j/A.sub.i)=P.sub.0.sup.(a.sub.j/y.sub.j)P(y.sub.j/A.sub.i) in the same way.
(43) The first probability P.sub.1.sup.(a.sub.i/y.sub.i) and the second probability P.sub.0.sup.(a.sub.j/y.sub.j) can be calculated if the probability density functions of the amplitudes, conditioned for the distance, are known:
(44)
(45) A very simple, weak model is used for the reflection of the ultrasonic signal from an object 8. In the present case, all types of objects 8 should be covered with the help of the filter. This applies both to objects 8 that reflect the ultrasonic signal very strongly, through to objects 8 that only reflect the ultrasonic signal very weakly. It is not possible here to define the object 8 that reflects the ultrasonic signal most weakly. An object 8 that reflects the ultrasonic signal most strongly, however, is known, namely a wall. For that reason, a maximum amplitude A.sub.max, which describes the reflection from a wall, is defined for the reflected ultrasonic signal. This applies to relatively short, medium and relatively long distances. It is assumed here, that the amplitude can occur with a value between 0 and A.sub.max. In this case, A.sub.max is the even distribution between 0 and A.sub.max.
(46) The probability density function for the model of the amplitude of the interfering signal can be determined on the basis of real measurement data. The distance with reference to the ultrasonic sensor 4 can be divided here into a plurality of segments of the same length. Amplitude ranges of the same length can, furthermore, be determined for the amplitude. Measurement data of interfering signals can be recorded here, under the precondition that there is no object 8 in the surrounding region 9 of the motor vehicle 1. The number of echoes within each of the amplitude ranges can, furthermore, be counted. An empirical probability density function of the interfering signals, conditioned to the distance, results from this.
(47) An example of measurement points 15 that describe interfering signals is illustrated by way of example in
(48)
(49) In addition to this, a second echo can be received from the object 8. The second echo is modelled here as follows: The second echo occurs with a detection probability of P.sub.D2, and the position of the second echo occurs, evenly distributed, at a distance of about 40 cm from the distance of the object 8. In order to avoid interferences between the first echo and the second echo, it is necessary that the PDAFAI is offered the possibility that the first echo is assigned to the object 8, and that a further echo is subsequently assigned as a second echo. The echoes are arranged with rising distance for this reason:
(50)
(51) The set of all possible assignments takes the second echo into account as follows:
(52)
(53) The state A.sub.ij here describes the echo i originating from the object 8, the echo j being a second echo, and the other echoes being interfering signals. The state A.sub.ii, which is also referred to as A.sub.i, is the state in which the echo i originates from the object 8 and the other echoes are interfering signals. A.sub.0 describes the state in which all echoes are interfering signals and none of them originate from the object.
(54) If A.sub.ij is true, y.sub.j is not used to update the Kalman filter. y.sub.j is only used if A.sub.ii, is true, since the distance of the second echo does not supply any accurate information about the current position of the object. This yields:
i0,ji,P(x/Z,A.sub.ij)=P(x/Z,A.sub.i)(23)
(55) With this, the mixed distribution from equation (1) yields:
(56)
(57) It is therefore necessary to find an expression for .sub.i. Using Bayes' theorem, we obtain:
(58)
(59) Cases i=j and i=0 are identical to the standard PDAFAI. This takes into account that ji. Apart from
(60)
and z.sub.j it is assumed that the objects 8 are evenly distributed with respect to the interfering signals within V. This leads to the following factorization:
(61)
(62) The definition of the qualified probability yields:
P(z.sub.i,z.sub.j/A.sub.ij)=P(z.sub.j/z.sub.i,A.sub.ij)P(z.sub.i/A.sub.ij)(28)
(63) From equation (24) we further obtain:
P(z.sub.i/A.sub.ij)=e.sub.iP.sub.1.sup.(a.sub.i)(29)
(64) P(z.sub.j/z.sub.i, A.sub.ij) is known from the previous assumptions. It is assumed here that A.sub.ij is true. This means that the second echo is arranged within V, the position of the second echo is evenly distributed between z.sub.i and the upper limit of V, which is limited to 40 cm. This corresponds to a segment with a length of V.sub.i. P.sub.2.sup. should correspond here to the probability density function of the second echo. This leads to the following factorization:
(65)
(66) It is furthermore assumed that the number of false alarms follows a diffuse distribution. This yields:
P(m/A.sub.ij)=P(m/A.sub.i)=.sub.0(31)
(67) .sub.0 will disappear from equation (27) within the normalization factor. An expression for P(A.sub.ij) is also required. P(U.sub.i=1.sup.mA.sub.i) and
(68)
can be determined for this purpose, and it can be assumed that all A.sub.i and A.sub.ij are equally probable.
(69) Furthermore, P.sub.D1 describes the probability for the detection of the object 8, and thus of the first echo. P.sub.D2 describes the probability for the detection of the second echo. P.sub.1 should be the probability that the first echo V and the second echo .Math.V. P.sub.2 should be the probability that the first echo V and the second echo V.
(70) The following calculation can be derived from this:
(71)
(72) It is further assumed that V=[a, b], and S is the covariance of the innovation. The following calculation can be derived from this:
(73)
(74) In accordance with the previous assumption of equal probabilities, we obtain:
(75)
(76) Altogether then, we obtain from equations (31), (32), (37), (38) and (39) in equation (27):
(77)
(78) .sub.0 is a normalization factor here, so that all the weightings add up to the value 1. It should be noted that the PDAFAI with the second echo reduces to the standard PDAFAI if P.sub.D2=0.
(79) The PDAFAI is, additionally, combined with an IMM (Interactive Multiple Model). Multiple models or hypotheses can be combined together with the aid of the IMM. A model for a constant speed, as well as a second model for a high acceleration, are used here. A third model where P.sub.D1=0 is also used, in order to describe the case in which the object is no longer present. The following Markov transition matrix is used here:
(80)
(81) In order to be able to distinguish between the interfering signals of an asphalted surface and a gravel road, the IMM could also be extended with three additional models. The first three models would then be used for the probability density function of the asphalt, and the last three models for the probability density function of the gravel road. This would, however, double the number of models, and thus significantly increase the running time.
(82) A method that places less demand on the resources would consist in making a hard decision at every step as to whether asphalt or gravel is present. This hard decision can be carried out on the basis of a Bayesian approach, identical to what is done within the IMM. In the present case, however, the model with the highest probability is selected. In practice the classification into asphalt or gravel is very robust. It has been found here, that the probability of selecting the correct model is very close to 1.
(83) Only the echoes that are originate from the ground are used to determine the probability. Since the ultrasonic sensor 4 cannot see through objects 8, and therefore cannot detect the ground behind an object 8, echoes that are located behind a tracked object 8 are not used for the calculation of the probability. If the object 8 is detected at a distance of more than 1 m, the model probabilities are not updated, since too little information about the ground is available to the ultrasonic sensor 4.
(84) The model probabilities are initialized with a value of 0.5, and the following Markov transitions are used:
(85)
(86) Here .sub.k.sup.j describes the probability of the measurement of a model j at time step k. The measurements here, independently of one another, determine:
(87)
(88) All the P(y.sub.i) are equally probable here. The probability can thus be simplified as follows:
(89)
(90) In the present case, the second echo, which originates from the object 8, is considered separately in the PDAF. This is referred to below as PDAF with second echo.
(91) The way in which the individually tracked objects 8, or the tracks, are treated is explained below. A new track is created as soon as an echo that cannot be assigned to any existing track is above the ground threshold value curve. A check is also made as to whether this track does not have a spacing of about 40 cm from an existing track. The variance related to the position is determined depending on the spacing measurement with the ultrasonic sensor 4, and the relative speed is set to the maximum possible value. It can furthermore be provided that a track is removed if the probability of the non-existence of the IMM falls below a predetermined threshold value which can, for example, be 70%. It can also be the case that two tracks are merged if the test related to the Mahalanobis distance is true. The fact that the Mahalanobis distance between two tracks is .sup.2-distributed with two degrees of freedom can be taken into account here.
(92) Overall, the filter can on the one hand be used to output the tracked position on the basis of the measurements with the ultrasonic sensor 4. On the other hand, the filter can be used to determine the signal peaks 13 out of the raw signal 10 of the ultrasonic sensor 4 that are to be assigned to the object 8. The functional capacity of the filter used is illustrated below. At first, the advantage of the PDAF with the second echo is shown on the basis of a simulated example. A static object that outputs a constant echo 10 cm behind the first echo is simulated here. In this case, the tracking errors for a normal PDAF and for the PDAF with the second echo have been calculated. The tracking errors describe the spatial deviation when tracking the object 8. In this respect, the diagram in
(93) In addition to this, measurements were carried out with a dummy pedestrian. This dummy pedestrian reflects numerous echoes that can, for example, originate from the torso, the legs and/or the arms. Up to five echoes of the ultrasonic signal can occur here.
(94) As explained above, it is provided that the type of the ground is classified. Various trials were carried out for this purpose, and are represented in the following table.
(95) TABLE-US-00001 Minimum Minimum probability probability Case for asphalt for gravel Dummy pedestrian getting 0.961 closer on asphalt Small dummy pedestrian 0.979 getting closer on asphalt Garbage bin getting 0.903 closer on asphalt Standard 75 mm post 0.949 getting closer on asphalt Driving over gravel 0.999 Garbage bin getting 0.988 closer on gravel Standard 75 mm post 0.990 getting closer on gravel
(96) It can be seen that the detection of the ground type delivers very good results. In practice, the surface in the surrounding region 9 of the motor vehicle 1 was recognized with a probability of more than 99% for almost all steps. The idea that it is not necessary to take the IMM into account when detecting the type of ground was thus confirmed. Computing capacity and time can thus be saved.
(97) The following table describes different cases in order to clarify the detection rate of the PDAF with the second echo.
(98) TABLE-US-00002 Detection Detection rate for rate for comparison with PDAF with ground threshold Case second echo value curve Dummy pedestrian getting 100% 92.5% closer on asphalt Small dummy pedestrian 100% .sup.65% getting closer on asphalt Garbage bin getting 100% .sup.58% closer on asphalt Standard 75 mm post 98% .sup.62% getting closer on asphalt Garbage bin getting 98.9% 77.5% closer on gravel Standard 75 mm post 100% 68.5% getting closer on gravel
(99) The PDAF with the second echo here counts a valid object detection if a proportion of the raw signal is detected as the most probable assignment, or if the signal peak exceeds the ground threshold value curve 11. When using the ground threshold value curve 11, a valid object detection is then counted if a signal peak 13 exceeds the ground threshold value curve 11.
(100) The advantage of tracking the object 8 on the basis of the raw signal 10 making use of the PDAF with the second echo entails significant advantages. The use of the ground threshold value curve 11 alone entails a significantly lower detection rate. On the one hand this is due to the fact that the amplitude of the signal peaks 13 in the raw signal 10 can show variations at relatively large distances, and the signal peaks can thus occur both above and below the ground threshold value curve 11. At relatively small distances, the amplitude of the ground threshold value curve 11 is selected to be relatively high, in order to suppress ground reflections from gravel. Echoes from weakly reflecting objects 8 are not detected here.