Obstacle detection method and system of mmwave radar and vehicle
12560705 ยท 2026-02-24
Assignee
Inventors
- Jinghu Sun (Huizhou, CN)
- Jian Wu (Huizhou, CN)
- Jiahuan Liu (Huizhou, CN)
- Yuanjie Shen (Huizhou, CN)
- Yulin Wu (Huizhou, CN)
Cpc classification
G01S7/32
PHYSICS
G01S7/2923
PHYSICS
G01S2013/464
PHYSICS
International classification
G01S7/32
PHYSICS
Abstract
The present invention provides an obstacle detection method, an obstacle detection system and a vehicle. An original range profile is separated to obtain a first range profile of a first target according to echo signal models, therefore a two-dimensional position coordinate of the first target is determined. The first target is in front of or beside a second target and is in an invisible line of sight of the mmWave radar, and the second target is in a direct line of sight of the mmWave radar. By adopting a signal separation method in the present invention, the first range profile can be effectively separated from an original range profile, thereby reducing interference of a range profile of the second target, and obtaining an accurate position of the first target.
Claims
1. An obstacle detection method with mm Wave radar, comprising: transmitting radar electromagnetic wave signals and receiving radar reflected waves via at least one mm Wave radar; obtaining echo signals according to echo signal models, the echo signals being from at least one second target which is in a direct line of sight of the mm Wave radar and at least one first target which is in front of or beside the second target and is in an invisible line of sight of the mm Wave radar; generating an original range profile
2. The obstacle detection method according to claim 1, wherein the echo signal models are constructed according to a plurality of first targets and second targets; wherein a construction method of the echo signal models comprises: obtaining echo path delays of the first targets and the second targets respectively according to detection paths of the mmWave radar, and constructing the echo signal models according to the echo path delays.
3. The obstacle detection method according to claim 2, wherein the echo path delays are specifically as follows:
4. The obstacle detection method according to claim 3, wherein a linear frequency-modulated signal of the mm Wave radar is set as follows:
y.sub.1(t)=.sub.1S(t.sub.path-1)+.sub.2s(t.sub.path-2)+n(t);
y.sub.2(t)=.sub.1s(t.sub.path-1)+.sub.2s(t.sub.path-3)+n(t); wherein f.sub.0 is a carrier frequency, A.sub.0 is an amplitude of a transmitted signal, ==B/T isa linear frequency modulation slope, j={square root over (1)} and B is signal bandwidth, T is a pulse time, u(t) is a moment function; .sub.1 is a scattering coefficient of the second target; .sub.2 is a scattering coefficient of the first target; and n(t) represents background noise.
5. The obstacle detection method according to claim 1, wherein the position is represented by a two-dimensional position coordinate of the first target, and is obtained using a minimum variance distortionless response (MVDR) angle measurement method.
6. The obstacle detection method according to claim 1, wherein the original range profile X is obtained by performing fast time dimension Fourier transform processing on the echo signals.
7. An obstacle detection system, comprising: a mm Wave radar module, configured for transmitting electromagnetic wave signals and capturing reflected waves; a detection module, configured for detecting at least one second target which is in a direct line of sight of the mm-Wave radar and at least one first target which is in front of or beside the second target and is in an invisible line of sight of the mm-Wave radar according to the reflected waves; and a display module, at least configured for presenting a position of the first target; wherein the detection module comprises: a simulation unit, configured for obtaining echo signals according to echo signal models which are stored therein and the reflected waves, the echo signals being from the at least one second target and the first target; and a calculation unit, configured for generating an original range profile X according to the echo signals, separating a first range profile X.sub.human of the first target from the original range profile X, obtaining the position of the first target according to the first range profile X.sub.human; wherein the calculation unit separates the first range profile X.sub.human of the first target from the original range profile X by: de-averaging the original range profile X to obtain a de-averaged matrix
8. The obstacle detection system according to claim 7, wherein the simulation unit is further configured for constructing the echo signal models according to a plurality of first targets and second targets.
9. The obstacle detection system according to claim 8, wherein a construction method of the echo signal models comprises: obtaining echo path delays of the first targets and the second targets respectively according to detection paths of the mm-Wave radar, and constructing the echo signal models according to the echo path delays.
10. The obstacle detection system according to claim 9, wherein the echo path delays are specifically as follows:
11. The obstacle detection system according to claim 10, wherein a linear frequency-modulated signal of the mm-Wave radar is set as follows:
y.sub.1(t)=.sub.1S(t.sub.path-1)+.sub.2s(t.sub.path-2)+n(t);
y.sub.2(t)=.sub.1s(t.sub.path-1)+.sub.2s(t.sub.path-3)+n(t); wherein f.sub.0 is a carrier frequency, A.sub.0 is an amplitude of a transmitted signal, =B/T is a linear frequency modulation slope, j={square root over (1)} and B is signal bandwidth, T is a pulse time, u(t) is a moment function; .sub.1 is a scattering coefficient of the second target; .sub.2 is a scattering coefficient of the first target; and n(t) represents background noise.
12. The obstacle detection system according to claim 7, wherein the position is represented by a two-dimensional position coordinate of the first target, and is obtained using a minimum variance distortionless response (MVDR) angle measurement method.
13. The obstacle detection system according to claim 7, wherein the original range profile X is obtained by performing fast time dimension Fourier transform processing on the echo signals.
14. A vehicle, comprising: a display; at least one mm Wave radar, configured for transmitting electromagnetic wave signals and capturing reflected waves; a computer readable storage, configured for storing echo signal models and a computer program; and one or more processors, configured for executing the computer program to implement an obstacle detection method to obtain a position of a first target and display the position of the first target on the display; wherein the obstacle detection method comprises: obtaining echo signals according to the reflected waves and the echo signal models, the echo signals being from at least one second target which is in a direct line of sight of the mm Wave radar and at least one first target which is in front of or beside the second target and is in an invisible line of sight of the mm Wave radar; generating an original range profile according to the echo signals; separating a first range profile of the first target from the original range profile; and obtaining the position of the first target according to the first range profile; wherein the calculation unit separates the first range profile X.sub.human of the first target from the original range profile X by: de-averaging the original range profile X to obtain a de-averaged matrix
15. The vehicle according to claim 14, wherein the echo signal models are constructed according to a plurality of first targets and second targets; wherein a construction method of the echo signal models comprises: obtaining echo path delays of the first targets and the second targets respectively according to detection paths of the mmWave radar, and constructing the echo signal models according to the echo path delays; wherein the echo path delays are specifically as follows:
16. The vehicle according to claim 15, wherein a linear frequency-modulated signal of the mmWave radar is set as follows:
y.sub.1(t)=.sub.1S(t.sub.path-1)+.sub.2s(t.sub.path-2)+n(t);
y.sub.2(t)=.sub.1s(t.sub.path-1)+.sub.2s(t.sub.path-3)+n(t); wherein f.sub.0 is a carrier frequency, A.sub.0 is an amplitude of a transmitted signal, =B/T is a linear frequency modulation slope, j={square root over (1)} and B is signal bandwidth, T is a pulse time, u(t) is a moment function; .sub.1 scattering coefficient of the second target; .sub.2 is a scattering coefficient of the first target; and n(t) represents background noise.
Description
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
(1) The foregoing and other exemplary purposes, aspects and advantages of the present invention will be better understood in principle from the following detailed description of one or more exemplary embodiments of the invention with reference to the drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
DETAILED DESCRIPTION OF THE INVENTION
(10) The invention will now be described in detail through several embodiments with reference to the accompanying drawings.
First Embodiment
(11) Please refer to
(12) The one or more mmWave radars may be fixed to any position of the vehicle, such as a head (may be a middle position above or below a bumper), two sides and the tail of the vehicle, so as to detect objects around the vehicle. The mmWave radar is used to transmit electromagnetic wave signals that objects in their path then reflect. By capturing reflected waves, the mmWave radar can determine a range, velocity and angle of the objects. The electromagnetic wave signals have a wavelength that is in the millimeter range.
(13) The display may be fixed to an instrument panel or a console of the vehicle, and is connected to the one or more processors. The display is used for displaying information to users.
(14) The computer readable storage is used for storing echo signal models and a computer program.
(15) The one or more processors is configured for executing the computer program stored in the computer readable storage to implement an obstacle detection method and display a position of a first target on the display after the computer program is executed to output the position. The one or more processors may be controlled by a vehicular MCU (microcontroller unit) or a SoC (system-on-chip) terminal of the advanced driver assistance systems (ADAS) of the vehicle.
(16) By executing the obstacle detection method, first targets which are in front of or beside a second target and are in an invisible line of sight of the mmWave radar can be detected accurately, improving the safety and the robustness of the ADAS, more effectively protecting a laterally shuttling obstacle (such as a crossing pedestrian) to effectively avoid an accident caused by the laterally moving object during driving, and then improving the user experience.
(17)
(18) That is, radar detection echo paths at least include a direct-line-of-sight path and ground reflection paths. The echo signal models stored in the computer readable storage of the vehicle is constructed according to the direct-line-of-sight path and the ground primary reflection path. In the direct-line-of-sight path, the mmWave radar O may directly detect the first target and the second target, the echo path is: O.fwdarw.C.fwdarw.O and O.fwdarw.A.fwdarw.O, that is, after a transmitted wave reaches the first target/second target, an echo is directly reflected.
(19) In the ground primary reflection paths, the mmWave radar O cannot directly detect the first target C, it indicates that the first target C is right located in front of or beside but be blocked by the second target A, leading to that the mmWave radar O cannot directly reach the first target. The echo path at this time is: O.fwdarw.B.fwdarw.C.fwdarw.B.fwdarw.O, that is, the mmWave radar O transmits a detection wave at a preset frequency, and the detection wave is reflected by a ground point B to the first target C and then returns in the same path.
(20) The echo signal models are constructed according to a plurality of first targets and second targets for testing. The construction method of the echo signal models includes: obtaining echo path delays of the first targets and the second targets respectively according to detection paths of the mmWave radar, and constructing the echo signal models according to the echo path delays.
(21) Preferably, a specific process of constructing the echo signal models may be as follows:
(22) An expression of a linear frequency-modulated signal transmitted by the mmWave radar is set as follows:
(23)
f.sub.0 represents a carrier frequency; A.sub.0 represents an amplitude of the transmitted signal; =B/T is a linear frequency modulation slope; j={square root over (1)}, a signal bandwidth is expressed as B; a pulse time is expressed as T; and u(t) is a moment function.
(24) At this time, the radar echo signal may be divided into two combinations, one is that the echo contains .sub.path-1 and .sub.path-2, and the other is that the echo contains .sub.path-1 and .sub.path-3. Therefore, the two echo signal models may be expressed as:
y.sub.1(t)=.sub.1S(t.sub.path-1)+.sub.2s(t.sub.path-2)+n(t);
y.sub.2(t)=.sub.1s(t.sub.path-1)+.sub.2s(t.sub.path-3)+n(t);
.sub.1 is a scattering coefficient of the second target; .sub.2 is a scattering coefficient of the first target; and n(t) represents background noise.
(25) Further, based on the above radar detection echo paths, let .sub.path-1 be a direct-line-of-sight echo path delay of detecting the second target (that is, the echo path delay of a second target which is detected in a direct-line-of-sight path), .sub.path-2 be an echo path delay of a first target which is detected in a ground primary reflection path, and .sub.path-3 be a direct-line-of-sight path of the first target (that is, the echo path delay of a first target which is detected in a direct-line-of-sight path). Then specific expressions of the echo path delays of the first targets and the second targets are as follows:
(26)
c is an electromagnetic wave propagation velocity, OA is a direct distance between the mmWave radar and the second target, OC is a direct distance between the mmWave radar and the first target. OB and BC are indirect distances between the mmWave radar and the first target, returning echo from the first target is reflected by the ground at a point B as a middle reflection point then received by the mmWave radar. And c is an electromagnetic wave propagation velocity.
(27) Based on this, the obstacle detection method of the present invention mainly includes the following steps S1 to S5 (see
(28) S3, separating a first range profile X.sub.human of the first target from the original range profile X. That is, separating the echo signals on the original range profile to obtain the first range profile X.sub.human. When the mmWave radar O is used to detect the first target C, as the radar O keeps in a motion state following the second target A, there is no stationary target in an environment for the radar O, and the traditional static clutter cancellation method cannot be adopted to eliminate the echo signal of the second target A. Considering the problem that the echo of the second target A cannot be eliminated, which leads to difficulty of detecting the first target, the present invention uses the signal separation method to separate the first range profile from the original range profile.
(29) The separation of the first range profile X.sub.human mainly include Fourier transform and signal separation, which may be specifically as follows: S31, de-averaging the original range profile X to obtain a de-averaged matrix
(30) In the above process, a formula of calculating the covariance matrix of the de-averaged matrix
(31)
(32) A formula of performing eigenvalue decomposition on the covariance matrix may be as follows:
D=UU.sup.1.
after eigenvalue decomposition, is a diagonal matrix; U is a matrix composed of eigenvectors of the matrix D; and the corresponding eigenvectors are U.sub.1, . . . , U.sub.M. Then, the eigenvectors are arranged in the descending order according to the corresponding eigenvalues; and at this time, the eigenvectors corresponding to the first k eigenvalues are selected as the mapping matrix for dimensionality reduction. The mapping matrix may be expressed as =[U.sub.1 . . . U.sub.k]. Then, the data matrix after dimensionality reduction may be expressed as:
X.sub.front=.sup.T
(33) This is because the first range profile X.sub.human of the first target and the second target's range profile (X.sub.front) are mixed to form the original range profile X. The signal intensity of the second target is maximal, which may be approximately considered that the original range profile X mainly contains the second target's range profile. Therefore, dimension reduction is performed to obtain the matrix X.sub.front which is considered include the principal component information of the second target, so that the range profile separation process between the first target and the second target is substantially completed. The first range profile X.sub.human may be calculated as follows:
X.sub.human=XX.sub.front
(34) Preferably, an incoherent superposition and a constant false alarm rate detection may be used to test and calculate the obtained first range profile. The specific step is as follows:
(35) The incoherent superposition method is used to accumulate an amplitude value at the target in the range profile. The process of incoherent superposition processing on the first target may be expressed as:
(36)
In the formula, j represents a number of periods; i is a number of range units; h is a number of indexes of frames; and |.Math.| represents an absolute value taking operation.
(37) After the amplitude value at the first target is accumulated, a cell average constant false alarm rate (CA-CFAR) detection method is used to detect a one-dimensional range profile of the first target after accumulation. For the ith range unit, a detection threshold may be expressed as:
(38)
In the formula, P.sub.f represents a false alarm probability; and N.sub.r represents a number of reference units.
(39) Then, the first range profile R.sub.human of the first target is obtained by comparing all range unit values in the first range profile X.sub.human with the detection thresholds. S4, obtaining a position of the first target according to the first range profile X.sub.human In the embodiment, an MVDR angle measurement method may be used to obtain a two-dimensional position coordinate as the position.
(40) For a uniform linear array model, a receiving-direction vector a() of an antenna of the mmWave radar may be expressed as:
(41)
d is a spacing between adjacent antennas in the mmWave radar; is a phase difference between adjacent antennas; k is a number of the antennas; is an incidence angle of a radar signal; and is a wavelength of the radar signal.
(42) Then, an azimuth angle of the target is calculated using a minimum variance distortionless response (MVDR) method. An average output power P() of a spatial filter may be expressed as:
(43)
R represents an autocorrelation matrix of an input matrix X.sub.human of the first range profile, R=E{x.sub.human(j)x.sub.human.sup.H(j)}.
(44) Then, in the direction vector is changed in an angle interval [, ] to obtain a P.sub.MVDR() change curve; then a spectrum peak search is performed, and at this time, an angle corresponding to a peak point is the azimuth angle .sub.human of the first target.
(45) After the azimuth angle .sub.human of the first target is obtained by applying the MVDR angle measurement method, in combination with the first target's range profile R.sub.human, the position, represented by a two-dimensional position coordinate, of the first target may be calculated as follows:
(46)
(47) The vehicle of the present invention effectively solves the problem that when the vehicular millimeter-wave radar is adopted to detect the first target (a person or an animal), a traditional static clutter cancellation method cannot be adopted to eliminate the echo signal of the second target as the radar keeps in a motion state following the second target (such as a vehicle) is effectively solved; and a signal separation method is adopted to separate the first target's range profile from the original echo range profile, thereby reducing interference of the second target, and obtaining an accurate positioning result of the first target. Thereby accurately and effectively determining and detecting a moving target, improving the safety and the robustness of an entire ADAS, more effectively protecting a laterally shuttling obstacle (such as a crossing pedestrian) to effectively avoid an accident caused by the laterally moving object during driving, and then improving the user experience.
Second Embodiment
(48) The present invention further provides an obstacle detection system as shown in
(49) The simulation unit is used for obtaining echo signals according to echo signal models which are storied therein and the reflected waves, the echo signals being from the at least one second target and the first target. The calculation unit is used for generating an original range profile X according to the echo signals, separating a first range profile X.sub.human of the first target from the original range profile X, obtaining a two-dimensional position coordinate of the first target according to the first range profile X.sub.human, and determining a position of the first target. The display module is used for presenting the position of the first target. That is, the simulation unit and the calculation unit together can implement the above-described obstacle detection method and has the same benefit of the vehicle in the first embodiment.
(50) The calculation unit may obtain the first range profile X.sub.human by separating the echo signals on the original range profile, then obtain a two-dimensional position coordinate of the first target using an MVDR angle measurement method: perform fast time dimension Fourier transform processing on the echo signals to obtain an original range profile XC.sup.MN, and de-average the original range profile X to obtain a de-averaged matrix
(51) A first target is detected based on an obstacle detection method. An actual measurement scene is shown in
(52) The mmWave radar is a linear frequency-modulated continuous mmWave radar. Assume the radar frequency is set to 77 G, bandwidth is set to 500 MHz, a radar position is set to the center origin O (0, 0), and a height of the radar is set to 0.35 m relative to the ground. In an initial stage of an experiment, the second target A keeps stationary, and the radar O is 15 m away from the second target. In the experiment, remote controlling the small flat car to move the radar O back and forth within 5-15 m from the second target A, while the pedestrian (the first target) keep moving around the stationary second target A.
(53) According to the processing steps of the present invention, the original range profile is first obtained by a Fourier transform operation, as shown in
(54) Afterwards, separation is performed on the original range profile to obtain the range profiles of the second target and the first target, as shown in
(55) An MVDR angle measurement algorithm is used to calculate an angle of the first target. Finally, positioning trace points of the first target are obtained from a position coordinate of the first target, as shown in
(56) Comprehensive analysis shows that the positions of the first target are consistent with a motion law of the radar system, and an accurate positioning result of the first target is obtained.
(57) Each component embodiment of the present invention may be realized in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of the functions of some modules according to the embodiments of the present invention. The present invention may also implement device programs (e.g., computer programs and computer program products) for performing part or all of the methods described herein. Such programs for implementing the present invention may be stored on a computer readable or may have the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or provided in any other form.
(58) It should be noted that herein, relationship terms of first, second and the like herein are just used for differentiating one entity or operation from the other entity or operation, and do not necessarily require or imply any practical relationship or sequence between the entities or operations. Moreover, terms of comprise, include or any other variant are intended to cover non-exclusive inclusion, so that a process, a method, an article or a device which includes a series of elements not only includes such elements, but also includes other elements not listed clearly or also includes inherent elements in the process, the method, the article or the device. Under the condition of no more limitation, the elements defined by a sentence include one . . . do not exclude additional identical elements in the process, the method, the article or the device which includes the elements.
(59) While the invention has been described in terms of several exemplary embodiments, those skilled on the art will recognize that the invention can be practiced with modification within the spirit and scope of the appended claims. In addition, it is noted that, the Applicant's intent is to encompass equivalents of all claim elements, even if amended later during prosecution.