RADAR ANTI-SPOOFING SYSTEMS FOR AN AUTONOMOUS VEHICLE THAT IDENTIFY GHOST VEHICLES
20230184928 · 2023-06-15
Inventors
Cpc classification
G01S7/4039
PHYSICS
G01S13/9011
PHYSICS
G01S13/9029
PHYSICS
G01S13/87
PHYSICS
G01S7/36
PHYSICS
G01S7/023
PHYSICS
G06V10/62
PHYSICS
G01S13/505
PHYSICS
International classification
G01S13/90
PHYSICS
G01S13/50
PHYSICS
G06V10/44
PHYSICS
G06V10/62
PHYSICS
Abstract
A radar anti-spoofing system for an autonomous vehicle includes a plurality of radar sensors that generate a plurality of input detection points representing radio frequency (RF) signals reflected from objects and a controller in electronic communication with the plurality of radar sensors. The one or more controllers execute instructions to determine a signal to noise ratio (SNR) distance ratio for the input detection points generated by the plurality of radar sensors, where a value of the SNR distance ratio is indicative of an object being a ghost vehicle. The one or more controllers also determine an effective particle number indicating a degree of particle degradation for the importance sampling for each variable that is part of the state variable. In response to determining the effective particle number is equal to or less than a predetermined threshold, the one or more controllers estimate a ghost position for the ghost vehicle.
Claims
1. A radar anti-spoofing system for an autonomous vehicle, the radar anti-spoofing system comprising: a plurality of radar sensors that generate a plurality of input detection points representing radio frequency (RF) signals reflected from objects; and one or more controllers in electronic communication with the plurality of radar sensors, wherein the one or more controllers execute instructions to: determine a signal to noise ratio (SNR) distance ratio for the plurality of input detection points generated by the plurality of radar sensors, wherein a value of the SNR distance ratio is indicative of an object being a ghost vehicle; determine importance sampling for each variable that is part of a state variable based on the plurality of input detection points and the SNR distance ratio; weight the importance sampling for each variable that is part of the state variable; determine an effective particle number indicating a degree of particle degradation for the importance sampling for each variable that is part of the state variable; and in response to determining the effective particle number is equal to or less than a predetermined threshold, estimate a ghost position for the ghost vehicle based on the state variable.
2. The radar anti-spoofing system of claim 1, wherein the SNR distance ratio represents a difference in an SNR constraint variable for the object over time, wherein the SNR constraint variable represents a physical constraint between a measured SNR and a distance of the object.
3. The radar anti-spoofing system of claim 1, wherein the SNR distance ratio is determined by:
4. The radar anti-spoofing system of claim 1, wherein the state variable is expressed as:
X.sub.t=[x(t),y(t),v.sub.x(t),v.sub.y(t),γ(t)].sup.T wherein X.sub.t is the state variable, x(t), y(t) represent x and y positions, v.sub.x(t), v.sub.y(t) represent x and y velocity coordinates, and γ(t) is the SNR distance ratio.
5. The radar anti-spoofing system of claim 1, wherein weighting the importance sampling for each variable that is part of the state variable is done by determining:
w.sub.t.sup.i=w.sub.t−1.sup.i*p(Z.sub.t|X.sub.t.sup.i,Z.sub.t−1)
p(Z.sub.t|X.sub.t.sup.i,Z.sub.t−1)∝Π.sub.j=1.sup.5(1+e.sup.−|X.sup.
6. The radar anti-spoofing system of claim 1, wherein the effective particle number is determined by:
7. The radar anti-spoofing system of claim 6, wherein the predetermined threshold is equal to half the number of total particle points.
8. The radar anti-spoofing system of claim 1, wherein the one or more controllers executes instructions to: in response to determining the effective particle number is equal to or less than the predetermined threshold, re-execute a resampling operation to improve particle distribution.
9. The radar anti-spoofing system of claim 1, wherein the one or more controllers executes instructions to: estimate the SNR distance ratio based on the state variable to determine an estimated SNR distance ratio.
10. The radar anti-spoofing system of claim 9, wherein the one or more controllers executes instructions to: compare the estimated SNR distance ratio with a predetermined value less than one; and in response to determining the estimated SNR distance ratio is less than or equal to the predetermined value that is less than one, determine the ghost position is a valid ghost point.
11. The radar anti-spoofing system of claim 9, wherein the one or more controllers executes instructions to: in response to determining estimated SNR distance ratio is greater than the predetermined value that is less than one, determine the ghost position is a non-ghost point.
12. A method for detecting and tracking ghost vehicles by a radar anti-spoofing system, the method comprising: determining, by one or more controllers, a SNR distance ratio for input detection points generated by a plurality of radar sensors, wherein a value of the SNR distance ratio is indicative of an object being a ghost vehicle; determining, by the one or more controllers, importance sampling for each variable that is part of a state variable based on the plurality of input detection points and the SNR distance ratio; weighting the importance sampling for each variable that is part of the state variable; determining an effective particle number indicating a degree of particle degradation for the importance sampling for each variable that is part of the state variable; and in response to determining the effective particle number is equal to or less than a predetermined threshold, estimating a ghost position for the ghost vehicle based on the state variable.
13. The method of claim 12, further comprising: in response to determining the effective particle number is equal to or less than the predetermined threshold, re-executing a resampling operation to improve particle distribution.
14. The method of claim 12, further comprising: estimating the SNR distance ratio based on the state variable to determine an estimated SNR distance ratio.
15. The method of claim 14, further comprising: comparing the estimated SNR distance ratio with a predetermined value less than one; and in response to determining the estimated SNR distance ratio is less than or equal to the predetermined value that is less than one, determining the ghost position is a valid ghost point.
16. The method of claim 14, further comprising: in response to determining estimated SNR distance ratio is greater than the predetermined value that is less than one, determining the ghost position is a non-ghost point.
17. A radar anti-spoofing system for an autonomous vehicle, the radar anti-spoofing system comprising: a plurality of radar sensors that generate a plurality of input detection points representing RF signals reflected from objects; and one or more controllers in electronic communication with the plurality of radar sensors, wherein the one or more controllers execute instructions to: determine an SNR deviation factor for an object based on the plurality of input detection points from the plurality of radar sensors; modify an innovation covariance matrix of a Kalman filter by combining a measurement noise covariance matrix with an SNR deviation factor; and determine a spoofing detection measure that quantifies a relationship between an updated state covariance matrix determined by the Kalman filter and a detected distance measured between the autonomous vehicle and the object, wherein a value of the spoofing detection measure changes with respect to time when the object is a ghost vehicle.
18. The radar anti-spoofing system of claim 17, wherein the one or more controllers execute instructions to: determine a spoofing detection measurement ratio based on a standard deviation of the spoofing detection measure determined over a defined time window divided by a mean value of the spoofing detection measure determined over the defined time window.
19. The radar anti-spoofing system of claim 18, wherein the one or more controllers execute instructions to: compare the spoofing detection measure ratio with a threshold value; in response to determining the spoofing detection measure ratio is greater than the threshold value, determines the object is a ghost vehicle; and in response to determining the spoofing detection measure ratio is less than or equal to the threshold value, determine the object is a real vehicle.
20. The radar anti-spoofing system of claim 17, wherein the one or more controllers execute instructions to: calculate a Doppler deviation factor for the object by determining a difference between an expected Doppler frequency and a measured Doppler frequency for the object.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0026] The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.
[0027]
[0028]
[0029]
[0030]
[0031]
DETAILED DESCRIPTION
[0032] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application, or uses.
[0033] Referring to
[0034] As seen in
[0035]
where A is a constant derived from the parameters of specific radar sensor and is independent of distance, d.sub.T represents a true distance, d.sub.M represents a measured distance, and Δd is a difference between the true distance and the measured distance. For a real moving vehicle, Δd<<d.sub.T, and c≈A. However, for a ghost vehicle, the measured distance d.sub.M is determined by the time delay generated by the spoofer, but the true distance d.sub.T is the distance between the spoofer to the autonomous vehicle 10 (
[0036] The measured distance d.sub.M and the true distance d.sub.T of a real vehicle are relatively close in value, and differences between the measured distance d.sub.M and the true distance d.sub.T are due to measurement noise. Moreover, it is to be appreciated that the SNR constraint variable c of the real vehicle is close to a constant value. In contrast, the measured distance d.sub.M and the true distance d.sub.T of a ghost vehicle are mismatched and have a relatively large difference in value. The SNR constraint variable c of the ghost vehicle varies with time and goes to zero as the ghost vehicle approaches the autonomous vehicle 10 (
where t and t+1 represent sequential time steps and γ is the SNR distance ratio 52. For a real vehicle, d.sub.M(t+1)≈d.sub.T(t+1) and d.sub.M(t)≈d.sub.T(t), and the SNR distance ratio 52 is approximately 1.0 (γ≈1.0). For a ghost vehicle, assuming the spoofing vehicle is at a constant distance to the autonomous vehicle 10 and the ghost vehicle is approaching the autonomous vehicle 10, the SNR distance ratio 52 is less than 1.0 and goes to 0 because the true distance d.sub.T is approximately the same between sequential time steps, however, the measured distance d.sub.M decreases as the time step increases, or d.sub.T(t+1)≈d.sub.T(t) and d.sub.M(t+1)≤d.sub.M(t). Thus, the value of the SNR distance ratio 52 indicates when the object is a ghost vehicle.
[0037] As seen in
[0038]
X.sub.t=[x(t),y(t),v.sub.x(t),v.sub.y(t),γ(t)].sup.T Equation 3
where x(t), y(t) represent x and y positions, v.sub.x(t), v.sub.y(t) represent x and y velocity coordinates, and γ(t) is the SNR distance ratio 52.
[0039] An observation variable Z.sub.t is expressed as Z.sub.t=X.sub.t+u.sub.t, where u.sub.t is an independent random noise process. For a given observation variable Z.sub.t, the importance sampling for each variable that is part of the state variable X.sub.t for the x-position x(t) is expressed in Equation set 4 as:
where N(m, σ) represents a normal distribution sample with a mean of m and a variance of σ, and a.sub.x is a constant for controlling the variances of the importance sampling and includes a value that is greater than 0. The sampling block 70 calculates an importance sampling for each variable that is part of the state variable X.sub.t (i.e., x(t), y(t), v.sub.x(t), v.sub.y(t), γ(t)), and is expressed in Equation Sets 5-8 as:
where a.sub.y, a.sub.vx, a.sub.vy, a.sub.γ, are constants for controlling the variances of the importance sampling and they are larger than zero, t is a time step, and t−1 is a time step immediately before t.
[0040] The weighting block 72 determines weights of the importance sampling corresponding to each variable that is part the state variable X.sub.t based on Equations 9 and 10, which are:
w.sub.t.sup.i=w.sub.t−1.sup.i*p(Z.sub.t|X.sub.t.sup.i,Z.sub.t−1) Equation 9
p(Z.sub.t|X.sub.t.sup.i,Z.sub.t−1)∝Π.sub.j=1.sup.5(1+e.sup.−|X.sup.
where w.sub.t.sup.i represents the weights of the sampled points at time step t, p(Z.sub.t|X.sub.t.sup.i,Z.sub.t−1) is a posterior distribution, {X.sub.t.sup.i}.sub.i=1.sup.N is the set of sampled points, and σ.sub.j represents a variance that depends upon the dynamic range of a corresponding component. The weighting block 72 then normalizes the weights for each time step t based on Equation 11, which is:
[0041] The check degradation block 74 determines an effective particle number N.sub.eff that indicates a degree of particle degradation for the importance sampling for each variable that is part of the state variable X.sub.t. In an embodiment, the effective particle number N.sub.eff is determined based on Equation 12, which is:
where N.sub.s is the number of total particle points. The check degradation block 74 then compares the effective particle number N.sub.eff with a predetermined threshold β. In an embodiment, the predetermined threshold is equal to half the number of total particle points, or N.sub.s/2, however, other values may be used as well. In response to determining the effective particle number N.sub.eff is equal to or less than the predetermined threshold β, the resampling block 76 re-executes a resampling operation to improve the particle distribution. The resampling operation spreads the concentrated weight values to multiple samples. However, in response to determining the effective particle number N.sub.eff is greater than the predetermined threshold β, then the resampling block 76 sends the sampled points and the state variable X.sub.t to the estimation block 78.
[0042] The estimation block 78 estimates the ghost position 54 for a ghost vehicle based on the state variable X.sub.t by Equation 13, which is:
pos(x,y)=E[X.sub.t(1:2)] Equation 13
where pos(x,y) represents an x, y coordinate of the ghost position 54 of the ghost vehicle. Once the ghost position 54 is determined, the check constraint ratio block 80 estimates the SNR distance ratio 52 based on the state variable X.sub.t by Equation 14, which indicates the state variable X.sub.t includes five elements and an average or mean is determined:
ŷ(t)=E[X.sub.t(5)] Equation 14
where ŷ represents an estimated SNR distance ratio. In response to determining the estimated SNR distance ratio is less than or equal a predetermined value that is less than one, the estimation block 78 determines the ghost position 54 is a valid ghost point. In response to determining estimated SNR distance ratio is greater than the predetermined value that is less than one, the ghost position 54 is a non-ghost point. In an embodiment, the predetermined value that is less than one is 0.98. Once the estimation block 78 determines several consecutive non-ghost points, the ghost vehicle tracking block 48 ceases to track the non-ghost vehicle.
[0043]
[0044] In block 204, the sampling block 70 of the ghost vehicle tracking block 48 determines the importance sampling for each variable that is part of a state variable X.sub.t based on the input detection points 50 and the SNR distance ratio 52, and is expressed in Equation Sets 4-8. The method 200 may proceed to block 206.
[0045] In block 206, the weighting block 72 weights the importance sampling for each variable that is part of the state variable X.sub.t. The weighting block 72 then normalizes the weights at each time step t based on Equation 11. The method 200 may then proceed to block 208.
[0046] In block 208, the check degradation block 74 determines the effective particle number N.sub.eff that indicates a degree of particle degradation for the importance sampling for each variable that is part of the state variable X.sub.t. The method 200 may then proceed to decision block 210.
[0047] In decision block 210, in response to determining the effective particle number N.sub.eff is equal to or less than the predetermined threshold the method 200 may then proceed to block 212. In block 212, the resampling block 76 re-executes a resampling operation to improve particle distribution. The method 200 may then proceed to block 214. Returning to decision block 210, in response to determining the effective particle number N.sub.eff is greater than the predetermined threshold β, then the method 200 may proceed to block 214.
[0048] In block 214, the estimation block 78 estimates the ghost position 54 for the ghost vehicle based on the state variable X.sub.t using Equation 13 as described above. The method 200 may then proceed to block 216.
[0049] In block 216, the check constraint ratio block 80 estimates the SNR distance ratio 52 based on the state variable X.sub.t. by Equation 14 to determine an estimated SNR distance ratio. The method 200 may then proceed to decision block 218.
[0050] In decision block 218, the check constraint ratio block 80 compares the estimated SNR distance ratio with a predetermined value less than one. In response to determining the estimated SNR distance ratio is less than or equal to the predetermined value that is less than one, the method proceeds to block 220, and the estimation block 78 determines the ghost position 54 is a valid ghost point. In response to determining estimated SNR distance ratio is greater than the predetermined value that is less than one, the method proceeds to block 222, and the estimation block 78 determines the ghost position 54 is a non-ghost point. The method 200 may then terminate or return to block 202.
[0051] Referring generally to the figures, the disclosed radar anti-spoofing system provides various technical effects and benefits for identifying and tracking ghost vehicles. Specifically, the radar anti-spoofing system provides an effective approach for identifying and tracking ghost vehicles for a nonlinear system and for non-Gaussian noise environments, thereby enabling the autonomous vehicle to only react to sensor data collected from real vehicles. The radar anti-spoofing system identifies an object as a ghost vehicle based on a value of the SNR distance ratio. Furthermore, the disclosed radar anti-spoofing system also includes a particle filtering technique to effectively track ghost vehicles as well.
[0052]
[0053] The SNR deviation module 140 determines a SNR deviation factor for an object in the environment based on input detection points 150 from the plurality of radar sensors 120. Specifically, the SNR deviation factor is calculated by determining a difference between an expected SNR and a measured SNR for the object. In an embodiment, the SNR deviation factor is determined based on Equation 15:
Dev.sub.SNR=1.0+|SNR.sub.Expected−SNR.sub.Measured| Equation 15
where Dev.sub.SNR is the SNR deviation factor, SNR.sub.Expected is the expected SNR, and SNR.sub.Measured is the measured SNR. It is to be appreciated that the additional constant of 1.0 in Equation 15 is applied to maintain the original measurement noise covariance when the expected SNR and the measured SNR are equal in value, which is what occurs when the object is a real vehicle.
[0054] The Doppler frequency deviation module 142 determines a Doppler deviation factor for THE object in the environment based on input detection points 150 from the plurality of radar sensors 120. Specifically, the Doppler deviation factor is calculated by determining a difference between an expected Doppler frequency and a measured Doppler frequency for the object. In an embodiment, the Doppler deviation factor is determined based on Equation 16:
Dev.sub.Doppler=1.0+|Doppler.sub.Expected−Doppler.sub.Measured| Equation 16
where Dev.sub.Doppler is the Doppler deviation factor, Doppler.sub.Expected is the expected Doppler frequency, and Doppler.sub.Measured is the measured Doppler frequency.
[0055] Both the SNR deviation factor and the Doppler deviation factor are sent to the Kalman filter 144. The Kalman filter 144 includes a prediction module 144A and an update module 144B, where the prediction module 144A receives initial values and predicts a state before sending the state to the update module 144B. The update module 144B determines four variables, a modified innovation covariance matrix S.sub.k+1, a Kalman gain K.sub.k+1, a state estimate x.sub.k+1|k+1, and an updated state covariance matrix P.sub.k+1|k+1. When employing a standard Kalman filter, the innovation covariance matrix S.sub.k+1 is normally expressed in Equation 17 as:
S.sub.k+1=H.sub.k+1P.sub.k+1|kH.sub.k+1.sup.T+R.sub.k+1 Equation 17
where H.sub.k+1 is an observation matrix, R.sub.k+1 is a measurement noise covariance matrix, and k represents a time step. For the present disclosure, the innovation covariance matrix S.sub.k+1 is modified by multiplying the measurement noise covariance matrix R.sub.k+1 by the SNR deviation factor, and is expressed in Equation 18 as:
S.sub.k+1=H.sub.k+1P.sub.k+1|kH.sub.k+1.sup.T+Dev.sub.SNR.Math.R.sub.k+1 Equation 18
[0056] It is to be appreciated that when the plurality of radar sensors 120 are spoofed, the value of the SNR deviation factor increases over time. As a result, the value of the measurement noise covariance matrix R.sub.k+1 increases over time and the Kalman gain K.sub.k+1 decreases over time. Accordingly, the input detection points 150 from the plurality of radar sensors 120 that are generated by ghost vehicles have a lower impact upon the state updates over time. Furthermore, because the Kalman gain K.sub.k+1 decreases over time, a value of the updated state covariance matrix P.sub.k+1|k+1 is reduced less over time as well.
[0057] In an embodiment, the innovation covariance matrix S.sub.k+1 is further modified by multiplying the measurement noise covariance matrix R.sub.k+1 by the SNR deviation factor and the Doppler deviation factor, and is expressed in Equation 19 as:
S.sub.k+1=H.sub.k+1P.sub.k+1|kH.sub.k+1.sup.T+Dev.sub.DopplerDev.sub.SNRR.sub.k+1 Equation 19
[0058] The updated state covariance matrix, P.sub.k+1|k+1 determined by the Kalman filter 144 is sent to the spoofing detection measure module 146. The spoofing detection measure module 146 determines a spoofing detection measure that quantifies a relationship between the updated state covariance matrix P.sub.k+1|k+1 determined by the Kalman filter 144 and a detected distance d measured between the autonomous vehicle 110 and the object. In an embodiment, the spoofing detection measure is determined based on Equation 20, which is:
where P represents the updated state covariance matrix, d represents a detected distance of the object, and n represents a dimension of the state vector. It is to be appreciated that for a real vehicle, a magnitude of the updated state covariance matrix P.sub.k+1|k+1 determined by the Kalman filter 144 is inversely related to the detected distance d of the object. Accordingly, real vehicles will generate a near-constant value for the spoofing detection measure over time. However, ghost vehicles generate relatively large fluctuations in the spoofing detection measure. Therefore, as explained in detail below, the spoofed vehicle module 148 monitors a value of the spoofing detection measure over time to determine if the object is a real vehicle or a ghost vehicle.
[0059] Continuing to refer to
where SDM.sub.m.sup.m+d is the SDM vector between time m and m+d.
[0060] It is to be appreciated that a value of the threshold value th is between zero and one and is determined based on a relationship between a probability of detection and a purity of detection. The probability of detection signifies what fraction of the real detections are correctly classified as real, and the purity indicates a ratio of real detections classified as real to all detections classified as real. In general, the rates between the probability of detection and a purity of the detection are a trade-off, where a lower value for the threshold value th results in a higher purity of detection, and a higher value for the threshold value th results in a higher probability of detection.
[0061]
[0062] In block 304, the Doppler frequency deviation module 142 determines the Doppler deviation factor for the object in the environment based on input detection points 150 from the plurality of radar sensors 120. Specifically, the Doppler deviation factor is calculated by determining a difference between the expected Doppler frequency and the measured Doppler frequency for the object, which is expressed in Equation 16 above. It is to be appreciated that block 304 is optional and may be omitted in some embodiments. The method 300 may then proceed to block 306.
[0063] In block 306, the innovation covariance matrix S.sub.k+1 of the update module 144B of the Kalman filter 144 is modified by combining the measurement noise covariance matrix R.sub.k+1 with the SNR deviation factor. In an embodiment, the Doppler deviation factor is also combined with the innovation covariance matrix S.sub.k+1 as well. The method 300 may then proceed to block 308.
[0064] In block 308, the spoofed vehicle module 148 determines a spoofing detection measure that quantifies a relationship between the updated state covariance matrix P.sub.k+1|k+1 determined by the Kalman filter 144 and the detected distance d measured between the autonomous vehicle 110 and the object. As mentioned above, the value of the spoofing detection measure changes with respect to time when the object is a ghost vehicle. The method 300 may then proceed to block 310.
[0065] In block 310, the spoofed vehicle module 148 determines the spoofing detection measurement ratio based on a standard deviation of the spoofing detection measure determined over a defined time window divided by a mean value of the spoofing detection measure determined over the defined time window, which is expressed in Equation 20 above. The method 300 may then proceed to decision block 312.
[0066] In decision block 312, the spoofed vehicle module 148 compares the spoofing detection measure ratio with the threshold value. In response to determining the spoofing detection measure ratio is greater than the threshold value th, the method 300 may proceed to block 314. In block 314, the spoofed vehicle module 148 determines the object is a ghost vehicle. In response to determining the spoofing detection measure ratio is less than or equal to the threshold value th, the method 300 may proceed to block 316. In block 316, the spoofed vehicle module 148 determines the object is a real vehicle. The method 300 may then terminate or return to block 302.
[0067] The controllers may refer to, or be part of an electronic circuit, a combinational logic circuit, a field programmable gate array (FPGA), a processor (shared, dedicated, or group) that executes code, or a combination of some or all of the above, such as in a system-on-chip. Additionally, the controllers may be microprocessor-based such as a computer having a at least one processor, memory (RAM and/or ROM), and associated input and output buses. The processor may operate under the control of an operating system that resides in memory. The operating system may manage computer resources so that computer program code embodied as one or more computer software applications, such as an application residing in memory, may have instructions executed by the processor. In an alternative embodiment, the processor may execute the application directly, in which case the operating system may be omitted.
[0068] The description of the present disclosure is merely exemplary in nature and variations that do not depart from the gist of the present disclosure are intended to be within the scope of the present disclosure. Such variations are not to be regarded as a departure from the spirit and scope of the present disclosure.