SIMULTANEOUS IDENTIFICATION AND LOCALIZATION OF OBJECTS BY MEANS OF BISTATIC MEASUREMENT
20230221425 · 2023-07-13
Inventors
Cpc classification
G01S2013/468
PHYSICS
G01S13/58
PHYSICS
G01S2013/466
PHYSICS
International classification
G01S13/34
PHYSICS
G01S13/58
PHYSICS
Abstract
A system identifies and localizes an object. The system contains a bistatic FMCW radar sensor system having two FMCW radar sensors and is configured to operate coherently or quasi-coherently and to emit a series of repeating ramp signals. An active RFID transponder is disposed on an object to be identified and to be localized and is configured to produce a modulated bistatic backscatter signal. A ramp signal sent out by the radar sensors at a ramp repetition frequency is modulated with an amplitude modulation signal, the modulation frequency is less than half the ramp repetition frequency. An evaluation unit establishes an association between a beat frequency and the modulation frequency of the active RFID transponder, which modulation frequency is already known, on the basis of the modulated bistatic backscatter signal by two Fourier transforms of the modulated backscatter signal according to the frequency and to the amplitude.
Claims
1-11. (canceled)
12. A system for identification and localization of an object, the system comprising: a bistatic frequency modulated continuous wave (FMCW) radar sensor system having at least two FMCW radar sensors, and configured to be operated coherently or quasi-coherently and configured to emit a series of repeating ramp signals; an active radio frequency identification (RFID) transponder disposed on the object to be identified and localized and set up to generate a modulated bistatic backscatter signal, wherein a ramp signal of the repeating ramp signals sent out by one of said at least two radar sensors at a ramp repetition frequency is modulated with an amplitude modulation signal, a modulation frequency of which is already known and is less than half a ramp repetition frequency; and an evaluation unit being set up to establish an association between a beat frequency and the modulation frequency of the active RFID transponder, the modulation frequency being an already known modulation frequency, on a basis of the modulated bistatic backscatter signal by means of a first Fourier transform of the modulated bistatic backscatter signal according to the ramp repetition frequency and a second Fourier transform according to an amplitude.
13. The system according to claim 12, wherein said evaluation unit is set up to determine a distance of said active RFID transponder to said bistatic FMCW radar sensor system on a basis of the beat frequency, and to identify the active RFID transponder on a basis of the already known modulation frequency.
14. The system according to claim 12, wherein when said bistatic frequency modulated continuous wave (FMCW) radar sensor system is operating as a quasi-coherent bistatic radar sensor system: further comprising a reference target with an already known position and a further active RFID transponder with the already known modulation frequency; wherein said evaluation unit: is set up to assign a beat frequency to said reference target on a basis of two Fourier transforms and the already known modulation frequency of said reference target; and further comprising a calibration unit, which is set up to carry out a calibration to determine a corrected beat spectrum on a basis of a bistatic measurement with one of said at least two radar sensors and on a basis of a determined beat frequency of said reference target.
15. The system according to claim 14, wherein said calibration unit is set up to: determine a frequency of said reference target in an abistatic region on a basis of a determined beat spectrum; determine a value of a frequency shift of the determined beat spectrum in the bistatic region on a basis of the frequency said reference target in the bistatic region determined by the bistatic measurement and an already known nominal frequency of a bistatic reflection signal of said reference target; and shift the determined beat spectrum by the value determined of the frequency shift.
16. The system according to claim 12, further comprising a position determination unit, which is set up to: determine a position of said active RFID transponder on a basis of an assigned said beat frequency; determine a first transit time of a monostatic reflection signal on a basis of a frequency of the object in a monostatic region of a determined beat spectrum; determine a second transit time of a bistatic reflection signal on a basis of a frequency of the object in a bistatic region of the determined beat spectrum; determine distances of said sensors to the object on a basis of the first and second transit times; and determine a position of the object by triangulation on a basis of the distances determined.
17. The system according to claim 12, further comprising a velocity determination unit, which is set up to: determine a first Doppler frequency of a monostatic reflection signal of the object in a monostatic region of a beat spectrum; determine a second Doppler frequency of a bistatic reflection signal of the object in a bistatic region of the beat spectrum; determine a first velocity component of the object on a basis of the first Doppler frequency; determine a second velocity component of the object on a basis of the second Doppler frequency and the first velocity component; and determine a vectorial velocity of the object on a basis of the first velocity component and the second velocity component.
18. The system according to claim 12, wherein said active RFID transponder is one of a plurality of RFID transponders, each of said RFID transponders has a different modulation frequency and each of said RFID transponders is disposed on a different object.
19. The system according to claim 12, wherein said active RFID transponder is one of a plurality of RFID transponders, which are disposed on one and a same said object such that a length and/or a width and/or a height of the object can be estimated with an aid of said RFID transponders.
20. A method for identification and localization of an object, which comprises the steps of: emitting a series of repeating ramp signals by means of a bistatic frequency modulated continuous wave (FMCW) radar sensor system with at least two FMCW radar sensors, and is configured to operate coherently or quasi-coherently; generating a modulated bistatic backscatter signal by means of an active radio frequency identification (RFID) transponder, which is disposed on the object to be identified and localized, wherein a ramp signal sent out by one of the at least two radar sensors at a ramp repetition frequency is modulated with an amplitude modulation signal, a modulation frequency of which is already known and is less than half the ramp repetition frequency; and establishing an association between a beat frequency and the modulation frequency of the active RFID transponder, the modulation frequency is already known, on a basis of the modulated bistatic backscatter signal by means of a first Fourier transform of the modulated backscatter signal according to the ramp repetition frequency and a second Fourier transform according to an amplitude.
21. A non-transitory computer program product with a computer program, which can be loaded directly into a computer unit of a system, with program sections to carry out all steps of the method according to claim 20 when the computer program is executed in the computer unit.
22. A non-transitory computer-readable medium having computer executable instructions which are capable of being executed by a computer unit, to carry out all steps of the method according to claim 20 when the computer executable instructions are executed by the computer unit.
Description
[0041] The invention is explained again in detail below by reference to the enclosed figures on the basis of exemplary embodiments. These show:
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064] In the first exemplary embodiment shown in
[0065] Transmission of the clock signal from the clock signal generator to the radar sensors R1, R2 can be implemented for example via an electric cable connection between the two radar sensors and the clock signal generator Tkt.
[0066] With the aid of the monostatic response it is possible to determine from the bistatic response the respective distance d.sub.11, d.sub.22 from the spatial direction from the two sensors R1, R2 to the target Z, and the velocity. Because the two sensors R1, R2 are set up at spatially distributed points a localization and a vectorial velocity measurement of objects Z is possible in such a cooperative radar system. Furthermore a distance d.sub.12, which the bistatic signal travels from the sensor R2 via the target Z to the sensor R1, is also drawn in. Only the measurement data from just one of the two sensors R1, R2 is needed to obtain this information.
[0067] The two sensor R1, R2 start a measurement by means of a common trigger signal from the trigger unit TR, which is connected to the two sensors R1, R2 either via a cable or by radio link. The common trigger signal ensures that the bistatic response can be measured within the limits set by the sensor hardware and software, i.e. in particular limits for the beat frequency bandwidth, the ramp configuration, and the A-D converter.
[0068] To distinguish between the monostatic response and the bistatic response at the first sensor R1, a frequency offset is implemented between the two radar sensors R1, R2, i.e. the FMCW signals of the first and the second radar sensors R1, R2 each start at different frequencies f.sub.0,1, f.sub.0,2. The bandwidth B and the duration T of the FMCW signal is the same for both sensors R1, R2. As a result the bistatic response is shifted by the frequency offset f.sub.off=f.sub.0,1−f.sub.0,2 to a predefined region in the baseband and can be separated from the monostatic response.
[0069] The beat signal S.sub.IF,1 of the first radar sensor R1 is related to the transit times τ.sub.11, τ.sub.12, of the monostatic reflection signal and the bistatic reflection signal as follows:
[0070] The signal S.sub.IF,1 comprises a monostatic component S.sub.IF,1, mono and a bistatic component which is attributable to the interaction between the second sensor R2, the target object Z, and the first sensor R1. The terms
behave proportionally to the distance of the target Z. The times τ.sub.11 and τ.sub.12 designate the transit times of the monostatic and bistatic signals S.sub.IF,1,mono, S.sub.IF,1,bi. The two phase values ϕ.sub.0,1, ϕ.sub.0,2 are the phases of the two sensor signals, the difference between which is known on the basis of the common clock timing.
[0071] Part of the beat spectrum measurement facility 10 shown in
[0072] Finally, on the basis of the raw data beat spectrum RBS, a monostatic beat frequency MZF and a bistatic beat frequency BZF of the target object Z are determined by a beat frequency determination unit 105.
[0073] Based on these beat frequencies and also the known bandwidth B of the signal and the signal duration T, it is possible to determine the transit times τ.sub.11, τ.sub.12 of the monostatic reflection signal and the bistatic reflection signal.
[0074] The distance d.sub.11 between the first sensor R1 and the target object Z can be calculated from the transit time τ.sub.11 of the monostatic signal S.sub.IF,1,mono by using the following equation:
[0075] where c is the speed of light or the propagation velocity of the radar waves.
[0076] From the transit time τ.sub.12 of the bistatic signal S.sub.IF,1,bi and also the value d.sub.11 determined for the distance between the first sensor R1 and the target object Z it is possible to calculate the distance d.sub.22 between the second sensor R2 and the target object Z by means of the following equation:
[0077] Using a simple trigonometric calculation based on the thus known sides of the triangle d, d.sub.11, d.sub.22 the position P of the target object Z relative to the radar system 10 can then be determined.
[0078] The velocity v=v.sub.11+v.sub.22, where v, v.sub.11, v.sub.22 are each vectorial variables and v.sub.11 points in the direction of d.sub.11 and v.sub.22 in the direction of d.sub.22, results from the Doppler frequencies of the monostatic and bistatic sensor signals S.sub.IF,1,mono, S.sub.IF,1,bi.
[0079] The Doppler frequency arises from the difference between the frequency of an emitted signal and the frequency of the reflected signal. Additionally the Doppler frequency can be calculated with the aid of multiple successive signals with a timing interval T. In this regard the Doppler frequency is given by the phase difference between the individual signals at the respective beat frequency of the target object.
[0080] The Doppler frequency can be calculated in various ways. In the case of static targets the phase of the beat signal is constant for signals that are consecutive in time. In the case of moving objects the phase of the beat signal changes with signals that are consecutive in time in proportion to the change in the distance and therefore in proportion to the velocity.
[0081] This change in the phase over time produces the Doppler frequency. This method is also designated as “Range Doppler Algorithm” or “Range Doppler Processing”.
[0082] The Doppler frequency fa, mono of the monostatic signal component is given by the following:
[0083] If the transit time Iii of the monostatic signal is known then the velocity vu, i.e. the velocity component of the target object Z in the direction of the path between the first sensor R1 and the target object Z, can be determined from the Doppler frequency f.sub.d,mono.
[0084] The Doppler frequency f.sub.d,bi of the bistatic sensor signal is given by the following:
[0085] From the bistatic Doppler frequency f.sub.d,bi and also the determined velocity component v.sub.11 it is then also possible to determine the second velocity component v.sub.22 in the direction of the path between the second sensor R2 and the target object Z. Additionally the vectorial total velocity v of the target object Z can be calculated from the two velocity components v.sub.11, v.sub.22 giving:
v=v.sub.11+v.sub.22. (6)
[0086] The evaluation unit 100a shown in
[0087]
[0088] The two sensors R1, R2, which make measurements in different spatial directions, are combined for form a cooperative radar system. The radar sensors R1, R2 are designed in the form of conventional stand-alone FMCW radar sensors and in each case measure a monostatic response from the target Z and from the reference target RO, i.e. a monostatic reflection signal RM, which can be used for determining the distance d.sub.11, d.sub.ref and also the velocity of the target Z or reference target RO in the radial spatial direction from the sensor R1 to the target Z or reference target RO. In addition to the monostatic response a bistatic reflection signal RB is also measured by the two radar sensors R1, R2 as in the case of the exemplary embodiment shown in
[0089] The bistatic reflection signal contains information about the distance d.sub.22 and about the velocity in the radial direction from the sensor R2 to the target Z and about the distance d.sub.11 in the direction from the radar sensor R1 to the target Z. This also applies correspondingly to the reference target RO.
[0090] As in the exemplary embodiment shown in
[0091] To distinguish between the monostatic response and the bistatic response at a sensor R1, a frequency offset is implemented between the two radar sensors R1, R2, i.e. the FMCW signals of the second radar sensors each start at different frequencies. The bandwidth and the duration of the FMCW signal is the same for both sensors R1, R2. As a result the bistatic response is displaced by the frequency offset f.sub.off to a predefined region in the baseband and can be separated from the monostatic response.
[0092] Following determination of a beat spectrum a correction of the bistatic component of the beat spectrum is then carried out, unlike in the exemplary embodiment shown in
[0093] As in the procedure illustrated in
[0094] As explained in conjunction with
[0095] The quasi-coherent operation can also be implemented with the aid of a GPS-controlled system or a radio link between the individual sensors.
[0096] GPS or radio links between the sensors can replace the trigger unit TR. Both variants can be used for the triggering function in coherent and quasi-coherent operation.
[0097] In the case of GPS signals a very stabile “pulse per second” signal (GPS 1 PPS) is sent (frequency 1 Hz). This signal can be received at the sensors in the system in the case of operation outdoors and following this a trigger signal can be generated locally. This process can be implemented in each case with the aid of a dedicated phase-locked loop, which uses the 1 PPS signal as a reference signal.
[0098] A radio link between the sensors presupposes a master/slave operation between the sensors. In this regard the master sensor can send a trigger signal to the slave sensor. This can take place both within the radar frequency band used for the distance measurement, and also with additional hardware in other frequency bands. In addition frequency and phase offsets can be compensated for with the aid of a previously defined signal form, which is sent by the master to the slave, similar to a pilot tone method.
[0099] An example of synchronization with the aid of a direct radio link between two radar sensors is given in the paper “Precise Distance Measurement with Cooperative FMCW Radar Units” by A. Stelzer, M. Jahn and S. Scheiblhofer, 1-4244-1463-6/08/$25.00 2008 IEEE, p. 771 to 774. However only the distance between the sensors is measured in this case.
[0100] Part of the beat spectrum measurement facility 20 shown in
[0101] The value f.sub.diff for the frequency shift and the raw data beat spectrum RBS are transmitted to a shift unit 104. The shift unit is used to shift the bistatic component of the raw data beat spectrum RBS by the value determined for the frequency shift f.sub.diff. In the course of this process a corrected beat spectrum BS.sub.k is determined, which can be used as the basis for a position calculation and a velocity calculation.
[0102] Finally, on the basis of the corrected beat spectrum BS.sub.k, a monostatic beat frequency MZF and a bistatic beat frequency BZF is determined for the target object Z by a beat frequency determination unit 105.
[0103] The evaluation unit 100 shown in
[0104]
[0105] During the measurement there was no full synchronization of the two radar sensors R1, R2 by means of a clock signal Tkt. Instead, a monostatic reflection signal MR and a bistatic reflection signal BR were measured both from the target object Z and also a reference target RO. In the beat spectrum the monostatic region MB and the bistatic region BB are separated from each other by means of a vertical black line L, which is situated approximately at a frequency of 250 kHz. Peak values RF, ZF, which correspond to the reference target RO and the target object Z, are plotted in the monostatic region. The frequency ZF, which corresponds to the target object, is situated at approximately 50 kHz, and the frequency RF, which corresponds to the reference target RO, is situated at approximately 100 kHz.
[0106] Peak values RFB, ZFB, which correspond to the reference target and the target object, can also be seen in the bistatic region BB of the beat spectrum BS. The frequency ZFB, which corresponds to the target object Z, is situated at approximately 530 kHz ad the frequency RFB, which corresponds to the reference target RO, is situated at approximately 570 kHz. The solid line indicates the raw data RD of the radar sensor R1, i.e. the data which has not yet been corrected with the aid of the reference target RO. A correction of the beat spectrum BS in the bistatic region BB results in the two target objects being shifted to the right in the beat spectrum. This process is possible on the basis of the known position of the reference target ZO and a likewise known beat frequency assigned to its distance away, in this case at about 660 kHz. The shifted spectrum CD is indicated by a dotted line. With the aid of the corrected spectral data CD the distance d.sub.22 between the second radar sensor R2 and the target ZO can be determined. Once the distances d.sub.11, d.sub.22 between the radar sensors R1, R2 and the target are known the unknown target can then be localized by means of triangulation, i.e. its position defined. Furthermore by defining the Doppler frequency the vectorial velocity of the target object Z can be determined. Monostatic and bistatic responses are evaluated for determination of both variables. These provide distance values or velocity values in two spatial directions.
[0107]
[0108]
[0109] In
[0110]
f.sub.n=f.sub.sample/N.sub.Abtast*n. (7)
[0111] Here f.sub.sample is the peak value sampling frequency and N.sub.abtast the quantity of samplings for the Fourier transform. The value n indicates the number of the nth bin. The frequency f.sub.n is the respective right boundary frequency of the nth bin.
[0112]
[0113]
[0114]
[0115]
[0116]
[0117]
[0118]
[0119] If all 24 amplitudes at frequency bin 27 are represented in one graph as a function of the ramp number ZR, then the representation shown in
[0120] In this regard the first value is the amplitude −33.04 dB of the receive signal of the first ramp, the second value the amplitude −32.65 dB of the receive signal of the second ramp, and the last value the amplitude −32.84 dB of the last ramp. In
[0121] Since the receive signals follow each other immediately in time, the receive time can also be plotted on the x-axis instead of the number ZR (ramp number) of the receive signal. In this example the receive time per signal is 414 μs.
[0122] If a Fourier transform is calculated over the time profile of the amplitude signal, then the amplitude spectrum shown in
[0123] If the amplitude value of the DC component is removed, then the spectrum illustrated in
[0124] The profile of the receive signal with the mean value taken out for the bin 27 is shown in
[0125]
[0126] This procedure has to be repeated for each frequency bin since due to the absence of coherence in the radar system the RFID transponder is situated at an unknown frequency bin. Bin 27 has been chosen here just as an example since it was already known from a previous evaluation that the RFID transponder of the reference object is situated there.
[0127] By chance it turns out in the spectrum in
[0128] To be able to establish unambiguously which frequency bin belongs to the RFID transponder to be identified, the average amplitude of the respective frequency bins can be used. Frequency bin 27 has an average amplitude of −33.27 dB. Since frequency bin 49 is situated in the noise region (see
[0129] If the Fourier transforms are weighted with the respective average amplitude of the bin then the picture shown in
[0130] Weighting the amplitude profile with the average amplitude of the bin does not necessarily need to be done if all noise bins have previously been excluded from the Fourier transform of the amplitudes (FFT2) by means of a suitable method. This can be accomplished with the aid of a target detection algorithm for example. Following target detection only those frequency bins that have been identified as a target are still investigated for a modulation frequency. However target detection is often more costly in terms of time and computing effort than a weighting with subsequent amplitude comparison.
[0131] If the weighted Fourier transforms of the receive signals of all frequency bins are written to the columns of a matrix, then the image shown in
[0132]
[0133] In step 21.1 a radar signal is initially generated by a radar sensor of a cooperative radar system. In step 21.11 this radar signal is amplitude-modulated by an RFID transponder, which is arranged on an object to be detected and identified. Following amplification of the modulated signal, the modulated signal is sent back to the cooperative radar system. In step 21.111 the modulated signal is captured and mixed by a radar sensor of the cooperative radar system. In the mixing step the modulated signal is mixed with the ramp signal of the radar sensor. In this way a differential signal is generated between the frequency of the modulated signal and the frequency of the receiving radar sensor, which is then also referred to as a beat signal. In step 21.IV the beat signal is sampled. In step 21.V the sampled data, which is assigned to different ramps, is separated from each other. In step 21.VI the first Fourier transform of the sampled signal data is then carried out to generate an amplitude spectrum. Furthermore in step 21.VII the second Fourier transform of the amplitude spectrum is carried out. Then, in step 21.VIII, the frequencies assigned to the individual objects are determined. In this regard, in a quasi-coherent radar sensor detection, the beat frequency of the RFID transponder of the reference object and also the modulation frequency assigned to the RFID transponder are initially determined in the spectrum. Additionally other objects are also identified on the basis of their modulation frequency, and localized on the basis of the beat signal assigned to them.
[0134] In step 21.IX, in order to rule out noise effects, the method of amplitude detection illustrated in
[0135] Subsequently further process steps can be taken for determining kinematic variables, such as for example the position, the velocity, or the vectorial velocity of an identified object. In detail this can be done for example by carrying out a determination of the monostatic and bistatic distances of the objects, triangulation, and from this, a position determination for the objects. For the velocity determination, a determination of the Doppler frequencies and velocities of the detected objects can be carried out. Furthermore to determine the vectorial velocity a determination of the direction of movement of the objects can also be carried out.
[0136] In conclusion reference is made once more to the fact that the method and devices described above just relate to preferred exemplary embodiments of the invention and that the invention can be varied by a person skilled in the art without departing from the scope of the invention, insofar as it is defined by the claims. For the sake of completeness reference is also made to the fact that the use of the indefinite article “a” does not exclude the eventuality that the relevant features can also be present multiple times. Likewise the term “unit” does not exclude the eventuality that same consists of multiple components, which can also be spatially distributed where appropriate.