Object detection apparatus, object detection method, and computer-readable recording medium
11262441 · 2022-03-01
Assignee
Inventors
Cpc classification
G01S13/34
PHYSICS
G08G1/166
PHYSICS
G01S7/415
PHYSICS
International classification
G01S13/34
PHYSICS
Abstract
An object detection apparatus 1 includes: an emitting unit 101 for emitting an RF transmission signal; a receiving unit 201 for receiving, if the RF transmission signal is reflected off an object, the reflected RF transmission signal as an RF reception signal; an IF signal generating unit 202 for generating, in every period, a complex IF signal based on a signal obtained by mixing the RF transmission signal with the RF reception signal; a position detecting unit 203 for detecting the position of the object based on an evaluation function generated based on the complex IF signal generated in every period; and a displacement detecting unit 204 for detecting a displacement of the object based on the position of the object and the phase of complex reflectance of the object calculated based on the complex IF signal.
Claims
1. An object detection apparatus for detecting an object using radio waves, comprising: an emitting unit configured to emit an RF transmission signal obtained by sweeping a frequency in every period; a receiving unit configured to receive, if the RF transmission signal emitted by the emitting unit is reflected off the object, the RF transmission signal reflected off the object as an RF reception signal; an IF signal generating unit configured to generate, in every period, a complex IF signal based on a signal obtained by mixing the RF transmission signal with the RF reception signal; a position detecting unit configured to detect a position of the object based on an evaluation function generated based on the complex IF signal generated in every period; and a displacement detecting unit configured to detect a displacement of the object based on the position of the object detected by the position detecting unit and a phase of complex reflectance of the object calculated based on the complex IF signal.
2. The object detection apparatus according to claim 1, further comprising an object identifying unit configured to identify at least one of a type and behavior of the object, based on the displacement of the object.
3. The object detection apparatus according to claim 1, wherein the IF signal generating unit includes a quadrature demodulator, and mixes the RF transmission signal with the RF reception signal using the quadrature demodulator to generate the complex IF signal.
4. The object detection apparatus according to claim 1, wherein the IF signal generating unit generates the complex IF signal by applying Hilbert transform to the signal obtained by mixing the RF transmission signal with the RF reception signal.
5. The object detection apparatus according to claim 1, wherein the position detecting unit uses, as the evaluation function, an evaluation function obtained based on a null steering method, and detects the position of the object based on a peak position of the evaluation function.
6. The object detection apparatus according to claim 5, wherein the position detecting unit uses a multiple signal classification method as the null steering method.
7. The object detection apparatus according to claim 5, wherein the position detecting unit uses an estimation of signal parameters via rotational invariance technique method as the null steering method.
8. An object detection method for detecting an object using radio waves, comprising: (a) emitting an RF transmission signal obtained by sweeping a frequency in every period; (b) receiving, if the RF transmission signal emitted in the (a) step is reflected off the object, the RF transmission signal reflected off the object as an RF reception signal; (c) generating, in every period, a complex IF signal based on a signal obtained by mixing the RF transmission signal with the RF reception signal; (d) detecting a position of the object based on an evaluation function generated based on the complex IF signal generated in every period; and (e) detecting a displacement of the object based on the position of the object detected in the (d) step and a phase of complex reflectance of the object calculated based on the complex IF signal.
9. A non-transitory computer-readable recording medium in an object detection apparatus including: an emitting unit configured to emit an RF transmission signal obtained by sweeping a frequency in every period; a receiving unit configured to receive, if the RF transmission signal emitted by the emitting unit is reflected off an object, the RF transmission signal reflected off the object as an RF reception signal; an IF signal generating unit configured to generate, in every period, a complex IF signal based on a signal obtained by mixing the RF transmission signal with the RF reception signal; and a processor, the recording medium storing a program including a command to cause the processor to perform: (a) a step of detecting a position of the object based on an evaluation function generated based on the complex IF signal generated in every period; and (b) a step of detecting a displacement of the object based on the position of the object detected in the (a) step and a phase of complex reflectance of the object calculated based on the complex IF signal.
10. The object detection method according to claim 8, further including (f) identifying at least one of a type and behavior of the object, based on the displacement of the object.
11. The object detection method according to claim 8, wherein, in the (c), the RF transmission signal is mixed with the RF reception signal by the quadrature demodulator to generate the complex IF signal.
12. The object detection method according to claim 8, wherein, in the (c), the complex IF signal is generated by applying Hilbert transform to the signal obtained by mixing the RF transmission signal with the RF reception signal.
13. The object detection method according to claim 8, wherein, in the (d), an evaluation function obtained based on a null steering method is used as the evaluation function, and the position of the object is detected based on a peak position of the evaluation function.
14. The object detection method according to claim 13, wherein, in the (d), a multiple signal classification method is used as the null steering method.
15. The object detection method according to claim 14, wherein, in the (d), an estimation of signal parameters via rotational invariance technique method is used as the null steering method.
16. The non-transitory computer-readable recording medium according to claim 9, wherein the program further includes a command to cause the processor to perform (c) a step of identifying at least one of a type and behavior of the object, based on the displacement of the object.
17. The non-transitory computer-readable recording medium according to claim 16, wherein, in the (a) step, an evaluation function obtained based on a null steering method is used as the evaluation function, and the position of the object is detected based on a peak position of the evaluation function.
18. The non-transitory computer-readable recording medium according to claim 17, wherein, in the (a) step, a multiple signal classification method is used as the null steering method.
19. The non-transitory computer-readable recording medium according to claim 17, wherein, in the (a) step, an estimation of signal parameters via rotational invariance technique method is used as the null steering method.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
MODE FOR CARRYING OUT THE INVENTION
Example Embodiment
(11) Hereinafter, an object detection apparatus, an object detection method, and a program according to an example embodiment of the invention will be described with reference to
(12) [Apparatus Configuration]
(13) First, a schematic configuration of the object detection apparatus according to this example embodiment will be described with reference to
(14) An object detection apparatus 1 according to this example embodiment shown in
(15) The emitting unit 101 emits an RF transmission signal, which is obtained by sweeping a frequency in every period. If the RF transmission signal emitted by the emitting unit 101 is reflected off an object, the receiving unit 201 receives the reflected RF transmission signal (reflected wave) as an RF reception signal. In this example embodiment, a signal received by the receiving unit 201, that is, an RF transmission signal reflected off an object is referred to as an RF reception signal.
(16) The IF signal generating unit 202 generates a complex IF signal in every period, based on a signal obtained by mixing an RF transmission signal and an RF reception signal. The position detecting unit 203 detects the position of an object based on an evaluation function generated based on the complex IF signal generated in every period. The displacement detecting unit 204 detects a displacement of an object based on the position of the object detected by the position detecting unit 203 and the phase of complex reflectance of the object that is calculated based on the complex IF signal.
(17) Thus, the object detection apparatus 1 detects not only the position of an object that is present in an area to which radio waves are emitted, but also a displacement thereof. Since the displacement is detected based on the phase of the complex reflectance of an object, the displacement of a stationary thing is zero, whereas the displacement of a stationary person takes a value greater than zero, and thus, a distinction therebetween can be made. For this reason, according to the object detection apparatus 1, the type and behavior of an object can be identified without being affected by the state of the object.
(18) Next, the configuration of the object detection apparatus according to this example embodiment will be described in more detail, with reference to
(19) As shown in
(20) In this example embodiment, the position detecting unit 203 detects the position of an object, or more specifically, the distance R between an object and the object detection apparatus 1, based on a peak position of the evaluation function generated based on the complex IF signal generated in every period. The evaluation function is expressed by Equation 22, which will be described later.
(21) In this example embodiment, the displacement detecting unit 204 calculates the complex reflectance of an object based on information indicating the position of a target object detected by the position detecting unit 203 and the complex IF signal, by employing Expressions 23 and 24, which will be described later. The displacement detecting unit 204 then calculates an infinitesimal displacement or vibration of the object as a displacement of the object, based on the phase of the complex reflectance of the object. The thus-calculated displacement of the object is a characteristic element of the invention.
(22) The object identifying unit 205 identifies one of or both the type and behavior of an object, based on the displacement of the object detected by the displacement detecting unit 204. For example, if the object is a fixed obstacle, the object does not vibrate and thus does not have any displacement either. Meanwhile, if the object is a person, the object has a vibration (displacement) of about 1 Hz when in a stationary state, and has a vibration (displacement) of about several Hz when in a walking state. If the object is a machine, such as a vehicle, the object has a vibration (displacement) of about several tens of Hz when in a state where an engine thereof is running, and does not vibrate when in a state where the engine is not running.
(23) Accordingly, the object identifying unit 205 identifies an object by analyzing the pattern of the displacement (vibration) of the object.
(24) [Apparatus Operations]
(25) Next, operations of the object detection apparatus 1 according to the example embodiment of the invention will be described with reference to
(26) Initially, in the transmitter 10, the emitting unit 101 emits a frequency-swept RF transmission signal toward a target area (step S1), as shown in
u(t)=U cos[θ(t)] [Equation 1]
(27) In Equation 1 above, t denotes time. U denotes the amplitude of the RF transmission signal u(t). θ denotes the phase. The phase θ is expressed as a function of the time t.
(28) If an object is present in the area to which the RF transmission signal is emitted, the RF transmission signal is reflected off the object present. This signal reflected off the object returns to the object detection apparatus 1.
(29) Next, upon the RF transmission signal being reflected off the object, the receiving unit receives the RF transmission signal that has been reflected off the object, as an RF reception signal (step S2). For example, the RF reception signal is a signal expressed by the following Equation 2.
u.sub.0(t)=U.sub.0 cos[θ.sub.0(t)] [Equation 2]
(30) In Equation 2 above, U.sub.0 denotes the amplitude of the RF reception signal u.sub.0(t). θ.sub.0(t) denotes the phase. The phase θ.sub.0(t) is expressed as a function of the time t.
(31) Also, in step S2, the receiving unit 201 transmits the RF reception signal u.sub.0(t) to the IF signal generating unit 202.
(32) Next, the IF signal generating unit 202 acquires the RF transmission signal u(t) from the emitting unit 101, acquires the RF reception signal u.sub.0(t) from the receiving unit 201, and mixes the RF transmission signal u(t) with the RF reception signal u.sub.0(t) to generate a complex IF signal (step S3).
(33) Specifically, the RF transmission signal u(t) acquired by the IF signal generating unit 202 is a chirp signal shown in
f(t)=f.sub.min+α(t−kT) [Equation 3]
(34) Here, the time t takes a value in a range: (kT-T/2)<t<(kT+T/2). k denotes an integer that is 0, ±1, ±2, . . . T denotes a signal period of the chirp signal. f.sub.min denotes the minimum frequency of the chirp signal. α denotes the rate of change (slope) of the frequency f(t) per unit time.
(35) If the frequency f(t) of the RF transmission signal u(t) changes as expressed by Equation 3 above, the relationship expressed by the following Equation 4 holds between the frequency f(t) and the phase θ(t).
f(t)=(½π)×(dθ(t)/dt) [Equation 4]
(36) Based on Equations 3 and 4 above, the phase θ(t) is calculated as expressed by the following Equation 5. Note that, in the following Equation 5, t-kT is replaced with t.sub.k since t.sub.k=t-kT.
θ(t.sub.k)=2πf.sub.mint.sub.k+παt.sub.k.sup.2 [Equation 5]
(37) If, for example, the RF reception signal u.sub.0(t) acquired by the IF signal generating unit is the chirp signal shown in
θ.sub.0(t)=θ(t−τ) [Equation 6]
(38) If the light velocity is denoted as c, and the distance to a target object in a single chirp transmission period is denoted as R, the relationship expressed by the following Equation 7 holds between the distance R and the delay time τ.
τ=2R/c [Equation 7]
(39) The IF signal generating unit 202 mixes the acquired RF transmission signal u(t) with the acquired RF reception signal u.sub.0(t) to generate an IF signal. Specifically, the IF signal generating unit 202 generates an in-phase component I(t) of the IF signal that is expressed by the following Equation 8 and a quadrature component Q(t) of the IF signal that is expressed by the following Equation 9, for example.
I(t)=cos[θ.sub.w(t)] [Equation 8]
Q(t)=sin[θ.sub.w(t)] [Equation 9]
(40) If the IF signal generating unit 202 includes a quadrature demodulator, the IF signal generating unit 202 can generate the in-phase component I(t) and the quadrature component Q(t) of the IF signal using the quadrature demodulator. Otherwise, if the IF signal generating unit 202 includes a modulator, the IF signal generating unit 202 can generate the in-phase component I(t) of the IF signal using the modulator, and can also generate the quadrature component Q(t) by applying Hilbert transform to the in-phase component I(t).
(41) The phase θ.sub.w(t) of the IF signal is the phase expressed by the following Equation 10. In Equation 10, the time t.sub.k takes a value in a range: (−T/2+τ)<t.sub.k<(T/2).
(42)
(43) If the position of an object (the distance from the object detection apparatus 1 to a target object) R(t) is 30 meters, the delay time τ=0.2 u seconds. A typical value of t.sub.k is a chirp period T (about 1 m second). Accordingly, if the delay time τ is compared with t.sub.k in Equation 10 above, the delay time τ is sufficiently smaller than t.sub.k.
(44) If the condition that the delay time τ<<t.sub.k is applied to Equation 10 above, approximation can be made such that the term τ.sup.2 is ignored. As a result, the phase θ.sub.w(t) of the IF signal is expressed by the following Equation 11.
θ.sub.w(t)=4πf.sub.minR/c+4παR t.sub.k/c [Equation 11]
(45) The IF signal generating unit 202 then generates a complex IF signal S(t), which is given by the following Equation 12, based on the in-phase component I(t) and the quadrature component Q(t) of the IF signal.
S(t)=I(t)+jQ(t)=exp[θ.sub.w(t)] [Equation 12]
(46) Next, the position detecting unit 203 detects the position of the object based on an evaluation function generated by the complex IF signal generated in every period (step S4). Here, it is presumed that N objects are present at positions at distances R.sub.1, R.sub.2, . . . , R.sub.N, respectively. The complex IF signal S(t) obtained in this case is given by the following Equation 13, according to the superposition theorem.
(47)
(48) In Equation 13 above, σ(R.sub.n) denotes the reflectance of an object that is present at the distance R.sub.n. The reflectance σ(R.sub.n) is an unknown. By detecting the positions R.sub.1, R.sub.2, . . . , R.sub.N at which the reflectance σ(R.sub.n) of the target objects is not zero, the distances R.sub.1, R.sub.2, . . . , R.sub.N to the target objects can be determined. Equation 13 above can also be expressed by the following Equation 14.
{right arrow over (S)}=A{right arrow over (σ)}′, [Equation 14]
(49) In Equation 14 above, S on the left side denotes a K×1-order vector, which is defined by the following Equation 15.
{right arrow over (S)}≡[S(t.sub.1),S(t.sub.2), . . . ,S(t.sub.K)].sup.t, [Equation 15]
(50) In Equation 15 above, S(t.sub.1), S(t.sub.2), . . . , S(t.sub.K) are values of the complex IF signal at sampling time t.sub.1, t.sub.2, . . . , t.sub.K in a single chirp, and K denotes the number of sampling points. [ ].sup.t in Equation 15 above denotes a transpose of the vector.
(51) In Equation 14 above, A on the right side denotes a K×N-order matrix, which is defined by the following Equation 16.
A≡[{right arrow over (a)}(R.sub.1),{right arrow over (a)}(R.sub.2), . . . ,(R.sub.N)], [Equation 16]
(52) A is also called a direction matrix. A vector a(R) in the direction matrix A is defined by the following Equation 17. Note that the vector a(R) is called a direction vector.
{right arrow over (a)}(R)≡[exp(jφ.sub.1(R)),exp(jφ.sub.2(R)), . . . ,exp(jφ.sub.K(R))].sup.t,φ.sub.k(R)≡4παt.sub.kR/c, [Equation 17]
(53) In Equation 14 above, σ′ in the right side is an N×1-order vector, which is defined by the following Equation 18.
{right arrow over (σ)}′≡[σ′(R.sub.1),σ′(R.sub.2), . . . ,σ′(R.sub.N)].sup.t, [Equation 18]
(54) Here, σ′(R.sub.n) (n=1, 2, . . . , N) denotes complex reflectance of a target object at the distance R.sub.n, and is defined by the following Equation 19.
σ′(R.sub.n)≡σ(R.sub.n)R.sub.n.sup.−2exp[j4πf.sub.minR.sub.n/c], [Equation 19]
(55) In the case where Equation 14 above holds, the positions R.sub.1, R.sub.2, . . . , R.sub.N at which the reflectance σ(R.sub.n) of the target objects is not zero can be detected by applying the processing of the MUSIC method. Thus, the distances R.sub.1, R.sub.2, . . . , R.sub.N of the target objects can be measured accurately.
(56) Accordingly, in this example embodiment, in step S4, the position detecting unit 203 measures the distance to each target object and determines the position thereof by performing the processing of the MUSIC method using the complex IF signal S(t) generated by the IF signal generating unit 202. In the following description, a more detailed description will be given of the method for determining the position of an object performed by the position detecting unit 203 in this example embodiment.
(57) The position detecting unit 203 calculates a vector S.sub.g, which is obtained by taking, out of the vector S defined by Equation 15 above, a subelement of the vector S, the vector S.sub.g being defined by the following Equation 20. In the following Equation 20, G denotes the number of elements of the vector S.sub.g.
{right arrow over (S)}.sub.g≡[S(t.sub.g),S(t.sub.g+1), . . . ,S(t.sub.g+G−1)].sup.t,(g=1,2, . . . ,K−G+1) [Equation 20]
(58) Next, the position detecting unit 203 calculates a correlation matrix R.sub.s using the vector S.sub.g in accordance with the following Equation 21. In the following Equation 20, the suffix H in the equation denotes a complex conjugate transposition.
(59)
(60) Next, the position detecting unit 203 calculates a characteristic vector [e.sub.1, e.sub.2, . . . , e.sub.G] of the correlation matrix R.sub.S. Furthermore, the position detecting unit 203 extracts a characteristic vector with which the characteristic value is smallest, and generates a matrix: E.sub.N=[e.sub.N+1, e.sub.N+2, . . . , e.sub.G].
(61) Next, the position detecting unit 203 calculates an evaluation function P.sub.MU(R) based on the MUSIC method that is defined by the following Equation 22, using the matrix E.sub.N calculated from the correlation matrix R.sub.S and the direction vector a(R) defined by Equation 17 above.
(62)
(63) In Equation 22 above, a variable R may be obtained by sweeping any value. In the MUSIC method, the evaluation function P.sub.MU(R) has peaks at the positions R.sub.1, R.sub.2, . . . , R.sub.N at which the reflectance σ(R.sub.n) of an object is not zero. Accordingly, the distances R.sub.1, R.sub.2, . . . , R.sub.N to the target objects can be measured based on the peak positions of the evaluation function P.sub.MU(R).
(64) Here, a description will be given, with reference to
(65) It is assumed that an object 31 is present at a position away from the object detection apparatus 1 by 1 m, and an object 32 is present at a position away from the object detection apparatus 1 by 1.3 m, as shown in
(66) If the evaluation function P.sub.MU(R) calculated in step S4 is applied to the example arrangement shown in
(67) As already described in the background art, the distance resolution achieved in the normal FMCW method is given as c/(2BW), where the bandwidth of the frequency of an RF transmission signal is denoted as BW, and the light velocity is denoted as c. Accordingly, if the bandwidth BW is 200 MHz, the theoretical value of the distance resolution is 75 cm. In this regard, in this example embodiment, the MUSIC method, which is a super-resolution algorithm, is applied in step S4, and thus, the distance resolution is improved to about ½ to ⅓ of the distance resolution in the case of a normal FMCW radar.
(68) The distance from the object detection apparatus 1 to each object is measured by performing the above-described steps S1 to S4, but it is difficult to identify the type and behavior of each object simply by measuring the distance to the object. As already mentioned, for each type or behavior of the object, an infinitesimal displacement or vibration with a specific pattern is generated by an object, and thus, measurement and analysis of such an infinitesimal displacement or vibration are required to identify the type and behavior of the object.
(69) For this reason, in this example embodiment, after step S4 has been performed, the displacement detecting unit 204 detects a displacement of each object based on the position of the object detected by the position detecting unit 203 and the phase of the complex reflectance of the object calculated based on the complex IF signal (step S5). If an object is a person or a vehicle, the displacement of the object takes a very small value that is 1 cm or less, and thus, the displacement detected in step S5 is, specifically, an infinitesimal displacement or vibration of the object.
(70) Now, processing performed by the displacement detecting unit 204 will be described in detail. Initially, the displacement detecting unit 204 calculates the vector σ′ defined by Equation 18 above, based on the following Equation 23, using the distances R.sub.1, R.sub.2, . . . , R.sub.N to the objects calculated in step S4.
{right arrow over (σ)}′=(A.sup.HA).sup.−1A.sup.H{right arrow over (S)}, [Equation 23]
(71) In addition, as described regarding the definition of Equation 16 above, information indicating the distances R.sub.1, R.sub.2, . . . , R.sub.N to the target objects are required to determine the direction matrix A. Accordingly, the displacement detecting unit 204 calculates the complex reflectance σ′(R.sub.n) (n=1, 2, . . . , N) of the object located at the distance R.sub.n, based on elements of the vector σ′ calculated using Equation 23 above.
(72) Next, the displacement detecting unit 204 calculates an infinitesimal displacement ΔR.sub.n of the object located at the distance R.sub.n, based on the phase Dσ′(R.sub.n) of the calculated complex reflectance σ′(R.sub.n) (n=1, 2, . . . , N) of the object, in accordance with the following Equation 24. Note that the following Equation 24 is obtained by modifying Equation 19 above.
(73)
(74) If an error of the phase Dσ′(R.sub.n) is denoted as Δθ, an error of the displacement is given as cΔθ/(4πf.sub.in). For example, if the error Δθ is 3 degrees, and the minimum RF frequency f.sub.min is 24.05 GHz, the error of the displacement takes a very small value, namely 52 μm. In this example embodiment, the accuracy of displacement detection is increased by using the phase of the complex reflectance in displacement detection.
(75) The displacement detecting unit 204 then calculates the infinitesimal displacement ΔR.sub.n for every chirp, thereby acquiring data regarding temporal changes in the infinitesimal displacement ΔR.sub.n.
(76) Also, in step S5, a displacement of each object is detected based on the phase of the complex reflectance of the object, as mentioned above. To obtain the complex reflectance of an object, a complex IF signal is required. This complex IF signal may be one that is generated by the IF signal generating unit 202 using a quadrature demodulator or Hilbert transform.
(77) Here, a description will be given of an example of the detection results of the infinitesimal displacement or vibration of an object obtained in step S5. Similarly to the example in step S4, it is assumed that an object 31 is present at a position away from the object detection apparatus 1 by 1 m, and an object 32 is present at a position away from the object detection apparatus 1 by 1.3 m, as shown in
(78)
(79) Next, the object identifying unit 205 identifies the type or behavior of the objects, based on the displacement of the objects detected in step S5 by the displacement detecting unit 204 (step S6). Specifically, in step S6, if, for example, the displacement detected in step S5 is zero, the object identifying unit 205 determines that the object is a fixed obstacle. If the displacement detected in step S5 is about 1 Hz, the object identifying unit 205 determines that the object is a stationary person.
(80) Furthermore, if the time-series change in the distance detected in step S4 matches the walking speed of a person, and the displacement detected in step S5 is a vibration with a frequency of several Hz, the object identifying unit 205 determines that the object is a walking person. If the time-series change in the distance detected in step S4 is zero, but the displacement detected in step S5 is a vibration with a frequency of about several tens of Hz, the object identifying unit 205 determines that the object is a stopped vehicle.
(81) As described above, in this example embodiment, measurement of an infinitesimal displacement or vibration of each object is performed by the displacement detecting unit 204, in addition to the measurement of the distance to each object performed by the position detecting unit 203. For this reason, in this example embodiment, the type or behavior of an object can be identified based on the infinitesimal displacement or vibration of the object, unlike the case of a conventional apparatus that only measures the distance to an object.
(82) Note that the above equations may be stored in units, or may be stored in a storage apparatus that is not shown in
(83) [Program]
(84) A program according to this example embodiment need only be a program for causing a computer to perform steps S3 to S6 shown in
(85) The program according to this example embodiment may also be executed by a computer system that is constituted by a plurality of computers. In this case, for example, each of the computers may function as any of the position detecting unit 203, the displacement detecting unit 204, and the object identifying unit 205.
(86) [Example Modification]
(87) Next, an example modification of this example embodiment will be described. In the above-described example, in step S4, the position of an object is detected (the distance to an object is measured) based on the MUSIC method, but the method used in step S4 is not particularly limited in this example embodiment. For example, in this example modification, in step S4, the position detection of an object may alternatively be performed (the distance to an object may be measured) based on an ESPRIT (Estimation of Signal Parameters via Rotational Invariance Technique) method.
(88) Note that both the MUSIC method and the ESPRIT method were originally developed for use in estimation of the arrival direction of radio waves, and both are known as ultrahigh-resolution algorithms that use a so-called null steering method, in which a null point of the antenna directivity is steered toward the arrival direction. In this example embodiment, the ESPRIT method is used to measure the distance to a target object, rather than to estimate the arrival direction of radio waves.
(89) Now, step S4 in the case of detecting the position of an object (measuring the distance to an object) based on the ESPRIT method will be described in detail. In this example modification, in step S4, the position detecting unit 203 first calculates the vector S.sub.g that is defined by Equation 20 above and is obtained by taking, out of the vector S defined by Equation 15 above, a subelement of the vector S. Furthermore, the position detecting unit 203 calculates the correlation matrix R.sub.S in accordance with Equation 21 above, using the vector S.sub.g.
(90) However, since the ESPRIT method is used in this example modification, a condition that the sampling times t.sub.1, t.sub.2, . . . , t.sub.k of the IF signal are provided at equal intervals needs to be satisfied. That is to say, the IF signal needs to be sampled at fixed sampling time Δt.
(91) Next, the position detecting unit 203 calculates the characteristic vector [e.sub.1, e.sub.2, . . . , e.sub.G] of the correlation matrix R.sub.S. Furthermore, a matrix E.sub.S=[e.sub.1, e.sub.2, . . . , e.sub.N] is generated using a characteristic vector other than the characteristic vector [e.sub.1, e.sub.2, . . . , e.sub.G] with which the characteristic value is smallest.
(92) Next, the position detecting unit 203 calculates matrices E.sub.X and E.sub.Y, which are given by the following Equation 25, using the matrix E.sub.S. In Equation 25, a matrix J1 is a (G−1)×G-order matrix generated by adding a zero vector to a Gth column in a (G−1)×(G−1)-order unit matrix. A matrix J2 is a (G−1)×G-order matrix generated by adding a zero vector to the first column in the (G−1)×(G−1)-order unit matrix.
E.sub.X=J.sub.1E.sub.S,E.sub.Y=J.sub.2E.sub.S [Equation 25]
(93) Next, the position detecting unit 203 calculates a matrix Ψ=E.sub.X.sup.−1E.sub.Y based on the calculated matrices E.sub.X and E.sub.Y. Furthermore, the position detecting unit 203 calculates a characteristic value β.sub.n(n=1, 2, . . . , N) of the matrix Ψ.
(94) Next, the position detecting unit 203 calculates the positions R.sub.1, R.sub.2, . . . , R.sub.N of the target objects based on the following Equation 26, using the calculated characteristic value β.sub.n(n=1, 2, . . . , N) of the matrix Ψ.
(95)
(96) Then, in this example modification as well, the displacement detecting unit 204 detects an infinitesimal displacement or vibration of each object (step S5), and the object identifying unit 205 identifies the type or behavior of each object (step S6), similarly to the example shown in
(97) Thus, in this example embodiment, either the MUSIC method or the ESPRIT method may be used as a method for detecting the position of an object (measuring the distance to an object) in step S4. Also, the method for detecting the position of a target object (measuring the distance to a target object) in step S4 is required to be a high-resolution method that enables a plurality of objects that are close to each other to be detected separately. That is to say, in this example embodiment, it is preferable to use an ultrahigh-resolution algorithm using the null steering method, which is typified by the MUSIC method or the ESPRIT method, to detect the position of an object (measure the distance to an object).
(98) [Example Application 1]
(99) Next, an example application of the object detection apparatus 1 according to this example embodiment will be described below with reference to
(100) In the example application 1, the object detection apparatus 1 is installed on a fixing jig 411, which protrudes from the ground surface, and detects objects that are present on the ground surface, as shown in
(101) In the example in
(102) Then, the object detection apparatus 1 identifies the types of the objects based on the displacement of the objects 403a and 403b. For example, the object 403a, which is a pedestrian, exhibits a displacement (movement) with a frequency of several Hz or less, depending on the movement state thereof. The object 403b, which is a vehicle such as an automobile, exhibits a displacement (vibration) of about several tens of Hz, depending on the operating state thereof.
(103) By using the fact that the frequency of displacement (vibration) thus differs depending on the type of each object, the object detection apparatus 1 identifies the types of the detected objects. In the example in
(104) In the example application 1, the object detection apparatus 1 can also identify the behavior (state) of each object. For example, a displacement detected in the case where an object is a pedestrian is a vibration with a low frequency of about 1 Hz if the pedestrian has stopped, and is a vibration (displacement) with a relatively high frequency of several Hz if the pedestrian is walking. A displacement detected in the case where an object is a vehicle is zero if the vehicle engine is not running, and is a vibration (displacement) of about several tens of Hz if the vehicle engine is running. Accordingly, the object detection apparatus 1 can identify the behavior (state) of an object by measuring a vibration (displacement) of the object. Thus, information indicating the behavior (state) of an object can be used in safety monitoring at a railroad crossing or an intersection.
(105) [Example Application 2]
(106) Next, another application example of the object detection apparatus 1 according to this example embodiment will be described below with reference to
(107) In the example application 2, the object detection apparatus 1 is mounted in a moving body 401, as shown in
(108) Also, as shown in
(109) In the example application 2 as well, the object detection apparatus 1 detects the positions of the objects 403a, 403b, and 403c using the MUSIC method or the ESPRIT method, and also measures displacements of the objects. The object detection apparatus 1 then identifies the types of the objects 403a, 403b, and 403c, based on the displacements thereof.
(110) For example, a pedestrian exhibits a displacement (movement) with a frequency of about several Hz or less, and a vehicle exhibits a displacement (vibration) with a frequency of about several tens of Hz, as mentioned in the example application 1. A fixed body exhibits no displacement (vibration), and the displacement thereof is zero.
(111) Thus, in the example application 2 as well, the types of the detected objects are identified using the fact that the frequency of displacement (vibration) differs depending on the type of each object, similarly to the example application 1. Also, in the example application 2 as well, the frequency of displacement is used to distinguish between the types of the objects, similarly to the example application 1. However, this is merely an example. In the example application 2 as well, the type of an object may be distinguished using a pattern of a time waveform of displacement thereof.
(112) In the example application 2, the object detection apparatus 1 in the state of being mounted in the moving body 401 can not only detect the presence of objects, but also identify the types of the objects, and thus can improve traffic safety.
(113) For example, if the object 403a can be identified as a pedestrian, the object detection apparatus 1 can predict that the pedestrian may make a dangerous action, e.g. cross a road 404, and can instruct the moving body 401 to take safety measures, e.g. lower the moving speed. Also, if the object 403c can be identified as a fixed obstacle, the object detection apparatus 1 can predict that the obstacle will continue to be present at the same position, and can instruct the moving body 401 to change the direction. Also, if the object 403b can be identified as a vehicle, the object detection apparatus 1 can predict that the object 403b will continue to move along the road, and can instruct the moving body 401 to not excessively approach the object 403b.
(114) Thus, according to the example application 2, the object detection apparatus 1 can predict movement of an object and notify the moving body 401 of the prediction results, in accordance with the identified type of the object. Thus, the moving body 401 can use the prediction results for the purpose of safety traveling.
(115) [Physical Configuration]
(116) A description will now be given, with reference to
(117) As shown in
(118) The CPU 511 loads the program (codes) according to this example embodiment that is stored in the storage device 513 to the main memory 512 and executes the program in a predetermined order, thereby performing various kinds of computation. The main memory 512 typically is a volatile storage device, such as a DRAM (Dynamic Random Access Memory). The program according to this example embodiment is provided in a state of being stored in a computer-readable recording medium 520. Note that the programs according to this example embodiment may also be distributed on the Internet to which the computer is connected via a communication interface 517.
(119) Specific examples of the storage device 513 may include a hard disk drive, a semiconductor storage device such as a flash memory, and the like. The input interface 514 mediates data transmission between the CPU 511 and input devices 518 such as a keyboard and a mouse. The display controller 515 is connected to a display device 519 and controls a display on the display device 519.
(120) The data reader/writer 516 mediates data transmission between the CPU 511 and the recording medium 520, reads out the program from the recording medium 520, and writes, in the recording medium 520, the results of processing performed by the computer 510. The communication interface 517 mediates data transmission between the CPU 511 and other computers.
(121) Specific examples of the recording medium 520 may include a general-purpose semiconductor storage device such as a CF (Compact Flash (registered trademark)) or a SD (Secure Digital), a magnetic recording medium such as a Flexible Disk, and an optical recording medium such as a CD-ROM (Compact Disk Read Only Memory).
(122) Note that the object detection apparatus 1 according to this example embodiment may also be realized not only by the computer in which the program is installed, but by using hardware that corresponds to each portion of the computer. Furthermore, a part of the object detection apparatus 1 may be realized by the program, and the remaining part may be realized by hardware.
(123) Part of, or the entire example embodiment described above can be expressed by the following (Supplementary Note 1) to (Supplementary Note 19), but is not limited thereto.
(124) (Supplementary Note 1)
(125) An object detection apparatus for detecting an object using radio waves, including:
(126) an emitting unit configured to emit an RF transmission signal obtained by sweeping a frequency in every period;
(127) a receiving unit configured to receive, if the RF transmission signal emitted by the emitting unit is reflected off the object, the RF transmission signal reflected off the object as an RF reception signal;
(128) an IF signal generating unit configured to generate, in every period, a complex IF signal based on a signal obtained by mixing the RF transmission signal with the RF reception signal;
(129) a position detecting unit configured to detect a position of the object based on an evaluation function generated based on the complex IF signal generated in every period; and
(130) a displacement detecting unit configured to detect a displacement of the object based on the position of the object detected by the position detecting unit and a phase of complex reflectance of the object calculated based on the complex IF signal.
(131) (Supplementary Note 2)
(132) The object detection apparatus according to Supplementary note 1, further including an object identifying unit configured to identify at least one of a type and behavior of the object, based on the displacement of the object.
(133) (Supplementary Note 3)
(134) The object detection apparatus according to Supplementary note 1 or 2, wherein the IF signal generating unit includes a quadrature demodulator, and mixes the RF transmission signal with the RF reception signal using the quadrature demodulator to generate the complex IF signal.
(135) (Supplementary Note 4)
(136) The object detection apparatus according to Supplementary note 1 or 2, wherein the IF signal generating unit generates the complex IF signal by applying Hilbert transform to the signal obtained by mixing the RF transmission signal with the RF reception signal.
(137) (Supplementary Note 5)
(138) The object detection apparatus according to any one of Supplementary notes 1 to 4, wherein the position detecting unit uses, as the evaluation function, an evaluation function obtained based on a null steering method, and detects the position of the object based on a peak position of the evaluation function.
(139) (Supplementary Note 6)
(140) The object detection apparatus according to Supplementary note 5, wherein the position detecting unit uses a multiple signal classification method as the null steering method.
(141) (Supplementary note 7)
(142) The object detection apparatus according to Supplementary note 5, wherein the position detecting unit uses an estimation of signal parameters via rotational invariance technique method as the null steering method.
(143) (Supplementary Note 8)
(144) An object detection method for detecting an object using radio waves, including:
(145) (a) a step of emitting an RF transmission signal obtained by sweeping a frequency in every period;
(146) (b) a step of receiving, if the RF transmission signal emitted in the (a) step is reflected off the object, the RF transmission signal reflected off the object as an RF reception signal;
(147) (c) a step of generating, in every period, a complex IF signal based on a signal obtained by mixing the RF transmission signal with the RF reception signal;
(148) (d) a step of detecting a position of the object based on an evaluation function generated based on the complex IF signal generated in every period; and
(149) (e) a step of detecting a displacement of the object based on the position of the object detected in the (d) step and a phase of complex reflectance of the object calculated based on the complex IF signal.
(150) (Supplementary Note 9)
(151) The object detection method according to Supplementary note 8, further including (f) a step of identifying at least one of a type and behavior of the object, based on the displacement of the object.
(152) (Supplementary Note 10)
(153) The object detection method according to Supplementary note 8 or 9, wherein, in the (c) step, the RF transmission signal is mixed with the RF reception signal by the quadrature demodulator to generate the complex IF signal.
(154) (Supplementary Note 11)
(155) The object detection method according to Supplementary note 8 or 9,
(156) wherein, in the (c) step, the complex IF signal is generated by applying Hilbert transform to the signal obtained by mixing the RF transmission signal with the RF reception signal.
(157) (Supplementary Note 12)
(158) The object detection method according to any one of Supplementary notes 8 to 11, wherein, in the (d) step, an evaluation function obtained based on a null steering method is used as the evaluation function, and the position of the object is detected based on a peak position of the evaluation function.
(159) (Supplementary Note 13)
(160) The object detection method according to Supplementary note 12, wherein, in the (d) step, a multiple signal classification method is used as the null steering method.
(161) (Supplementary Note 14)
(162) The object detection method according to Supplementary note 12, wherein, in the (d) step, an estimation of signal parameters via rotational invariance technique method is used as the null steering method.
(163) (Supplementary Note 15)
(164) A computer-readable recording medium in an object detection apparatus including: an emitting unit configured to emit an RF transmission signal obtained by sweeping a frequency in every period; a receiving unit configured to receive, if the RF transmission signal emitted by the emitting unit is reflected off an object, the RF transmission signal reflected off the object as an RF reception signal; an IF signal generating unit configured to generate, in every period, a complex IF signal based on a signal obtained by mixing the RF transmission signal with the RF reception signal; and a processor, the recording medium storing a program including a command to cause the processor to perform:
(165) (a) a step of detecting a position of the object based on an evaluation function generated based on the complex IF signal generated in every period; and
(166) (b) a step of detecting a displacement of the object based on the position of the object detected in the (a) step and a phase of complex reflectance of the object calculated based on the complex IF signal.
(167) (Supplementary note 16)
(168) The computer-readable recording medium according to Supplementary note 15, wherein the program further includes a command to cause the processor to perform
(169) (c) a step of identifying at least one of a type and behavior of the object, based on the displacement of the object.
(170) (Supplementary note 17)
(171) The computer-readable recording medium according to Supplementary note 15 or 16,
(172) wherein, in the (a) step, an evaluation function obtained based on a null steering method is used as the evaluation function, and the position of the object is detected based on a peak position of the evaluation function.
(173) (Supplementary note 18)
(174) The computer-readable recording medium according to Supplementary note 17,
(175) wherein, in the (a) step, a multiple signal classification method is used as the null steering method.
(176) (Supplementary note 19)
(177) The computer-readable recording medium according to Supplementary note 17,
(178) wherein, in the (a) step, an estimation of signal parameters via rotational invariance technique method is used as the null steering method.
(179) Although an example embodiment of the present invention has been described, this example embodiment is an example, and does not limit the scope of the invention. Addition, various omission, replacement, and modification may be made to the example embodiment without departing from the gist of the invention.
(180) The invention of the present application has been described above with reference to the example embodiments, but the invention of the present application is not limited to the above example embodiment. The configurations and the details of the invention of the present application can be modified in various manners that can be understood by those skilled in the art within the scope of the invention of the present application.
(181) This application is based upon and claims the benefit of priority from Japanese application No. 2017-87605, filed on Apr. 26, 2017, the disclosure of which is incorporated herein in its entirety by reference.
INDUSTRIAL APPLICABILITY
(182) As described above, according to the invention, an object can be identified without being affected by the state of the object. The invention is useful as a railroad crossing monitoring apparatus for monitoring a railroad crossing, a vehicle monitoring apparatus mounted in a vehicle for monitoring the surroundings thereof, and the like, for example.
DESCRIPTIONS OF REFERENCE SIGNS
(183) 1 Object detection apparatus
(184) 10 Transmitter
(185) 20 Receiver
(186) 31, 32 Object
(187) 101 Emitting unit
(188) 201 Receiving unit
(189) 202 IF signal generating unit
(190) 203 Position detecting unit
(191) 204 Displacement detecting unit
(192) 205 Object identifying unit
(193) 401 Moving body
(194) 402 RF transmission signal
(195) 403a, 403b, 403c Object
(196) 404 Road
(197) 411 Fixing jig
(198) 510 Computer
(199) 511 CPU
(200) 512 Main memory
(201) 513 Storage device
(202) 514 Input interface
(203) 515 Display controller
(204) 516 Data reader/writer
(205) 517 Communication interface 518 Input device 519 Display device 520 Recording medium 521 Bus