SYSTEM AND METHOD FOR DETECTING AERIAL VEHICLE POSITION AND VELOCITY VIA SOUND
20170219686 · 2017-08-03
Inventors
Cpc classification
H04R1/04
ELECTRICITY
G01S5/28
PHYSICS
International classification
G01S5/28
PHYSICS
Abstract
A system for determining a signal source position and velocity, and methods for manufacturing and using same are provided. An exemplary method includes determining a signal source position and velocity by performing a direction analysis on a plurality of audio signals and performing an intensity analysis on the audio signals. Another exemplary method includes determining that a signal source is on a collision course with a moving platform and providing an instruction for altering the course of the moving platform to avoid a collision with the signal source. An exemplary system includes an acoustic sensing system, having a primary microphone array, a secondary microphone, and a processing device for determining a signal source position and velocity by performing a direction analysis on a plurality of audio signals and performing an intensity analysis on the audio signals.
Claims
1. A method of determining a position and a velocity of a signal source, comprising: performing a direction analysis on a plurality of audio signals associated with the signal source; performing a frequency analysis on the plurality of audio signals; and estimating the position and the velocity of the signal source.
2. The method of claim 1, further comprising: obtaining first ones of the audio signals from a primary microphone array; obtaining a second one of the noise audio signals from a secondary microphone; generating a set of processed audio signals by subtracting the second one of the noise audio signals from each of the first ones of the audio signals.
3. The method of claim 2, further comprising: conducting a frequency estimation on the set of processed audio signals.
4. The method of claim 3, further comprising: determining a signal direction of the signal source based on the set of processed audio signals.
5. The method of claim 4, wherein the set of processed audio signals are a first set of processed audio signals, the method further comprising: generating a second set of processed audio signals based on the subtracting.
6. The method of claim 5, further comprising: conducting a frequency estimation on the second set of processed audio signals.
7. The method of claim 6, wherein the signal direction is a first signal direction, the method further comprising: determining a second signal direction of the signal source based on the second set of processed audio signals.
8. The method of claim 7, further comprising: determining whether the signal source is approaching or moving away from a detection position by performing a Doppler analysis of the first and second sets of processed audio signals.
9. A method of determining a position and a velocity of a signal source, comprising: conducting a frequency estimation on a first set of audio signals; determining a first signal direction of the signal source based on the first set of audio signals; conducting a frequency estimation on a second set of audio signals; determining a second signal direction of the signal source based on the second set of audio signals; determining whether the signal source is approaching or moving away from a detection position by performing a Doppler analysis of the first and second set of audio signals; and determining the position and the velocity of the signal source based on the Doppler analysis, a direction analysis and an intensity analysis.
10. The method of claim 9, further comprising: predicting a future position and a future velocity of the signal source based on the Doppler analysis, the direction analysis and the intensity analysis.
11. An acoustic sensing system, comprising: a housing; a primary microphone array positioned on the housing and comprising a plurality of microphones; a secondary microphone positioned on the housing and being operably connected to the primary microphone array; and a processing device configured to determine a position and a velocity of a signal source based on a direction analysis and an intensity analysis of a plurality of audio signals received via the primary microphone array and the secondary microphone.
12. The acoustic sensing system of claim 11, wherein the primary microphone array and secondary microphone are positioned on parallel, but different, planes on the housing.
13. The acoustic sensing system of claim 11, wherein the primary microphone array points in a first direction and the secondary microphone points in a second direction that is different from the first direction.
14. The acoustic sensing system of claim 13, wherein the first direction is opposite to the second direction.
15. The acoustic sensing system of claim 13, wherein the first direction is substantially perpendicular to the second direction.
16. The acoustic sensing system of any one of claim 11, wherein microphones of the primary microphone array are positioned on a substrate in a matrix configuration having rows and columns.
17. The acoustic sensing system of claim 11, wherein the processing device is further configured to subtract one of the plurality of audio signals that is obtained by the secondary microphone from each of ones of the plurality of audio signals that are obtained by the primary microphone array to generate a set of processed audio signals.
18. The acoustic sensing system of any claim 17, wherein the processing device is further configured to conduct a frequency estimation on the set of processed audio signals.
19. The acoustic sensing system of claim 18, wherein the processing device is further configured to determine a signal direction of the signal source based on the set of processed audio signals.
20. The acoustic sensing system of claim 11, wherein the processing device is further configured to predict a future position and a future velocity of the based on a Doppler analysis, the direction analysis and the intensity analysis of the plurality of audio signals.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049] It should be noted that the figures are not drawn to scale and that elements of similar structures or functions are generally represented by like reference numerals for illustrative purposes throughout the figures. It also should be noted that the figures are only intended to facilitate the description of the exemplary embodiments. The figures do not illustrate every aspect of the described embodiments and do not limit the scope of the present disclosure.
DETAILED DESCRIPTION
[0050] Since currently-available aerial vehicle position and velocity detection systems are deficient, a system for determining a signal source position and velocity using sound can prove desirable and provide a basis for a wide range of applications, such as detection and avoidance of approaching aerial vehicles. This result can be achieved, according to one embodiment disclosed herein, by a signal source position and velocity detection system 100 as illustrated in
[0051] Turning to
[0052] Turning to
[0053] Although shown as comprising a single microphone 112 for purposes of illustration only, the secondary microphone 130 can include any suitable number of microphones 112 positioned in any suitable arrangement. The microphones 112 of the array 110 and the microphones 112 of the secondary microphone 130 can be the same and/or different type of microphone. Additionally, each microphone 112 can be operable to detect sound waves of any suitable frequency, including subsonic, sonic, and/or ultrasonic frequencies. Suitable types of microphones 112 can include a condenser microphone, a dynamic microphone, a ribbon microphone, a carbon microphone, a piezoelectric microphone, a fiber-optic microphone, a laser microphone, a liquid microphone, a MEMS microphone, or the like, without limitation. Each microphone 112 can have any suitable sensing pattern, including omnidirectional, bi-directional, sub-cardioid, cardioid, hyper cardioid, super cardioid, shotgun, or the like.
[0054] Although shown in
[0055] As illustrated in
[0056] Although
[0057] The examples discussed herein relate to detection of position and velocity of a signal source, such as an Unmanned Aerial Vehicle (UAV) or other aerial vehicle, via sound using the system 100; however, further embodiments can relate to detection of position and velocity of other stationary and/or mobile objects including vehicles, people, animals, devices, or the like, and the disclosed examples and illustrative embodiments should not be construed to be limiting on the scope of the disclosed system 100.
[0058] Additionally, in some embodiments where the system 100 is positioned on an aerial vehicle, the system 100 can detect the sound signature of the aerial vehicle reflected off of an object and use this detection to avoid the object. For example, the system 100 may use echo-location techniques to avoid objects based on an echo of the sound from the aerial vehicle upon which the system 100 is positioned.
[0059] Various embodiments can include a ground-based assembly 1105 (shown in
[0060] As illustrated in
[0061] Although the first aerial vehicle 200 is shown as being a quad-rotor UAV herein for purposes of illustration only, it should be clear that any suitable type of first aerial vehicle 200 can include the detection system 100. Additionally, while a first aerial vehicle 200 and/or mobile platform can include a UAV, the aerial vehicle and/or mobile platform can additionally and/or alternatively include an airplane, jet, helicopter, or the like.
[0062]
[0063] For example,
[0064] However, as discussed herein the audio signature of the second aerial vehicle 305 (shown in
[0065] Graph 900D shows a received signal 904 (dashed line) that can be identified as corresponding to audio signature 901. In this example, the frequency of the received signal 904 is shifted upward in frequency compared to baseline frequency 901 because the second aerial vehicle 305 is approaching the system 100 (see, e.g.,
[0066] Graph 900E shows a received signal 905 (dashed lines) that can be identified as corresponding to audio signature 902. In this example, the frequency of the received signal 905 is shifted downward in frequency compared to baseline frequency 902 because the second aerial vehicle 305 is moving away from the system 100 (see, e.g.,
[0067] Graph 900F shows a received signal 906 (dashed lines) that can be identified as corresponding to audio signature 903. In this example, the frequency of the received signal 906 is shifted upward in frequency compared to baseline frequency 903 because the second aerial vehicle 305 is approaching the system 100 (see, e.g.,
[0068] Although naturally occurring audio signatures of aerial vehicles can be identified (e.g., the audio signature of a motor and/or rotors), in some embodiments, aerial vehicles can include a speaker that broadcasts an audio signature and/or other unique identifying signal such as a serial number, or the like. Such an audio signature can be an audio signature as discussed above, including a pattern. For example, in one embodiment an audio signature can cycle between signatures 901, 902 and 903, with each having a duration of one second. In another example, the audio signature 903 can be broadcast on-and-off for one or more selected time periods to generate a pattern (e.g., like Morse code). Such an audio signature can be subsonic, sonic, and/or supersonic. In some embodiments, unique audio signatures can be provided for each given aerial vehicle (e.g., like a MAC address) so that each aerial vehicle can be identified based on its associated unique audio signature.
[0069] Returning to
[0070] If a determination is made that a collision course is not present, then the methods 400, 500 continues to block 440 where the current course is maintained. However, if a determination is made that a collision course is present, then the method 400 continues to block 450 where an avoidance maneuver is performed. Avoidance maneuvers can include any suitable course correction or movement that can prevent a collision, including moving in the opposite direction from an approaching second aerial vehicle 305; moving in an orthogonal direction from an approaching second aerial vehicle 305; moving around an approaching second aerial vehicle 305; or hovering in place to allow the approaching second aerial vehicle 305 to pass.
[0071] At decision block 460, a determination is made whether the second aerial vehicle 305 has ended its flight, and if so, the methods 400, 500 are done in block 499. However, if the flight of the second aerial vehicle 305 is not ended, then the method 400 cycles back to block 420 (shown in
[0072] In some embodiments, audio signals can be pro-processed to remove noise. For example, referring to
[0073] In various embodiments, the noise signal received from the secondary microphone 130 is assumed to substantially represent background noise and the audio signal from the microphones 112 of the array 110 represents desirable target signal plus background noise. Accordingly, by subtracting the audio signal from the secondary microphone 130 from the respective audio signals from the microphones 112 of the array 110 can leave desirable target signal.
[0074] Accordingly, it can be advantageous to position the array 110 on a selected portion of the UAV housing 201 (shown in
[0075] In contrast, in some embodiments, the noise signal of the secondary microphone 130 is not removed from audio signals obtained by the array 110. The audio signals obtained by the array 110 thereby can be processed or otherwise handled as described herein without the noise removal, at 410. Stated somewhat differently, in some embodiments, the system 100 can omit the secondary microphone 130. For example, as discussed above,
[0076]
[0077] In various embodiments, the position and velocity of a signal source can be determined by observing changes of determined position of a signal source including distance and/or direction of the signal source.
[0078]
[0079] For example, assume that matrix A indicates the attributions of the signal sources, (referred to as (A={a.sub.1, a.sub.2, . . . , a.sub.N})), a.sub.i is a function of frequency (f) and/or incidence angle (θ). Further assume that F represents source signals and W indicates noise. The composite source and noise signal received can be indicated as X=AF+W. Assuming R.sub.x indicates the covariance matrix of X, then the eigenvalues of R.sub.x matrix are {λ.sub.1, λ.sub.2, . . . , λ.sub.N}. If signal sources have D signals, then among the eigenvalues, N−D eigenvalues are equal. In other words, {λ.sub.D+1, λ.sub.D+2, . . . , λ.sub.D+N} correspond to the noise space while other D eigenvalues correspond to the signal space. Further assume that E.sub.N indicates eigenvectors corresponding to eigenvalues {λ.sub.D+1, λ.sub.D+2, . . . , λ.sub.N} in R.sub.x matrix. These eigenvectors indicate noise space. The noise space and signal space can be necessarily orthogonal. Therefore, if the signal space and the noise space are orthogonal, the inner product of the signal space and the noise space will be 0. Additionally, assume that P(ω)=I/a*(ω)E.sub.NE.sub.N*a(ω) indicates the reciprocal of the inner product. The relationship between the change of signal power P with angular frequency ω is illustrated in
[0080] In block 720, a signal direction of the first signal sample source can be determined. For example, in one embodiment, the inner product of the signal space and the noise space can be calculated. In contrast to frequency estimation discussed above, the signal space here can alter with the change of the incidence angle, which is represented by P(θ)=I/a*(θ)E.sub.NE.sub.N*a(θ). As shown in
[0081] In further embodiments, frequency estimation and signal direction determination can be performed in any suitable way. For example, frequency estimation and signal direction determination can occur as part of implementation of a Multiple Signal Classification algorithm (MUSIC algorithm) (see, e.g., Schmidt, IEEE Transactions On Antennas And Propagation, Vol. AP-34. No. 3, March 1986, which is incorporated herein in its entirety for all purposes).
[0082] In block 730, frequency estimation of a second signal sample is conducted, and, in block 740, signal direction of the second signal sample source is determined. In block 750, a determination is made whether the signal source is approaching or moving away from the first aerial vehicle 200. For example, as illustrated in
[0083] In contrast, as illustrated in
[0084] In other words, signal source of the second aerial vehicle 305 moving toward sensing aerial vehicle 200 causes sound waves 310A to be compressed and therefore perceived as having a higher frequency or higher pitch. On the other hand, signal source of the second aerial vehicle 305 moving away from sensing aerial vehicle 200 causes sound waves 310B to be expanded and therefore perceived as having a lower frequency or lower pitch. Accordingly, by comparing the frequency of sequential signal source samples, whether the signal source is approaching or moving away can be determined.
[0085] Additionally and/or alternatively, signal intensity can also be used to determinate whether the signal source is approaching or moving away. For example, where signal intensity and the pitch of the signal increase, a determination can be made that the signal source is approaching. Similarly, where signal intensity and the pitch of the signal decrease, a determination can be made that the signal source is moving away.
[0086] Therefore, according to the Doppler Effect, it can be determined whether the signal source is approaching or moving away. The intensity of a signal source can assist in such a determination. For example, if the frequency is increasing and the intensity is going up, the signal source can be determined to be approaching. Otherwise, the signal source can be determined to be moving away.
[0087] In block 760, the distance of the signal source from the primary microphone array 110 is determined. For example, in some embodiments, such a determination can be made based on the intensity of the signal. In other words, a louder signal can be determined to be closer than a quieter signal. In some embodiments, distance can calculated based on a known or assumed distance and intensity values corresponding to a given signal source. For example, if a determination is made that the signal source is a UAV of “Type A,” the operating intensity of this UAV at various distances can be known and the intensity of a received signal can be compared to these known values to estimate a distance value. In other embodiments, distance values can be estimated based on assumed operating intensities of a given signal source. In some embodiments, distances can be in units of distance (e.g., meters) or can be generally descriptive of distance ranges (e.g., very far, far, close, very close, and the like).
[0088] In block 770, the current position and velocity of the signal source is determined. For example, such a determination can be based on one or more signal direction determination, distance determination, and/or approaching/moving away determination as discussed herein.
[0089] In block 780, the bearing of the signal source optionally can be determined. For example, in addition to calculating the current position of a signal source as described above in reference to block 770, it can also be advantageous to estimate the bearing or future position(s) and/or velocity/velocities of a signal source. Such a determination can be based on one or more velocity determination, position determination, signal direction determination, distance determination, and/or approaching/moving away determination as discussed herein.
[0090] In various embodiments, the determining the bearing of the signal source, at 780, is absent. For example,
[0091] Additionally, any of the methods described herein can be embodied in a computer product that is encoded on non-transitory machine-readable storage media. For example, a non-transitory machine-readable storage media can comprise a portable memory device such as a flash drive, or a memory associated with a device such as the memory 122 that is part of the sensing device 120 shown in
[0092] Additionally, although various embodiments discussed herein relate to a first aerial vehicle 200 detecting a second aerial vehicle 305 (shown in
[0093] For example,
[0094]
[0095]
[0096] Accordingly, as illustrated in
[0097]
[0098]
[0099] The described embodiments are susceptible to various modifications and alternative forms, and specific examples thereof have been shown by way of example in the drawings and are herein described in detail. It should be understood, however, that the described embodiments are not to be limited to the particular forms or methods disclosed, but to the contrary, the present disclosure is to cover all modifications, equivalents, and alternatives.