Systems and methods for detecting a gunshot
11282536 · 2022-03-22
Assignee
Inventors
- Ted Michael Davis (Decatur, GA, US)
- Eric H Bedell (Marietta, GA, US)
- Robert S McKeeman (Atlanta, GA, US)
Cpc classification
G08B13/1672
PHYSICS
F41H11/00
MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
G10L19/02
PHYSICS
G10L25/18
PHYSICS
International classification
G10L25/18
PHYSICS
G10L19/02
PHYSICS
Abstract
Systems and methods for detecting a gunshot event are disclosed. More particularly, systems and methods for detecting a gunshot event using the ultrasonic frequency distribution across a broad range of frequencies resulting from a gun's muzzle blast to determine whether an actual gunshot event has occurred and to minimize false positives and false negatives are disclosed. Yet further, systems and methods for determining the location of an actual gunshot event by utilizing the decay of the frequency distribution across a broad range of frequencies resulting from a gun's muzzle blast are disclosed.
Claims
1. A method for determining the occurrence of a gunshot comprising: a) capturing a sound signal digitally with such fidelity that the constituent frequencies that comprise its ultrasonic frequencies are retained and preserved, wherein the sampling rate used to capture and preserve the frequency information of the digital signal is in a range from 48 kHz to 384 kHz; b) mathematically transforming the frequency information by creating a spectrogram having a spectrum of frequencies of the signal as it varies with time or a spectrum of frequencies over a short period of time; and c) determining whether the spectrogram or spectrum or sampled portions of the spectrogram or spectrum contains an ultrasonic burst that corresponds to an ultrasonic signature of a gunshot having contiguous ultrasonic component sound frequency content that includes an entire spectrum of frequencies in a range of 20 kHz up to 192 kHz.
2. The method of claim 1 wherein the step of capturing a sound signal includes sampling the sound source at a sampling rate that is at least twice the highest discrete ultrasonic frequency sought to be captured.
3. The method of claim 1 wherein the step of mathematically transforming utilizes calculating a Fast Fourier Transformation in accordance with any known FFT algorithm.
4. The method of claim 1 wherein the step of mathematically transforming utilizes calculating a Fast Fourier Transformation in accordance with known FFT implementation.
5. The method of claim 1, wherein the frequency information is mathematically transformed by creating a spectrogram having a spectrum of frequencies of the signal as it varies with time, the method further comprising detecting an impulse prior to executing the mathematical transformation step that yields the spectrogram.
6. The method of claim 1 further comprising transmitting the captured sound signal to a second location for storage or further processing.
7. The method of claim 1, wherein the frequency information is mathematically transformed by creating a spectrogram having a spectrum of frequencies of the signal as it varies with time, the method further comprising transmitting said spectrogram to a second location for storage or further processing.
8. The method of claim 1, wherein the frequency information is mathematically transformed by creating a spectrum of frequencies over a short period of time, the method further comprising transmitting said spectrum to a second location for storage or further processing.
9. The method of claim 1 further comprising transmitting the captured sound signal to a second location prior to executing the mathematical transformation step that yields the spectrogram.
10. The method of claim 1 wherein the step of determining a gunshot utilizes a correlation function to determine whether the spectrogram or spectrum corresponds to a known ultrasonic signature of a gunshot.
11. The method of claim 1 wherein the step of determining a gunshot utilizes Artificial Intelligence to determine whether the spectrogram or spectrum corresponds to a known ultrasonic signature of a gunshot.
12. A method for accurately determining the occurrence of a gunshot comprising: a) capturing a sound signal, either digital or analog, with such fidelity that the constituent frequencies that comprise its ultrasonic frequencies are retained and preserved, wherein at least one bandpass filter is utilized to capture one or more discrete component sound frequencies within a range from 20 kHz to 192 kHz; and b) determining whether said one or more discrete component sound frequencies are consistent with an ultrasonic burst that corresponds to an ultrasonic signature of a gunshot having contiguous ultrasonic component sound frequency content that includes an entire spectrum of frequencies in a range of 20 kHz up to 192 kHz.
13. The method of claim 12 further comprising detecting an impulse prior to filtering.
14. The method of claim 12 further comprising transmitting the captured sound signal to a second location prior to filtering.
15. The method of claim 12 wherein the step of determining a gunshot utilizes a correlation function to determine whether the discrete component sound frequencies correspond to a known ultrasonic signature of a gunshot.
16. The method of claim 12 wherein the step of determining a gunshot utilizes Artificial Intelligence to determine whether the discrete component sound frequencies correspond to a known ultrasonic signature of a gunshot.
17. A detection device for determining the occurrence of a gunshot comprising: a) a microphone that is capable of capturing sound frequencies within the ultrasonic spectrum, above 20 kHz, for capturing a sound signal; b) an analog to digital converter for converting the microphone's analog sound signal to a digital sound signal; c) a processing circuit for processing and analyzing the resulting digital sound signal; and d) a data storage device for retaining and preserving any captured or analyzed data wherein: said microphone and analog to digital converter capture a digital sound signal with such fidelity that the constituent frequencies that comprise the ultrasonic spectrum are retained and preserved; said processing circuit analyzes the captured digital sound signal for frequency information in a range from 20 kHz to 192 kHz; said processing circuit mathematically transforms the digital information by creating a spectrogram having a spectrum of frequencies of the signal as it varies with time or a spectrum of frequencies over a short period of time; said processing circuit determines whether said spectrogram or spectrum or sampled portions of the spectrogram or spectrum contain an ultrasonic burst, that corresponds to a known ultrasonic signature of a gunshot having contiguous ultrasonic component sound frequency content that includes an entire spectrum of frequencies in a range of 20 kHz up to 192 kHz; and said storage device retains and preserves the data as it is captured, transformed and used for determination.
18. The detection device of claim 17 wherein, responsive to a gunshot determination, the processing circuit records at least one of a date and time of occurrence of the determination.
19. The detection device of claim 17 wherein said device includes a GPS receiver for acquiring the geographic location of the system.
20. The detection device of claim 17 wherein said device includes a mounting system wherein: a) said mounting system integrates with a standard wall outlet; and b) said mounting system utilizes the wall outlet receptacle as a source of power and alignment.
21. The detection device of claim 20 further comprising a mounting system that utilizes a security fastener to prevent unwarranted removal.
22. The detection device of claim 17 wherein said device includes means for electronically publishing a report.
23. A detection device for determining the occurrence of a gunshot comprising: a) a microphone capable of capturing sound frequencies within the ultrasonic spectrum, above 20 kHz, for capturing a sound signal; b) an analog to digital converter for converting the microphone's analog sound signal to a digital sound signal or at least one filtering circuit; c) a processing circuit for processing and analyzing the resulting digital sound signal; d) a data storage device for retaining and preserving any captured or analyzed data wherein: the microphone and analog to digital converter capture a digital sound signal with such fidelity that the constituent frequencies that comprise the ultrasonic spectrum are retained and preserved; the processing circuit or the at least one filtering circuit applies a bandpass filter(s) to capture discrete component sound frequencies within a range from 20 kHz to 192 kHz; the processing circuit determines whether the discrete component sound frequencies are consistent with the characteristic ultrasonic burst, that corresponds to the known ultrasonic signature of a gunshot having contiguous ultrasonic component sound frequency content that includes an entire spectrum of frequencies in a range of 20 kHz up to 192 kHz; and said storage device is for retaining and preserving the data as it is captured, transformed and used for determination.
24. The detection device of claim 23 further comprising a sensor for detecting an impulse prior to filtering.
25. The detection device of claim 23 wherein said device includes a transmitter for conveying data and a receiver for receiving data.
26. The detection device of claim 23 wherein said device includes a display screen.
Description
BRIEF DESCRIPTION OF THE FIGURES
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
DETAILED DESCRIPTION
(11) All guns produce supersonic muzzle blasts (a shockwave) due to the pressure differential between the chamber pressure and the atmospheric pressure at the end of the barrel. In contrast, fireworks and other types of black powder explosions are subsonic deflagration events, not detonations that produce a supersonic shockwave. While fireworks produce and are a loud noise event, they do not have the requisite geometry allowing for pressure to build within a confined space. The present embodiments recognize that muzzle blasts produce such a supersonic shockwave and utilize the characteristic ultrasonic noise produced by this shockwave as it transitions from supersonic to sonic propagation speed as the wave reaches its Weber Radius, and to distinguish a gunshot from other loud sounds that lack the unique characteristic of the gunshot muzzle blast, particularly in the ultrasonic frequency range.
(12) The disclosed systems and methods detect and analyze a gunshot event in a manner that reduces and/or minimizes instances of false positives and false negatives. The disclosed systems and methods utilize the tell-tale acoustic signature of a gunshot resides in significant part within its ultrasonic spectrum; it is characterized as a very short-duration, high-energy, wide-spectrum ultrasonic burst (the idiosyncrasy) that cannot be heard by the human ears. This type of ultrasonic event is measurably different from ultrasonic sounds produced by a piezoelectric transducer, a magnetostrictive transducer, or by an electrodynamic action.
(13) The muzzle blast of a gun produces the ultrasonic shockwave upon exiting the firearm. As that shockwave slows to sonic speed, at that very instant, the muzzle blast reaches its Weber Radius. For a handgun, the Weber Radius is reached at approximately 0.4 meters from the gun. The person of ordinary skill will appreciate that for different guns, ammunition, powder or other variables, the Weber Radius may be a somewhat of a somewhat greater or lesser dimension. Regardless, at that point, a short-duration, high-energy, wide-spectrum ultrasonic burst is the byproduct of this boundary-layer energy exchange within the atmosphere. The person of ordinary skill would further understand two documents to pertain to this effect, namely—ISO 9613-1 “Calculation of the absorption of sound by the atmosphere” and ISO 17201-2 “Estimation of muzzle blast and projectile sound by calculation.” These documents focused on sound frequencies below 20 kHz, annoyance sounds, and therefore the charts provided and sound data disclosed were capped at 10 kHz, well within the human hearing range. However, the underlying formulas provided within these ISO documents allow for deriving a gunshot's frequency-dependent sound propagation characteristics within our atmosphere based upon Weber Radius calculations and the discussed model. These characteristics are recognized as applicable to the ultrasonic frequencies resulting from a muzzle blast as described above.
(14) While scientific formulas predict the wide spectrum frequency content, accurately measuring such information also requires appropriate equipment. For example, processing sound data at ultrahigh sampling rates in accordance with the Nyquist-Shannon sampling theorem calls for equipment that is not limited to the Compact Disc standard sampling rate of 44,100 samples per second. Some embodiments therefore include custom-built circuitry that captures data up to 400,000 samples per second, resulting in ultrasound acoustic data capture up to 200 kHz.
(15) It is to be understood that the very short-duration, high-energy, wide-spectrum ultrasonic burst is an idiosyncrasy of a gunshot sound. And it differs for different firearms and ammunition. The unique nature of this sounds burst is demonstrated in U.S. Pat. No. 3,202,087 (the '087 patent), which is directed to a nondestructive testing apparatus for pipe welds. More particularly, the '087 patent shows how difficult it is to generate high intensity, wide spectrum, ultrasonic waves in the first place. Piezoelectric transducers, magnetostrictive transducers, electrodynamic, and electrostatic methods all had limitation and were not capable of generating the requisite bursts. There were also no known mechanical means of generating such bursts. The '087 patent concludes that the solution to generate the required high intensity, wide spectrum, ultrasonic waves was to properly direct a gunshot into a resonance chamber within a coupling connected to the pipe. The gun used was a concrete anchor driver that may be purchased at a hardware store that utilizes a 22-caliber gun cartridge, minus the bullet. The muzzle blast was focused by the described coupling that induced the required high intensity, wide spectrum, ultrasonic waves into the subject pipe. While nondestructive pipe weld testing is not considered to be analogous to the current disclosure, this patent confirms that producing such a wide spectrum ultrasonic burst is a unique characteristic of a gun's muzzle blast. As described and claimed herein, the present systems and methods utilize that unique idiosyncrasy to detect whether a possible gunshot event is actually a gunshot or some other loud noise that may be confused with an actual gunshot.
(16) In some embodiments, sounds that are candidate gunshots. For example, an embodiment may sample continuously (or periodically) the audio sound frequency spectrum up to 200 kHz. Mechanical collisions do not generate a burst of sound with the tell-tale gunshot sound burst including the ultrawide spectrum across the ultrasonic band from above 20 kHz to 200 kHz. Moreover, detecting and classifying such a burst as a gunshot event includes sampling, processing, and storing sound throughout the ultrasonic frequency range. As explained herein, the information contained within the ultrasonic burst allows for the proper detection and classification of gunshots. The disclosed embodiments make use of a gunshot's ultrasonic idiosyncrasies to accomplish gunshot recognition.
(17) Sampling refers to how the sound data is collected. The microphone preferably has the ability to reproduce the frequency content of the sampled waveform. In application, a true gunshot produces a complex analog waveform having components that range from 20 hz to well above 30 kHz, having a practical ultrasonic spectrum based upon distance and frequency decay of approximately 200 kHz. In order to not lose the high-frequency content of the sampled analog waveform, it is desired that the analog-to-digital conversion (ADC), according to the Nyquist Theorem, provide a sampling rate of at least twice that of the component frequency sought to be captured digitally. The sampling rate may be twice f.sub.max, the highest frequency component measured in Hertz for a given analog signal. When sampling is less than 2f.sub.max, the highest frequency components of the gunshot may be lost. Given bandwidth requirements, an ADC capable of sampling analog data at approximately 400 kHz is one appropriate sampling rate. To put this sampling rate in perspective, typical sampling rates of consumer quality acoustic systems are set to 44.1 kHz, often referred to as CD quality sound, since audio compact discs use the 44.1 kHz sampling rate.
(18) Sampling also refers to the proper collection of representative data for later use in an embodiment during teaching and classification. For example, some embodiments that utilize Artificial Intelligence (AI) may depend on or use previously gathered data. For example, it is known that a gunshot's sound magnitude varies based upon angle from the shooter and other factors as described more fully in an article titled “Estimation of The Directivity Pattern of Muzzle Blasts” by Karl-Wilhelm Hirsch, Werner Bertels. Applying these factors, various samples of representative gunshot data may be harvested. In the Hirsch and Bertels article, samples were collected using an apparatus that encircled the shooter in 10 degree radials and at two discrete distances of 10 and 20 meters. While the Hirsch and Bertels' analysis was restricted to between 315 Hz and 10 kHz, within the human hearing range, the disclosed methodology provides useful information informing a proper sampling geometry for use in developing representative gunshot data for use in the present disclosure. Hirsch and Bertels plotted the eccentricity of the sound exposure level based upon angle from front to back of the shooter and determined that “ . . . lower frequency components have a stronger directionality than higher frequencies. This is a special feature of muzzle blasts compared to other typical sound sources modeled as point sources.” Hirsch and Bertels stated: “For a muzzle blast, the body of radiation is certainly not a sphere. Due to the basic rotational symmetry around the barrel axis, the radiating body still needs to be a body of revolution but estimating its shape and its radiation impedance is a rather challenge. The gases leaving the barrel with supersonic speed develop a so-called MACH-plate. The body of radiation will be wider to the front than looking from the rear giving reason for a strong frequency dependent directivity pattern.”
(19) There is a known method for visualizing shock waves. The method dates back three centuries to Robert Hooke's observations of the patterns generated by the sun's light as it passed through a candle's flame and the shadow it then produced upon the floor. This was later rediscovered by August Toepler, known today as the Schlieren method. This identical method was used by Weber and Mach to view a bullet's shockwaves in 1939. Recently however, an article published within the American Scientist, “High-speed Imaging of Shock Wave, Explosions and Gunshots”, by Gary S. Settles, reveals shockwaves as never before seen. The shockwave is spherical and not an asymmetrical body or “Mach-plate” as described here by Hirsch and Bertels. The Penn State Gas Dynamics Lab has developed a method providing real-time visualization at full scale, with size and resolution far superior to the Schlieren method. Using this method, the lab has taken high-speed video showing a spherical muzzle blast being produced. The wavefront's shape is spherical. The molecular collisions and what precisely is happening at the nanoscale that gives rise to such a symmetrical shape having eccentricity in its energy and frequency distribution remain unexplained. This is perhaps best described as reproducible but a somewhat chaotic state that will never be modeled perfectly.
(20) While the present system and methods do not depend or rely upon such modeling, these visualization techniques do allow for validation and for measurement of the bullet's position and the muzzle blast's position on a frame-by-frame basis. A gun's discharge is described to be a deflagration burn of the shell's propellant—a subsonic explosion that propels the bullet. It is very likely that such deflagration burns do transitions to a detonation burning for supersonic rifle rounds with exit velocities more than double the speed of sound and with muzzle blast shockwaves exceeding Mach 6.
(21) Based upon the foregoing, the person of ordinary skill may appreciate that a library of representative gunshot data may be collected and used. For example, such a library may be used as an AI training set. To do so, many discrete samples of gunshots from different weapons firing different ammunition may be captured while varying the common acoustic variables associated with a gunshot's sound. Recording stations may be set at various angles and distances to obtain samples from a plethora of ammunition and weaponry. Each sample collected has its associated metadata recorded including: distance, angle, caliber, barrel length and any other information deemed advisable for reliably capturing a gunshot's full spectrum.
(22) The resulting library of representative sounds may be processed to obtain templates in the form of Spectrograms, where a typical representation for each combination is obtained. Spectrograms provide visual representations of time, frequency, and intensity information of signals (a picture). The data visually displayed in the template Spectrograms is conducive to both correlation and AI classification methods of the present. Regardless of the methodology used by a particular embodiment, the disclosed systems and methods preferably contemplate that the aforementioned ultrasonic burst is included within the dataset for the classification step to yield an accurate result. Prior art systems have not captured such information, and therefore such systems are unable to leverage the information contained therein.
(23) Processing refers to the processing of the collected and library data. There can be various requirements and steps. For example, in real-time, a multi-level gating analysis process may be continuously run against a digital sample to determine if a possible gunshot warrants advanced processing. Initially, “the net may be cast widely” by performing, for example, a continuous high-level audio analysis looking for a candidate impulse. This first gating analysis may be comprised of an amplitude test (e.g., is the captured sample signal loud enough that it could potentially be a gunshot), an ultrasonic test (e.g., does ultrasonic data exist in the captured sample such that it could potentially be a gunshot), or a wide spectrum correlation test (e.g., does frequency data correlate strongly enough with at least one known gunshot frequency response such that it could potentially be a gunshot). Other gating criteria may be employed. It's not necessarily important to be discriminating at this stage. This first gating step promotes signal processing efficiency, allowing for the reduction of unwarranted advanced, and more costly, processing.
(24) If the result of this first processing stage yields a candidate sound, a system or method may apply a second processing stage, which may include an analysis of an audio waveform and the data associated with a Spectrogram that includes ultrasonic frequency data. The analysis may comprise different techniques, including gating, correlation and AI analysis. For example, additional gating may be employed directed to other as yet untested analytical points. Multiple gating inquiries may be used to further analyze the candidate sound and as answered by such filters, a determination of whether the candidate sound constitutes a gunshot. With reference to the correlation and AI methods, the frequency information of the Spectrogram may be determined in a number of ways, including amongst others, utilizing a Fast Fourier Transformation (FFT) analysis. While any of the known FFT algorithms may be used, the particularly described process essentially corresponds to computing the magnitude of the short-time Fourier transforms (STFT) of the signal. By calculating the frequency components of the signal over slices of time, separate pieces may be calculated and these windows may overlap in time and may be assembled or transformed. In any event, the systems and methods contemplate that the captured or sampled data is mathematically transformed to analysis. In one embodiment, a correlation function is used to determine whether the Spectrogram of the candidate sound corresponds to a known ultrasonic signature of a gunshot. The person of ordinary skill in the art may be aware of such correlation functions. By way of example, the Pearson correlation coefficient may be stated as a statistic that measures linear correlation between two signal variables X and Y. It has a value between +1 and −1, where 1 is total positive linear correlation (the signals are exactly the same), 0 is no linear correlation (the signals have nothing in common), and −1 is total negative linear correlation (one signal is the perfect inverse of the other). One expression for the subject formula to obtain the correlation coefficient between X and Y is:
(25)
where cov is covariance and std is standard deviation
(26) Applying an appropriate correlation function in the disclosed analysis of a Spectrogram of a candidate gunshot sound, determining whether said candidate sound is a gunshot utilizes such a correlation function to determine whether that Spectrogram corresponds to a known ultrasonic signature of a gunshot as shown in the library.
(27) A person of ordinary skill in the art will appreciate that Artificial Intelligence (AI) differs from correlation. Stated more succinctly, AI is not correlation. AI builds a specific, custom function to apply to inputs and generate an output (this is often referred to as the model). In its simplest form, the function may take the form of A+B(s0)+C(s1)+D(s2) . . . +N(sn), where sn is the value of the sample at the n position. The values of A through N are initially unknown. One builds the function by feeding many signals, along with their known outputs, (the ground truth) into an algorithm that will adjust the values of A through N repeatedly until an acceptable formula exists (a formula that produces the correct output at a satisfactory rate). In an AI embodiment, a determination regarding the candidate gunshot sound utilizes artificial intelligence to determine whether the candidate sound Spectrogram corresponds to the know ultrasonic signature of a gunshot.
(28) Storing refers to storing raw sampling of audio data for gunshot and for non-gunshot audio events during the collection phase. Those data are then compiled into a library that edge devices can quickly use to make fast and efficient gunshot/non-gunshot decisions, using the gating, correlation, and machine learning methods mentioned above that describe the “signature” of a gunshot. Additionally, in one of the preferred embodiments, edge devices store and forward to a remote data center for further processing and also as a final repository of raw samples of potential gunshot audio events. Gunshot recognition algorithm embodiments including AI may be accomplished here where the computing horsepower is sufficient, further reducing the cost of the edge devices as these may be deployed by the millions. The central repository may then then used to further refine the processing library and algorithm to further enhance the overall system and its outcomes.
(29) The systems and methods may be expressed in different embodiments depending upon the connectivity, processing power, and storage capacity available on the edge gunshot detection device, and whether recognition is performed by the gunshot detection device as a local edge processor, or by sending raw audio waveform data to a remote processor and storage for analysis and recognition feedback as described above. Recognition algorithm embodiments could include simpler or more complex Signature Pattern Analysis and Correlation, Spectrogram Pixel Array Histogram Correlation, Spectrogram AI Model Edge Processing, other methods, or combinations thereof depending upon engineering tradeoffs of processing power, storage capacity, response time performance, real-time connectivity, security, device dimensions, battery life, durability, and cost.
(30) One embodiment uses ADC and mathematical processing such as FFT transformations instead of filters. For example, a preferred disclosed embodiment does not require the use of bandpass filters to distinguish between events (e.g., gunshot vs. not a gunshot). The person of ordinary skill in the art may appreciate that mathematically transforming the signal data utilizing a Fast Fourier Transformation may be accomplished using any of the family of known FFT algorithms including but not limited to the following: Cooley-Tukey FFT algorithm, Prime-factor FFT algorithm, Bruun's FFT algorithm, Rader's FFT algorithm, Bluestein's FFT algorithm, Goertzel algorithm. Further, the person or ordinary skill in the art will appreciate that mathematically transforming the signal data utilizing or calculating a Fast Fourier Transformation may be accomplished using any of the family of known FFT implementations including but not limited to the following: ALGLIB, FFTW, FFTS, FFTPACK, Math Kernel Library, cuFFT.
(31) One embodiment may also be able to transmit gunshot detection events directly from an edge gunshot detection device to a remote processing center or locally to the hive of other devices that might benefit from its information. Real-time communication over wireless communications such as 4G-LTE, 5G, Bluetooth, Wi-Fi, 900 Mhz, LTE-M, NB-IoT and other wired and wireless connectivity are all contemplated for transmission of data. Such transmissions could be relayed if deemed appropriate to police officers, corrections staff, security guards, first responders and/or associated vehicles, churches, synagogues, mosques, schools, shopping malls, restaurants, retail stores, sports stadiums, smart cities and their associated devices. Ultimately 911 Dispatch Centers, local video integration centers, Federal, State, and Regional emergency monitoring and alert centers; fire stations; emergency medical response centers; hospitals; national and local vendor security monitoring services; cloud and local server artificial intelligence-based security monitoring and management systems; centrally-monitored industrial, commercial, and/or residential video and security monitoring centers; standalone un-monitored home security systems; consumer smart speaker and connectivity devices such as Amazon Echo and Google Home, and any number of other mobile and fixed location security data gathering and management solutions, may be provided with near real-time access to the resulting metadata.
(32) In some embodiments there may also be geographical areas designated where a user would not want a gunshot detection device to record or report a gunshot. One example is a Police department may not want a gunshot detector, recording or other device to report a gunshot detection event from within a gun practice range. And similarly, an entity may only want gunshot detection to operate within a specified time period, such as a designated date, day of week, and time range or an enterprise may want users to have the option to place the gunshot detector into a manually selected “Off-Duty” mode that would ignore all possible gunshot events. This could be useful for police training at gun ranges where the officer is wearing a device that performs the gunshot detection device functionality on their person or has an edge detection device mounted on their police vehicle. Thus, a preferred embodiment would accommodate such policy-based requests.
(33) It could also be useful for gunshot detection events to automatically activate a camera or another gunshot detection device and broadcast an alert and/or a live audio stream to a local or remote monitoring system, or to other connected devices however accomplished. A silent alert or a live audio stream could allow other first responders and/or law enforcement to be notified of a possible active shooter situation and they could listen to a live audio stream of the event in real-time allowing for imp roved situational awareness and enhanced response capability.
(34) Moreover, the real-time location of a wearable or a fixed location device could be displayed on an electronic map. This information could also provide real-time situational awareness of the location of an active shooter upon gunshot detection where the map would automatically slew and zoom in to the location of interest and provide an audible alert tone. Similarly, a preferred embodiment may have an embedded GPS receiver allowing real-time situational awareness of the location of the device and also nearby gunshot or active shooter events as they unfold. In a like manner, an embodiment of a gunshot detection device or method could include an emergency alert or “Panic Button” capability. One could manually send a “Weapon Situation” alert before any shots were fired (or knife, ax, sword, club, baseball bat, bomb, vehicle, etc. were used as the weapon). As yet another example, a gunshot detection device could have alert sounding capability, or be able to take and upload photographs, and/or start live audio and/or video streaming to a local and/or central monitoring system to provide a real-time situational awareness view of audio, visual, and location metadata in a location where a gunshot was identified.
(35) An embodiment of a gunshot detection device or method could further serve as an individual component or combination microphone and edge processor, and as such may be able to locally identify gunshot events, and screen out False Positives. It would be advantageous for nearby Gunshot Detector devices to communicate with each other, and on a “Crowdsource” basis further confirm that a gunshot event has occurred. Such confirmation could thus collectively improve classification. When seconds can mean the difference between life and death in an active-shooter situation, any time delay having the sound recording being placed into a review wait queue, and/or waiting some amount of time for a next available human analyst to listen to, classify, and report a possible gunshot event, should be avoided to the maximum extent possible. Therefore, a gunshot detection system that requires remote human confirmation will cause delay and thus further delay an appropriate response (or even fail) when it was needed most.
(36) Another embodiment allows for relatively inexpensive purpose-built acoustic hardware to be paired with devices that have innate computational capabilities, but may lack the required sampling rate to capture the ultrasonic audio, such as smartphones. Thus, it is to be understood that the disclosed systems and methods may be used with, incorporated within, mobile video and audio recording devices such as personal cameras, smartphones, broadcast media mobile news video cameras and audio recording devices, consumer-grade still and video cameras, audio recorders, smart speakers, and any other electronic fixed or mobile devices where an acoustic but proximity constrained gunshot detection alert capability might be desired. As discussed above, prior art attempts at gunshot detection have used smartphones to detect candidate gunshot sounds. Embodiments preferably support sound sampling rates sufficient to obtain ultrasonic data. In the alternative, an unmodified smartphone or similar computing platform may overcome any innate limitations by having a secondary device paired with or directly connected to the platform that incorporates the teaching.
(37) FBI statistics between 1988 and 2003 show that 93% of the time, the distance between a shooter and a police officer killed by a gunshot occurred at distance of 50 feet or less. NYPD data from 1854 to 1979 shows that 90% of officers were killed within 15 feet from the shooter. For gunshot events between 1970 and 1979 where NYPD officers survived, the shooting distance in 75% of cases was less than 20 feet. Anecdotal reports from several recent school, church, mosque, and synagogue multiple gunshot events indicate they generally occurred after a gunman entered into a classroom, sanctuary, or hallway of relatively small dimensions. The disclosed systems and methods thus contemplate embodiments having a somewhat limited effective distance of up to 200 meters more than adequately address the majority of the scenarios found in practice.
(38) The disclosed systems and methods could also be implemented as a standalone, dedicated, fixed location gunshot detection sensor, in all the locations and types of entities already identified. An example of such standalone embodiment would be a replacement for the standard wall power outlet plate, where one of the outlets is utilized for powering the gunshot detection device. Representative embodiments are shown in
(39)
(40)
(41) In these implementations, a security screw may be utilized for the plate to be securely and easily mounted at a wall socket. The disclosed systems and methods may further be applied in a wide variety of existing types of fixed location sensor and “internet of things” (IoT) technology devices such as wired or wireless security cameras, security systems, perimeter security light and motion sensors, smart speakers, doorbells, thermostats, aircraft and train controllers and sensors, fire, smoke, and carbon monoxide alarms, kitchen appliances, industrial machinery controllers, electric and gas meters, electric distribution and substation transformers, high voltage transmission line sensors, pipeline pumping station controllers, traffic lights, street lights, toll booths, other smart cities devices, gasoline pumps, retail point of sale systems, and any number of other mobile and fixed location devices where having a gunshot detection capability might be desired. Devices and methods can also provide a highly reliable “crowdsourced” network ability to quickly identify and more precisely report the location of a gunshot event.
(42) The person of ordinary skill may appreciate that a fixed or known gunshot detection device location may be used to provide real-time situational awareness. For example, location information from such a device including an internal GPS sensor, or location information such as a known or assigned location such as Teacher X is assigned to Classroom 1 in School A, may be utilized to provide real-time situational awareness of approximately where in a school, office, or other facility one or more gunshots have occurred. So, by reference to a fixed or known location, the approximate real-time location of an active shooter can be estimated with significant reliability. Relatedly, a personal camera or other potential gunshot detection devices may be constructed so as to have local communications capabilities. Examples of such capabilities may include Bluetooth and Wi-Fi real-time wireless communications. As a result, such devices could communicate in real-time and be utilized to further address reliable detection of a possible gunshot event. For example, a false positive could be further identified (including confirmed or rejected as such) by real-time correlation and polling of other nearby detection devices.
(43) The disclosed systems and methods further contemplate having policy-based processing logic that can automatically start video recording based upon combinations of events. Gunshot detection can be one of these policy-based video recording start events. In many cases a video recording start from any combination of policy-based events causes pre-event video to be pre-pended to the camera's video segment. In the case of a gunshot event, the policy-based recording engine determines whether to pre-pend video and/or audio to video being stored and/or transmitted. In addition, a personal camera or data recording device or apps captures GPS, accelerometer, gyroscope, and other metadata that may be embedded in the video file and/or stored once a gunshot has been detected. A gunshot detection device and method may also generate and transmit gunshot detection sound wave data, metadata, and alerts to persons that may appropriately utilize such information. For example, gunshot detection metadata and alerts from one or more preferred gunshot detection devices can then be transmitted to real-time situational awareness systems (such as the commercial product known as AVaiLWeb™). The disclosed systems and methods could then make gunshot detection metadata available to first responders and others or used in association with web browser map-based views of a facility or area (e.g., a campus or business). Such real-time situational awareness views and alerts may be provided to smartphones, tablets, laptops, computer monitors, Police Computer Aided Dispatch and Video Integration Center monitors, and other web-browser capable display systems.
(44) Further, the disclosed systems and methods include that gunshot detection metadata and alerts may be transmitted to other gunshot detection devices, including wearables, vehicle mounted, or fixed location devices, within local proximity or within a designated GeoFence boundary. Some or all gunshot detection devices could receive emergency alert messages with audio alerts, text messages, active shooter information (e.g., photographs, video clips, classroom or office lockdown instructions, etc.). A gunshot detection device may further provide on-going alerts, status messages, and all-clear messages to teachers, supervisors, or other personnel who have a gunshot detection device.
(45) In view thereof, one embodiment of the present includes a method for accurately determining the occurrence of a gunshot by utilizing the ultrasonic spectrum. Such method may include three steps: a) Capturing a digital audio signal with such fidelity that the constituent frequencies that comprise ultrasonic frequencies are retained and preserved; b) Mathematically transforming the captured data by creating a spectrum of frequencies of the signal as it varies with time (spectrogram); c) Determining whether the spectrogram or sampled portions thereof contains the characteristic short-duration, high-energy, wide-spectrum, ultrasonic burst, that corresponds to the discovered unique ultrasonic signature of a Gunshot.
(46) These steps are reflected in the chart provided in
(47) The disclosed systems and methods contemplate that the electrical design may avoid or appropriately address audio signal overload. A loud noise in close proximity to a microphone may give rise to a signal that would cause clipping at the analog-to-digital converter. If the resulting signal is clipped, phantom components outside the passband of the anti-aliasing filter will result; these components will then likely alias and will cause non-harmonically related frequencies to be produced. The disclosed systems and methods preferably capture an audio signal with such fidelity that the constituent frequencies that comprise its ultrasonic frequencies are “real” and not an aberration or phantom signal content.
(48)
(49)
(50) It is to be understood that
(51) With further reference to the drawings,
(52) Referring to
(53) With regard to
(54)
(55) Stepping through a gunshot's waveform provides insight into the distribution of its energy. Mathematically transforming the captured data by creating a spectrum of frequencies of the signal as it varies with time (spectrogram) is a superior way to visualize and record the variation of a waveform's energy. Referring to
(56) The present systems and method further include determining whether the spectrogram or sampled portions thereof contains the characteristic short-duration, high-energy, wide-spectrum, ultrasonic burst, that corresponds to a unique ultrasonic signature of a gunshot in, for example, the library. As stated earlier, accurately detecting this acoustic idiosyncrasy which is uniquely produced by a gunshot requires advanced analytics and equipment capable of sampling, digitally storing, and processing sound data at ultrahigh sampling rates as required by the Nyquist-Shannon sampling theorem. Such equipment at the time of this filing was not innately contained, exposed, or enabled within any smartphone, tablet, or computer. These devices were limited to CD quality sound having sampling rates of 44.1 kHz.
(57) The current systems and methods provide for the capturing of audio. This step generally refers to the use of a microphone, and such capture may be accomplished with either an analog or a digital microphone. Current state-of-the-art microphones having digital outputs work well up to about 100 kHz. However, beyond that frequency their signal does not accurately represent the actual sampled waveform. The systems and methods contemplates that this technology will improve over time. For this reason, digital microphones may prove to be viable and their use is within the scope of the systems and methods such that the sampled audio signal is captured with such fidelity that the constituent ultrasonic frequencies are also retained and preserved.
(58) Given the state of current digital microphones, an embodiment may use an analog microphone having a very wide frequency response that encompasses the constituent ultrasonic frequencies, allowing for these to be retained and preserved. For example, studio, reference, and monitor type equipment designed with the music professional may be inadequate when it comes to capturing and meeting the preferred frequency response. Given that short duration of the high-energy wide-spectrum ultrasonic impulse is a small fraction of the overall energy and given its wide distribution, the disclosed systems and methods contemplate not losing such information within the power spectrum.
(59) Thus, by way of example, equipment having CD quality sound, having a typical defined sampling rate of 44.1 kHz, limiting the maximum frequency that may be captured digitally to 22 kHz. This upper limit is insufficient.
(60) Some embodiments thus comprise a gunshot detection device or method that has or utilizes a processor, microphone, audio to digital conversion (ADC) technology, memory, and software processing logic that captures and/or processes digital audio signals up to 200 KHz, Analog Audio Capture, ADC and a Fast Fourier transformation processing capability, and allows for storage of the resulting digital audio signal. The resulting digital audio data may be stored in the gunshot detection device's memory on a rolling loop basis of sufficient size to accommodate the processing and communications limitations of the edge device. Such continuous rolling loop data storage process is known to the person of ordinary skill in art.
(61) It is to be further understood that the rate of decay based upon frequency allows for calculating a signal back to its source. In other words, the distance from the fired gun (e.g., a shooter) may be determined using the full spectrum of the signal sampled at a given location. Given the eccentricity of the radiation pattern for low frequencies, building a robust sampling library from various distances, angles, guns, barrel lengths, calibers, and propellant loads is important. The preferred embodiment contemplates obtaining tens of thousands of sample spectrograms to be used for teaching its AI system to do the final comparison and to provide results that not only confirm that the source is a gunshot but provide a means for identifying the type of gun being used. Also, the distance from the fired gun (e.g., a shooter) may be determined using the full spectrum of the signal sampled at a given location. By taking the intensity of several ultrasonic frequencies at a discrete location and applying the International Standard document ISO 9613-1:1993 Part 1 “Calculation of the absorption of sound by the atmosphere,” and applying the formulas within section 6.2, allows for deriving the relative distance from sample taken to its point source. It is also possible to use such a library of gunshot data, essentially arrays of values of intensity, time, and frequency (spectrograms), and using correlation to determine the best match. Both methods provide very good results for determining other key information such as gun type, ammunition type, direction of shot, etc.
(62) Some embodiments may further include publishing the determination. This publishing process may be performed using a plethora of wired or wireless communications methods from the gunshot detection device to one or more subscribers or recipients of gunshot event data. A device or method may incorporate one or more communications technologies and methodologies, or may be connected to one or more wired or wireless communications devices that serve as a data transport mechanism for a gunshot detection device to publish gunshot event data. Gunshot event publishing data can, but is not limited to, being transmitted via local area wired network servers and access points; telephone lines; powerline network connectivity; Wi-Fi, Bluetooth and other wireless connectivity to local devices such as Wi-Fi or Bluetooth access points, Bluetooth receivers, nearby smartphones and other local devices with Wi-Fi, Bluetooth, Near Field Communications; Infrared or Ultraviolet optical signaling; Ultrasound signaling; ZigBee; Mesh Network; and other local area data communications methods and technologies. Gunshot event messages can also be transmitted wirelessly via wide-area AARL radio, 3G, 4G-LTE, 5G, LTE-M, NB-IoT, SigFox, LMR data, 900 Mhz and other public open access radio frequency bands, television network sideband datacasting, BGAN and other satellite data communications technologies, and any number of other existing and future wide-area wired or wireless communications networks and technologies. Nothing in this description limits the publication of gunshot event data or precludes the use of any method or system to communicate and publish such information.
(63) A gunshot detection device may also publish additional information such as a device serial number, location, and gunshot date and timestamp. The device and/or method may capture and send NMEA or other GPS message data. The device may further be able to establish an audio communications channel and transmit live audio from the device microphone over a local or wide area network so that First Responders can listen to live audio being broadcast from a preferred embodiment that has detected a gunshot event.
(64) Current embodiments may further transmit captured information to a second location such as a nearby personal body camera; an in-car video recording device, a first responder data center; a building or campus security system processing server; smart speaker; a Cloud-based processing center, or any other external processor. In such a situation, the second location's processor may compare the candidate gunshot audio data to a collection of known gunshot audio signatures previously captured or otherwise obtained.
(65) Either internal to the gunshot detection device or by means of an external processor, it may be determined that a given candidate gunshot dataset most closely matches a previously captured gunshot signature maintained in the library. This operation can be performed by correlation or the use of an Artificial Intelligence engine maintained in the Cloud. Moreover, other detailed metadata about the Gunshot Detection event such as type of weapon, caliber of the projectile, distance of the shooter from the gunshot detection device, and compass heading of the shooter from the gunshot detection device, are examples of the information that can also be determined.
(66) It is to be further understood that a gunshot detection device and methods may be placed in various locations, either fixed or mobile. For example, a future smartphone may be provided with an audio subsystem that is able to capture gunshot audio within the ultrasonic spectrum, and thereby, with the appropriate software, serves as a mobile Gunshot Detector. In an alternative embodiment, a Gunshot Detector could be an appliance that plugs into a 110 volt AC electrical outlet to provide Gunshot Detection inside a room, hallway, auditorium, chapel, retail location, school classroom, courthouse, police station, media studio, hotel, restaurant, hospital room or corridor, sports stadium, transit stop/station, or public park. The Gunshot Detector could be mounted on a Smart Cities power pole, affixed to the outside of a building, or to any number of other internal or external fixed locations.
(67) The technologies described herein may be implemented in various ways, including as computer program products comprising memory storing instructions causing a processor to perform the operations associated with the above technologies. The computer program product comprises a tangible, non-transitory computer readable storage medium storing applications, programs, program modules, scripts, source code, program code, object code, byte code, compiled code, interpreted code, machine code, executable instructions, and/or the like (also referred to herein as executable instructions, instructions for execution, program code, and/or similar terms). Such tangible, non-transitory computer readable storage media include all the above identified media (including volatile and non-volatile media), but does not include a transitory, propagating signal. Non-volatile computer readable storage medium may specifically comprise: a floppy disk, flexible disk, hard disk, magnetic tape, compact disc read only memory (“CD-ROM”), compact disc compact disc-rewritable (“CD-RW”), digital versatile disc (“DVD”), Blu-ray™ disc (“BD”); any other non-transitory optical medium, and/or the like. Non-volatile computer-readable storage medium may also comprise read-only memory (“ROM”), programmable read-only memory (“PROM”), erasable programmable read-only memory (“EPROM”), electrically erasable programmable read-only memory (“EEPROM”), flash memory, and/or other technologies known to those skilled in the art.
(68) Many modifications and other embodiments of the concepts and technologies set forth herein will come to mind to one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that embodiments other than the embodiments disclosed herein are intended to be included within the scope of the appended claims. Although specific terms may be employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation