Multiband flash detection system

Abstract

A multiband imaging system comprising: an optical module configured for acquiring simultaneously images from a common field-of-view (FOV) scene in a short wavelength spectral band and in a long wavelength spectral band, the optical module comprising a polarizer configured for applying polarization filtering to electromagnetic radiation of the long wavelength spectral band; and a processing module configured to analyze data indicative of received irradiance distribution between the short and long wavelength spectral bands.

Claims

1. A multiband imaging system for detecting muzzle flashes, comprising: a short wavelength imaging module configured for acquiring an image in a short wavelength; a long wavelength imaging module configured for acquiring an image in a long wavelength, where the short wavelength and long wavelength imaging modules simultaneously acquire images from a common field-of-view (FOV) scene in a short wavelength spectral band and in the long wavelength spectral band, respectively; a polarizer configured for applying polarization filtering to electromagnetic radiation of a long wavelength spectral band entering the long wavelength imaging module to filter out specular reflections from surfaces having roughness close to the short wavelength and smaller than the long wavelength; and a processing module configured to analyze data indicative of received irradiance distribution between the short and long wavelength spectral bands for determining the muzzle flashes.

2. The system according to claim 1, wherein the processing module is further configured to detect a section of the common FOV scene in which a ratio between an irradiance in the long wavelength spectral band and an irradiance in the short wavelength spectral band exceeds a predetermined threshold.

3. The system according to claim 1, wherein the short wavelength spectral band is within a visible band or UV-visible-NIR and the long wavelength spectral band is within a shortwave infrared band.

4. The system according to claim 1, wherein the long wavelength spectral band and the short wavelength spectral band do not overlap.

5. The system according to claim 1, wherein the long wavelength spectral band is approximately 1.5 m to 1.7 m and the short wavelength spectral band is approximately 0.5 m to 0.6 m.

6. The system according to claim 1, wherein: the long wavelength imaging module includes a first channel including a first focal plane array configured to sense electromagnetic radiation in the long wavelength spectral band; the short wavelength imaging module includes a second channel including a second focal plane array configured to sense electromagnetic radiation in the short wavelength spectral band; wherein the first and second focal plane arrays are configured so that a defined mapping links corresponding pixels of the first and second focal plane arrays, the corresponding pixels imaging similar field directions in a field of view of the imaging system when the imaging system is operated; and the polarizer is arranged in the first channel upstream of the first focal plane array.

7. The system according to claim 6, wherein the processing module is configured to compute for at least some corresponding pixels, a ratio between corresponding pixels received irradiances.

8. The system according to claim 7, wherein the processing module is further configured to detect if the ratio crosses a predefined threshold thereby detecting a field direction in the field of view of the optical detection system in which muzzle flash or detonation took place.

9. The system according to claim 8, wherein the predefined ratio is adaptive so as to operate under a Neymann-Pearson detector regime.

10. The system according to claim 8, wherein the processing module is further configured to estimate a blackbody effective temperature matching the received irradiance distribution from a detected muzzle-flash/detonation field direction.

11. The system according to claim 1, wherein the polarizer is configured to reject electromagnetic radiation of polarization different from a linear polarization of the polarizer.

12. The system according to claim 11, wherein the linear polarization of the polarizer is vertical.

13. The system according to claim 11, wherein the imaging system further comprises a housing defining a vertical orientation of the imaging system in standard condition and the polarizer is configured so that the linear polarization of the polarizer is parallel to the vertical orientation.

14. The system according to claim 11, wherein the polarizer is configured so that the linear polarization of the polarizer stays approximately collinear with a gravitational field direction.

15. The system according to claim 6, wherein the polarizer is configured to reject electromagnetic radiation of polarization different from a linear polarization of the polarizer, and the linear polarization of the polarizer is perpendicular to a plane containing optical axes of the first and second channels.

16. The system according to claim 1, wherein the polarizer is mounted retractably.

17. The system according to claim 16, further configured to retract the polarizer at a low ambient light condition and/or when sun-reflected light is not a significant part of an overall scene irradiance.

18. A detection method for detecting muzzle flashes, comprising: simultaneously acquiring images from a common FOV scene in a short wavelength spectral band using a short wavelength imaging module and in a long wavelength spectral band using a long wavelength imaging module, while applying polarization filtering to electromagnetic radiation of the long wavelength spectral band entering the long wavelength imaging module to filter out specular reflections from surfaces having roughness close to the short wavelength and smaller than the long wavelength, and generating data indicative of the acquired images; analyzing the data to determine a spectral irradiance distribution between shortwave infrared and visible spectral bands; detecting one or more sectors of the common FOV scene for which a ratio between an irradiance in the long wavelength spectral band and an irradiance in the short wavelength spectral band exceeds a predefined threshold for determining the muzzle flashes.

19. The detection method according to claim 18, wherein the predefined threshold is adaptive so as to operate under a Neymann-Pearson detector regime.

20. The method according to claim 18, wherein a polarization direction of a polarizer that applies the polarization filtering is oriented perpendicular to a horizontal plane.

21. The method according to claim 20, further comprising: retracting the polarizer at a low ambient light condition and/or when sun-reflected light is not a significant part of an overall scene irradiance.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) In order to better understand the subject matter that is disclosed herein and to exemplify how it may be carried out in practice, embodiments will now be described, by way of non-limiting example only, with reference to the accompanying drawings, in which:

(2) FIG. 1, previously described, illustrates schematically Planck curves for different blackbody temperatures.

(3) FIG. 2, previously described, illustrates schematically a detection system in a field of operation collecting sunlight reflected from a reflecting object according to embodiments of the present disclosure.

(4) FIGS. 3A-3C, previously described, illustrate different modes of reflection for two electromagnetic radiations of different wavelengths off object surfaces having different roughness.

(5) FIG. 4 illustrates steps of a method of detecting muzzle-flashes and detonations according to embodiments of the present disclosure.

(6) FIG. 5 illustrates elements of a detection/imaging system according to some embodiments of the present disclosure.

(7) FIG. 6 illustrates elements of a detection/imaging system according to some embodiments of the present disclosure.

DETAILED DESCRIPTION OF EMBODIMENTS

(8) Described herein are some examples of systems and methods for analyzing a scene and detecting muzzle-flashes and detonations, i.e. fire events.

(9) In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the subject matter. However, it will be understood by those skilled in the art that some examples of the subject matter may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to obscure the description.

(10) As used herein, the phrase for example, such as, for instance and variants thereof describe non-limiting examples of the subject matter.

(11) Reference in the specification to one example, some examples, another example, other examples, one instance, some instances, another instance, other instances, one case, some cases, another case, other cases or variants thereof means that a particular described feature, structure or characteristic is included in at least one example of the subject matter, but the appearance of the same term does not necessarily refer to the same example.

(12) It should be appreciated that certain features, structures and/or characteristics disclosed herein, which are, for clarity, described in the context of separate examples, may also be provided in combination in a single example. Conversely, various features, structures and/or characteristics disclosed herein, which are, for brevity, described in the context of a single example, may also be provided separately or in any suitable sub-combination.

(13) As apparent from the following discussions, it is appreciated that throughout the specification discussions utilizing terms such as generating, determining, providing, receiving, using, transmitting, performing, forming, analyzing, or the like, may refer to the action(s) and/or process(es) of any combination of software, hardware and/or firmware. For example, these terms may refer in some cases to the action(s) and/or process(es) of a programmable machine, that manipulates and/or transforms data represented as physical, such as electronic quantities, within the programmable machine's registers and/or memories into other data similarly represented as physical quantities within the programmable machine's memories, registers and/or other such information storage, transmission and/or display element(s).

(14) It is noted that in some embodiments, a dual band imaging/detection system according to the present disclosure may employ a SWIR band and a visible band to distinguish between optical radiance sources within an imaged scene which are likely to be active (e.g. hot) blackbody (or grey body) emitters with effective temperature in the range of 1200K-2500K from other optical sources.

(15) In this connection, it is noted that the most abundant optical radiance sources within an imaged scene are generally those created by sunlight reflection. Sun irradiance, reaching a terrestrial object arrives as an essentially parallel beam of rays at a direction with respect to Earth horizon which is equal to the Sun elevation angle (also referred to as zenith angle) in a common geodesic East/North/Up referential. Further, it is noted that sun irradiance is non polarized.

(16) Incident sun irradiance spectrum at ground altitudes on Earth can be effectively modeled as a grey body with an effective blackbody temperature in the range of 5400K-5900K (depending on sun nadir angle, spectral band and weather conditions). As such, it can be effectively distinguished from blackbody/greybody emitters that are objects of interest by means of the multi band imaging system.

(17) However, sunlight reflections off surfaces of a certain roughness may result in polarized and specular (glint) reflected light at long wavelength (e.g. SWIR), whereas reflection of visible band light from the same surfaces would result in scattering into a large cone (i.e. diffused) and essentially non polarized.

(18) When the dual band imaging system is located at the direction of the specularly reflected long wavelength light, it would measure significantly stronger long wavelength irradiance at the optics aperture, than it would have for a diffused or Lambertian reflection. Calculations show that in such conditions, the long wavelength irradiance may be as much as six times stronger than without the specular reflection. This may distort the relative distribution of optical power as received between the different wavelength bands and may lead to an erroneous classification of the imaged object (reflection surface) as an object of interest.

(19) Since the specular reflected light may be polarized, the Applicant has found that it can be attenuated by incorporating a polarizer in the optical chain of the long wavelength imaging channel.

(20) Firstly, it is noted that objects of interest emit unpolarized lighthence incorporation of a polarizer in the long wavelength optical detection means should attenuate the received irradiance from such sources in a known way50% attenuation due to linear polarization and additional known attenuation due to polarizer transmission or absorption effects that are not related to polarization. This attenuation may be compensated by using either sensor signal integration time, aperture diameter, and/or numerical calculation in the signal processor.

(21) Secondly, it is noted that for reflected light in the visible band light is expected to be essentially unpolarized if it is reflected off a polished metal surface or from a rough (compared to the wavelength) dielectric surface.

(22) Thirdly, for reflected light in the long wavelength band (SWIR): When light is reflected off rough surfaces, or from non-dielectric surfaces, or at steep angles (w.r.t surface normal), the reflected light is expected to be essentially unpolarized and therefore its reception is not modified in a significant manner. When light is reflected off smooth (0.5 m) surfaces such as a car's exterior and painted surfaces, reflected light is expected to be essentially polarized and specular. In this case, a polarizer, if aligned such that its polarization plane is misaligned with the reflected light direction of polarization, would significantly attenuate the specular reflected light.

(23) Fourthly, in practical and most frequent scenarios, the line of sight of the optical imaging means would be almost parallel to the horizon. Sun irradiance is maximum, when the sun is high in the sky (zenith elevation angle close to nadir). On such occasions, specularly reflected light that can be received by the optical imaging (detection) means would have its plane of polarization essentially in the horizontal direction.

(24) Therefore, the present disclosure contemplates having a linear polarizer in the long wavelength reception channel. Therefore, by using the imaging system such that an optical axis of the system is substantially parallel to the ground and the linear polarizer (direction of the transmitted polarization) is substantially perpendicular to the ground, the desired effect of attenuating the long wavelength specularly reflected light by surfaces of intermediate roughness may be achieved.

(25) In some embodiments, the polarizer may be configured so that the linear polarization direction is vertical

(26) In some embodiments, the polarizer may be configured so that the linear polarization direction stays parallel to the gravitational field.

(27) In some embodiments, the imaging system may be configured so that a linear polarization direction of the polarizer which is transmitted through the polarizer is substantially perpendicular to a plane containing the first and second optical axes of the short and long wavelength channels.

(28) In some embodiments, the system may further comprise a housing. The housing (for example its shape) may define a vertical axis of the imaging system. The vertical axis of the imaging system may refer to a position of the imaging system when used in standard conditions i.e. a light of sight parallel to the ground (and predefined roll). The polarizer may be configured so that a polarization direction is (substantially) parallel to the vertical orientation of the imaging system. For example, the housing may include a flat support surface (lower or upper surface) for supporting the imaging system and the polarization direction of the polarizer may be perpendicular to the support surface.

(29) In some embodiments, the imaging/detection system may be mounted on a pan/tilt unit so as to be positioned according to a desired line of sight. The polarizer may be configured so that an orientation of the polarizer stays perpendicular to the line of sight plane. However, it is noted that even if the LOS of the optical detection/imaging system is not horizontalthe loss of performance is only degraded with inclination angle (theta) of the LOS (with respect to horizon)practically the specularly reflected light component shall be amplified as sin(theta).

(30) FIG. 4 illustrates steps of a method useful for detecting muzzle-flash and detonation events. In a first step S100, electromagnetic radiations may be collected using a dual (or at least dual) band optical system. The dual band optical system may include a short wavelength and long wavelength channels and a polarizer arranged upstream of the long wavelength channel so that light is propagated through the polarizer on its way to an imaging sensor (focal plane array) of the long wavelength channel. Each source area within a field of view of the dual band optical system may be associated with a short wavelength pixel irradiance collected on a pixel of a short wavelength focal plane array (FPA) of the short wavelength channel and a long wavelength pixel irradiance collected on a corresponding pixel of a long wavelength focal plane array (FPA) of the long wavelength focal plane array (FPA). It is noted that the term corresponding pixels refers to respective pixels from the short and long wavelength focal plane array (FPA)s which image an identical area of a scene when the dual band optical system is operated i.e. used to image a scene. Corresponding pixels may also be understood as pixels whose field direction does not deviate by more than of their Instantaneous Field of View (IFOV) along pitch and yaw. In a second step S110, a spectral irradiance distribution between the two spectral bands may be analyzed. The spectral irradiance distribution may be expressed as a ratio between corresponding pixel intensities in the long wavelength band and in the short wavelength band. In a third step S120, one or more area complying with a eligibility parameter may be detected. The eligibility parameter may be expressed as a threshold value. An area may be deemed to comply with the eligibility parameter if the calculated ratio meets for example exceeds) the threshold value. As explained hereinabove, the Applicant has found that flashes are characterized by a very high ratio between the long wavelength irradiance and the short wavelength irradiance. In a fourth optional step S130, an effective temperature of one or more detected (eligible) area may be computed to verify if the effective temperature is coherent with a fire event. It is reminded that a firing event behaves like a blackbody or grey body emitter of around 1200K-2500K. This leads to obtain one or more verified areas. In a fifth step S140, data indicative of the detected area and/or of the checked area may be outputted so as to enable appropriate action to be taken if a fire event is detected.

(31) FIG. 5 illustrates elements of a imaging/detection system for detecting fire events according to some embodiments of the present disclosure. The system may include an optical module 10 and a processing module 20. The processing module 20 may provide data indicative of detection of firing events to an output module 30 by performing some of the steps of the method previously described. The optical module 10 may be a dual band imaging system. The optical module may enable simultaneous acquisition of a common scene in two separate spectral band, a short wavelength spectral band, for example a visible band, and a long wavelength spectral band, for example a SWIR band. In some embodiments, the optical module may comprise a first channel 13 and a second channel 14. The first and second channels 13, 14 may be configured for respectively acquiring the images on the long wavelength band and on the short wavelength band. The first channel 13 may comprise a first optics 11 and a first imaging module 15. The second channel 14 may comprise a second optics 12 and a second imaging module 16. The first and second optics 11, 12 may be configured side by side so that the optical axes of the first and second optics 11, 12 are offset and approximately parallel. The first and second imaging modules 15, 16 may respectively include a first focal plane array 151 configured to sense electromagnetic radiation in the long wavelength spectral band and a second focal plane array 161 configured to sense electromagnetic radiation in the short wavelength spectral band. Furthermore, additional optics 152, 162 may be added to improve image acquisition in the first and second imaging modules 15, 16. The first and second focal plane arrays (FPA) 151, 161 may be configured so that a defined mapping links corresponding pixels imaging similar source areas in a field of view of the system (dual band imaging system) when the system is operated. In other words, the dual band imaging system may be spatially registered. A polarizer 17 may be configured for filtering electromagnetic radiation of the long wavelength spectral band. The polarizer may be arranged on the first channel, upstream of the first focal plane array 151. The polarizer 17 may be configured upstream (before with respect to light trajectory) of the first optics 11. This enables avoiding a change of polarization of the light before it reaches the polarizer 17.

(32) In some embodiments, the polarizer 17 may also be configured for filtering the short wavelength spectral band. The polarizer 17 may be a linear polarizer. The polarizer 17 may be configured so that a linear polarization which is transmitted through the polarizer is perpendicular to a line of sight direction (or optical axis) of the optical module 10.

(33) Further, the polarizer 17 may be configured so that a linear polarization direction of the polarizer 17 which is transmitted through the polarizer is substantially perpendicular to a plane containing the first and second optical axes of the first and second optics 11, 12.

(34) The optical module 10 may further comprise a housing. The housing (for example its shape) may define a vertical axis of the optical module 10. The vertical axis of the optical module 10 may refer to a position of the optical module when used in standard conditions i.e. a light of sight parallel to the ground and predefined roll. The polarizer 17 may be configured so that a polarization direction is (substantially) parallel to the vertical orientation of the imaging module 10. For example, the housing may include a flat support surface (lower or upper surface) for supporting the optical module and the polarization direction of the polarizer may be perpendicular to the support surface. In some embodiments, the vertical direction of the optical module 10 defined by the housing may be perpendicular to the plane containing the optical axes of the first and second optics 11, 12.

(35) The polarizer 17 may be configured so that an orientation of the polarization direction can be modified i.e. the polarizer 17 may be tiltable. The polarizer 17 may be configured so that the linear polarization of the polarizer stays (substantially) collinear with the gravitational field.

(36) Further, the polarizer 17 may be mounted retractably and the system may be configured to retract the polarizer at low ambient light condition and/or when sun-reflected light is not a significant part of the overall scene irradiance.

(37) The processing module 20 may be configured for analyzing an irradiance distribution between the short and long wavelength spectral bands. The spectral irradiance distribution may be expressed as a ratio between corresponding pixel intensities in the long wavelength band and in the short wavelength band. The processing module 20 may further be configured to detect one or more areas of the common scene for which a ratio between an irradiance in the long wavelength spectral band and an irradiance in the short wavelength spectral band exceeds a predetermined threshold. In some embodiments, the polarizer may be for example a polarizer such as the P/N HR from 3M made by American Polarizers Inc. or the P/N 54-112 by Edmund Optics. In some embodiments, the polarizer may be for example based on liquid crystal or birefringent crystal and may be controlled by electrical/thermal or stress/strain commands. The processing module 20 may further be configured for computing an effective temperature of the detected areas so as to verify if the effective temperature is coherent with a fire event. The verification enables to limit residual false positive responses and provide verified areas. Data indicative of the detected areas and/or verified areas may be provided as output to the output unit 30.

(38) FIG. 6 illustrates a variant of the system illustrated on FIG. 5. For the sake of conciseness, certain similar elements already described with reference to FIG. 5 are not repeated. The elements represented by identical numerals on FIG. 5 and FIG. 6 are identical. FIG. 6 illustrates an alternative optical module 100 for the system of imaging/detection of detecting fire events according to the present disclosure. The optical module 100 has a folded optical configuration and is configured to enable simultaneous acquisition of a common scene in two separate spectral band, a short wavelength spectral band, for example a visible band, and a long wavelength spectral band, for example a SWIR band. The optical module 100 comprises a common channel 110, a first channel 130 and a second channel 140. The common channel 111 may comprise a common optics 111 and a beam splitter arrangement 112 configured for splitting the common channel 110 into the first and second channels 130, 140. In some embodiments, the beam splitter arrangement 112 may comprise a dichroic mirror and a standard mirror. The common optic 111 may be used as a single aperture for acquiring images in both spectral bands. The first and second channels 130, 140 may be configured for respectively acquiring the images on the long wavelength band and on the short wavelength band.

(39) The first and second channels may respectively include a first imaging module 15 and a second imaging module 16. The first and second imaging module 15, 16 may be spatially registered.

(40) A polarizer 17 may be configured for filtering electromagnetic radiation of the long wavelength spectral band. The polarizer 17 may be a linear polarizer. The polarizer 17 may be arranged on the first channel, upstream of the first imaging module 15. The polarizer 17 may be configured upstream (before with respect to light trajectory) of the common optics 111.

(41) The polarizer 17 may be configured so that a linear polarization which is transmitted through the polarizer is perpendicular to a line of sight direction (or optical axis) of the optical module 100. Further, the polarizer 17 may be configured so that a linear polarization direction of the polarizer 17 which is transmitted through the polarizer is substantially perpendicular to a plane containing the first and second optical axes of the first and second imaging modules 15, 16 i.e. the central axes with respect to the focal plane arrays.

(42) The optical module 10 may further comprise a housing (not shown). The housing may be configured so as to define a vertical direction for the optical module 10. The vertical direction of the optical module 10 may refer to a preferential operating/holding direction of the optical module in standard conditions. The polarizer 17 may be configured so that a polarization direction is (substantially) parallel to the vertical axis of the imaging module 10. In some embodiments, the vertical direction of the optical module 10 defined by the housing may be perpendicular to the plane containing the optical axes of the first and second imaging modules 15, 16.

(43) The polarizer 17 may be configured so that an orientation of the polarization direction can be modified i.e. the polarizer 17 may be tiltable. The polarizer 17 may be configured so that the linear polarization of the polarizer stays (substantially) collinear with the gravitational field.

(44) Further, the polarizer 17 may be mounted retractably and the system may be configured to retract the polarizer at low ambient light condition and/or when sun-reflected light is not a significant part of the overall scene irradiance.

(45) The processing module 20 and the output unit 30 (which may not be part of the detection/imaging system) may be configured as previously described, in particular with reference to FIG. 5.

(46) While certain features of the invention have been illustrated and described herein, many modifications, substitutions, changes, and equivalents will now occur to those of ordinary skill in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.

(47) It will be appreciated that the embodiments described above are cited by way of example, and various features thereof and combinations of these features can be varied and modified.

(48) While various embodiments have been shown and described, it will be understood that there is no intent to limit the invention by such disclosure, but rather, it is intended to cover all modifications and alternate constructions falling within the scope of the invention, as defined in the appended claims.

(49) It will also be understood that the system according to the presently disclosed subject matter can be implemented, at least partly, as a suitably programmed computer. Likewise, the presently disclosed subject matter contemplates a computer program being readable by a computer for executing the disclosed method. The presently disclosed subject matter further contemplates a machine-readable memory tangibly embodying a program of instructions executable by the machine for executing the disclosed method.