Passive clear air turbulence detection system and method

10701287 ยท 2020-06-30

Assignee

Inventors

Cpc classification

International classification

Abstract

A passive thermal imaging system is described. The system includes at least one detector array configured to detect thermal electromagnetic radiation (EMR), imaging optics, and processing electronics. The imaging optics are configured to receive thermal EMR from an object, and to image the received thermal EMR onto pixels of each of the at least one detector array. The processing electronics are configured to receive a detected signal from each of the pixels of the at least one detector array, to calculate a correlation value based on a correlation between the received detected signals from the pixels, and to compare the correlation value with a threshold correlation value to determine whether a detection event has occurred.

Claims

1. A passive thermal imaging system, comprising: a plurality of detector arrays, each of the detector arrays configured to detect thermal electromagnetic radiation (EMR) within a same band around a desired EMR wavelength, each of the detector arrays comprising a plurality of pixels; imaging optics configured to receive thermal EMR within the band from an object, and to image the received thermal EMR from a same region of the object onto pixels of each of the plurality of detector arrays; and processing electronics configured to receive a detected signal from each of the pixels of the plurality of detector arrays, to calculate a correlation value based on a multi-correlation of the received detected signals of corresponding pixels of different detector arrays of the plurality of detector arrays, the detected signals based on the thermal EMR from the object, and to compare the correlation value with a threshold correlation value to determine that a detection event has occurred in response to the correlation value exceeding the threshold correlation value being equal to or between 0.8 and 0.85, the processing electronics are configured to calculate the correlation value based on a covariance of the received detected signals of the corresponding pixels of the different detector arrays, the detection event corresponding to a size of a temperature fluctuation of the object, wherein the imaging optics are configured to receive thermal EMR from a region of the atmosphere as the object, and where the detection event is clear air turbulence exhibiting thermal fluctuations of air at a distance from the system 10 kilometers.

2. The passive thermal imaging system of claim 1, wherein the plurality of detector arrays comprises two detector arrays, and the processing electronics is configured to calculate a correlation value based on cross-correlation of corresponding pixels of the plurality of detector arrays.

3. The passive thermal imaging system of claim 1, wherein the plurality of detector arrays comprises three detector arrays, and the processing electronics is configured to calculate a correlation value based on triple-correlation of corresponding pixels of the plurality of detector arrays.

4. The passive thermal imaging system of claim 1, wherein the plurality of detector arrays comprise at least one of a nanoparticle plasmonic detector array, a mercury cadmium telluride detection array, or a bolometer detector array.

5. The passive thermal imaging system of claim 4, wherein the plurality of detector arrays comprise a nanoparticle plasmonic detector array.

6. The passive thermal imaging system of claim 1, wherein the processing electronics is configured to time integrate or spatially integrate the detected signals at a rate of 1 to 10 times per second.

7. The passive thermal imaging system of claim 1, wherein the imaging optics comprises an imaging lens.

8. The passive thermal imaging system of claim 7, further comprising: a bandpass filter which filters the received thermal EMR from the object within a EMR wavelength range.

9. A system for detecting clear air turbulence, comprising: a structure having the passive thermal imaging system of claim 1 mounted thereon.

10. The system of claim 9, wherein the structure is one of a vehicle or a ground-based platform.

11. The system of claim 10, wherein the structure is a vehicle, which is one of an aircraft, a spacecraft, or an unmanned aerial vehicle.

12. The passive thermal imaging system of claim 1, further comprising: a bandpass filter which filters the received thermal EMR from the object within a EMR wavelength range of 10 microns2 microns.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 is a schematic illustrating a passive thermal imaging system according to an embodiment of the invention.

(2) FIG. 2 is a schematic illustrating a view of a detector array including an array of pixels according to an embodiment of the invention.

(3) FIGS. 3A and 3B illustrate the effect of turbulence on EMR radiation received from a region of interest and impinging on a receiver plane.

(4) FIG. 4 is graph illustrating standard deviation in arrival angle due to reasonable atmospheric turbulence level as a function of beam diameter d.sub.B for different sizes of index of refraction fluctuation due to turbulence.

(5) FIG. 5 illustrates a randomly populated signal matrix.

(6) FIG. 6 illustrates a noise matrix.

(7) FIG. 7 illustrates a signal plus noise matrix.

(8) FIG. 8 is a schematic illustrating a system for detecting air turbulence including a passive thermal imaging system according to an embodiment of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

(9) According to certain embodiments of the present invention, a passive optical system which may discriminate a minimum change of 2 C. from an imaged region and its background, and thus is appropriate for detecting CAT is described. The passive system uses correlation techniques to reduce the effects of thermal background noise to allow for detection of CAT at a distance from the system of >10 km. Such a detection distance of CAT provides a warning time of about 30 seconds for an optical system on an aircraft traveling at about 600 miles/hr. Such a small temperature change may be determined in the presence of certain natural background radiation from the day time and night time sky, although not necessarily in the presence of all strengths of natural background radiation.

(10) FIG. 1 illustrates a passive thermal imaging system 100 according to an embodiment of the invention. The system 100 includes at least one detector array 110, (110a and 110b in FIG. 1), imaging optics 120 (imaging optics components 120a and 120b in FIG. 1), and processing electronics 130. The imaging optics 120 images an object of interest 150 onto the at least one detector array 110. While FIG. 1 illustrates the at least detector array 110 to be two detector arrays 110a and 110b, the at least one detector array 110 may be a single detector array, or more than two detector arrays, such as three detector arrays. Likewise, while FIG. 1 illustrates the imaging optics to be two imaging optics components 120a and 120b, the imaging optics 120 may be a single imaging optics component, or more than two imaging optics components, such as three imaging optics components. In general, the imaging optics components 120a and 120b image thermal electromagnetic radiation (EMR) from an object 150 of interest onto detector arrays 110a and 110b, respectively.

(11) FIG. 2 illustrates a view of a detector array 110 including an array of pixels 112. While FIG. 2 illustrates a 33 array of pixels for ease of illustration, in general, the size of the array of pixels will be much larger than 33. The detector material for the pixels 112 may be any material appropriate for detecting thermal EMR at an appropriate wavelength. In this regard, the detector array 110 may comprise at least one of a nanoparticle plasmonic detector array, a mercury cadmium telluride detection array, or a bolometer detector array. Nanoparticle plasmonic detector arrays are described in, for example, U.S. patent application Ser. No. 13/243,342 entitled NANO-STRUCTURE ARRAYS FOR EMR IMAGING, filed Sep. 23, 2011, which is incorporated by reference in its entirely herein.

(12) Referring back to FIG. 1, the system 100 may include at least one bandpass filter 140 (filters 140a and 140b in FIG. 1) which filters the received thermal EMR from the object 150 within a EMR wavelength range of interest. For example, for a EMR wavelength of interest of 10 microns, the bandpass filter 140 may pass EMR in a wavelength range of 10 microns2 microns.

(13) The imaging optics 120 images the EMR from the object at a desired wavelength of interest. For example, for a EMR wavelength of interest of 10 microns, the imaging optics may comprise a lens, or lenses, made of germanium to image the thermal EMR from the object 150.

(14) The imaging system 100 may be of appropriate dimensions for imaging thermal EMR from an object at an appropriate distance. For example, if the system 100 is intended to image thermal EMR from an object at a distance of about 10 km from the system 100, the system may be an f/5 system, for example, where the imaging optics 120 has a focal length of about 0.5 meters, for example, and a lens diameter of about 10 cm, for example.

(15) The processing electronics 130 receives a detected signal from each of the pixels 112 of the at least one detector array 110. The processing electronics 130 further calculates a correlation value based on a correlation between the received detected signals from the pixels 112, and compares the correlation value with a threshold correlation value to determine whether a detection event has occurred.

(16) Below is provided a background discussion for determining the signal to noise and event detection capability of the system 100, where the event is detection of CAT.

(17) Basic Optical Principles for System and Signal Strength

(18) For an extended source that fills the field of view of a detector, the detector irradiance H is related to the source radiance, N, by the following radiometric equation, where trans is the transmission of the atmosphere and system optics, m is the system magnification, v/u, and FN.sub.0 is the f/# of the system:

(19) := .Math. N .Math. trans 4 .Math. FNo 2 .Math. ( m + 1 ) 2

(20) For a 273 K object temperature, the spectral radiance of the extended body, where emissivity is assumed to be equal to unity, is 8 Watts per square meter, steradian, micron. For the above 0.5 m, f/5 lens, operated with an 8-12 micron bandpass filter, and with 50% atmospheric and optical transmission efficiency overall, the detector irradiance H is calculated to be 0.5 Watts per square meter.

(21) For a 10 micron square nanoparticle plasmonic detector array operated in the LWIR region of 8-12 microns, where such a nanoparticle plasmonic detector array is described in, for example, U.S. patent application Ser. No. 13/243,342 entitled NANO-STRUCTURE ARRAYS FOR EMR IMAGING, filed Sep. 23, 2011, which is incorporated by referenced in its entirely herein, the maximum Responsivity may be estimated to be about 5000 Amps/Watt, with a RMS Noise performance at 2 pico-Amps. Presuming a Responsivity in practice to be about 500 Amps/Watt, the signal to noise ratio in such a nanoparticle plasmonic pixel would be 1.410.sup.4, and at least 1,000 even if the detector noise was 10 greater. Alternatively, a typical MCT detector of a 15 micron pixel side cooled to 77 K would yield a signal to noise ratio of 40, and an un-cooled typical microbolometer of a 17 micron pixel side would yield a signal to noise ratio of 9.5.

(22) From a system performance point of view, of concern is the measurement of the difference in temperature of the target object from its adjacent background, which should be about 2 C. for CAT detection. In measuring such a 2 C. temperature difference, the Minimum Resolvable Temperature Difference (MRTD) and Minimum Detectable Temperature Difference (MDTD) are the parameters of importance as is known in thermal imaging. To determine the MRTD, NDTD, as well as Noise Equivalent Temperature Difference (NETD), standard equations may be used as in known [Lloyd, J. M., 1975; Thermal Imaging Systems, Plenum Press].

(23) In calculating the MRTD and MDTD, a dwell time of 0.2 seconds is presumed. The NETD for the three detectors under consideration noted above is determined to be 11 milliKelvin for a nanoparticle plasmonic detector, 96 milliKelvin for a typical MCT detector, and 980 milliKelvin for a typical microbolometer detector.

(24) The MDTD may be calculated for a 1 kHz bandwidth system, which provides for the three detectors under consideration noted above as follows: 4.6 milliKelvin for a nanoparticle plasmonic detector, 24 milliKelvin for a typical MCT detector, and 300 milliKelvin for a typical microbolometer detector.

(25) Thus, without accounting for natural background radiation, all three LWIR detectors noted can measure the necessary temperature difference required for CAT detection.

(26) Background Radiation, Atmospheric Transmission, Turbulence Effects

(27) In practice, however, the natural background radiation, atmospheric transmission and turbulence effects must be taken into account in determining whether or not CAT may be detected. The ability to discriminate against background noise contributions and fluctuations is of critical importance to effective realization in practice of the concept of passive CAT discrimination and reliable measurement.

(28) Background noise can enter an optical system for detection of CAT from a wide range of circumstances, such as looking at the sun, the moon as the background, looking at clouds, or the day or night sky, or even at the Earth itself. For the purposes of performance calculations, the magnitude of the different background noise contributions that might be encountered by a CAT system in practice must be considered, where such contributions may come from the, sun, the daytime sky, the full moon, the earth, or the brightest stars.

(29) Further, atmospheric transmission must be taken into account in determining whether or not CAT may be detected. The transmittance of the atmosphere at an EMR wavelength of 10 microns is of concern for the system described above. The overall transmissivity of the atmosphere, per km, is about 80% per km for a wavelength region of 10 microns.

(30) The turbulence of interest is associated with small thermal fluctuations, which along a 10 km path length, may have an appreciable effect on the integrity of the image. In order to estimate the effect of turbulence on the image, information on the thermal fluctuations likely at 10 micron EMR wavelength is needed. The effect of turbulence can be explained with respect to FIGS. 3A, 3B and 4.

(31) FIGS. 3A and 3B illustrate the effect of turbulence on EMR radiation received from a region of interest located at the point Transmitter and impinging on a receiver plane. The turbulence will cause fluctuation in the index of refraction of the air, thus affecting the imaging onto the image plane. The effect of atmospheric turbulence depends on the relative sizes of the beam diameter, d.sub.B, and the size of the fluctuation, 1. FIG. 3A illustrates the case where the size of the fluctuation 1 is much less than the beam diameter d.sub.B of the radiation from the point Transmitter, while FIG. 3B illustrates the case where the size of the fluctuation 1 is much greater than the beam diameter d.sub.B of the radiation from the point Transmitter. As seen in FIGS. 3A and 3B, if d.sub.B/1<<1, the major effect of turbulence is to deflect the imaging-beam as a whole. If d.sub.B/1<<1, small portions of the beam are diffracted and the imaging beam can become badly distorted.

(32) FIG. 4 illustrates standard deviation in arrival angle due to reasonable atmospheric turbulence level as a function of beam diameter d.sub.B for different sizes of index of refraction fluctuation due to turbulence [see W. K. Pratt, (1969), Laser Communications Systems, Wiley].

(33) Basic Performance Estimates

(34) Expressions for the background radiation power at the detector are derived from the standard radiometry equation found in many optics textbooks [see Pratt, W. K., Laser Communication Systems, Wiley (1969)]. These expressions are summarized in the table below.

(35) TABLE-US-00001 Background Source Radiation Relationship Expression Quantity Any source P B = a r i d r 2 4 𝒲 ( ) Spectral irradiance Spherical source of diameter, d.sub.s, P B = a r i d r 2 16 R 2 𝒲 ( ) Spectral radiant emittance not filling receiver field of view P B = 2 a r i d r 2 16 R 2 𝒩 ( ) Spectral radiance Photon P B = 2 a r i d r 2 h f c 16 R 2 𝒬 ( ) spectral radiance Extended source filling receiver P B = a r i R 2 d r 2 4 𝒲 ( ) Spectral radiant emittance field of view, .sub.R P B = 2 a r i R 2 d r 2 4 𝒩 ( ) Spectral radiance Photon P B = 2 a r i R 2 d r 2 h f c 4 𝒬 ( ) spectral radiance,
where the parameters shown in the table are as follows: .sub.a atmospheric transmissivity .sub.r receiver transmissivity .sub.i input filter bandwidth in wavelength units (X is wavelength) .sub.R receiver field-of-view angle d.sub.s diameter of the background radiation source d.sub.r diameter of the receiver H spectral irradiance N spectral radiance W spectral radiant emittance in wavelength units P.sub.B background radiation average power at the detector surface R Range

(36) At 10 microns wavelength, the values of background due to sun, daytime sky, night-time sky, full moon, earth and brightest stars are as follows:

(37) TABLE-US-00002 Sun: H()~10.sup.5 Watts per cm.sup.2. Daytime Sky: N()~5 10.sup.4 Watts per cm.sup.2, micron, steradian. Night-time Sky: N()~0.1 10.sup.10 Watts per cm.sup.2, micron, steradian. Full Moon: H()~10.sup.10 Watts per cm.sup.2, micron. Earth: W()~3 10.sup.3 Watts per cm.sup.2, micron. Brightest Stars: H()~10.sup.14 Watts per cm.sup.2, micron.

(38) Based on these values, the background power at a pixel in our optical system may be calculated. For a pixel side being 10 microns, and the focal-length of the lens being set, as above, at 0.5 meters, the following background power levels at the detector pixel, under the background conditions may be calculated to be:

(39) TABLE-US-00003 Sun: ~1.3 10.sup.3 Watts. Daytime Sky: ~8 10.sup.11 Watts. Night-time Sky: ~1.6 10.sup.12 Watts. Full Moon: ~1.3 10.sup.8 Watts. Earth: ~4.7 10.sup.10 Watts. Brightest Stars: negligible.

(40) By applying the Responsivity (Amps/Watt) to this natural background noise power, the induced natural background noise current may be calculated and the signal to noise ratio may be estimated (neglecting atmospheric transmission for a worst case calculation). The signal to noise with no natural background noise, and for natural background noise due to daytime sky are estimated as shown in the table below for a nanoparticle plasmonic detector, a typical MCT detector, and a typical microbolometer detector, for responsivity (Resp) values as shown.

(41) TABLE-US-00004 SNR: No SNR: Daytime background Sky Background nanoparticle plasmonic .sub.(Resp=500) ~10.sup.4 0.63 MCT .sub.(Resp=120) ~40.sup. 0.57 Microbolometer .sub.(Resp=500) ~95.sup. 0.15

(42) As can be seen, even though the nanoparticle plasmonic detector has extremely low noise compared to both the MCT and microbolometer detectors, the magnitude of the natural background daylight sky noise dominates the detector noise itself.

(43) Detector Array Correlation Signal Processing for Passive CAT

(44) As noted above, the passive system uses correlation techniques to reduce the effects of thermal background noise to allow for detection of CAT at a distance from the system of 10 km. The type of correlation techniques may depend on the number of detector arrays employed in the passive system. Returning to FIG. 1, if the detector array 110 comprises a single detector array, the processing electronics 130 may calculate a correlation value based on auto-correlation of the pixels of the single detector array. If the detector array 110 comprises a plurality of detector arrays, the processing electronics 130 may calculate a correlation value based on multi-correlation of corresponding pixels of the plurality of detector arrays. For example, if the detector array 110 comprises two detector arrays, such as the detector arrays 110a and 110b shown in FIG. 1, the processing electronics 130 may calculate a correlation value based on a cross-correlation of corresponding pixels of the two detector arrays.

(45) An example of a correlation technique for the detector array 110 comprising two detector arrays is now described. Each of the detector arrays 110a and 110b are arranged to image an overlapping, though not identical region in space.

(46) The correlation coefficient .sub.X,Y between two random variables X and Y having standard deviations .sub.X and .sub.Y is defined as:

(47) X , Y = corr ( X , Y ) = cov ( X , Y ) X Y
where corr(X,Y) is the correlation function, nd cov(X,Y) is the covariance function.

(48) For two detector matrix arrays A and B, the covariance of the elements in the m by n arrays A and B is defined as:

(49) 0 c var ( A , B ) = 1 mn .Math. i = 0 m - 1 .Math. j = 0 n - 1 [ A i , j - mean ( A ) ] [ B i , j - mean ( B ) ] _
where A.sub.i,j and B.sub.i,j are the i, jth elements of the arrays A and B, respectively, and the bar indicates complex conjugation, and

(50) mean ( A ) = 1 mn .Math. i = 0 m - 1 .Math. j = 0 n - 1 A i , j

(51) The correlation function of the two detector arrays can be calculated by the processing electronics 130 based on the above equation for the covariance of the elements.

(52) For small array sizes, perhaps 100.sup.2 elements, the correlation value, Corr (A, B), rapidly computes a scalar between 0 (0%) and 1 (100%) as the correlation value; i.e., Pearson's r coefficient.

(53) The processing electronics may then compare the value of the correlation value with a threshold value, which may be between 0.8 and 0.85 for example, and if the correlation value is above the threshold value, the processing electronics indicates that an event has occurred, where the event may be the existence of CAT.

(54) The processing electronics may calculate the correlation coefficient many times per second with dedicated fast logic (>5 times per second dwell/integration time), to provide a continuous stream of correlation values that could be compared to a threshold level, above which a high probability of CAT signals is expected to have been the cause. For example, the processing electronics may calculate the correlation coefficient 1 to 10 times per second.

(55) While a cross-correlation coefficient is calculated for two detector arrays, alternatively the auto-correlation coefficient may be calculated for a single detector array, or a triple-correlation coefficient may be calculated for a three detector array arrangement.

(56) Correlation Performance Estimates for a Two Detector Array Passive CAT Scheme

(57) Below is described a simulation for estimating the correlation performance for a two detector array arrangement. From the calculation above regarding signal to noise ratios in the presence of daytime sky, the RMS noise level is taken to be about 0.5. In this simulation there are two sets of 1010 matrix elements, corresponding to a 1010 arrangement of pixels in two detector arrays, with numbers for the noise value taken from a random distribution of range 0 to 1.

(58) In this simulation, the peak signal levels, representing CAT fluctuations of around 2 C. will take values from 0.5 (same as the rms noise) to 2, and will only populate 20% of the sensor array elements, to which the noise will also be added.

(59) As a simulation, for the 20% of elements, the randomly populated signal matrix is taken as is shown in FIG. 5, where L is the signal level for each pixel having the signal level L, while the remaining 80% of the elements have a 0 signal. This simulation corresponds to the situation where a turbulent cluster is mostly imaged in the top left hand corner of the signal matrix. The signal matrix for the second detector array has similar but not the same spatial characteristics as that for the first detector array.

(60) For the noise backgrounds, two matrices, one for each of the signal matrices, are constructed with random numbers as described, where one of the noise matrices, the one of the first detector array, is shown in FIG. 6.

(61) Setting the signal level L at 1.0, the signal plus noise matrix has the typical form as shown in FIG. 7. The correlation value, Corr (A, B), may be determined based on the signal plus noise matrices of the two detector arrays according to the above equations.

(62) The table below illustrates what happens to the correlation coefficient as the value of the signal level L of the 20% filled signal pixels is raised from an RMS noise value of 0.5 up to 2.0.

(63) TABLE-US-00005 L Correlation value 0.5 0.36 1.0 0.7 1.5 0.84 2.0 0.9 2.5 0.94 3.0 0.96 4.0 0.97

(64) A correlation threshold value in the region of 0.8 to 0.85 allows for the beginning of detection of a fairly low and sparsely populated detector element against a similar level of RMS noise background.

(65) Higher correlation values would be expected to be achieved for larger sizes, such as for 100100 or 10001000, presuming the correlation values can be correlated in real time.

(66) Mounted Optical System

(67) As illustrated in FIG. 8, the above described thermal imaging system may be mounted in practice on an appropriate platform. FIG. 8 illustrates a system 800 for detecting air turbulence. The system 800 comprises a structure 810, and a passive thermal imaging system 100, such as that described with respect to FIG. 1, mounted on the structure 800. As can be seen in FIG. 8, the detector arrays 110a and 110b may be arranged in separated regions of the structure 810, and to image the same object 150.

(68) The structure 800 may be a vehicle or a ground based platform. The vehicle may be an aircraft, a spacecraft, or an unmanned aerial vehicle (UAV), for example.

(69) The embodiments of the invention has been described in detail with particular reference to preferred embodiments thereof, but it will be understood by those skilled in the art that variations and modifications can be effected within the spirit and scope of the invention.