An improved system and method for illumination source identification from above the earth's surface
20260036467 ยท 2026-02-05
Inventors
Cpc classification
G01J3/0208
PHYSICS
G01J3/0275
PHYSICS
G01J3/42
PHYSICS
G01J2003/066
PHYSICS
International classification
B64G1/66
PERFORMING OPERATIONS; TRANSPORTING
Abstract
A vehicle contains a light-detection module that operates to capture and analyze light emitted from a plurality of sources on the surface of the Earth, while the vehicle is flying above the surface of the Earth. The light detection module is operatively coupled to a processing module with access to a data bank module comprising optical emission spectra data values and flicker spectra data values characteristic of two or more artificial illumination source present on the surface of the Earth. In some cases, the vehicle may, for example, be a satellite, a drone, an airplane, or a balloon.
Claims
1. A vehicle comprising a light-detection module operatively configured to capture and analyze light emitted from a plurality of sources on the surface of the Earth, while the vehicle is flying above the surface of the Earth; wherein the light detection module is operatively coupled to a processing module with access to a data bank module comprising optical emission spectra data values and flicker spectra data values characteristic of two or more artificial illumination source present on the surface of the Earth.
2. The vehicle of claim 1, wherein the vehicle is one of a group consisting of a satellite, a drone, an airplane, and a balloon.
3. The vehicle of claim 1, wherein the capture includes capture of light intensity signals in N1 optical spectrum segments, N1 being greater than or equal to 2; and wherein the analyzing includes computing a flicker spectrum on each of the N1 light intensity signals in the N1 optical spectrum segments.
4. The vehicle of claim 3, wherein the computing includes performing a Fast Fourier Transform on each of the N1 captured light intensity signals in the N1 optical spectrum segments.
5. The vehicle of claim 1, wherein at least a part of the processing module is located within the vehicle.
Description
BRIEF DESCRIPTIONS OF THE FIGURES
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
[0065]
[0066]
[0067]
[0068]
[0069]
[0070]
DETAILED DESCRIPTION OF THE INVENTION
Definitions
[0071] The innovative system disclosed in this patent application is referred to as a light-pollution characterization system (LPC system) although it will be clear that this disclosed apparatus and methods employed can be applied to any other illumination unmixing task without departing from the spirit of the invention. The LPC system comprises a light detection module, a processing module, and a memory module with reference information for each illumination source that is to be detected.
[0072] Measured light is assumed to comprise a mixture of M known and unknown illumination sources. The former (known) produce mutually uncorrelated light streams and the latter (unknown) are considered to be noise in the measurement. The method assumes that the known sources can be identified in the mixture if their characteristics (illumination source reference data for sources of the same types) are known prior to the unmixing analysis. If there are M known source types in the reference source data bank (matrix S), the result of the unmixing analysis is an array of real numbers x.sub.m (m=0, 1, 2, . . . . M), each of which represents the fraction of a known illumination source (for m>0) in the measured mixture. The sum of all coefficients x.sub.m (x.sub.m) is unity.
Single-Pixel Multi-Spectral Detection
[0073]
[0074] The outputs from N amplifiers 503 are coupled to N input ports of an analog switch module 504, the output of the analog switch 504 is then fed into an analog-to-digital converter 505 (ADC) and the digital information from the ADC 505 is fed by a digital interface 506 into a microcontroller 507 that processes the measurement data and delivers the result at the output terminal 512 in digital form. The microcontroller 507 is programmed to control the sampling times of the ADC 505 via electrical connection 513 and the channel selection on the analog switch 504 using electrical connection 508.
[0075]
[0076] As in the previous embodiment, the system is operatively configured to acquire data by sampling all N channels 610 in time with a sampling rate and over a predetermined exposure time. The microcontroller triggers the measurement using trigger line 619 and acquires the data via the digital interface lines 616.
[0077] Both embodiments illustrated in
Optical Spectrum and Creation of the Reference Data Base
[0078] The N optical filters are each designed to transmit a segment of the optical spectrum of incident light. The segments of the optical spectrum are selected to provide partially orthogonal measurements of the incident light.
[0079] There are many commercially available illumination sources used in the world today which can be loosely categorized into (i) open flame or fire, (ii) incandescent sources in which a filament is heated to produce emission that approximates black-body radiation, (iii) gas discharge and fluorescent lamps, and (iv) solid-state lighting. To create a reference-spectrum base, one needs at least one spectrum of each of the illumination sources. Inasmuch as different types of light sources emit light with distinct spectral features, varying by design and manufacturing technology choices and manufacturing tolerance, present public illumination technologies span a wide range of light qualities and cost structures. This is particularly true with metal-halide lamps where the mixture of gases is often proprietary. This variability also applies to the solid-state sources as the ratio between blue and yellow portion of the spectra define the correlated color temperature and the phosphor choice is still under development and each manufacturer uses a different phosphor and a different blue light-emitting diode. The logic for selecting the wavelengths for the bandpass filters is illustrated with the help of
[0080] Measured emission spectra 700 of a high-pressure mercury (HPM) lamp, shown in
[0081] Measured emission spectra 800 of high-pressure sodium (HPS) lamp, shown in
[0082] Finally, detecting an LED emission is illustrated in
[0083] With detectors placed behind filters with central wavelengths .sub.1 to .sub.11, one obtains 11 signal channels and, clearly, presence of signals at some wavelengths, as for example, .sub.1 and .sub.11, will uniquely detect the presence of the HPM and HPS lamps. When illumination from any of these light sources is measured using one of the LPC systems illustrated shown in
Absolute Emission Power and Power Consumption
[0084] The power balance in a light source's emission is illustrated in
[0085] A fraction of the PE [W] power is emitted into the visible part of the spectrum, and we can refer to this fraction as the radiance [W] in the visible part of the spectrum or, more efficiently, we quantify the visible part of the spectrum as luminous flux [lm]. Luminous efficacy K.sub.r of an illumination source is measured in lumens per watt [lm/W] and it is the ratio of luminous flux I. [lm] per every watt of electromagnetic power P.sub.EM generated for the purpose of light generation.
[0086] Every illumination source (i.e., lamp) also dissipates heat P.sub.HEAT [W] while providing the power delivered to the electromagnetic spectrum P.sub.EM [W] for illumination. Since P.sub.HEAT is actually heat and by Planck's law any material body at elevated temperature emits radiation, we shall maintain that the heat can also be drawn as an electromagnetic spectrum emitted from the lamp.
[0087] These metrics are illustrated in
[0088] The two metrics used to quantify these luminous-flux and power conversions for illumination sources are luminous efficacy of the radiation given by K.sub.r:=L/P.sub.EM [lm/W] (IEC 845-21-090), while luminous efficiency of a lamp is the ratio P.sub.EM/P.sub.ELEC. As an example, a halogen incandescent lamp has luminous efficacy of the radiation K.sub.r5.5 lm/W, while its luminous efficiency is less than 1%. An LED lamp can have K.sub.r130 lm/W and 13%.
[0089] A goal of the LPC system is relate the measured quantity to at least one of the following illumination sources quantities: (a) the luminous flux coming from the Earth, (b) overall radiance coming from the Earth and (c) electrical power used to deliver the measured luminous flux. This would enable the production of a global map of the estimated quantity.
[0090] Suppose we have an illumination source m that emits P.sub.EM/(m,t) into space and we capture N different spectral segments of its spectrum each centered at .sub.n with bandwidth .sub.n. Each of the filters Fon has its own insertion loss, each lens L.sub.n its own scattering losses and inefficiency, each detector D.sub.n behind its own responsivity, all of which are different for a different center wavelength n, and finally the transimpedance of the amplifiers A.sub.n. We shall merge the insertion loss, filter shape, lens losses, detector responsivities and amplifier gains into one effective responsivity Rn that converts the incident power [W] into a dimensionless signal at the output of the amplifier. We use dimensionless quantity because once the hardware is built, it can always be related to a voltage or a current. Each of the elements Y.sub.n(t) of the measured vector Y is related to the power spectral density via:
[0091] where R.sub.n() [l/W] is the effective responsivity on channel n versus wavelength [nm] and P.sub.EM(,t) [W/nm] is the power spectral density of the electromagnetic radiation produced by the illumination source versus wavelength. The factor (beta) depends on how far away from the source we make the measurement of the emitted light. It will be high in the laboratory, but very small when the light from the Earth is measured on a satellite. Note that Y.sub.n(t) is a radiometric quantity and is not directly relatable to the luminous flux because it includes emission at the wavelengths that are outside of the visible range.
[0092] With the simultaneous measurement of the light incident on all n channels, we obtain a vector Y(t). Every illumination source hence has a unique vector Y(t) that captures the shape of the spectral emission P.sub.EM(t) incident on the sensor. We now estimate the flicker spectrum on each of the components of the vector Y.sub.n(t) and obtain Fourier components for each of n components. For each of the N channels of flicker spectra and for the K-component measurement vector, we select a certain number of desired components. The measurement vector now contains N elements that correspond to the DC values of detector signal, while we can select any number of the harmonic amplitudes of the signal from each channel N to further describe the captured signal. If for each channel we use the DC value and H harmonics, the total number of data points taken per illumination source will be K=N.Math.(1+H). The intensity of measured light is proportional to the sum of N DC components of the vector Y because the AC components do not contribute to the overall power of the light captured. We refer to this intensity measure as the N-element norm of the vector Y.
[0093] The intensity of the light captured is proportional to the N-element norm of measurement vector Y, while the relative values of the components of the normalized vector y are used to determine the composition, namely, break the measured light into known illumination source components using the unmixing algorithm disclosed in this application. The N-element norm of measurement vector Y can then be related to the power dissipation on the surface of the Earth needed to achieve the measured intensity. The N-element norm and the normalized vectors are given as:
[0094] Note that N is the number of channels, but that k is the number of elements in the measurement vector Y and that the number of elements K in this vector is larger than the number of channels by the number of harmonics of interest in the captured light, hence 1kK and that K>N. Normalized measurement vector y has components denoted with y.sub.k.
[0095] Note furthermore, that the DC values (elements of vector Y) are non-negative by definition, but that the Fourier amplitudes of the flicker spectra will generally be complex numbers and the argument of the first harmonic will depend on the timing when the spectrum was acquired relative to the phase of the power grid at the surface of the Earth. For each light-source all of the complex harmonic amplitudes should be rotated by the phase of the first harmonic amplitude to ensure that the first harmonic amplitude is a real positive number, while the amplitudes of harmonics with harmonic numbers greater than unity should be converted from complex numbers to real numbers with values equal to the absolute value of the phase-corrected harmonic amplitude.
Variables
[0096] N=number of channels (number of parallel filters, lenses and detectors). [0097] M=number of illumination sources considered and characterized to make the reference matrix: number of columns in the reference matrix. [0098] H=number of frequencies in the measured flicker spectrum where harmonic amplitude values are taken (H does not include the DC value). [0099] K=number of elements in the measurement vector Y: K=N(1+H), where I stands for the DC value: number of rows in the reference matrix
Unmixing Method Description
[0100] The measurement of light emitted from the Earth results in a normalized vector y. The assumption is that this vector y is a linear superposition of known (reference) illumination sources y.sub.m (m=0, 1, 2, . . . . M). This is generally referred to as linear mixing.
where the elements of the m-row vector x=[x.sub.1 x.sub.2 . . . x.sub.M].sup.T are target abundances (the superscript T means transposed). The reference matrix S contains m columns, one column for each illumination source measured during the calibration. The reference matrix is shown below:
[0101] The method is a spectral unmixing algorithm to be used on the processing module 403, which relies on a reference matrix data bank (within memory module 404). The data are vectors of numbers, each of a length K, stored for each individual light source to which the device has been calibrated. As such, the reference data bank contains KM data points, where M is the number of light sources (number of targets).
[0102] The matrix S is formed with M column vectors s.sub.m, where each column vector contains K elements (rows), each of the K elements is an output from the N channels measured on illumination source m of the M different illumination sources and H selected higher flicker frequency components of the temporal response, hence K=N. (1+H). The components (rows) of the column vector s.sub.m are denoted s.sub.k,m, where 1kK. The elements of these vectors are non-negative and the N-element norm of the vector components of s.sub.m is equal to unity:
[0103] Note that the s.sub.n,m are positive real numbers as was described above. The reference measurements are done for each m of the M illumination sources and a matrix S with K rows and M columns is formed. The reference illumination sources are also referred to as targets (to be consistent with the hyperspectral sub-pixel imaging terminology).
[0104] The assumption is that the mixtures of light coming from the many sources are linear superpositions in the sense that the power from each of the available sources is weighted by some target abundance coefficient and that the individual contributions are added. For each measurement, the target abundance is given by the elements in an M-row vector x=[x.sub.1 x.sub.2 . . . x.sub.M].sup.T. The total intensity of the measurement is denoted |Y|.sub.N, while the target abundances x.sub.m sum to unity (all have a taxicab norm equal to 1):
[0105] Any measurement of an illumination mixture is expressed in terms of the total intensity P and the normalized distribution of channels given by the vector y. This is expressed ideally with the expression y=S.Math.x:
[0106] With the normalizations, the measured vector v must have its N-element norm equal to unity:
[0107] Therefore, a system with K channels produces a (K1) vector y,
[0108] Since y (K1) and S (KM) are measured quantities, we are seeking an estimate of the unknown vector of target abundances x (M1). Vector z is the best fit for x in the least square sense |ySx|>|ySz|, where | . . . | is the Euclidian norm of the vector between the | signs. The optimal target abundance vector z is S.sup.+y, where S.sup.+ (MK) is the Moore-Penrose inverse of matrix S. The error in the method is |S.sup.+yx|. This approach to linear square optimization is well-known in the art and can be found in publicly available literature.sup.4.
[0109] The above-described approach is a least squares unconstrained method, but other constrained approaches can be found in publicly available literature and are shortly summarized below. All of the approaches are publicly available. Adding constraints to the unmixing approach is a natural addition since the target abundance quantities as well as reference spectra used in the unmixing are normalized and constrained. Namely, the target abundances x.sub.m sum to unity (all have a taxicab norm equal to 1), see Equation (6). Therefore, the optimal target abundance vector z coordinates also sum to unity and this vector can be found from the unconstrained optimization problem by seeking the vector of target abundances subject to the linear restriction: a.sup.Tx=1, where a is a unity column vector (M1) where each coordinate is equal to one.
[0110] The second constraint is that the coordinates in the target abundance vector x must be non-negative numbers. Adding this constraint complicates finding the abundance vector since no closed-form solution has been found and an iterative algorithm must be employed to find the optimal target abundance vector z that is the best fit for x in the least square sense subject to the constraint that each .sup.4Such as, for example. J. M. Ortega. Matrix Theory published by Plenum Press in New York (1987) coordinate of z is a non-negative number. Note that both the non-negativity constraint and the sum to one constraint can be included. The constrained method is a special case of a more general convex optimization problem.
[0111] Interior-point methods are a certain class of iterative algorithms commonly employed to solve general convex optimization problems. It is known that the iterative approach converges towards the optimal solution as the methods satisfy Karush-Kuhn-Tucker (KKT) conditions, which are necessary derivative tests for the optimal solution.
[0112] The most important advantage of using flicker harmonics in the inversion disclosed above is that it provides more information on each illumination source than was available from just DC data. This is evident from the following consideration: in the case when only DC light intensity is being captured by N filters, the reference matrix size is (NM) and there are three options: [0113] When N
[0116] The relative size of N and M is bound by two opposing conditions. In order to achieve high unmixing accuracy, we need that NM. On the other hand, we need M to be as large as possible to capture largest possible number of illumination sources. Unfortunately, the number of filters Nis limited by the size and weight of the module that needs to fit onto a nanosatellite. The ideal approach to resolving this problem is to effectively increase N without increasing the number of channels. This is precisely what adding the harmonic information does: the condition for high accuracy of the unmixing algorithm is in fact ensuring that KM. Consequently, adding H harmonics, effectively increases the number of channels and thereby provides higher accuracy relatively to DC only approaches. For example, if only the first flicker harmonic is captured in addition to the DC value on each of the N channels, the measurement vector is doubled and hence the number of reference sources in the reference matrix can be doubled. In this way, the reference matrix has double the number of rows and columns. This is a preferable approach in the case where the number of filters is limited, which is the case with the disclosed LPCM. As an example, using just one harmonic (H=1) will effectively double the number of channels, which is a great advantage for a module with a limited number of channels.
Calibration
[0117] The first step in practicing the invention is to create a reference matrix with reference illumination source data. This may be in the form of a matrix that has K rows and M columns and is populated with numbers that have been obtained by characterizing M different illumination sources using an N-channel LPC system that captures/harmonics of the incident light in each channel. The laboratory experimental environment is illustrated in
[0118] Now, in
Filter Selection
[0119] The accuracy of the unmixing algorithm further depends on the filter selection, namely, how are the central wavelengths and full-width half-maxima selected. This is preferably done in the following manner: for each source m, we manually select a set .sub.m of wavelengths that are characteristic for that light sources .sub.m={.sub.1, .sub.2 . . . .sub.lm} along with filter bandpass widths .sub.m={.sub.1, .sub.2, . . . .sub.lm}. For each source m, hence, there is a number of filters associated with the source. We add filters at wavelengths where no source appears and obtain a complete set of possible filters with the total number of filters denoted with F. Each filter in this union has a defined center wavelength and full-width half-maximum (FWHM).
[0120] Now select N filters from the defined F (the are .sub.NC.sub.F combination for this selection.sub.NC.sub.F is a binomial coefficient n choose k) for each combination perform a simple Monte Carlo method in selecting a random target abundance vector and computing the error |S.sup.+yx| between the estimated S.sup.+y and the initial target abundance x vectors. The algorithm then finds the filter combination that gives the lowest error |S.sup.+yx|.
[0121] The far-right column of the table shown in
Method of Practicing the Invention
[0122]
[0123] In calibration step 351, M different illumination sources are provided. The set of provided illumination sources contains representative categories of illumination sources that are expected to be detected in the normal operation mode. At the output from step 351, the illumination source counter m is set to the first illumination source: m=1.
[0124] In step 352, illumination source m is powered on, and the electrical power delivered to the illumination source P.sub.m is noted.
[0125] In step 353, the temporal variation of N optical spectrum segments is captured and converted into N electrical signals.
[0126] In step 354, the N electrical signals are converted to digital form. Both the DC average and flicker spectrum of the captured data is estimated. The flicker spectrum is sampled at H predetermined frequencies plus the amplitude value at zero frequency to obtain N.Math.(1+H) amplitudes to be used in the data analysis.
[0127] In step 355, the N.Math.(1+H) digital data points of illumination source m are stored in the reference data bank.
[0128] In step 356, the method decides whether all of the M illumination sources have been characterized. If the answer is no, then the illumination source counter m is incremented in step 357, and the calibration method is continued by starting from the step 352, with now incremented illumination source counter m. If the calibration has completed with m=M, then the LPC system can be used in normal operation mode.
[0129] In step 358, the LPC system is in an operating environment, which may be on a satellite measuring light-pollution from an orbit, an airplane, a vehicle or may be stationary. The LPC is exposed to light that is to be analyzed.
[0130] In step 359, the LPC captures temporal fluctuations of the optical emission captured in at least in one of N spectral segments and converts this into electrical signal.
[0131] In step 360, the electrical signal is converted into digital form. Each of the DC average and flicker spectrum of the captured data is estimated. The flicker spectrum is sampled at H predetermined frequencies plus one amplitude at zero frequency to obtain 1+H amplitudes to be used in the data analysis.
[0132] In step 361, the N.Math.(1+H) digital measurement data and the measurement number or location where the measurement was done is saved in digital form in LPC memory.
[0133] In step 362, the LPCM is ready to make another measurement and if this is required (YES), the method will start over from step 358 at a different location or measurement ordinal number. If LPC memory is full or there is an opportunity to download the memory contents (NO), the data is downloaded to a remote processor or the same processor in the LPC for further processing. In step 363, the downloaded data is processed for every location or measurement in that the unmixing algorithm is executed and target abundance coefficients x.sub.m for 1mM are determined and, optionally, electrical power P.sub.m consumed by each of the sources is used to compute electrical power dissipation per illumination source in the mixture. The method uses both DC and AC characteristics of conventional illumination sources to improve the accuracy of unmixing.
[0134] There are variations on the presented method and the LPC system that can be implemented to optimize the unmixing without departing from the invention. Some of these variations are discussed below.
[0135] Any number of harmonics of 100 Hz and 120 Hz may be selected for sampling during measurement stage in step 354 and 360, and the set of flicker-spectrum samples does not have to be a harmonic, but rather suitable selected frequency which is off interest. Natural light sources, such as, fire, volcanic eruption or Aurora Borealis will fluctuate and will not have peaks in the flicker spectrum, but may be detected by selecting an appropriate set of frequencies that capture the power spectral density of the light intensity fluctuation and from which the form of the power spectral density can be inferred.
[0136] The filter passbands generally do not overlap, but it is also possible that for the purpose of improving signal to noise ratio, some of the filters have overlapping bands.
[0137] For the purposes of this application, flicker frequency spectrum refers to oscillations or fluctuations in the light intensity with frequency components between 0 Hz and at least 20 kHz.
[0138] It should be understood that there are many variations of the disclosed methods and systems described in the embodiments above without limiting the present invention, and that the scope of the present invention is to be determined by the following claims.