System and method for illumination source identification
12480811 ยท 2025-11-25
Inventors
Cpc classification
G01J3/0208
PHYSICS
G01J3/0275
PHYSICS
G01J3/42
PHYSICS
G01J2003/066
PHYSICS
International classification
B64G1/66
PERFORMING OPERATIONS; TRANSPORTING
Abstract
A light detection module has N optical channels, each with an optical filter, a detector, and an amplifier; and an N1 switch with N input ports each connected to one corresponding output port of each channel to receive an amplified detector output corresponding to a filtered optical intensity incident on that detector. The switch cycles between channels, connecting each amplified detector output in turn to the output port. An ADC samples a time dependent optical intensity signal from the switch, generating a corresponding ADC digital signal output. A microcontroller, connected to the N1 switch and the ADC, controls acquisition by the ADC to provide a digital voltage data stream from each channel; making the average optical intensity value characterizing the voltage data stream available from each channel at a digital output port of the microcontroller, as N data values, characterizing the light incident on the N channels of the module.
Claims
1. A light detection module receptive to incident light; the light detection module comprising: N optical channels, wherein each optical channel comprises an optical filter, a detector, and an amplifier, and each optical channel having an output port; an N1 switch having N input ports and a single output port, wherein each input port is connected to a corresponding one and only one output port of each of said N optical channels to receive a corresponding amplified detector output corresponding to a filtered optical intensity incident on the detector, and wherein the switch is operatively configured to sequentially cycle between channels, to connect each of the amplified detector outputs in turn to the output port of the switch; an analog-to-digital converter (ADC) connected to the output port of the N1 switch, and operatively configured to sample a time dependent optical intensity signal input to the ADC from the switch, and generate a corresponding time dependent digital signal output from the ADC; and a microcontroller, connected to the N1 switch and the ADC, and operatively configured to: control an acquisition sequence by setting a sampling rate and a sample duration used by the ADC to provide a digital voltage data stream from each channel in turn; and make at least an average optical intensity value characterizing the voltage data stream available from each optical channel in turn at a digital output port of the microcontroller; such that the module provides an output at the digital output port of the microcontroller comprising N data values, characterizing the light incident on the N optical channels of the module; wherein the microcontroller is further operatively configured, when cycling through the channel output ports in turn, to, for each channel: compute an estimated flicker spectrum from the digital voltage data stream provided by the ADC for that channel; sample the estimated flicker spectrum for that channel at DC and at H select flicker sampling frequencies where H is an integer greater than 0; and make said H values of the estimated flicker spectrum, available at the digital output port of the microcontroller for each channel; such that the output provided by the module at the digital output port of the microcontroller comprises N*(1+H) data values, characterizing the light incident on the module.
2. The light detection module of claim 1, wherein computing the estimated flicker spectrum comprises executing a Fast Fourier Transform algorithm.
3. The light detection module of claim 1, wherein H=1, and the values of the estimated flicker spectrum provided for each channel are a value of the average light intensity and a value of amplitude at a predetermined flicker frequency.
4. The light detection module of claim 3, wherein the predetermined frequency is one of 100 Hz and 120 Hz.
5. The light detection module of claim 2, wherein the digital output of the microcontroller is connected to a microprocessor module with access to reference data on a plurality of artificial light sources; wherein the microprocessor is operatively configured to execute an unmixing algorithm to produce relative abundance information characterizing the mixture of artificial light sources; and wherein the reference data comprises N*(1+H) reference flicker spectrum intensity values previously measured, by detectors identical to, or calibrated with respect to, the N channel detectors, through filters identical to, or calibrated with respect to, the N channel filters, from received emission from the plurality of artificial light sources, and sampled at flicker spectrum frequency values identical to the H frequencies sampled in the incident light by the light detection module.
Description
BRIEF DESCRIPTIONS OF THE FIGURES
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
DETAILED DESCRIPTION OF THE INVENTION
Definitions
(16) The innovative system disclosed in this patent application is referred to as a light-pollution characterization system (LPC system) although it will be clear that this disclosed apparatus and methods employed can be applied to any other illumination unmixing task without departing from the spirit of the invention. The LPC system comprises a light detection module, a processing module, and a memory module with reference information for each illumination source that is to be detected.
(17) Measured light is assumed to comprise a mixture of M known and unknown illumination sources. The former (known) produce mutually uncorrelated light streams and the latter (unknown) are considered to be noise in the measurement. The method assumes that the known sources can be identified in the mixture if their characteristics (illumination source reference data for sources of the same types) are known prior to the unmixing analysis. If there are M known source types in the reference source data bank (matrix S), the result of the unmixing analysis is an array of real numbers x.sub.m (m=0, 1, 2, . . . M), each of which represents the fraction of a known illumination source (for m>0) in the measured mixture. The sum of all coefficients x.sub.m (x.sub.m) is unity.
(18) Single-Pixel Multi-Spectral Detection
(19)
(20) The outputs from N amplifiers 503 are coupled to N input ports of an analog switch module 504, the output of the analog switch 504 is then fed into an analog-to-digital converter 505 (ADC) and the digital information from the ADC 505 is fed by a digital interface 506 into a microcontroller 507 that processes the measurement data and delivers the result at the output terminal 512 in digital form. The microcontroller 507 is programmed to control the sampling times of the ADC 505 via electrical connection 513 and the channel selection on the analog switch 504 using electrical connection 508.
(21)
(22) As in the previous embodiment, the system is operatively configured to acquire data by sampling all N channels 610 in time with a sampling rate and over a predetermined exposure time. The microcontroller triggers the measurement using trigger line 619 and acquires the data via the digital interface lines 616.
(23) Both embodiments illustrated in
(24) Optical Spectrum and Creation of the Reference Data Base
(25) The N optical filters are each designed to transmit a segment of the optical spectrum of incident light. The segments of the optical spectrum are selected to provide partially orthogonal measurements of the incident light.
(26) There are many commercially available illumination sources used in the world today which can be loosely categorized into (i) open flame or fire, (ii) incandescent sources in which a filament is heated to produce emission that approximates black-body radiation, (iii) gas discharge and fluorescent lamps, and (iv) solid-state lighting. To create a reference-spectrum base, one needs at least one spectrum of each of the illumination sources. Inasmuch as different types of light sources emit light with distinct spectral features, varying by design and manufacturing technology choices and manufacturing tolerance, present public illumination technologies span a wide range of light qualities and cost structures. This is particularly true with metal-halide lamps where the mixture of gases is often proprietary. This variability also applies to the solid-state sources as the ratio between blue and yellow portion of the spectra define the correlated color temperature and the phosphor choice is still under development and each manufacturer uses a different phosphor and a different blue light-emitting diode. The logic for selecting the wavelengths for the bandpass filters is illustrated with the help of
(27) Measured emission spectra 700 of a high-pressure mercury (HPM) lamp, shown in
(28) Measured emission spectra 800 of high-pressure sodium (HPS) lamp, shown in
(29) Finally, detecting an LED emission is illustrated in
(30) With detectors placed behind filters with central wavelengths .sub.1 to .sub.11, one obtains 11 signal channels and, clearly, presence of signals at some wavelengths, as for example, .sub.1 and .sub.11, will uniquely detect the presence of the HPM and HPS lamps. When illumination from any of these light sources is measured using one of the LPC systems illustrated shown in
(31) Absolute Emission Power and Power Consumption
(32) The power balance in a light source's emission is illustrated in
(33) A fraction of the P.sub.EM [W] power is emitted into the visible part of the spectrum, and we can refer to this fraction as the radiance [W] in the visible part of the spectrum or, more efficiently, we quantify the visible part of the spectrum as luminous flux [lm]. Luminous efficacy K.sub.r of an illumination source is measured in lumens per watt [lm/W] and it is the ratio of luminous flux L [lm] per every watt of electromagnetic power P.sub.EM generated for the purpose of light generation.
(34) Every illumination source (i.e., lamp) also dissipates heat P.sub.HEAT [W] while providing the power delivered to the electromagnetic spectrum P.sub.EM [W] for illumination. Since P.sub.HEAT is actually heat and by Planck's law any material body at elevated temperature emits radiation, we shall maintain that the heat can also be drawn as an electromagnetic spectrum emitted from the lamp.
(35) These metrics are illustrated in
(36) The two metrics used to quantify these luminous-flux and power conversions for illumination sources are luminous efficacy of the radiation given by K.sub.r:=L/P.sub.EM [lm/W] (IEC 845-21-090), while luminous efficiency of a lamp is the ratio P.sub.EM/P.sub.ELEC. As an example, a halogen incandescent lamp has luminous efficacy of the radiation K.sub.r5.5 lm/W, while its luminous efficiency is less than 1%. An LED lamp can have K.sub.r130 lm/W and 13%.
(37) A goal of the LPC system is relate the measured quantity to at least one of the following illumination sources quantities: (a) the luminous flux coming from the Earth, (b) overall radiance coming from the Earth and (c) electrical power used to deliver the measured luminous flux. This would enable the production of a global map of the estimated quantity.
(38) Suppose we have an illumination source m that emits P.sub.EM(m,t) into space and we capture N different spectral segments of its spectrum each centered at .sub.n with bandwidth .sub.n. Each of the filters F.sub.n has its own insertion loss, each lens L.sub.n its own scattering losses and inefficiency, each detector D.sub.n behind its own responsivity, all of which are different for a different center wavelength n, and finally the transimpedance of the amplifiers A.sub.n. We shall merge the insertion loss, filter shape, lens losses, detector responsivities and amplifier gains into one effective responsivity R.sub.n that converts the incident power [W] into a dimensionless signal at the output of the amplifier. We use dimensionless quantity because once the hardware is built, it can always be related to a voltage or a current. Each of the elements Y.sub.n(t) of the measured vector Y is related to the power spectral density via:
(39)
where R.sub.n() [1/W] is the effective responsivity on channel n versus wavelength [nm] and P.sub.EM(,t) [W/nm] is the power spectral density of the electromagnetic radiation produced by the illumination source versus wavelength. The factor (beta) depends on how far away from the source we make the measurement of the emitted light. It will be high in the laboratory, but very small when the light from the Earth is measured on a satellite. Note that Y.sub.n(t) is a radiometric quantity and is not directly relatable to the luminous flux because it includes emission at the wavelengths that are outside of the visible range.
(40) With the simultaneous measurement of the light incident on all n channels, we obtain a vector Y(t). Every illumination source hence has a unique vector Y(t) that captures the shape of the spectral emission P.sub.EM(,t) incident on the sensor. We now estimate the flicker spectrum on each of the components of the vector Y.sub.n(t) and obtain Fourier components for each of n components. For each of the N channels of flicker spectra and for the K-component measurement vector, we select a certain number of desired components. The measurement vector now contains N elements that correspond to the DC values of detector signal, while we can select any number of the harmonic amplitudes of the signal from each channel N to further describe the captured signal. If for each channel we use the DC value and H harmonics, the total number of data points taken per illumination source will be K=N.Math.(1+H). The intensity of measured light is proportional to the sum of N DC components of the vector Y because the AC components do not contribute to the overall power of the light captured. We refer to this intensity measure as the N-element norm of the vector Y.
(41) The intensity of the light captured is proportional to the N-element norm of measurement vector Y, while the relative values of the components of the normalized vector y are used to determine the composition, namely, break the measured light into known illumination source components using the unmixing algorithm disclosed in this application. The N-element norm of measurement vector Y can then be related to the power dissipation on the surface of the Earth needed to achieve the measured intensity. The N-element norm and the normalized vectors are given as:
(42)
(43) Note that N is the number of channels, but that k is the number of elements in the measurement vector Y and that the number of elements K in this vector is larger than the number of channels by the number of harmonics of interest in the captured light, hence 1kK and that K>N. Normalized measurement vector y has components denoted with y.sub.k.
(44) Note furthermore, that the DC values (elements of vector Y) are non-negative by definition, but that the Fourier amplitudes of the flicker spectra will generally be complex numbers and the argument of the first harmonic will depend on the timing when the spectrum was acquired relative to the phase of the power grid at the surface of the Earth. For each light-source all of the complex harmonic amplitudes should be rotated by the phase of the first harmonic amplitude to ensure that the first harmonic amplitude is a real positive number, while the amplitudes of harmonics with harmonic numbers greater than unity should be converted from complex numbers to real numbers with values equal to the absolute value of the phase-corrected harmonic amplitude.
(45) Variables
(46) N=number of channels (number of parallel filters, lenses and detectors). M=number of illumination sources considered and characterized to make the reference matrix; number of columns in the reference matrix. H=number of frequencies in the measured flicker spectrum where harmonic amplitude values are taken (H does not include the DC value). K=number of elements in the measurement vector Y: K=N(1+H), where 1 stands for the DC value; number of rows in the reference matrix
Unmixing Method Description
(47) The measurement of light emitted from the Earth results in a normalized vector y. The assumption is that this vector y is a linear superposition of known (reference) illumination sources y.sub.m (m=0, 1, 2, . . . M). This is generally referred to as linear mixing.
(48)
where the elements of the m-row vector x=[x.sub.1 x.sub.2 . . . x.sub.M].sup.T are target abundances (the superscript T means transposed). The reference matrix S contains m columns, one column for each illumination source measured during the calibration. The reference matrix is shown below:
(49)
(50) The method is a spectral unmixing algorithm to be used on the processing module 403, which relies on a reference matrix data bank (within memory module 404). The data are vectors of numbers, each of a length K, stored for each individual light source to which the device has been calibrated. As such, the reference data bank contains KM data points, where M is the number of light sources (number of targets).
(51) The matrix S is formed with M column vectors s.sub.m, where each column vector contains K elements (rows), each of the K elements is an output from the N channels measured on illumination source m of the M different illumination sources and H selected higher flicker frequency components of the temporal response, hence K=N(1+H). The components (rows) of the column vector s.sub.m are denoted s.sub.k,m, where 1kK. The elements of these vectors are non-negative and the N-element norm of the vector components of s.sub.m is equal to unity:
(52)
(53) Note that the s.sub.n,m are positive real numbers as was described above. The reference measurements are done for each m of the M illumination sources and a matrix S with K rows and M columns is formed. The reference illumination sources are also referred to as targets (to be consistent with the hyperspectral sub-pixel imaging terminology).
(54) The assumption is that the mixtures of light coming from the many sources are linear superpositions in the sense that the power from each of the available sources is weighted by some target abundance coefficient and that the individual contributions are added. For each measurement, the target abundance is given by the elements in an M-row vector x=[x.sub.1 x.sub.2 . . . x.sub.M].sup.T. The total intensity of the measurement is denoted |Y|.sub.N, while the target abundances x.sub.m sum to unity (all have a taxicab norm equal to 1):
(55)
(56) Any measurement of an illumination mixture is expressed in terms of the total intensity P and the normalized distribution of channels given by the vector y. This is expressed ideally with the expression y=S.Math.x:
(57)
(58) With the normalizations, the measured vector y must have its N-element norm equal to unity:
(59)
(60) Therefore, a system with K channels produces a (K1) vector y,
(61)
(62) Since y (K1) and S (KM) are measured quantities, we are seeking an estimate of the unknown vector of target abundances x (M1). Vector z is the best fit for x in the least square sense |ySx|>|ySz|, where | . . . | is the Euclidian norm of the vector between the | signs. The optimal target abundance vector z is S.sup.+y, where S.sup.+ (MK) is the Moore-Penrose inverse of matrix S. The error in the method is | S.sup.+yx|. This approach to linear square optimization is well-known in the art and can be found in publicly available literature.sup.4. .sup.4 Such as, for example, J. M. Ortega, Matrix Theory published by Plenum Press in New York (1987)
(63) The above-described approach is a least squares unconstrained method, but other constrained approaches can be found in publicly available literature and are shortly summarized below. All of the approaches are publicly available. Adding constraints to the unmixing approach is a natural addition since the target abundance quantities as well as reference spectra used in the unmixing are normalized and constrained. Namely, the target abundances x.sub.m sum to unity (all have a taxicab norm equal to 1), see Equation (6). Therefore, the optimal target abundance vector z coordinates also sum to unity and this vector can be found from the unconstrained optimization problem by seeking the vector of target abundances subject to the linear restriction: a.sup.Tx=1, where a is a unity column vector (M1) where each coordinate is equal to one.
(64) The second constraint is that the coordinates in the target abundance vector x must be non-negative numbers. Adding this constraint complicates finding the abundance vector since no closed-form solution has been found and an iterative algorithm must be employed to find the optimal target abundance vector z that is the best fit for x in the least square sense subject to the constraint that each coordinate of z is a non-negative number. Note that both the non-negativity constraint and the sum to one constraint can be included. The constrained method is a special case of a more general convex optimization problem.
(65) Interior-point methods are a certain class of iterative algorithms commonly employed to solve general convex optimization problems. It is known that the iterative approach converges towards the optimal solution as the methods satisfy Karush-Kuhn-Tucker (KKT) conditions, which are necessary derivative tests for the optimal solution.
(66) The most important advantage of using flicker harmonics in the inversion disclosed above is that it provides more information on each illumination source than was available from just DC data. This is evident from the following consideration: in the case when only DC light intensity is being captured by N filters, the reference matrix size is (NM) and there are three options: When N<M, the problem is underdefined and the estimate computation using the pseudoinverse will produce a large error largely independent of the choice of filters. We shall not use this case. When N=M, the problem is well defined provided that the determinant of the reference matrix is not zero. This is generally true because it is unlikely that captured the spectra are scaled versions of any other spectrum in the reference matrix. If there is no noise added to the measured data, zero error is achieved. When N>M, the system is over-defined and zero error is achieved if there is no noise.
(67) The relative size of N and M is bound by two opposing conditions. In order to achieve high unmixing accuracy, we need that NM. On the other hand, we need M to be as large as possible to capture largest possible number of illumination sources. Unfortunately, the number of filters N is limited by the size and weight of the module that needs to fit onto a nanosatellite. The ideal approach to resolving this problem is to effectively increase N without increasing the number of channels. This is precisely what adding the harmonic information does: the condition for high accuracy of the unmixing algorithm is in fact ensuring that KM. Consequently, adding H harmonics, effectively increases the number of channels and thereby provides higher accuracy relatively to DC only approaches. For example, if only the first flicker harmonic is captured in addition to the DC value on each of the N channels, the measurement vector is doubled and hence the number of reference sources in the reference matrix can be doubled. In this way, the reference matrix has double the number of rows and columns. This is a preferable approach in the case where the number of filters is limited, which is the case with the disclosed LPCM. As an example, using just one harmonic (H=1) will effectively double the number of channels, which is a great advantage for a module with a limited number of channels.
(68) Calibration
(69) The first step in practicing the invention is to create a reference matrix with reference illumination source data. This may be in the form of a matrix that has K rows and M columns and is populated with numbers that have been obtained by characterizing M different illumination sources using an N-channel LPC system that captures L harmonics of the incident light in each channel. The laboratory experimental environment is illustrated in .sub.1 from the illumination source also positioned in the laboratory and a measurement is being made of the filtered light in N-channels and flicker spectra of each channel analyzed to provide N DC values plus N.Math.H harmonics of the emitted light. In addition, the emitted light may also be measured using a color-meter to provide calibrated photometric characterization and the electrical power dissipation noted.
(70) Now, in .sub.2 facing towards the Earth (nadir pointing) and the same light source is position at the surface of the Earth. Then, for any position of the satellite, we need an of the free-space loss . This can be done analytically by assuming that the light dispersion obeys ray optics and that we know the approximate emission pattern, for example, whether the emitter can be treated as a Lambertian emitter. In one embodiment, the filter selection is done in such a way that the filter passbands avoid wavelengths in which the atmosphere has highest absorption.
(71) Filter Selection
(72) The accuracy of the unmixing algorithm further depends on the filter selection, namely, how are the central wavelengths and full-width half-maxima selected. This is preferably done in the following manner: for each source m, we manually select a set .sub.m of wavelengths that are characteristic for that light sources .sub.m={.sub.1, .sub.2, . . . .sub.m} along with filter bandpass widths .sub.m={.sub.1, .sub.2, . . .
.sub.m}. For each source m, hence, there is a number of filters associated with the source. We add filters at wavelengths where no source appears and obtain a complete set of possible filters with the total number of filters denoted with F. Each filter in this union has a defined center wavelength and full-width half-maximum (FWHM).
(73) Now select N filters from the defined F (the are .sub.NCF combination for this selection .sub.NC.sub.F is a binomial coefficient n choose k) for each combination perform a simple Monte Carlo method in selecting a random target abundance vector and computing the error |S.sup.+yx| between the estimated S.sup.+y and the initial target abundance x vectors. The algorithm then finds the filter combination that gives the lowest error |S.sup.+yx|.
(74) The far-right column of the table shown in
(75) Method of Practicing the Invention
(76)
(77) There are variations on the presented method and the LPC system that can be implemented to optimize the unmixing without departing from the invention. Some of these variations are discussed below.
(78) Any number of harmonics of 100 Hz and 120 Hz may be selected for sampling during measurement stage in step 354 and 360, and the set of flicker-spectrum samples does not have to be a harmonic, but rather suitable selected frequency which is off interest. Natural light sources, such as, fire, volcanic eruption or Aurora Borealis will fluctuate and will not have peaks in the flicker spectrum, but may be detected by selecting an appropriate set of frequencies that capture the power spectral density of the light intensity fluctuation and from which the form of the power spectral density can be inferred.
(79) The filter passbands generally do not overlap, but it is also possible that for the purpose of improving signal to noise ratio, some of the filters have overlapping bands.
(80) For the purposes of this application, flicker frequency spectrum refers to oscillations or fluctuations in the light intensity with frequency components between 0 Hz and at least 20 kHz.
(81) It should be understood that there are many variations of the disclosed methods and systems described in the embodiments above without limiting the present invention, and that the scope of the present invention is to be determined by the following claims.