Wide-area sensing of amplitude modulated signals
11375146 · 2022-06-28
Assignee
Inventors
Cpc classification
H03D3/007
ELECTRICITY
H04B10/64
ELECTRICITY
H04B10/613
ELECTRICITY
International classification
H03D3/00
ELECTRICITY
Abstract
Amplitude-modulated (AM) signals spanning a spatial wide area can be efficiently detected using a slowly scanning optical system. The system decouples the AM carrier from the AM signal bandwidth (or carrier uncertainty), enabling Nyquist sampling of only the information-bearing AM signal (or the known frequency bandwidth). The system includes a staring sensor with N pixels (e.g., N>10.sup.6) that searches for a sinusoidal frequency of unknown phase and frequency, perhaps constrained to a particular band by a priori information about the signal. Counters in the sensor pixels mix the detected signals with local oscillators to down-convert the signal of interest, e.g., to a baseband frequency. The counters store the down-converted signal for read out at a rate lower than the Nyquist rate of AM signal. The counts can be shifted among pixels synchronously with the optical line-of-sight for scanning operation.
Claims
1. A method of detecting an amplitude-modulated (AM) optical signal having a center frequency f.sub.c and a bandwidth f.sub.b, the method comprising, at a pixel in an imaging array: transducing the AM optical signal to an AM analog signal with a photodetector in the pixel; converting the AM analog signal to an electronic pulse train with a current-to-frequency converter in the pixel; mixing a first copy of the electronic pulse train with an in-phase square wave modulated at a mixing frequency f.sub.LO to produce an in-phase representation of the AM optical signal; mixing a second copy of the electronic pulse train with a quadrature square wave modulated at the mixing frequency f.sub.LO to produce a quadrature representation of the AM optical signal; and integrating the in-phase representation and the quadrature representation in the pixel over at least part of an integration period less than or equal to ½f.sub.b; and reading the in-phase representation and the quadrature representation from the pixel at a frame rate greater than or equal to 2f.sub.b.
2. The method of claim 1, wherein the center frequency f.sub.c is about 100 kHz to about 10 GHz and the bandwidth f.sub.b is about 10 kHz to about 100 kHz.
3. The method of claim 1, wherein mixing the first copy of the electronic pulse train with the in-phase square wave and integrating the in-phase representation comprise counting pulses in the electronic pulse train with a first counter in the pixel while switching the first counter between a count-up mode and a count-down mode at the mixing frequency f.sub.LO.
4. The method of claim 1, wherein the pixel is a first pixel in the imaging array, and further comprising, at second pixel in the imaging array: transducing another AM optical signal having a center frequency f.sub.c2 and a bandwidth f.sub.b2 to another AM analog signal with a photodetector in the second pixel; converting the other AM analog signal to another electronic pulse train with a current-to-frequency converter in the second pixel; mixing a first copy of the other electronic pulse train with the in-phase square wave modulated to produce an in-phase representation of the other AM optical signal; mixing a second copy of the other electronic pulse train with the quadrature square wave to produce a quadrature representation of the other AM optical signal; and integrating the in-phase representation of the other AM optical signal and the quadrature representation of the other AM optical signal in the second pixel over at least part of an integration period less than or equal to ½f.sub.b2; and reading out the in-phase representation of the other AM optical signal and the quadrature representation of the other AM optical signal from the second pixel at a frame rate greater than or equal to 2f.sub.b2.
5. The method of claim 1, further comprising: Fourier transforming the in-phase representation and the quadrature representation to produce a spectral signature of the AM optical signal.
6. The method of claim 1, wherein the pixel is a first pixel, and further comprising: integrating the in-phase representation in the first pixel during a first portion of the integration period; transferring the in-phase representation from the first pixel to a second pixel in the imaging array; and integrating the in-phase representation in the second pixel during a second portion of the integration period.
7. The method of claim 6, wherein the first portion of the integration period is an integer multiple of the reciprocal of the mixing frequency f.sub.LO.
8. The method of claim 6, wherein transferring the in-phase representation from the first pixel to the second pixel occurs synchronously with motion of the imaging array with respect to a source of the AM optical signal.
9. The method of claim 6, further comprising: demodulating the in-phase representation.
10. An imaging array for detecting an amplitude-modulated (AM) optical signal having a center frequency f.sub.c and a bandwidth f.sub.b, the imaging array comprising: a pixel comprising: a photodetector to transduce the AM optical signal to an AM analog signal with a photodetector in the pixel; a current-to-frequency converter, operably coupled to the photodetector, to convert the AM analog signal to an electronic pulse train; a first counter, operably coupled to the current-to-frequency converter, to count pulses in a first copy of the electronic pulse train over at least part of an integration period less than or equal to ½f.sub.b; a second counter, operably coupled to the current-to-frequency converter, to count pulses in a second copy of the electronic pulse train over the at least part of the integration period; and circuitry, operably coupled to the first counter and to the second counter, to (i) mix the first copy of the electronic pulse train with an in-phase square wave modulated at a mixing frequency f.sub.LO to produce an in-phase representation of the AM optical signal in the first counter, (ii) mix a second copy of the electronic pulse train with a quadrature square wave modulated at the mixing frequency f.sub.LO to produce a quadrature representation of the AM optical signal, and (iii) read out the in-phase representation from the first counter and the quadrature representation from the second counter at a frame rate greater than or equal to 2f.sub.b.
11. The imaging array of claim 10, wherein the center frequency f.sub.c is about 100 kHz to about 10 GHz and the bandwidth f.sub.b is about 20 kHz to about 100 kHz.
12. The imaging array of claim 10, wherein the circuitry is configured to mix the first copy of the electronic pulse train with the in-phase square wave by switching the first counter between a count-up mode and a count-down mode at the mixing frequency f.sub.LO.
13. The imaging array of claim 10, wherein the pixel is a first pixel, the photodetector is a first photodetector, the current-to-frequency converter is a first current-to-frequency converter, and the circuitry is first circuitry, and further comprising: a second pixel comprising: a second photodetector to transduce another AM optical signal to another AM analog signal; a second current-to-frequency converter, operably coupled to the second photodetector, to convert the other AM analog signal to another electronic pulse train; a third counter, operably coupled to the second current-to-frequency converter, to count pulses in a first copy of the other electronic pulse train over at least part of an integration period less than or equal to ½f.sub.b2; a fourth counter, operably coupled to the second current-to-frequency converter, to count pulses in a second copy of the other electronic pulse train over the at least part of the integration period less than or equal to ½f.sub.b2; and second circuitry, operably coupled to the third counter and to the fourth counter, to (i) mix the first copy of the other electronic pulse train with the in-phase square wave to produce an in-phase representation of the other AM optical signal in the third counter, (ii) mix a second copy of the other electronic pulse train with the quadrature square wave to produce a quadrature representation of the other AM optical signal, and (iii) read out the in-phase representation from the third counter and the quadrature representation from the fourth counter at a frame rate greater than or equal to 2f.sub.b2.
14. The imaging array of claim 10, wherein the pixel is a first pixel, and further comprising: a second pixel; and transfer circuitry, operably coupled to the first pixel and the second pixel, to transfer the in-phase representation from the first pixel to the second pixel.
15. The imaging array of claim 14, wherein the first pixel configured to integrate the in-phase representation during a first portion of the integration period and the second pixel is configured to integrate the in-phase representation during a second portion of the integration period.
16. The imaging array of claim 15, wherein the first portion of the integration period is an integer multiple of the reciprocal of the mixing frequency f.sub.LO.
17. The imaging array of claim 15, wherein the transfer circuitry is configured to transfer the in-phase representation from the first pixel to the second pixel synchronously with motion of the imaging array with respect to a source of the AM optical signal.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1) The skilled artisan will understand that the drawings primarily are for illustrative purposes and are not intended to limit the scope of the inventive subject matter described herein. The drawings are not necessarily to scale; in some instances, various aspects of the inventive subject matter disclosed herein may be shown exaggerated or enlarged in the drawings to facilitate an understanding of different features. In the drawings, like reference characters generally refer to like features (e.g., functionally similar and/or structurally similar elements).
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
DETAILED DESCRIPTION
(13) A digital focal plane array can detect one or more amplitude-modulated (AM) signals while monitoring a signal. It can also down-convert the AM signals to lower carrier frequencies for slower readout without information loss. This makes it possible to detect and de-modulate AM optical signals modulated with radio-frequency (RF) signals whose carrier frequencies exceed the DFPA frame rate.
(14) To understand how a DFPA senses an AM signal using this technique, consider a DFPA that detects an optical beacon that is modulated with an AM signal at a (potentially unknown) frequency between 500 Hz and 625 Hz. The Nyquist sampling rate for this AM signal is at 1250 Hz (double the highest signal frequency). This may be higher than the pixel read out rate of the DFPA.
(15) A telescope focuses an image of the beacon onto a pixel in the DFPA. A photodetector in the DFPA pixel generates a photocurrent whose amplitude varies with the AM signal. A current-to-frequency converter in the DFPA pixel turns the photocurrent into a pulse train that represents the AM signal. Up/down counters in the DFPA pixel count the pulse train while being switched between up- and down-counting modes with 500 Hz in-phase and quadrature square waves. This down-converts the signal of interest to a baseband frequency between 0 Hz and 125 Hz.
(16) The counters store the full array of in-phase and quadrature samples for read out at a Nyquist rate of 250 Hz (i.e., a DFPA frame rate of 250 frames per second), which is significantly lower than the Nyquist rate of the raw AM signal. The in-phase and quadrature samples can be read out simultaneously by configuring the in-phase and quadrature counters as a single shift register for read out. The Fourier transform of the in-phase and quadrature time series (with time duration given by the desired frequency resolution and/or signal-to-noise ratio) yields the (down-converted) spectral signature of the AM signal. In this way, the signal is obtained using a frame rate equal to 250 Hz, rather than the full Nyquist sampling frequency of 1250 Hz. In this example, the factor of five reduction in sampling rate is achieved by exploiting a priori signal information with on-chip DFPA in-phase and quadrature demodulation.
(17) A Wide Field-of-View Camera for Detecting Amplitude-Modulated (AM) Signals
(18)
(19) In operation, the DFPA 110 converts an AM optical signal, which may have a bandwidth from 2-100 kHz on a carrier frequency from 100 kHz to 1 GHz or more, from the AM source 11 into an AM digital signal (e.g., an electronic or digital pulse train). It down-converts and integrates the AM optical signal from the carrier frequency to a lower intermediate frequency according to one or more control signals 122 as explained in greater detail below. The control and I/O circuitry 120 reads out the integrated AM digital signal at a frame rate that is equal to or greater than the Nyquist frequency for the down-converted AM optical signal and lower than the carrier frequency of AM optical signal to provide video signals 124.
(20)
(21) The first up/down counter 216a is coupled directly to a first local oscillator (LO.sub.1) 230a, and the second up/down counter 216b is coupled to a second local oscillator (LO.sub.2) 230b, which, in this example, is at the same frequency as LO.sub.1 230a but 90 degrees out-of-phase (collectively, LOs 230). These LOs may serve the entire DFPA 110, with the first and second LO signals globally distributed to each pixel 210 in the DFPA 110. (That is, there can be a total of two LOs 230 for the entire DFPA 110.) If desired, each pixel 210 may include additional in-pixel circuitry (e.g., a mixer programmable with in-pixel memory) that can tune the frequencies of these global LO signals on a per-pixel basis.
(22) And each pixel 210 in the DFPA 110 is coupled to its neighboring pixels 210 with orthogonal transfer circuitry 218, allowing the digital numbers to be exchanged and manipulated, e.g., for data processing. The orthogonal transfer circuitry 218 is connected to all of the bits in the counters 216 with independent control of the counters 216 and to each of the neighboring pixels 210 in the DFPA. (The bits act as a counter in signal accumulation mode but are configured as a shift register in data transfer mode.) In operation, the orthogonal transfer circuitry 218 can transfer one or more of the bits to one or more of the neighboring pixels. For more on DFPAs and DFPA operation, including a more detail on the orthogonal transfer circuitry 218, please see, e.g., U.S. Pat. No. 8,605,853 B2 to Schultz et al., which is incorporated herein by reference in its entirety.
(23)
(24) The photodetector 212 senses the AM image 21 as an AM optical signal 211 that is modulated with a radio-frequency (RF) signal that can be characterized by a center frequency or carrier frequency f.sub.c and bandwidth f.sub.b. The photodetector 212 converts this AM optical signal 211 into an AM analog signal 213 at the carrier frequency f.sub.c and bandwidth f.sub.b. The Nyquist frequency f.sub.N of the this AM analog signal 213 is 2(f.sub.c+f.sub.b/2). If the carrier frequency f.sub.c is high enough, the Nyquist frequency f.sub.N may be higher than the DFPA's frame rate, making it challenging to sample the AM analog signal 213 directly with the DFPA.
(25) To address this challenge, the pixel 210 digitizes and down-converts the AM analog signal 213 as follows. First, the current-to-frequency converter 214 samples the AM analog signal 213 to form an electronic pulse train 215. This pulse train 215 is an asynchronous pulse train with instantaneous frequency proportional to the instantaneous input current (AM analog signal 213) from the photodetector 212. While the camera's shutter is open, the number of pulses within the shutter time gives the digital output which, when multiplied by the electrons per count, yields the total integrated signal electrons. The shutter should be operated fast enough (i.e., shutter integration time short enough) to ensure that the AM modulation is sampled at the Nyquist frequency of the modulation.
(26)
(27) The Nyquist frame rate can be reduce by mixing the AM analog signal 213 down to a lower frequency using the counters 216. The first up/down counter 216a counts the pulses in a first copy of the pulse train 214 while being toggled or switched between up- and down-counting modes by a mixing signal 231a from a first LO 230a. If the mixing signal 231a is a square wave at a mixing frequency f.sub.LO, the first counter 216a will end up storing an in-phase, digital representation of the AM optical signal mixed down to a carrier frequency of f.sub.c−f.sub.LO=f.sub.IF with a bandwidth f.sub.b as shown in
(28) This mixing operation reduces the Nyquist sampling rate of the in-phase and quadrature representations to f.sub.N′=2(f.sub.c−f.sub.LO+f.sub.b/2)=2(f.sub.IF+f.sub.b/2) for double-sideband signal modulation and (f.sub.c−f.sub.LO+f.sub.b/2)=(f.sub.IF+f.sub.b/2) for single-sideband signal modulation (e.g., signal modulation represented by in-phase I(t) and quadrature Q(t) waveforms). If the center frequency f.sub.c and bandwidth f.sub.b are known a priori, the mixing frequency f.sub.LO can range between a minimum of 0 to a maximum of f.sub.c−f.sub.b/2, corresponding to maximum and minimum Nyquist frame rate f.sub.FR values of 2(f.sub.c+f.sub.b/2) and 2f.sub.b, respectively, for double-sideband signal modulation. For single-sideband modulation, the maximum and minimum Nyquist frame rates are f.sub.c+f.sub.b/2 and f.sub.b, respectively. Here the DFPA frame rate is the rate at which the counters 216 are read out. The following descriptions assume simple double-sideband signal modulation; single-sideband modulation would enable twice the signal bandwidth for the same frame rate.
(29) The counters 216a and 216b accumulate in-phase and quadrature counts, respectively, during an integration period of less than or equal to 1/f.sub.N′=1/[2(f.sub.c−f.sub.LO+f.sub.b/2)]. For signals mixed to baseband (i.e., for f.sub.c=f.sub.LO), the integration period is less than or equal to 1/(2f.sub.b). At the end of each integration period, the control and I/O circuitry 120 simultaneously reads all of the counters 216 in all of pixels 210 to produce time samples 224. The frequency of this read-out operation is the frame rate f.sub.FR, which can be at video rates or higher and is greater than or equal to 2f.sub.b.
(30) Spectral processing can be used on the video image produced by the DFPA to detect the presence of an AM optical signal 211 at the carrier frequency f.sub.c. Once the AM optical signal 211 is detected, standard AM demodulation techniques can be applied to the time series 224 obtained from each signal-bearing pixel 210.
(31) The counters 216 in the different pixels 210 the DFPA 110 can all be modulated at the same frequency f.sub.LO, e.g., for scanning as described below, or at different frequencies. For instance, the counters 216 in different pixels 210 or groups of pixels 210 in the DFPA 110 can be modulated at (different) frequencies selected to match or approximate the center frequencies of different AM optical signals 211 in different sections of the DFPA's field of view. This enables the DFPA 110 to receive and demodulate different AM optical signals 211 simultaneously at frame (readout) rates that are lower than the Nyquist sampling rate of the highest-frequency AM optical signal 211.
(32) A low-intensity beacon waveform (e.g., the AM optical signal) detected initially by the DFPA 110 can encode channel-specific attributes (e.g., channel-specific carrier and bandwidth). One way to encode the beacon waveform is by frequency bin location. For example, a readout rate of 1 kHz and an integration (or search) time of 1 second gives 1,000 possible frequency bin locations or about 2.sup.10 bits of available channel capacity. The counters 216 in the pixels 210 used to detect these beacons could be modulated and read out independently to accommodate different channel characteristics. For example, the DFPA 110 could be periodically switched into the AM detection mode described above to see if there are any beacons ready to communicate. If so, then the DFPA 110 can identify the beacon's center frequency f.sub.c and bandwidth f.sub.b and configure the local oscillator frequency f.sub.LO and frame rate to receive the AM modulated signal.
(33)
(34) The mixers 284a and 284b produce intermediate frequency (IF) in-phase and quadrature analog signals 263a and 263b, which are converted by respective current-to-frequency converters 264a and 264b into an in-phase pulse train 265a and a quadrature pulse train 265b, respectively. Because the current-to-frequency converters 264 operate on the down-converted signals 263, they can operate at lower rates than the current-to-frequency converter 214 in the pixel 210 of
(35) The pixels 210 and 260 each detect and accumulate in-phase and quadrature components of the AM signal. In-phase and quadrature sampling is advantageous because it yields a signal even if the counter is out of phase with the input signal (e.g., mixing a sine wave with a cosine wave produces a null result). But the pixels do not have to detect in-phase and quadrature components. Instead, they can integrated a digitized, down-converted version of the AM optical signal with a single counter. In the digital pixel 210 in
(36) The mixing and integrating operations described above can be applied to the entire focal plane array or to one or more sub-regions of the DFPA 110. In the latter case, the effective frame rate (in this case, the rate at which the sub-regions of the DFPA 110 can be read out) can be significantly increased relative to the full DFPA frame rate, thereby enabling detection and demodulation of higher bandwidth AM signals. In this way, information regarding the location of the signal within the DFPA can be used to detect and demodulate higher bandwidth AM signals.
(37) Scanning and Multi-Camera Operation
(38)
(39)
(40) Once steps 352 and 354 have been repeated for a period of less than or equal to an integration period of less than or equal to 1/f.sub.N′=1/[2(f.sub.c−f.sub.LO+f.sub.b/2)] (step 356), the image is read out of the DFPA (step 358). Put differently, the DFPA is read a frame rate greater than or equal to the Nyquist frequency f.sub.N′ of the down-converted (in-phase and quadrature) samples stored in the counters. Between frame read-outs, the pixels in the DFPA count pulses in a digitized, down-converted beacon signal while synchronously shifting the counts with relative motion of the DFPA and beacon. Ensuring that a complete up-down count is achieved prior to shifting a count from one pixel to the next pixel avoids or reduces signal-to-noise ratio (SNR) loss due to pixel-to-pixel response non-uniformities.
(41) The data read out from the DFPA can be considered a time series. For pixels that sense AM signals, the time series varies with the AM modulation. For pixels that are imaging, the time series is constant, at least on the time scale of the AM modulation. Computing Fourier transforms of the time series makes it possible to distinguish the pixels that detected AM signals from the pixels that simply imaged the scene. The time series from the pixels that detected AM optical signals can then be demodulated to yield the signal of interest (the amplitude modulation).
(42)
CONCLUSION
(43) All parameters, dimensions, materials, and configurations described herein are meant to be exemplary and the actual parameters, dimensions, materials, and/or configurations will depend upon the specific application or applications for which the inventive teachings is/are used. It is to be understood that the foregoing embodiments are presented primarily by way of example and that, within the scope of the appended claims and equivalents thereto, inventive embodiments may be practiced otherwise than as specifically described and claimed. Inventive embodiments of the present disclosure are directed to each individual feature, system, article, material, kit, and/or method described herein. In addition, any combination of two or more such features, systems, articles, materials, kits, and/or methods, if such features, systems, articles, materials, kits, and/or methods are not mutually inconsistent, is included within the inventive scope of the present disclosure.
(44) Also, various inventive concepts may be embodied as one or more methods, of which at least one example has been provided. The acts performed as part of the method may in some instances be ordered in different ways. Accordingly, in some inventive implementations, respective acts of a given method may be performed in an order different than specifically illustrated, which may include performing some acts simultaneously (even if such acts are shown as sequential acts in illustrative embodiments).
(45) All publications, patent applications, patents, and other references mentioned herein are incorporated by reference in their entirety.
(46) All definitions, as defined and used herein, should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and/or ordinary meanings of the defined terms.
(47) The indefinite articles “a” and “an,” as used herein in the specification and in the claims, unless clearly indicated to the contrary, should be understood to mean “at least one.”
(48) The phrase “and/or,” as used herein in the specification and in the claims, should be understood to mean “either or both” of the elements so conjoined, i.e., elements that are conjunctively present in some cases and disjunctively present in other cases. Multiple elements listed with “and/or” should be construed in the same fashion, i.e., “one or more” of the elements so conjoined. Other elements may optionally be present other than the elements specifically identified by the “and/or” clause, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, a reference to “A and/or B”, when used in conjunction with open-ended language such as “comprising” can refer, in one embodiment, to A only (optionally including elements other than B); in another embodiment, to B only (optionally including elements other than A); in yet another embodiment, to both A and B (optionally including other elements); etc.
(49) As used herein in the specification and in the claims, “or” should be understood to have the same meaning as “and/or” as defined above. For example, when separating items in a list, “or” or “and/or” shall be interpreted as being inclusive, i.e., the inclusion of at least one, but also including more than one, of a number or list of elements, and, optionally, additional unlisted items. Only terms clearly indicated to the contrary, such as “only one of” or “exactly one of,” or, when used in the claims, “consisting of,” will refer to the inclusion of exactly one element of a number or list of elements. In general, the term “or” as used herein shall only be interpreted as indicating exclusive alternatives (i.e. “one or the other but not both”) when preceded by terms of exclusivity, such as “either,” “one of,” “only one of,” or “exactly one of.” “Consisting essentially of,” when used in the claims, shall have its ordinary meaning as used in the field of patent law.
(50) As used herein in the specification and in the claims, the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements. This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, “at least one of A and B” (or, equivalently, “at least one of A or B,” or, equivalently “at least one of A and/or B”) can refer, in one embodiment, to at least one, optionally including more than one, A, with no B present (and optionally including elements other than B); in another embodiment, to at least one, optionally including more than one, B, with no A present (and optionally including elements other than A); in yet another embodiment, to at least one, optionally including more than one, A, and at least one, optionally including more than one, B (and optionally including other elements); etc.
(51) In the claims, as well as in the specification above, all transitional phrases such as “comprising,” “including,” “carrying,” “having,” “containing,” “involving,” “holding,” “composed of,” and the like are to be understood to be open-ended, i.e., to mean including but not limited to. Only the transitional phrases “consisting of” and “consisting essentially of” shall be closed or semi-closed transitional phrases, respectively, as set forth in the United States Patent Office Manual of Patent Examining Procedures, Section 2111.03.