Designs and methods of multi-function digital readout integrated circuits with an embedded programmable gate array
10681289 ยท 2020-06-09
Assignee
Inventors
- Nansheng Tang (Mason, OH, US)
- George Buritica (Mason, OH, US)
- Doug Droege (Mason, OH, US)
- Dave Forrai (Mason, OH, US)
- John Forsthoefel (Mason, OH, US)
- Mike Spicer (Mason, OH, US)
- Al Timlin (Mason, OH, US)
- Stefan Lauxtermann (Mason, OH, US)
- Edward S. Brinkman (Mason, OH, US)
Cpc classification
International classification
Abstract
Embodiments disclosed herein relate to a ROIC with a plurality of unit cells coupled to a detector array having a plurality of detectors for collecting photoelectrons over a plurality of temporal instances. An individual unit cell is electrically coupled to an individual detector to have one-to-one correspondence and includes one or more storage elements coupled to one or more programmable logic control switches. The storage element(s) store signal charges representing the photoelectrons while the programmable logic control switch(es) direct the signal charges from the storage element(s) at an individual temporal instance. A configuration of signal charges in the plurality of unit cells is mathematically operated as a three-dimensional matrix having a plurality of elements, where the three dimensions correspond to the two spatial dimensions of an individual unit cell and the individual temporal instance, and an individual element has a value corresponding to the number of signal charges stored therein.
Claims
1. A readout integrated circuit (ROIC) coupled to a detector array having a plurality of detectors for collecting photoelectrons over a plurality of temporal instances, the ROIC comprising a plurality of unit cells arranged in two spatial dimensions, wherein an individual unit cell of the plurality of unit cells is electrically coupled to an individual detector of the plurality of detectors to have one-to-one correspondence and comprises: one or more storage elements for storing signal charges representing the photoelectrons collected by the detector array at an individual temporal instance of the plurality of temporal instances; and one or more programmable logic control switches coupled to the one or more storage elements for directing the signal charges towards or away from the one or more storage elements at the individual temporal instance, wherein: a configuration of signal charges in the plurality of unit cells is mathematically represented and operated as a matrix in three dimensions having a plurality of elements; the three dimensions correspond to the two spatial dimensions and the individual temporal instance; and an individual element of the matrix has a value corresponding to the number of signal charges stored in the individual unit cell at the individual temporal instance.
2. The ROIC of claim 1, wherein the storage element is a capacitor.
3. The ROIC of claim 1, wherein: when the one or more programmable logic control switches form a closed switch, the signal charges are directed, at the individual temporal instance, towards the one or more storage elements in series with the one or more programmable logic control switches.
4. The ROIC of claim 1, wherein the one or more programmable logic control switches in one or more individual unit cells are operably configured such that when a first storage element in a first unit cell stores a first set of signal charges received at a first temporal instance, at least one second storage element in the first unit cell or a second unit cell stores a second set of signal charges received at at least one second temporal instance.
5. The ROIC of claim 4, wherein the one or more programmable logic control switches in the one or more individual unit cells are operably configured to determine a summation of signal charges stored in the one or more individual unit cells over the plurality of temporal instances by electrically connecting in parallel the first storage element and the at least one second storage element.
6. The ROIC of claim 4, wherein the one or more programmable logic control switches in the one or more individual unit cells are operably configured to determine a difference of signal charges stored within the one or more individual unit cells by reversing a polarity of the first storage element or the at least one second storage element after the first storage element stores the first set of signal charges received at the first temporal instance and the at least one second storage element stores the second set of signal charges at the second temporal instance but before the first storage element is electrically connected in parallel with the at least one second storage element.
7. The ROIC of claim 4, wherein the one or more programmable logic control switches in the one or more individual unit cells are operably configured to determine a maximum value of signal charge stored over the plurality of temporal instances by electrically connecting the first storage element to a first source-follower amplifier and the at least one second storage element to a second source-follower amplifier through a common bias current connection.
8. The ROIC of claim 4, wherein: the one or more programmable logic control switches in the one or more individual unit cells are operably configured to determine whether the second set of signal charges stored in the at least one second storage element is increasing or decreasing in comparison to the first set of signal charges stored in the first storage element by electrically connecting the first storage element and the at least one second storage element to a differential comparator circuit.
9. The ROIC of claim 4, wherein: the one or more programmable logic control switches in the one or more individual unit cells are operably configured to direct the first set of signal charges received at the first temporal instance in the first storage element to the second storage element during the at least one second temporal instance.
10. The ROIC of claim 4, wherein: the at least one second storage element comprises a second storage element, a third storage element and at least one fourth storage element; the at least one second temporal instance comprises a second temporal instance and at least one third temporal instance; the first storage element stores the first set of signal charges received at the first temporal instance during the second temporal instance; the second storage element stores the second set of signal charges received at the second temporal instance; the third storage element stores a third set of signal charges received at the at least one third temporal instance; the one or more programmable logic control switches in the one or more individual unit cells are operably configured to hold a fourth set of signal charges in the first storage element, the second storage element or the at least one fourth storage element during the at least one third temporal instance while the third set of signal charges received during the at least one third temporal instance are stored in the third storage element; the fourth set of signal charges is formed by a mathematical operation of the first set of signal charges received at the first temporal instance and the second set of signal charges received at the second temporal instance; and the mathematical operation is selected from at least one of: a summation of signal charges, a maximum value of signal charges, trend determination of signal charges or a difference of signal charges.
11. The ROIC of claim 1, wherein the one or more programmable logic control switches in the individual unit cell are operably configured to determine a summation of signal charges stored in the individual unit cell over successive temporal instances by electrically connecting in parallel individual storage elements of the one or more storage elements at the successive temporal instances.
12. The ROIC of claim 1, wherein the one or more programmable logic control switches in the individual unit cell are operably configured to determine a maximum value of signal charges stored over successive temporal instances by electrically connecting the individual storage elements to a source-follower amplifier through a common bias current connection.
13. The ROIC of claim 1, wherein: the one or more programmable logic control switches in the individual unit cell are operably configured to determine whether a signal charge stored in a second storage element at a second temporal instance is increasing or decreasing in comparison to a signal charge stored in a first storage element at a first temporal instance by electrically connecting the one or more storage elements to a differential comparator circuit; and the first temporal instance and the second temporal instance are successive temporal instances.
14. The ROIC of claim 1, wherein the one or more programmable logic control switches in the individual unit cell are operably configured to determine a difference of signal charges stored within the individual unit cell over any two successive temporal instances by reversing a polarity of a first storage element or a second storage element after the first storage element and the second storage element store the signal charges at the two successive temporal instances but before the first storage element is electrically connected in parallel to the second storage element.
15. The ROIC of claim 1, wherein the one or more programmable logic control switches in the individual unit cell are operably configured to determine whether a signal charge stored in an individual storage element of the one or more storage elements at the individual temporal instance meets a threshold value by electrically connecting the individual storage element and an external voltage corresponding to the threshold value through a differential comparator circuit.
16. The ROIC of claim 1, wherein: the detector array is coupled to a diffractive-filter array; and one or more programmable logic control switches in the individual unit cell is further configured to identify and extract spectral signature information of an individual photon corresponding to an individual signal charge stored in the one or more storage elements.
17. The ROIC of claim 1, further comprising: one or more programmable logic control switches coupled across a subset of adjacent unit cells within the ROIC.
18. The ROIC of claim 17, wherein the one or more programmable logic control switches coupled across the subset of adjacent unit cells are operably configured to determine whether a signal charge stored in an individual unit cell in the subset of adjacent unit cells meets a threshold value by electrically connecting the one or more storage elements in the individual unit cell and an external voltage corresponding to the threshold value through a differential comparator circuit.
19. The ROIC of claim 17, wherein: the one or more programmable logic control switches coupled across the subset of adjacent unit cells are operably configured to direct a first set of signal charges stored in a first storage element in a first unit cell to at least a second storage element in a second unit cell; and the first unit cell and the second unit cell are adjacent unit cells in the subset of adjacent unit cells.
20. The ROIC of claim 17, wherein the one or more programmable logic control switches coupled across the subset of adjacent unit cells are operably configured to determine a summation of signal charges stored in the subset of adjacent unit cells by electrically connecting in parallel individual storage elements of the one or more storage elements across the subset of adjacent unit cells.
21. The ROIC of claim 17, wherein the one or more programmable logic control switches coupled across the subset of adjacent unit cells are operably configured to determine a maximum value of signal charges stored in the subset of adjacent unit cells by electrically connecting individual storage elements of the one or more storage elements across the subset of adjacent unit cells to a source-follower amplifier through a common bias current connection.
22. The ROIC of claim 17, wherein: the one or more programmable logic control switches coupled across the subset of adjacent unit cells are operably configured to determine whether signal charges stored in a second unit cell is increasing or decreasing in comparison to signal charges stored in a first unit cell by electrically connecting the one or more storage elements in the first unit cell and the second unit cell to a differential comparator circuit; and the first unit cell and the second unit cell are adjacent unit cells in the subset of adjacent unit cells.
23. The ROIC of claim 17, wherein: the one or more programmable logic control switches coupled across the subset of adjacent unit cells are operably configured to determine a difference of signal charges stored in any two adjacent unit cells by reversing a polarity of a first set of storage elements in a first unit cell or a second set of storage elements in a second unit cell, after the first set of storage elements and the second set of storage elements store the signal charges but before the first set of storage elements is electrically connected in parallel to the second set of storage elements; and the first unit cell and the second unit cell are adjacent unit cells in the subset of adjacent unit cells.
24. The ROIC of claim 17, wherein: the one or more programmable logic control switches coupled across the subset of adjacent unit cells are operably configured to determine a difference of signal charges stored in any two adjacent unit cells by directing a flow of signal charges in a first unit cell through a current mirror circuit and into a storage element in a second unit cell and directing a flow of signal charges in the second unit cell directly into the storage element; and the first unit cell and the second unit cell are adjacent unit cells in the subset of adjacent unit cells.
25. The ROIC of claim 17, wherein the one or more programmable logic control switches coupled across the subset of adjacent unit cells are operably configured to achieve time-delay-integration (TDI) by electrically connecting in parallel the one or more storage elements across the subset of adjacent unit cells at successive temporal instances.
26. The ROIC of claim 17, wherein: the one or more programmable logic control switches are coupled across at least two subsets of adjacent unit cells within the ROIC.
27. The ROIC of claim 26, wherein individual subsets of the at least two subsets of adjacent unit cells together form the plurality of unit cells in the ROIC.
28. The ROIC of claim 26, wherein individual subsets of the at least two subsets of adjacent unit cells have an equal number of adjacent unit cells.
29. The ROIC of claim 28, wherein individual subsets of the at least two subsets of adjacent unit cells together form the plurality of unit cells in the ROIC.
30. The ROIC of claim 26, wherein the one or more programmable logic control switches coupled across the at least two subsets of adjacent unit cells are operably configured to determine whether a signal charge stored in an individual unit cell in individual subsets of the at least two subsets of adjacent unit cells meets a threshold value by electrically connecting the one or more storage elements in the individual unit cell and an external voltage corresponding to the threshold value to a differential comparator circuit.
31. The ROIC of claim 26, wherein: the one or more programmable logic control switches coupled across the at least two subsets of adjacent unit cells are operably configured to direct a first set of signal charges stored in a first storage element in a first unit cell to at least a second storage element in a second unit cell; and the first unit cell and the second unit cell belong to different subsets in the at least two subsets of adjacent unit cells.
32. The ROIC of claim 26, wherein the one or more programmable logic control switches coupled across the at least two subsets of adjacent unit cells are operably configured to determine a summation of signal charges stored in the at least two subsets of adjacent unit cells by electrically connecting in parallel individual storage elements of the one or more storage elements across the at least two subsets of adjacent unit cells.
33. The ROIC of claim 26, wherein the one or more programmable logic control switches coupled across the at least two subsets of adjacent unit cells are operably configured to determine a maximum value of signal charges stored in the at least two subsets of adjacent unit cells by electrically connecting individual storage elements of the one or more storage elements across the at least two subsets of adjacent unit cells to a source-follower amplifier through a common bias current connection.
34. The ROIC of claim 26, wherein: the one or more programmable logic control switches coupled across the at least two subsets of adjacent unit cells are operably configured to determine whether signal charges stored in a second unit cell is increasing or decreasing in comparison to signal charges stored in a first unit cell by electrically connecting the one or more storage elements in the first unit cell and the second unit cell to a differential comparator circuit; and the first unit cell and the second unit cell belong to different subsets in the at least two subsets of adjacent unit cells.
35. The ROIC of claim 26, wherein: the one or more programmable logic control switches coupled across the at least two subsets of adjacent unit cells are operably configured to determine a difference of signal charges stored in any two unit cells by reversing a polarity of a first set of one or more storage elements in a first unit cell or a second set of one or more storage elements in a second unit cell, after the first set of storage elements and the second set of storage elements store the signal charges but before the first set of storage elements is electrically connected in parallel to the second set of storage elements; and the first unit cell and the second unit cell belong to different subsets in the at least two subsets of adjacent unit cells.
36. The ROIC of claim 26, wherein: the one or more programmable logic control switches coupled across the at least two subsets of adjacent unit cells are operably configured to determine a difference of signal charges stored in any two unit cells by directing a flow of signal charges in a first unit cell through a current mirror circuit and into a storage element in a second unit cell and directing a flow of signal charges in the second unit cell directly into the storage element; and the first unit cell and the second unit cell belong to different subsets in the at least two subsets of adjacent unit cells.
37. The ROIC of claim 26, wherein the one or more programmable logic control switches coupled across the at least two subsets of adjacent unit cells are operably configured to achieve time-delay-integration (TDI) by electrically connecting in parallel the one or more storage elements across the at least two subsets of adjacent unit cells at successive temporal instances.
38. An infrared sensor assembly comprising: a detector array having a plurality of detectors for collecting photoelectrons over a plurality of temporal instances; and a readout integrated circuit (ROIC) coupled to the detector array and comprising a plurality of unit cells arranged in two spatial dimensions, wherein: an individual unit cell of the plurality of unit cells is electrically coupled to an individual detector of the plurality of detectors to have one-to-one correspondence, and the individual unit cell comprises: one or more storage elements for storing signal charges representing the photoelectrons collected by the detector array at an individual temporal instance of the plurality of temporal instances; and one or more programmable logic control switches coupled to the one or more storage elements for directing the signal charges towards or away from the one or more storage elements at the individual temporal instance, wherein: a configuration of signal charges in the plurality of unit cells is mathematically represented and operated as a matrix in three dimensions having a plurality of elements; the three dimensions correspond to the two spatial dimensions and the individual temporal instance; and an individual element of the matrix has a value corresponding to the number of signal charges stored in the individual unit cell at the individual temporal instance.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The embodiments set forth in the drawings are illustrative and exemplary in nature and not intended to limit the subject matter defined by the claims. The following detailed description of the illustrative embodiments can be understood when read in conjunction with the following drawings, where like structure is indicated with like reference numerals and in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
(24)
(25)
(26)
(27)
DETAILED DESCRIPTION
(28) Embodiments described herein are directed to multi-function ROICs with an embedded programmable gate array. The individual unit cells of the ROICs described herein have different combinations of one or more circuit modules for receiving, storing and mathematically operating signal charges received from the individual detectors of a detector array over a period of time. Circuit topologies having different combinations of the one or more circuit modules are designed to function as an embedded programmable gate array within the ROIC. Accordingly, the signal charges within the individual unit cells as well as across different subsets of individual unit cells within the ROIC can be controlled for extraction of information in the ROIC itself and subsequent production of infrared images. The extraction of information-enriched data at or near the point of incidence of the infrared radiation and subsequent processing of the information-enriched data in the analog domain enables the production of infrared images with the least latency, minimal noise, while consuming the least amount of bandwidth and energy.
(29) Referring to
(30) The transparent substrate 122 comprises a material that is transparent to radiation in the desired wavelength, such as wavelengths in the infrared or near-infrared spectrum. The transparent substrate 122, which may be made of silicon, for example, provides a window or an entry point for radiation (illustrated as arrows 170) into the detector array 110. Optional anti-reflective layers 124 and 124 may be applied to the transparent substrate 122 to increase the infrared radiation entering the detector array 110.
(31) The absorber layer 130 is coupled to the frontside common electrical contact 120 at a first end and the backside electrical contact 140 at a second end opposite to the first end. In one embodiment, the absorber layer 130 is bonded to the transparent substrate 122 via an adhesive bonding layer 116 such as, but not limited to, an epoxy adhesive. The backside electrical contact 140 is connected to a surface 132 of the absorber layer 130.
(32) The ROIC 160 includes a ROIC substrate (of M rows and N columns) divided into a plurality of unit cells 165.sub.i arranged in two spatial dimensions (say, X.sub.i and Y.sub.i on the plane of the ROIC 160). While the ROIC 160 includes the plurality of unit cells 165.sub.i, only one unit cell 165.sub.i is illustrated in
(33) In operation, infrared radiation (illustrated by arrows 170) is transmitted through the transparent substrate 122 and the anti-reflective layers 124 and 124 into the absorber layer 130. The absorber layer 130 converts the incident infrared radiation into photoelectrons that are transmitted as signal charges through the bonding bump 150.sub.i and the electrical contact 162 into the individual unit cell 165.sub.i.
(34) The individual unit cells 165.sub.i have different combinations of one or more circuit modules 165.sub.ai for receiving, storing and mathematically operating the signal charges received from the individual detectors 115.sub.i. The individual circuit module 165.sub.ai includes one or more storage elements C.sub.i for storing signal charges representing the photoelectrons collected by the corresponding detector 115.sub.i at the individual temporal instance T.sub.i. In some embodiments, the storage element C.sub.i for storing signal charges may be a capacitor, though in other embodiments, any electrical or electronic component capable of storing charges may be used. The one or more storage elements C.sub.i are coupled to one or more programmable logic control switches S.sub.i for directing the signal charges towards or away from the one or more storage elements C.sub.i at the individual temporal instance T.sub.i.
(35) A configuration of signal charges stored in the plurality of unit cells 165.sub.i at the individual temporal instance T.sub.i can be mathematically represented by a three-dimensional matrix P.sub.Ti having a plurality of elements q.sub.i, where the three dimensions correspond to the two spatial dimensions X.sub.i, Y.sub.i of the individual unit cell 165.sub.i (row number and column number of the unit cells 165.sub.i) and the individual temporal instance T.sub.i. The number of signal charges stored in the unit cell 165.sub.i having dimensions X.sub.i, Y.sub.i at the individual temporal instance T.sub.i can thus be represented by a unique value as a function of X.sub.i, Y.sub.i and T.sub.i and forms the individual element q.sub.i of the three-dimensional matrix P.sub.Ti. Accordingly, the three-dimensional matrix P.sub.Ti having a plurality of elements q.sub.i can be mathematically operated to extract information from the signal charges. Any mathematically allowable operation of the three-dimensional matrix P.sub.Ti, regardless of the number of operands, can perceivably be performed to achieve a desired outcome by programmable logic control switches purposely designed in and controlled by the programmable logic gates, to achieve such desired outcome, preferably in the analog domain to achieve the intended benefits.
(36) Circuit topologies having different combinations of one or more circuit modules 165.sub.ai can function as embedded programmable gate arrays within the ROIC 160.
(37) Any number of circuit modules 165.sub.ai such as, but not limited to, the one shown in
(38) In the example circuit topology of the individual unit cell 165.sub.i shown in
(39) In a first non-limiting example, the signal charges may be subsequently stored in the storage element C.sub.1 if the programmable logic control switch G.sub.11 is closed, G.sub.12 closed to a proper bias V.sub.1, and the programmable logic control switches G.sub.21, G.sub.51 and G.sub.61 are open and will remain stored in C.sub.1. The signal charges stored in the storage element C.sub.1 may subsequently be directed towards the storage element C.sub.2 by keeping the programmable logic control switches G.sub.51, and G.sub.61 open and closing the programmable logic control switches G.sub.11 and G.sub.21 with G.sub.22 closed to a proper bias V.sub.2. As an alternative, the signal charges stored in the storage element C.sub.1 may be directed towards the storage element C.sub.3 by keeping the programmable logic control switches G.sub.21, G.sub.52 and G.sub.61 open and closing the programmable logic control switches G.sub.11, G.sub.31 and G.sub.51, with G.sub.32 closed to a proper bias V.sub.3. As another alternative, the signal charges stored in the storage element C.sub.1 may be directed towards the storage element C.sub.4 by keeping the programmable logic control switches G.sub.21, G.sub.51 and G.sub.62 open and closing the programmable logic control switches G.sub.11, G.sub.41 and G.sub.61 with G.sub.42 closed to a proper bias V.sub.4. Finally, the signal charges stored in the storage element C.sub.1 may be directed towards an adjacent unit cell 165.sub.i or read out by keeping the programmable logic control switches G.sub.21, G.sub.31 and G.sub.41 open and closing the programmable logic control switches G.sub.11, G.sub.77, and either both programmable logic control switches G.sub.51, G.sub.52 or both programmable logic control switches. G.sub.61, G.sub.62, while keeping G.sub.12 closed to a proper bias V.sub.1.
(40) In a second non-limiting example, the signal charges may be subsequently stored in the storage element C.sub.2 if the programmable logic control switch G.sub.21 is closed, G.sub.22 closed to a proper bias V.sub.2, and the programmable logic control switches G.sub.11, G.sub.51 and G.sub.61 are open and will remain stored in C.sub.2. The signal charges stored in the storage element C.sub.2 may subsequently be directed towards the storage element C.sub.1 by keeping the programmable logic control switches G.sub.51, and G.sub.61 open and closing the programmable logic control switches G.sub.11 and G.sub.21 with G.sub.12 closed to a proper bias V.sub.1. As an alternative, the signal charges stored in the storage element C.sub.2 may be directed towards the storage element C.sub.3 by keeping the programmable logic control switches G.sub.11, G.sub.52 and G.sub.61 open and closing the programmable logic control switches G.sub.21, G.sub.31 and G.sub.51 with G.sub.32 closed to a proper bias V.sub.3. As another alternative, the signal charges stored in the storage element C.sub.2 may be directed towards the storage element C.sub.4 by keeping the programmable logic control switches G.sub.11, G.sub.51 and G.sub.62 open and closing the programmable logic control switches G.sub.21, G.sub.41 and G.sub.61 with G.sub.42 closed to a proper bias V.sub.4. Finally, the signal charges stored in the storage element C.sub.2 may be directed towards an adjacent unit cell 165.sub.i or read out by keeping the programmable logic control switches G.sub.11, G.sub.31 and G.sub.41 open and closing the programmable logic control switches G.sub.21, G.sub.77, and either both programmable logic control switches G.sub.51, G.sub.52 or both programmable logic control switches. G.sub.61, G.sub.62, while keeping G.sub.22 closed to a proper bias V.sub.2.
(41) In a third non-limiting example, the signal charges may be subsequently stored in the storage element C.sub.3 if the programmable logic control switches G.sub.11, G.sub.21, G.sub.52 and G.sub.61 are open and the programmable logic control switches G.sub.51 and G.sub.31 are closed with G.sub.32 closed to a proper bias V.sub.3, and will remain in C.sub.3. The signal charges stored in the storage element C.sub.3 may be directed towards the storage element C.sub.1 by keeping the programmable logic control switches G.sub.52, G.sub.21 and G.sub.61 open and closing the programmable logic control switches G.sub.11, G.sub.31 and G.sub.51 with G.sub.32 closed to a proper bias V.sub.3. As an alternative, the signal charges stored in the storage element C.sub.3 may be directed towards the storage element C.sub.2 by keeping the programmable logic control switches G.sub.52, G.sub.11 and G.sub.61 open and closing the programmable logic control switches G.sub.21, G.sub.31 and G.sub.51 with G.sub.32 closed to a proper bias V.sub.3. As another alternative, the signal charges stored in the storage element C.sub.3 may be directed towards the storage element C.sub.4 by keeping the programmable logic control switches G.sub.11, G.sub.21, G.sub.52 and G.sub.62 open and closing the programmable logic control switches G.sub.31, G.sub.41, G.sub.51 and G.sub.61 with G.sub.32 closed to a proper bias V.sub.3 and with G.sub.42 closed to a proper bias V.sub.4. Finally, the signal charges stored in the storage element C.sub.3 may be directed towards an adjacent unit cell 165.sub.i or read out by keeping the programmable logic control switches G.sub.62 and G.sub.51 open and closing the programmable logic control switches G.sub.52 and G.sub.77 with G.sub.32 closed to a proper bias V.sub.3.
(42) In a fourth non-limiting example, the signal charges may be subsequently stored in the storage element C.sub.4 if the programmable logic control switches G.sub.11, G.sub.21, G.sub.62 and G.sub.51 are open and the programmable logic control switches G.sub.61 and G.sub.41 are closed with G.sub.42 closed to a proper bias V.sub.4, and will remain in C.sub.4. The signal charges stored in the storage element C.sub.4 may be directed towards the storage element C.sub.1 by keeping the programmable logic control switches G.sub.62, G.sub.21 and G.sub.51 open and closing the programmable logic control switches G.sub.11, G.sub.41 and G.sub.61 with G.sub.42 closed to a proper bias V.sub.4. As an alternative, the signal charges stored in the storage element C.sub.4 may be directed towards the storage element C.sub.2 by keeping the programmable logic control switches G.sub.62, G.sub.11, and G.sub.51 open and closing the programmable logic control switches G.sub.21, G.sub.41 and G.sub.61 with G.sub.42 closed to a proper bias V.sub.4. As another alternative, the signal charges stored in the storage element C.sub.4 may be directed towards the storage element C.sub.3 by keeping the programmable logic control switches G.sub.11, G.sub.21, G.sub.52 and G.sub.62 open and closing the programmable logic control switches G.sub.31, G.sub.41, G.sub.51 and G.sub.61 with G.sub.42 closed to a proper bias V.sub.4 and with G.sub.32 closed to a proper bias V.sub.3. Finally, the signal charges stored in the storage element C.sub.4 may subsequently be directed towards an adjacent unit cell 165.sub.i or read out by keeping the programmable logic control switches G.sub.52 and G.sub.61 open and closing the programmable logic control switches G.sub.62 and G.sub.77 with G.sub.42 closed to a proper bias V.sub.4.
(43) The examples above demonstrate how the signal charges can be stored and directed to move through the example circuit topology of the individual unit cell 165.sub.i of
(44) Similarly, a circuit topology comprising at least three storage elementsa first storage element C.sub.1, a second storage element C.sub.2, and a third storage element C.sub.3can enable signal charges received at a first temporal instance T.sub.1 to be stored in the first storage element C.sub.1 during a second temporal instance T.sub.2 while signal charges received at the second temporal instance T.sub.2 are directed to move or stored in a second storage element C.sub.2. The signal charges stored in the first storage element C.sub.1 become a first operand and the signal charges present in the second storage element C.sub.2 become a second operand that can then be mathematically operated on to form a third operand stored in the third storage element C.sub.3.
(45) Alternatively, a circuit topology comprising at least four storage elementsa first storage element C.sub.1, a second storage element C.sub.2, a third storage element C.sub.3 and a fourth storage element C.sub.4can enable signal charges received at a first temporal instance T.sub.1 to be stored in the first storage element C.sub.1 during a second temporal instance T.sub.2 while signal charges received at the second temporal instance T.sub.2 are directed to move or stored in a second storage element C.sub.2. The signal charges stored in the first storage element C.sub.1 become a first operand and the signal charges present in the second storage element C.sub.2 become a second operand that can then be mathematically operated on to form a third operand stored in the first storage element C.sub.1, the second storage element C.sub.2 or the fourth storage element C.sub.4 at a third temporal instance T.sub.3, during which a third set of signal charges are received and stored in the third storage element C.sub.3. The signal charges stored in the third storage element C.sub.3 become a fourth operand. The third operand and the fourth operand can then be mathematically operated on to form a fifth operand.
(46) In some embodiments, the signal charges stored at multiple temporal instances T.sub.i can be temporarily stored and later operated on in a range of mathematical operations. The signal charges stored temporarily over a sequence of temporal instances T.sub.i may be rearranged in numerous ways to extract information from the incident infrared radiation. The mathematical operations may include, without limitation, determining whether a signal charge meets a threshold value, a summation of signal charges, determining a maximum value of signal charges, determining a difference of signal charges or determining an increasing or decreasing trend.
(47) The addition of the signal charges stored in the first storage element C.sub.1 and the second storage element C.sub.2 of the individual unit cell 165.sub.i may be accomplished by electrically connecting in parallel the storage elements C.sub.1 and C.sub.2, which enables voltage equalization and summation of the signal charges stored therein. The resultant voltage is the weighted average of signal charges stored in the storage elements C.sub.1 and C.sub.2 and can be analyzed, for example by measuring the gain of an amplifier electrically connected directly to the individual unit cell 165.sub.i, to find the summation of the signal charges.
(48) Determining a difference of signal charges stored in the first storage element C.sub.1 and the second storage element C.sub.2 of the individual unit cell 165.sub.i may be accomplished by reversing a polarity of the first storage element C.sub.1 or the second storage element C.sub.2 after the first storage element C.sub.1 stores the signal charges directed thereto and the second storage element C.sub.2 stores the signal charges directed thereto and then electrically connecting the first storage element C.sub.1 in parallel to the second storage element C.sub.2. In some embodiments such as shown in
(49) The above two mathematical operations combined allow a direct output of the Luminance and Chrominance in a two-color sensor operation and achieve histogram equalization if an additional gain amplifier is employed, circumventing many steps in external processing.
(50) The capability to perform one or more mathematical operations is not limited to two operands and can extend to multiple operands derived from one or more mathematical operations or from signal charges received and stored at different temporal instances T.sub.i within the individual unit cell 165.sub.i. A time series analysis can thus be performed using the signal charges received over a plurality of temporal instances T.sub.i, both for the individual unit cell 165.sub.i as well as for the plurality of unit cells 165.sub.i forming the ROIC 160.
(51) While the examples above demonstrate only a few ways in which the signal charges stored in one or more storage elements C.sub.x can be controlled using one or more programmable logic control switches G.sub.x1, G.sub.x2, various other ways of controlling the stored signal charges within the individual unit cell 165.sub.i as well as across different subsets of individual unit cells 165.sub.i within the ROIC 160 are contemplated to be included within the scope and content of the disclosure. The embedded programmable gate array formed by the resultant combination of individual circuit modules 165.sub.ai within the individual unit cell 165.sub.i can be programmed through the temporal operation of a set of the programmable logic control switches G={G.sub.00, G.sub.11, G.sub.12, G.sub.21, G.sub.22, G.sub.31, G.sub.32, G.sub.41, G.sub.42, G.sub.51, G.sub.52, G.sub.61, G.sub.62, G.sub.77, . . . } or a subset thereof within the individual unit cell 165.sub.i as well as different subsets of individual unit cells 165.sub.irepresentable by a three-dimensional matrix P.sub.i described abovewithin the ROIC 160. The storage and control of signal charges in the plurality of unit cells 165.sub.i over the plurality of temporal instances T.sub.i thus advantageously enables moving frames of infrared images to be captured over a desired time of exposure to infrared radiation.
(52) Various example embodiments of circuit modules 165.sub.ai are now discussed below to demonstrate the possibilities for mathematically operating on the signal charges flowing into the individual unit cell 165.sub.i of the ROIC 160.
(53)
(54)
(55)
(56) As a non-limiting example, a combination of the example circuit module 400 and the example circuit module 500 can be used to determine a maximum value of either the present value of signal charges residing in the third storage element C.sub.3 or the average of past values of signal charges in the second storage element C.sub.2 and the first storage element C.sub.1 stored at the successive temporal instances (t1) and (t2) respectively. The first storage element C.sub.1 and the second storage element C.sub.2 storing signal charges at the successive temporal instances (t2) and (t1) respectively are first electrically connected in parallel prior to reading the combined source-follower amplifier output.
(57)
(58)
(59) Though not shown in
(60)
(61) A combination of one or more of the circuit modules 300, 400, 500, 600, 700, and 800 are implementable as the circuit modules 165.sub.ai within the individual unit cell 165.sub.i. Moreover, the circuit topologies inherent in the circuit modules 300, 400, 500, 600, 700, and 800 are equally applicable for operating signal charges across any subset of adjacent unit cells within the ROIC 160. The circuit topologies inherent in the circuit modules 300, 400, 500, 600, 700, and 800 are also applicable across at least two subsets of adjacent unit cells 165.sub.i. In some embodiments, the at least two subsets may form the entire plurality of unit cells 165.sub.i in the ROIC 160. In some embodiments, individual subsets of the at least two subsets of adjacent unit cells have an equal number of adjacent unit cells. In some embodiments, the individual subsets of the at least two subsets of adjacent unit cells have an equal number of adjacent unit cells and they together form the entire plurality of unit cells 165.sub.i in the ROIC 160. In all embodiments involving one or more subsets of adjacent unit cells, one or more additional programmable logic control switches may be coupled across the one or more subsets of adjacent unit cells within the ROIC 160 to achieve desired circuit topologies.
(62)
(63)
(64)
(65)
(66)
(67) Alternatively, the example circuit module 1300B (shown in
(68) As a matter of general principle, the embodiments described herein and their combinations can be utilized to effectively control the flow of signal charges within one or more individual unit cells 165.sub.i comprising the ROIC 160. The programmable logic control switches in one or more individual unit cells 165.sub.i can be operably configured such that when a first storage element C.sub.1 in a first unit cell 165.sub.a1 stores a first set of signal charges received at a first temporal instance T.sub.1, at least one second storage element C.sub.2 in the first unit cell 165.sub.a1 or a second unit cell 165.sub.a2 stores a second set of signal charges received at at least one second temporal instance T.sub.2.
(69) The programmable logic control switches in one or more individual unit cells 165.sub.i can be operably configured to determine a summation of signal charges stored in the one or more individual unit cells 165.sub.i over a plurality of temporal instances T.sub.i by electrically connecting in parallel the first storage element C.sub.1 in the first unit cell 165.sub.a1 and the at least one second storage element C.sub.2 in the first unit cell 165.sub.a1 or the second unit cell 165.sub.a2.
(70) The programmable logic control switches in one or more individual unit cells 165.sub.i can be operably configured to determine a difference of signal charges stored within the one or more individual unit cells 165.sub.i by reversing a polarity of the first storage element C.sub.1 or the at least one second storage element C.sub.2 after the first storage element C.sub.1 stores the first set of signal charges received at the first temporal instance T.sub.1 and the at least one second storage element C.sub.2 stores the second set of signal charges at the second temporal instance T.sub.2 but before the first storage element C.sub.1 is electrically connected in parallel with the at least one second storage element C.sub.2.
(71) The programmable logic control switches in one or more individual unit cells 165.sub.i can be operably configured to determine a maximum value of signal charges stored over the plurality of temporal instances T.sub.i by electrically connecting the first storage element C.sub.1 to a first source-follower amplifier and the at least one second storage element C.sub.2 to a second source-follower amplifier through a common bias current connection.
(72) The programmable logic control switches in one or more individual unit cells 165.sub.i can be operably configured to determine whether the second set of signal charges stored in the at least one second storage element C.sub.2 is increasing or decreasing in comparison to the first set of signal charges stored in the first storage element C.sub.1 by electrically connecting the first storage element C.sub.1 and the at least one second storage element C.sub.2 to a differential comparator circuit.
(73) Accordingly, in some embodiments, subsets of 22 unit cells 165.sub.i can be designed with programmable logic control switches and storage elements shared by all four unit cells 165.sub.i, enabling that subset of 22 unit cells 165.sub.i to be further programmed for mathematical operations. The signal charges received by all four unit cells 165.sub.i at the same temporal instance T.sub.i can be added as a sum to boost noise performance. The signal charges received by any one unit cell 165.sub.i can be subtracted from those received at the same temporal instance T.sub.i by one or more unit cells 165.sub.i in the subset to improve unresolved target detection.
(74) In some embodiments, one or more programmable logic control switches are configured to achieve time-delay-integration (TDI), especially for motion-related signal-starving applications. The one or more programmable logic control switches are coupled across one or more subsets of adjacent unit cells 165.sub.i by electrically connecting in parallel one or more storage elements C.sub.x across the one or more subsets of adjacent unit cells 165.sub.i at successive temporal instances T.sub.i. Thus, the signal charges received in a first storage element C.sub.1 in a first unit cell 165.sub.1 at a first temporal instance T.sub.1 are added to the signal charges received in a second storage element C.sub.2 in a second unit cell 165.sub.2, adjacent to the first unit cell 165.sub.1, at a second temporal instance T.sub.2, and so on. It is further contemplated that with real-time reprogramming based on properly coordinated metadata from external sources, TDI can be done efficiently in and around localized areas of the images of a moving target without the need to extend to the entire field-of-view (FOV) of the detector array 110.
(75) Additionally, it is contemplated that in some embodiments, the detector array 110 may be coupled to a diffractive-filter array. In such embodiments, the one or more programmable logic control switches in the individual unit cell 165.sub.i can be additionally programmed to form spectral combs to identify and extract spectral signature information of an individual photon corresponding to an individual signal charge stored in the one or more storage elements C.sub.x of the individual unit cell 165.sub.i. Accordingly, the ROIC 160 is configured to extract multi-signature (spectral, temporal and spatial) data.
(76) The embodiments described herein can be advantageously used for the design and operation of multi-function ROICs that enable programmable controls of how information from infrared radiation is received, stored, and conveniently extracted for subsequent production of infrared images. Many application-driven matrix operations can be achieved by first designing a selected set of storage elements in the ROIC coupled to another selected set of corresponding programmable logic control switches and then programming the set of programmable logic control switches to execute a sequence of operations over a period of time, to extract information-enriched data at or near the point of incidence of the infrared radiation. The extraction of information-enriched data and the subsequent processing through mathematical operations in the analog domain within the ROIC offers significant benefits, as compared to processing the data further downstream in the digital domain after passing through an analog-to-digital converter and a digital image processor. The produced images enjoy the least latency, minimal noise, and contain maximal information while consuming the least amount of bandwidth and energy. Accordingly, such ROICs can have useful applications requiring real-time information extraction in a multifunction sensor with limited bandwidth, such as the ones used or envisioned to be used in advanced threat warning, infrared search and track, and pilotage in degraded visual environment.
(77) It is noted that the terms substantially and about may be utilized herein to include the inherent degree of uncertainty that may be attributed to any quantitative comparison, value, measurement, or other representation. These terms are also utilized herein to represent the degree by which a quantitative representation may vary from a stated reference without resulting in a change in the basic function and intended scope of the subject matter at issue.
(78) While particular embodiments have been illustrated and described herein, it should be understood that various other changes and modifications may be made without departing from the spirit and scope of the claimed subject matter. Moreover, although various aspects of the claimed subject matter have been described herein, such aspects need not be utilized in combination. It is therefore intended that the appended claims cover all such changes and modifications that are within the scope of the claimed subject matter.