Analog voting with outlier suppression

Abstract

A method including collecting analog image data from an imaging array wherein the analog image data includes analog image data from a plurality of imaging pixels and from a plurality of opaque pixels. Each row of the imaging array includes both imaging pixels and opaque pixels. Opaque subtraction is performed in an analog domain, wherein biases determined in the opaque pixels for a given row of the imaging array are subtracted from the analog image data of the imaging pixels of that given row for each row of the imaging array. Performing opaque subtraction includes suppressing outliers in the analog image data from the plurality of opaque pixels. The method includes performing analog to digital conversion (ADC) on the analog image data to produce digital image data for the imaging pixels. ADC is performed after opaque subtraction in the analog domain.

Claims

1. A method comprising: collecting analog image data from an imaging array wherein the analog image data includes analog image data from a plurality of imaging pixels and from a plurality of opaque pixels, wherein each row of the imaging array includes both imaging pixels and opaque pixels; performing opaque subtraction in an analog domain, wherein biases determined in the opaque pixels for a given row of the imaging array are subtracted from the analog image data of the imaging pixels of that given row for each row of the imaging array, wherein performing opaque subtraction includes suppressing outliers in the analog image data from the plurality of opaque pixels; and performing analog to digital conversion (ADC) on the analog image data to produce digital image data for the imaging pixels, wherein ADC is performed after opaque subtraction in the analog domain, wherein suppressing outliers includes clipping the analog image data from the plurality of opaque pixels prior to performing opaque subtraction to reduce impact on the digital image data of outliers in the opaque pixels, wherein clipping the analog image data from the plurality of opaque pixels includes using an operational transconductance amplifier (OTA) on the analog voltage data from the plurality of opaque pixels, wherein output current of the OTA is governed by
I.sub.out≈min(I.sub.LIM,max(−I.sub.LIM,G.sub.m*(V.sub.P−V.sub.N)) where I.sub.out is output current of the OTA, I.sub.LIM is limiting current for clipping outliers, G.sub.m is gain of the OTA, and V.sub.p-V.sub.n differential input voltage of the OTA.

2. The method as recited in claim 1, wherein the limiting current for clipping outliers is governed by
I.sub.LIM≈I.sub.biasN*S.sub.105/S.sub.104, wherein I.sub.LIM is the limiting current for clipping outliers, I.sub.biasN is tail current of the OTA, and S.sub.105/5.sub.104 is current mirror gain of the OTA.

3. The method as recited in claim 1, wherein collecting analog image data includes feeding the analog image data from the plurality of opaque pixels on a column by column basis wherein the analog image data from each column of the opaque pixels is fed to a respective OTA, wherein there is one OTA per column of opaque pixels.

4. The method as recited in claim 1, wherein suppressing outliers in the analog image data from the plurality of opaque pixels includes suppressing analog image data from at least one of a dead pixel, a hot pixel, and/or a pixel with blinking response.

5. A method comprising: collecting analog image data from an imaging array wherein the analog image data includes analog image data from a plurality of imaging pixels and from a plurality of opaque pixels, wherein each row of the imaging array includes both imaging pixels and opaque pixels; performing opaque subtraction in an analog domain, wherein biases determined in the opaque pixels for a given row of the imaging array are subtracted from the analog image data of the imaging pixels of that given row for each row of the imaging array, wherein performing opaque subtraction includes suppressing outliers in the analog image data from the plurality of opaque pixels; and performing analog to digital conversion (ADC) on the analog image data to produce digital image data for the imaging pixels, wherein ADC is performed after opaque subtraction in the analog domain, wherein suppressing outliers includes clipping the analog image data from the plurality of opaque pixels prior to performing opaque subtraction to reduce impact on the digital image data of outliers in the opaque pixels, wherein clipping the analog image data from the plurality of opaque pixels includes using an operational transconductance amplifier (OTA) on the analog voltage data from the plurality of opaque pixels, wherein collecting analog image data includes feeding the analog image data from the plurality of opaque pixels on a column by column basis wherein the analog image data from each column of the opaque pixels is fed to a respective OTA, wherein there is one OTA per column of opaque pixels, wherein each OTA has a respective output, wherein suppressing outliers includes shorting the outputs of the OTAs together to average analog image data for rows of the opaque pixels, wherein outliers arc suppressed by current limiting in the OTAs, wherein output current of the OTA is governed by
I.sub.out≈min(I.sub.LIM,max(−I.sub.LIM,G.sub.m*(V.sub.P−V.sub.N)) where I.sub.out is output current of the OTA, I.sub.LIM is limiting current for clipping outliers, G.sub.m is gain of the OTA, and V.sub.p-V.sub.n is differential input voltage of the OTA.

6. The method as recited in claim 5, further comprising using average analog image data for the rows, with outliers suppressed, to reduce row noise in the analog image data from the plurality of imaging pixels to create analog image data with reduced row noise.

7. The method as recited in claim 6, wherein performing ADC includes converting the analog image data with reduced row noise into digital image data.

8. The method as recited in claim 7, further comprising outputting the digital image data to at least one of a visual display, a hard copy, and/or a tangible storage medium.

9. A system comprising: a pixel array including a sub array of imaging pixels and a sub-array of opaque pixels; an analog voting component operatively connected to the sub-array of opaque pixels to receive analog image data from the sub-array of opaque pixels; and a filtering component operatively connected to the sub-array of imaging pixels to receive analog image data from the sub-array of imaging pixels, and to the analog voting component for subtracting row averages from the sub-array of opaque pixels to reduce row noise in analog image data from the sub-array of imaging pixels, wherein the analog voting component is configured to suppress outliers in the row averages from the sub-array of the opaque pixels, wherein the analog voting component includes a respective operational transconductance amplifier (OTA) connected to each respective column of the sub-array of opaque pixels, wherein each OTA has a respective output, wherein suppressing outliers includes shorting the outputs of the OTAs together to average analog image data for rows of the opaque pixels, wherein outliers are suppressed by current limiting in the OTAs, wherein output current of the OTA is governed by
I.sub.out≈min(I.sub.LIM,max(−I.sub.LIM,G.sub.m*(V.sub.P−V.sub.N)) where I.sub.out is output current of the OTA, I.sub.LIM is limiting current for clipping outliers, G.sub.m is gain of the OTA, and V.sub.p-V.sub.n is differential input voltage of the OTA.

10. The system as recited in claim 9, wherein outputs of each of the OTAs are shorted together to output row averages with outliers suppressed to the filtering component.

11. The system as recited in claim 9, further comprising an analog to digital conversion (ADC) component is operatively connected to receive analog image data from the filtering component for conversion into digital image data, wherein the ADC component resides in a read out only integrated circuit (ROIC) and wherein the pixel array, analog voting component, and the filtering component all reside in a focal plane array (FPA).

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) So that those skilled in the art to which the subject disclosure appertains will readily understand how to make and use the devices and methods of the subject disclosure without undue experimentation, embodiments thereof will be described in detail herein below with reference to certain figures, wherein:

(2) FIG. 1 is diagram showing a “Lenna” image, widely used in image processing community and papers, wherein the image has row noise, and showing the image with the dark references subtracted;

(3) FIG. 2 is a diagram of the image of FIG. 1 in the case of hot and/or dead pixels in the dark reference, and showing the image that results in subtracting the dark references when hot and/or dead pixels are present in the dark references;

(4) FIG. 3 is a schematic view of an embodiment of a system constructed in accordance with the present disclosure, showing the pixel array and analog voting component;

(5) FIG. 4 is a schematic view of the voting component of FIG. 1, showing the operational transconductance amplifiers (OTAs);

(6) FIG. 5 is a schematic view of one of the OTAs of FIG. 4;

(7) FIG. 6 is a graph schematically showing the clipping effect for suppressing a hot pixel using an OTA as in FIG. 4; and

(8) FIG. 7 is a diagram showing the “Lenna” image with hot and/or dead pixels in the dark reference, and showing the image that results from outlier suppression in the analog voting component of FIG. 3.

DETAILED DESCRIPTION

(9) Reference will now be made to the drawings wherein like reference numerals identify similar structural features or aspects of the subject disclosure. For purposes of explanation and illustration, and not limitation, a partial view of an embodiment of a system in accordance with the disclosure is shown in FIG. 3 and is designated generally by reference character 100. Other embodiments of systems in accordance with the disclosure, or aspects thereof, are provided in FIGS. 4-7, as will be described. The systems and methods described herein can be used to reduce row noise in digital imaging devices, e.g. without digital processing overhead as in traditional systems.

(10) The system 100 includes a pixel array 102 including a sub array of imaging pixels 104 and a sub-array of opaque pixels 106. An analog voting component 108 is operatively connected to the sub-array of opaque pixels 106 to receive analog image data from the sub-array of opaque pixels 106. A filtering component 110 is operatively connected to the sub-array of imaging pixels 104 to receive analog image data from the sub-array of imaging pixels 104, e.g. using row by row sampling capacitors 112. The filtering component 110 is operatively connected to the analog voting component 108 for subtracting row averages from the sub-array of opaque pixels 106 to reduce row noise in analog image data from the sub-array of imaging pixels 104. The analog voting component 108 is configured to suppress outliers in the row averages from the sub-array of the opaque pixels 106 before subtracting the row averages from the sub-array of opaque pixels 106.

(11) The analog voting component 108 includes a respective operational transconductance amplifier (OTA) 114 connected by a respective OTA input 116 to each respective column of the sub-array of opaque pixels 106 of FIG. 3. Outputs 118 of each of the OTAs are shorted together to a single output 120 of the analog voting component 108 to output row averages with outliers suppressed to the filtering component 110 of FIG. 3. FIG. 5 shows an example of an OTA schematic for uses as the OTAs 114. Any other suitable OTA architecture can be used. While FIGS. 1 and 2 show schematics for four rows and columns, those skilled in the art will readily appreciate that this is for sake of clarity and that any suitable number of columns/rows can be used in the sub-arrays 104, 106.

(12) With reference again to FIG. 3, an analog to digital conversion (ADC) component 122 is operatively connected to receive analog image data 124 from the filtering component 110 for conversion into digital image data. The ADC component 122 resides in a read out only integrated circuit (ROIC) 126. The pixel array 102, analog voting component 108, and the filtering component 110 all reside in a focal plane array (FPA) 128.

(13) A method includes collecting analog image data from an imaging array wherein the analog image data includes analog image data from a plurality of imaging pixels, e.g. from the sub-array of imaging pixels 104, and from a plurality of opaque pixels, e.g. from the sub-array of opaque pixels 106. Each row of the imaging array 102 includes both imaging pixels and opaque pixels. Opaque subtraction is performed in an analog domain, wherein biases determined in the opaque pixels for a given row of the imaging array 102 are subtracted from the analog image data of the imaging pixels of that given row for each row of the imaging array 102. Performing opaque subtraction includes suppressing outliers in the analog image data from the plurality of opaque pixels. The method includes performing analog to digital conversion (ADC) on the analog image data to produce digital image data for the imaging pixels. ADC is performed after opaque subtraction in the analog domain.

(14) With reference to FIG. 6, suppressing outliers includes clipping the analog image data from the plurality of opaque pixels prior to performing opaque subtraction to reduce impact on the digital image data of outliers in the opaque pixels. Clipping the analog image data from the plurality of opaque pixels includes using an OTA 114, as shown in FIGS. 4-5 on the analog voltage data from the plurality of opaque pixels. Output current of the OTA 114 is governed by
I.sub.out≈min(I.sub.LIM,max(−I.sub.LIM,G.sub.m*(V.sub.P−V.sub.N))
where I.sub.out is output current of the OTA, I.sub.LIM is limiting current for clipping outliers, G.sub.m is gain of the OTA, V.sub.P−V.sub.n is differential input voltage of the OTA. The limiting current for clipping outliers is governed by
I.sub.LIM≈I.sub.biasN*S.sub.105/S.sub.104,
wherein I.sub.LIM is the limiting current for clipping outliers, I.sub.biasN is tail current of the OTA, and S.sub.105/S.sub.104 is current mirror gain of the OTA. Suppressing outliers in the analog image data from the plurality of opaque pixels includes suppressing analog image data from at least one of a dead pixel, a hot pixel, and/or a pixel with blinking response. As shown in FIG. 6, a hot pixel is clipped has its current clipped in the OTA 114 of FIG. 4 to not exceed I.sub.tail, whereas the remaining, normal pixels are not clipped and so have current values between −I.sub.tail and I.sub.tail.

(15) With reference again to FIG. 4, collecting analog image data includes feeding the analog image data from the plurality of opaque pixels on a column by column basis wherein the analog image data from each column of the opaque pixels is fed through a respective input 116 to a respective OTA 114, wherein there is one OTA 114 per column of opaque pixels. Suppressing outliers includes shorting the OTA outputs 118 together to average analog image data for rows of the opaque pixels, wherein outliers are suppressed by current limiting in the OTAs.

(16) With reference to FIG. 3, the method includes using average analog image data for the rows, with outliers suppressed, to reduce row noise in the analog image data from the plurality of imaging pixels in the filter component 110 to create analog image data with reduced row noise. Performing ADC includes converting the analog image data with reduced row noise from the filter component 110 into digital image data using the ADC component 122. The method can include outputting the digital image data to at least one of a visual display, a hard copy, and/or a tangible storage medium, as indicated the arrow out of the ROTC 126 in FIG. 3.

(17) Usinge the methods above, for small BlkCol differences (small differences between inputs 116 of FIG. 4), vColRef (output 120 in FIG. 4) will settle to the average of the BlkCol inputs. Kirchoff's law states that the vColRef will settle to a voltage where the sum of all OTA output currents is zero. For larger differences between the BlkCol inputs, the OTA's current limiting feature should be accounted for as:
0=min(I.sub.LIM,max(−I.sub.LIM,Gm*(BlkCol<0>−vColRef))+min(I.sub.LIM,max(−I.sub.LIM,Gm*(BlkCol<1>−vColRef))+min(I.sub.LIM,max(−I.sub.LIM,Gm*(BlkCol<2>−vColRef))+min(I.sub.LIM,max(−I.sub.LIM,Gm*(BlkCol<3>−vColRef)),
where vColRef is the Column Reference Voltage, the average or voted average voltage of opaque reference columns (represented by the single output 120 in FIG. 3) that is subtracted from all live columns in the capacitive difference sampling circuit 110, and where the other variables are as described above and shown in FIG. 4. FIG. 7 shows the improvement in row noise reduction using this technique where hot/dead pixels are present in the dark reference. In case of one outlier column, the particular OTA 114 will enter ILIM current limiting. The output voltage (also V.sub.N on all OTAs 114) will settle to where the sum of currents is zero. The outlier will still have some effect on vColRef voltage, but the impact is significantly suppressed.

(18) Additional potential benefits include that hot pixels are typically very noisy due to shot noise, but the noise gain from these suppressed pixels is virtually zero. This can make the difference between making the ROIC commercially viable, or having to discard it in quality control.

(19) The methods and systems of the present disclosure, as described above and shown in the drawings, provide for improved row noise reduction in digital imaging devices. While the apparatus and methods of the subject disclosure have been shown and described, those skilled in the art will readily appreciate that changes and/or modifications may be made thereto without departing from the scope of the subject disclosure.