Analog-to-digital converter having reference signal, image sensor, and image capturing apparatus
11558575 · 2023-01-17
Assignee
Inventors
Cpc classification
H04N25/616
ELECTRICITY
H04N25/75
ELECTRICITY
H04N23/667
ELECTRICITY
International classification
Abstract
An analog-to-digital converter includes a generator, a comparator, and a counter. The generator generates a reference signal whose voltage changes with respect to time. The voltage of the reference signal changes with a constant slope in a predetermined first period since the voltage starts changing. The slope of the voltage becomes steeper with respect to time in a second period after the first period. The comparator compares the reference signal and a voltage output from outside, and outputs a comparison result. The counter counts at a predetermined first cycle since the voltage of the reference signal starts changing until the comparison result is inverted.
Claims
1. An image sensor comprising: a plurality of pixels each including a photoelectric converter that generates an electric signal corresponding to an amount of incident light and a converter that converts the electric signal transmitted from the photoelectric converter to a voltage; an analog-to-digital converter comprising: a generator that generates a reference signal whose voltage changes with respect to time, wherein the voltage of the reference signal changes with a constant slope in a predetermined first period since the voltage starts changing, and the slope of the voltage becomes steeper with respect to time in a second period after the first period; a comparator that compares the reference signal and a voltage output from outside, and outputs a comparison result; a counter that counts at a predetermined first cycle since the voltage of the reference signal starts changing until the comparison result is inverted, a first storage circuit for storing a first count value corresponding to a reset voltage of the converter when it is reset before the electric signal is transferred from the photoelectric converter, and a second storage circuit for storing a second count value corresponding to a signal voltage of the converter after the electric signal is transferred from the photoelectric converter, wherein the analog-to-digital converter converts the voltage output from the pixel into a digital signal, outputs a difference between the first count value and the second count value, and outputs the first count value, and a correction unit that corrects the difference using a correction function, selected from a plurality of correction functions, corresponding to the first count value, the functions capable of converting a non-linear relationship to a linear relationship, wherein the correction unit is implemented by one or more processors, circuitry or a combination thereof.
2. The image sensor according to claim 1, wherein the change in the voltage of the reference signal in the second period is expressed as a 1.5.sup.th-order function of time or the first cycle.
3. The image sensor according to claim 1, wherein the generator has a resistor group in which a predetermined number of resistors with a constant resistance and a plurality of resistors with larger resistances than the constant resistance which are different from each other are connected in series in ascending order of resistance, and generates the reference signal by applying a first voltage at one end of the resistor group and a second voltage at the other end of the resistor group, and sequentially reading out voltages from a plurality of contacts between the plurality of resistors connected between the first voltage and the second voltage, from one of the ends of the resistor group toward the other end of the resistor group at a predetermined second cycle.
4. The image sensor according to claim 3, wherein the generator sequentially reads out the voltages from the end at which the resistor with a smallest resistance is arranged toward the end at which the resistor with a largest resistance is arranged.
5. The image sensor according to claim 3, wherein the generator sequentially reads out the voltages from the end at which the resistor with a largest resistance is arranged toward the end at which the resistor with a smallest resistance is arranged.
6. The image sensor according to claim 3, wherein the resistance of each of the resistors forming the resistor group and the second cycle are set so that the voltage of the reference signal in the second period is expressed by a 1.5.sup.th-order function of time or the first cycle.
7. The image sensor according to claim 1, wherein in a case where an exposure period of the photoelectric converter is a third period, the first period is made longer than a case where the exposure time is a fourth period shorter than the third period.
8. The image sensor according to claim 1, wherein in a case where temperature of the image sensor is a first temperature, the first period is made longer than in a case where the temperature of the image sensor is a second temperature lower than the first temperature.
9. The image sensor according to claim 1, wherein in a case where the slope of the reference signal is set to be a first slope which is gentler than a threshold, the first period is made longer than in a case where the slope is not set to be the first slope.
10. The image sensor according to claim 1, wherein the generator is controlled such that the comparator compares the reset voltage and the reference signal during the first period, and compares the signal voltage and the reference signal during the first period and the second period.
11. The image sensor according to claim 10, wherein a period in which the voltage of the reference signal is changed in order to compare the reset voltage and the reference signal is shorter than the first period for comparing the signal voltage with the reference signal.
12. An image capturing apparatus comprising: an image sensor including: a plurality of pixels each including a photoelectric converter that generates an electric signal corresponding to an amount of incident light and a converter that converts the electric signal transmitted from the photoelectric converter to a voltage; an analog-to-digital converter having: a generator that generates a reference signal whose voltage changes with respect to time, wherein the voltage of the reference signal changes with a constant slope in a predetermined first period since the voltage starts changing, and the slope of the voltage becomes steeper with respect to time in a second period after the first period; a comparator that compares the reference signal and a voltage output from outside, and outputs a comparison result; a counter that counts at a predetermined first cycle since the voltage of the reference signal starts changing until the comparison result is inverted; a first storage circuit for storing a first count value corresponding to a reset voltage of the converter when it is reset before the electric signal is transferred from the photoelectric converter; and a second storage circuit for storing a second count value corresponding to a signal voltage of the converter after the electric signal is transferred from the photoelectric converter; wherein the analog-to-digital converter converts the voltage output from the pixel into a digital signal, and outputs a difference between the first count value and the second count value, and the first count value with a predetermined number of bits; and a correction unit that corrects a digital signal output from the image sensor, wherein the correction unit corrects the difference based on the first count value using a correction function, selected from a plurality of correction functions, corresponding to the first count value, the functions capable of converting a non-linear relationship to a linear relationship, and wherein the correction unit is implemented by one or more processors, circuitry or a combination thereof.
13. The image capturing apparatus according to claim 12 further comprising a setting unit that sets a shooting mode, wherein, in a case where a mode to perform continuous shooting is set as the shooting mode, the predetermined number of bits are made smaller than in a case where a single shooting is set, and wherein the setting unit is implemented by one or more processors, circuitry or a combination thereof.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the disclosure, and together with the description, serve to explain the principles of the disclosure.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
DESCRIPTION OF THE EMBODIMENTS
(14) Hereinafter, embodiments will be described in detail with reference to the attached drawings. Note, the following embodiments are not intended to limit the scope of the disclosure, and limitation is not made a disclosure that requires a combination of all features described in the embodiments. Two or more of the multiple features described in the embodiments may be combined as appropriate. Furthermore, the same reference numerals are given to the same or similar configurations, and redundant description thereof is omitted.
First Embodiment
(15)
(16) The image sensor 100 includes a pixel array unit 101, an analog-to-digital (AD) conversion unit or an AD converter 111, a vertical selection circuit 121, a horizontal selection circuit 131, and an output unit 141.
(17) A plurality of pixels 102 are arranged in a two-dimensional array in the pixel array unit 101. When an output of the vertical selection circuit 121 is input to the pixels arranged in the row via a pixel drive pulse wiring 103, selection switches of the pixels in the predetermined row are turned on, and the amplification transistors of the pixels in the row are connected to output lines 104. The configuration of each pixel 102 will be described later with reference to
(18) The AD conversion unit 111 has a reference signal generation circuit 112, a plurality of AD conversion circuits 113 each arranged for each output line 104, and an AD counter 114.
(19) The AD conversion circuit 113 converts an output voltage of the pixel in the corresponding column of the row selected by the vertical selection circuit 121, which is input from the outside of the AD conversion circuit 113 via the output line 104, into a digital signal and holds it. Then, the digital signals of the columns sequentially selected by the horizontal selection circuit 131 are output to the outside of the image sensor 100 via the output unit 141. By sequentially performing this reading operation while changing the row selected by the vertical selection circuit 121, the two-dimensional image signal is read out from the image sensor 100.
(20)
(21) In
(22) The transfer switch 203 is controlled by a control signal ϕTX, and is turned on when the control signal ϕTX is High (H) and turned off when the control signal ϕTX is Low (L). The reset switch 204 is controlled by a control signal ORES, and is turned on when the control signal ORES is H and turned off when the control signal ORES is L. The selection switch 205 is controlled by a control signal ϕSEL, and is turned on when the control signal ϕSEL is H and turned off when the control signal ϕSEL is L.
(23) The AD conversion circuit 113 shown in
(24)
(25) Further, during an AD conversion period, the voltage selection circuit 402 changes a potential from V.sub.REFH (contact 411, one of the two ends) toward the V.sub.REFL (the other end) by sequentially selecting a contact 411, a contact 412, a contact 413, and so on, at a constant cycle. The selected voltage is output to the voltage follower 403, which transmits the received voltage to the comparators 301 each arranged for each output line 104.
(26) Among the resistors R.sub.1 to R.sub.N of the series resistance group 401, a predetermined number of resistors from the V.sub.REFH end have the same resistances, and after the predetermined number, the resistances of the resistors gradually increase as they approach the V.sub.REFL end. With this configuration, during the operation of the voltage selection circuit 402, the voltage of the reference signal initially decreases by a constant amount of change with respect to time, and the amount of change gradually increases after a predetermined time has elapsed.
(27)
(28) A “comparator output” represents the output of the comparator 301, a “count value” represents the count value input from the AD counter 114, and an “N signal” represents a first count value corresponding to an N signal described later, and an “N+S signal” represents a second count value corresponding to an N+S signal described later.
(29) The pixel signal readout consists of N signal readout and N+S signal readout. The N signal corresponds to a voltage of the FD 202 when it is reset before charge stored in the PD 201 is transferred, and the N+S signal corresponds to a voltage of the FD 202 after the charge stored in the PD 201 is transferred. By calculating the difference between the N signal and the N+S signal, a signal corresponding to the amount of charge stored in the PD 201 is obtained. Hereinafter, operations performed in the order of the N signal readout and the N+S signal readout will be described with reference to the timing chart of
(30) N Signal Readout (t.sub.501 to t.sub.506)
(31) First, the selection switch 205 is turned on (t.sub.501) to connect the amplification transistor 206 and the output line 104, and the reset switch 204 is turned on (t.sub.502) then to off (t.sub.503) to reset the FD 202 before transferring charge. As a result, a voltage V.sub.OL of the output line 104 becomes a voltage V.sub.RES corresponding to the reset voltage (t.sub.503).
(32) After that, the AD counter 114 is driven so that the count value increases at a constant cycle, and the reference signal generation circuit 112 is driven so that an amount of change (slope) of the reference signal V.sub.REF becomes constant with respect to time or the count value (t.sub.504 to t.sub.506). In the present embodiment, this period (t.sub.504 to t.sub.506) is referred to as an “N conversion period”. In this period, the reference signal V.sub.REF is controlled to decrease from a high voltage (V.sub.REFH) by an amount that includes an amount of voltage represented by
V.sub.RES±V.sub.M1
by using a margin voltage V.sub.M1 determined from variation in threshold for the amplification transistor 206 and the thermal noise at the time of resetting the FD 202. Note that, during the N conversion period, the cycle of shifting the contacts is adjusted so that the contacts between the predetermined number of resistors whose resistances do not change and which are included in the series resistance group 401 shown in
(33) In this embodiment, since electrons are accumulated in the PD 201, the reference signal V.sub.REF is decreased from a high voltage, but when holes are accumulated in the PD 201, it is raised from a low voltage.
(34) The comparator 301 outputs a comparison result between the reference signal V.sub.REF and the voltage V.sub.OL of the output line 104, and when the voltages become the same, the output of the comparator 301 is inverted and the first count value is stored in the N signal latch circuit 302 (t.sub.505). The latch circuit 302 is a first storage or memory circuit. In the present embodiment, the AD counter 114 is used as a common circuit and the AD count value is transmitted to the latch circuit of each column. However, the time until the output of the comparator 301 inverts may be counted by arranging the AD counter 114 in each column and transmitting the clock signal.
(35) N+S Signal Readout (t.sub.507 to t.sub.512)
(36) By turning on (t.sub.507) and then off (t.sub.508) the transfer switch 203, charge accumulated in the PD 201 is transferred to the FD 202. As a result, the voltage of the FD 202 reset to the reset potential decreases by a voltage (ΔV.sub.FD) approximately proportional to the number of transferred charges, and the voltage V.sub.OL of the output line 104 decreases by a voltage (ΔV.sub.OL) approximately proportional to the ΔV.sub.FD. That is, ΔV.sub.OL becomes a voltage that is approximately proportional to the amount of light. Further, in the present embodiment, the voltage V.sub.OL of the output line 104 corresponding to the voltage of the 1-D 202 after the transfer switch 203 is turned on (t.sub.507) then to off (t.sub.508) when the PD 201 is not irradiated with light during the accumulation period is called V.sub.DC.
(37) After that, the AD counter 114 is driven so that the count value increases at a constant cycle, and the reference signal generation circuit 112 is driven so that the slope of the reference signal V.sub.REF is constant (t.sub.509 to t.sub.510). In the present embodiment, this period (t.sub.509 to t.sub.510) is referred to as a “first N+S conversion period”. In this period, the reference signal V.sub.REF is controlled to decrease from a high voltage by an amount that includes an amount of voltage represented by
V.sub.DC±V.sub.M2
by using a margin voltage V.sub.M2 determined from variation in threshold for the amplification transistor 206 and the thermal noise at the time of resetting the FD 202. For V.sub.M2, it is preferable that V.sub.M2>V.sub.M1 holds in consideration of the variation in dark current accumulated in the PD 201 during the accumulation period in addition to V.sub.M1. That is, the first N+S conversion period may be set longer than the N conversion period.
(38) Further, since the variation in the dark current is larger when the accumulation period (exposure time) of the PD 201 is longer, it is preferable to set the first N+S conversion period longer in a case where the accumulation period is long than in a case where the accumulation period is short. Further, since the variation in the dark current is larger when the temperature of the image sensor 100 is higher, it is preferable to set the first N+S conversion period longer in a case where the temperature of the image sensor 100 is high than in a case where the temperature of the image sensor 100 is low.
(39) While the first N+S conversion period, the cycle of shift in the contacts is adjusted so that the contacts between a predetermined number of resistors whose resistances do not change and which are included in the series resistance group 401 shown in
(40) Subsequently, the slope of the reference signal V.sub.REF is continuously made steeper while keeping a rate of increase in count by the AD counter 114 in the fixed cycle (t.sub.510 to t.sub.512). In the present embodiment, this period (t.sub.510 to t.sub.512) is referred to as a “second N+S conversion period”. During this second N+S conversion period, among the resistors of the series resistance group 401 shown in
(41) During the first N+S conversion period and the second N+S conversion period (t.sub.509 to t.sub.512), when the reference signal V.sub.REF and the voltage V.sub.OL of the output line 104 becomes the same voltage, the output of the comparator 301 is inverted and the second count value is latched in the N+S signal latch circuit 303 (t.sub.511). The latch circuit 303 is a second storage or memory circuit. By continuously increasing the slope of the reference signal V.sub.REF during the second N+S conversion period, it is possible to suppress the gap between digital signals caused by a difference in slopes between the reference signals and, comparing to an AD conversion period when a reference signal having a constant slope is used, it is possible to shorten the AD conversion period.
(42) After the pixel signal has been read out, the horizontal selection circuit 131 sequentially selects columns to read out the digital signals from the selected columns, and the digital signals are output from the image sensor 100 via the output unit 141. When reading out each of the digital signals, a signal obtained by subtracting the digital signal stored in the N signal latch circuit 302 from the digital signal stored in the N+S signal latch circuit 303 using the differential circuit 304 is output as a first output signal. Further, the upper bits or all the bits of the signal stored in the N signal latch circuit 302 are read out as a second output signal according to the number of bits set in the signal bit selection circuit 305 in advance of the read out. Further, if the preset number of bits is 0, the second output signal is not read out.
(43) Here, the readout noise superimposed on the digital signal during AD conversion will be described. In the present specification, unless otherwise specified, the readout noise indicates a random noise superimposed on the readout circuit, and the comparison between the readout noises indicates the comparison between the noises in the correction signal described later at the input of the AD conversion circuit 113.
(44) In the N conversion period of the present embodiment, since the amount of change of the reference signal V.sub.REF with respect to time is constant, readout noise is constant regardless of the magnitude of the voltage V.sub.OL of the output line 104. That is, the readout noise of the N signal is constant regardless of variation in the threshold of the amplification transistor 206, variation in the voltage of the FD 202 due to the thermal noise at the time of resetting the FD 202, and the like.
(45) Also, during the N+S conversion period, in a case where the magnitude of the voltage V.sub.OL of the output line 104 is
V.sub.OL≥V.sub.DC−V.sub.M2,
the comparator 301 is inverted in the first N+S conversion period. In the first N+S conversion period, the slope of the reference signal V.sub.REF is equivalent to that in the N conversion period, so the readout noise is equivalent to that in the N conversion period. That is, when the light irradiation is sufficiently small, the comparator 301 is inverted in the first N+S conversion period, and the readout noise becomes constant.
(46) Further, in a case where the magnitude of the voltage V.sub.OL of the output line 104 is
V.sub.OL<V.sub.DC−V.sub.M2,
the comparator 301 is inverted in the second N+S conversion period. In the second N+S conversion period, the slope of the reference signal V.sub.REF becomes steeper when the voltage V.sub.OL of the output line 104 is lower. The readout noise in the single slope AD conversion method is smaller when the amount of change of the reference signal V.sub.REF with respect to time is smaller, and is larger when the amount of change of the reference signal V.sub.REF with respect to time is larger. Therefore, the readout noise is larger when the V.sub.OL is smaller. That is, the readout noise is small when the light intensity is small and the obtained signal is easily affected by the readout noise, and the readout noise is large when the light intensity is large and the obtained signal is not easily affected by the readout noise, with the readout noise continuously changing with respect to the light intensity.
(47) Further, when the slope of the reference signal V.sub.REF is sufficiently large, the readout noise increases in proportion to the slope of the reference signal V.sub.REF. Further, since the distribution of photons is Poisson distribution, the signal-to-noise ratio (SNR) increases with the increase in the amount of light in the rate of the 0.5.sup.th power of the amount of light. Therefore, in order to prevent the SNR from deteriorating with respect to the increase in the amount of light, it is preferable that the increase in the slope of the reference signal V.sub.REF in the second N+S conversion period is controlled such that the disadvantage of the increased slope does not exceed the advantage of the increased amount of light that improves the SNR. That is, by setting the derivative of the reference signal V.sub.REF with respect to time or count value to the 0.5.sup.th power of the time or count value, it is possible to prevent the SNR from decreasing with respect to the increase in the amount of light. From the above, it is preferable that the reference signal V.sub.REF in the second N+S conversion period is controlled in accordance with a 1.5.sup.th-order function of time or count value.
(48) Further,
(49) The slope of the reference signal V.sub.REF is gentler, and the reference signal V.sub.REF at the end of the second N+S conversion period is higher comparing to a case in the normal readout shown in
(50) By doing so, the voltage range of the voltage V.sub.OL of the output line 104 that can be AD-converted becomes narrower than that at the time of normal readout, however, since the slope of the reference signal V.sub.REF is gentle, the readout noise becomes small.
(51) In addition, since the slope of the reference signal V.sub.REF is gentler than that at the time of normal readout, and the time required until the V.sub.OL satisfies the condition of
V.sub.OL=V.sub.DC−V.sub.M2
becomes long, it is preferable to lengthen the first N+S conversion period.
(52) As described above, according to the first embodiment, AD conversion can be performed at high speed without generating a gap between signals and readout noises.
(53) In the above-mentioned example, the case where the AD conversion circuit is arranged for each column has been described, but the disclosure is not limited to this, and can be appropriately applied to a known AD conversion circuit.
Second Embodiment
(54) Next, a second embodiment will be described. In the second embodiment, a specific configuration example of an image capturing apparatus will be described.
(55)
(56) A photographing lens 701 forms an optical image of a subject on the image sensor 100. A lens driving unit 702 performs zoom control, focus control, aperture control, and the like of the photographing lens 701. An overall control calculation unit 703 functions as a signal processing unit that performs processing such as generation of a correction signal and an image using the first output signal and the second output signal output from the image sensor 100, and also controls the entire image capturing apparatus.
(57) A memory unit 704 functions as a memory for temporarily storing image data. A display unit 705 is a device that displays various information and images. A recording unit 706 is a detachable, for example, semiconductor memory for recording and reading image data. An operation unit 707 includes various interfaces of the image capturing apparatus, and the overall control calculation unit 703 controls each configuration of the image capturing apparatus according to an instruction from the user via the operation unit 707.
(58)
(59) In the N+S signal read out, when the reset level is high (821), the output of the comparator 301 is inverted at the timing t.sub.811, and the AD count value corresponding to the timing t.sub.811 is held in the N+S signal latch circuit 303. On the other hand, when the reset level is low (822), the output of the comparator 301 is inverted at the timing t.sub.812, and the AD count value corresponding to the timing t.sub.812 is held in the N+S signal latch circuit 303. The slope of the reference signal V.sub.REF at the timing t.sub.812 is steeper than the slope of the reference signal V.sub.REF at the timing t.sub.811. Therefore, when the reset level is low, the first output signal is smaller than that when the reset level is high, even if the ΔV.sub.OL is the same.
(60)
(61)
(62) First, the correction function selection circuit 1003 selects the correction function 1100 from the correction function table 1002 according to the number of bits of the second output signal and its value, and transmits the correction function 1100 to the correction block 1001. Even if the second output signal is not output, the correction function 1100 corresponding to the state that the second output signal is 0 bits is selected and transmitted to the correction block 1001. In the correction block 1001, the first output signal is input to the correction function 1100 to obtain the corrected signal. By doing so, it is possible to obtain a signal having a linear relationship with respect to ΔV.sub.OL (1200) from the first output signal having a non-linear relationship with respect to ΔV.sub.OL.
(63) Increasing the number of bits of the second output signal can reduce the error due to correction, and decreasing the number of bits of the second output signal can reduce the amount of data transmitted from the image sensor 100. Therefore, for example, it is conceivable to change the number of bits of the second output signal according to the shooting mode set by the user operation of a shooting mode selection switch included in the operation unit 707. As an example, if the shooting mode is set to a single shooting mode, the number of bits of the second output signal is increased, and if the shooting mode is set to a mode required to perform shooting operation continuously, such as a continuous shooting mode, a movie shooting mode, and the like, the number of bits in the second output signal is reduced.
(64) As described above, according to the second embodiment, AD conversion can be performed at high speed without generating a gap between signals and readout noises.
(65) While the disclosure has been described with reference to exemplary embodiments, it is to be understood that the disclosure is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
(66) This application claims the benefit of Japanese Patent Application No. 2020-024664, filed on Feb. 17, 2020 which is hereby incorporated by reference herein in its entirety.