METHOD, APPARATUS, AND SYSTEM PROVIDING AN IMAGER WITH PIXELS HAVING EXTENDED DYNAMIC RANGE
20230113004 · 2023-04-13
Inventors
Cpc classification
H04N25/59
ELECTRICITY
H04N25/75
ELECTRICITY
H04N25/589
ELECTRICITY
International classification
H04N25/59
ELECTRICITY
H04N25/589
ELECTRICITY
Abstract
The dynamic range of a pixel is increased by using selective photosensor resets during a frame time of image capture at a timing depending on the light intensity that the pixel will be exposed to during the frame time. Pixels that will be exposed to high light intensity are reset later in the frame than pixels that will be exposed to lower light intensity.
Claims
1. An imager, comprising: a shared pixel including a first photosensor, a first transfer transistor selectively coupling the first photosensor to a floating diffusion region, a second photosensor, a second transfer transistor selectively coupling the second photosensor to the floating diffusion region, and a photosensor reset transistor coupled to a gate of the first transfer transistor, wherein the imager is configured to: determine a first value of light intensity to which the first photosensor will be exposed during a first frame time, and individually assign a first brightness value to the first photosensor based, at least in part, on the determined first value of light intensity.
2. The imager of claim 1, wherein the shared pixel further includes a reset transistor selectively coupling the first and second photosensors to a supply voltage via the first and second transfer transistors, respectively.
3. The imager of claim 2, wherein the reset transistor includes a source connected to the floating diffusion region and a drain connected to the supply voltage.
4. The imager of claim 1, wherein: the photosensor reset transistor is a first photosensor reset transistor; and the shared pixel further includes a second photosensor reset transistor coupled to a gate of the second transfer transistor.
5. The imager of claim 4, wherein the first photosensor reset transistor includes a source coupled to the gate of the first transfer transistor, a drain configured to receive an enable signal, and a gate configured to receive a transfer signal.
6. The imager of claim 5, wherein: the enable signal is a first enable signal; the transfer signal is a first transfer signal; and the second photosensor reset transistor includes a source coupled to the gate of the second transfer transistor, a drain configured to receive a second enable signal, and a gate configured to receive a second transfer signal.
7. The imager of claim 5, wherein the shared pixel further includes a capacitor coupled to the floating diffusion region.
8. The imager of claim 5, wherein the imager is further configured to reset first charge accumulated on the first photosensor during the first frame time by activating, at a first timing associated with the assigned first brightness value, (a) a reset transistor selectively coupling the first photosensor to a supply voltage via the first transfer transistor, and (b) the first transfer transistor.
9. The imager of claim 5, wherein the imager is further configured to: determine a second value of light intensity to which the second photosensor will be exposed during a second frame time, and individually assign a second brightness value to the second photosensor based, at least in part, on the determined second value of light intensity.
10. The imager of claim 9, wherein the imager is further configured to: reset first charge accumulated on the first photosensor during the first frame time by activating, at a first timing associated with the assigned first brightness value, (a) a reset transistor selectively coupling the first and second photosensors to a supply voltage via the first and second transfer transistors, respectively, and (b) the first transfer transistor; and reset second charge accumulated on the second photo sensor during the second frame time by activating, at a second timing associated with the assigned second brightness value, the reset transistor and the second transfer transistor.
11. The imager of claim 9, wherein the second brightness value is different from the first brightness value.
12. A shared pixel, comprising: a first photosensor; a first transfer transistor selectively coupling the first photosensor to a floating diffusion region; a first photosensor reset transistor having a source coupled to a gate of the first transfer transistor, a drain configured to receive a first enable signal, and a gate configured to receive a first transfer signal; a second photosensor; a second transfer transistor selectively coupling the second photosensor to the floating diffusion region; a second photosensor reset transistor having a source coupled to a gate of the second transfer transistor, a drain configured to receive a second enable signal, and a gate configured to receive a second transfer signal; and a reset transistor selectively coupling the first and second photosensors to a supply voltage via the first and second transfer transistors, respectively, and having a gate configured to receive a reset signal.
13. A method of operating the shared pixel of claim 12, the method comprising: determining a first value of light intensity to which the first photosensor will be exposed during a first frame time; individually assigning a first brightness value to the first photosensor based, at least in part, on the determined first value of light intensity; determining a second value of light intensity to which the second photosensor will be exposed a second frame time; and individually assigning a second brightness value to the second photosensor based, at least in part, on the determined second value of light intensity.
14. The method of claim 13, further comprising resetting, during the first frame time, the first photosensor, wherein resetting the first photosensor includes: pulsing the reset signal applied to the gate of the reset transistor; pulsing the first transfer signal applied to the gate of the first photosensor reset transistor; and pulsing the first enable signal applied to the drain of the first photosensor reset transistor.
15. The method of claim 14, wherein resetting the first photosensor includes simultaneously pulsing the reset signal, the first transfer signal, and the first enable signal at a first time during the first frame time, wherein the first time corresponds to the first brightness value.
16. The method of claim 14, further comprising resetting, during the second frame time, the second photosensor, wherein resetting the second photosensor includes: pulsing the reset signal applied to the gate of the reset transistor; pulsing the second transfer signal applied to the gate of the second photosensor reset transistor; and pulsing the second enable signal applied to the drain of the second photosensor reset transistor.
17. The method of claim 16, wherein: resetting the first photosensor includes simultaneously pulsing the reset signal, the first transfer signal, and the first enable signal at a first time during the first frame time; the first time corresponds to the first brightness value; resetting the second photosensor includes simultaneously pulsing the reset signal, the second transfer signal, and the second enable signal at a second time during the second frame time; and the second time is different from the first time and corresponds to the second brightness value.
18. The method of claim 17, wherein the second frame time at least partially overlaps the first frame time such that the second time occurs during the first frame time.
19. The method of claim 17, further comprising: resetting the floating diffusion region during the first frame time and at a third time that is after the first time and different from the second time, wherein resetting the floating diffusion region includes pulsing the reset signal applied to the gate of the reset transistor; after resetting the floating diffusion region, reading a first reset voltage signal from the shared pixel, wherein the first reset voltage signal is based at least in part on a first voltage at the floating diffusion region; transferring, during the first frame time and at a fourth time after the first time and different from the second and third times, first charge from the first photosensor to the floating diffusion region, wherein transferring the first charge includes simultaneously pulsing the first enable signal and the first transfer signal; and after transferring the first charge, reading a first image signal from the shared pixel, wherein the first image signal is based at least in part on the first charge at the floating diffusion region.
20. The method of claim 19, further comprising: resetting the floating diffusion region during the second frame time and at a fifth time that is after the second time and different from the first and fourth times, wherein resetting the floating diffusion region during the second frame time includes pulsing the reset signal applied to the gate of the reset transistor; after resetting the floating diffusion region during the second frame time, reading a second reset voltage signal from the shared pixel, wherein the second reset voltage signal is based at least in part on a second voltage at the floating diffusion region; transferring, during the second frame time and at a sixth time after the second time and different from the first and third through fifth times, second charge from the second photosensor to the floating diffusion region, wherein transferring the second charge includes simultaneously pulsing the second enable signal and the second transfer signal; and after transferring the second charge, reading a second image signal from the shared pixel, wherein the second image signal is based at least in part on the second charge at the floating diffusion region.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
DETAILED DESCRIPTION
[0028] In the following detailed description, reference is made to the accompanying drawings, which are a part of the specification, and in which is shown by way of illustration various embodiments whereby the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to make and use the invention. It is to be understood that other embodiments may be utilized, and that structural, logical, and electrical changes, as well as changes in the materials used, may be made without departing from the spirit and scope of the present invention.
[0029] The term “pixel” refers to a picture element unit cell containing a photosensor and transistors for converting light radiation to an electrical signal. For purposes of illustration, a representative pixel is illustrated in the figures and description herein and, typically, fabrication of all pixels in an imager will proceed simultaneously in a similar fashion.
[0030] Although various embodiments are described herein with reference to the architecture of one pixel, it should be understood that this is representative of a plurality of pixels in an array of an imager. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the invention is defined only by the appended claims.
[0031] The disclosed embodiments increase the dynamic range of an imager using multiple pixel resets to reset the accumulated charge on the pixel photosensor. The accumulated charge in the photosensor is reset at varying times during a frame time depending on the light intensity that the pixel will be exposed to during the frame time. Pixels that will be exposed to high light intensity are reset later in the frame than pixels that will be exposed to lower light intensity. This reduces the value of the pixel image signal produced by pixels exposed to high light intensity relative to pixels exposed to low light intensity and increases the dynamic range as the pixel image signal exposed to high light intensity can be expanded during digital signal processing.
[0032] The light intensity that the pixels will be exposed to during the frame time is initially determined. This may be accomplished using the same latency approach as is used in automatic exposure techniques, which are known in the art. The light intensity that each pixel in the array will be exposed to may be mapped together with the automatic exposure technique using the image processor or a camera processor.
[0033] Preset thresholds of light intensity are used to designate a plurality of light intensity ranges. Each light intensity range is associated with a brightness value. The light intensity may be divided into two, three, four, or more ranges. Each pixel exposed to light intensity falling into a range is assigned the brightness value associated with that range and that value is associated with a time of application of a photosensor reset signal for the pixel.
[0034] In one embodiment, the brightness value for each pixel is stored to memory. In another embodiment, to save memory, pixels having the same brightness value may be grouped into zones of pixels and the dimensions of the zones may be stored to memory.
[0035]
[0036] In another embodiment, to save memory, brightness zones with the same brightness value but having complex shapes may be approximated by one or more shapes having easily defined areas, such as circles, rectangles, ovals, triangles, annular rings, and others.
[0037] Once a brightness value has been assigned to each pixel and the values have been stored to memory either directly or as zone coordinates, the array of pixels may be operated to capture an image.
[0038]
[0039] The reset control signal RESET is pulsed once during each frame time T.sub.F for each brightness value that may be assigned to each pixel. In this embodiment, four brightness values are used, and therefore, four reset control signals RESET.sub.1, RESET.sub.2, RESET.sub.3, RESET.sub.4 will be pulsed during the frame time T.sub.F.
[0040] The transfer control signal TX is pulsed and applied to the photosensor reset transistor 364 at the same time as the reset control signals RESET.sub.2, RESET.sub.3, RESET.sub.4 to turn on transfer gate 354 when an enable signal EN is present at the photosensor reset transistor 364, and thus reach the photosensor while the reset transistor 356 is on. The transfer control signal TX activates the photosensor reset transistor 364.
[0041] Depending on the brightness value assigned to the pixel 350, a dedicated column controller pulses an enable signal EN[2], EN[3], or EN[4] during the pulsing of one of the reset control signals RESET.sub.2, RESET.sub.3, RESET.sub.4 and transfer control signals TX. The enable signal EN[2], EN[3], or EN[4] activates the transfer transistor 354 to transfer any accumulated charge from the photosensor 352 to the floating diffusion region N, which is then under reset, and thus resets the photosensor 352 to restart charge integration. The enable signal EN[1], EN[2], EN[3], or EN[4] pulse should be shorter than the transfer control signal TX pulse to ensure that the transfer gate transistor 354 is completely off before the reset control signal RESET resets the floating diffusion region N, which discards the charge transferred from the photosensor 352. This ensures that the transfer transistor 354 is completely off during charge integration.
[0042] If the brightness value assigned to the pixel 350 is low, the pixel 350 will receive only the first enable signal EN[1] to reset and read out the charge on the photosensor 352 at the end of the frame time T.sub.F so that the photosensor 352 may accumulate charge over a first integration time T.sub.1, which is equal to the entire frame time TF. Regardless of the brightness value assigned, each pixel at least receives the first enable signal EN[1] during each frame time TF to reset and read out the charge on the photosensor 352. If the brightness value assigned to the pixel 350 is of a lower intermediate value, the pixel 350 will receive the second enable signal EN[2] to reset the photosensor near the middle of the frame time TF so that the photosensor 352 will accumulate charge over a shorter integration time T.sub.2. If the brightness value assigned to the pixel 350 is of a higher intermediate value, the pixel 350 will receive the third enable signal EN[3] to reset the photosensor towards the end of the frame time T.sub.F so that the photosensor 352 will accumulate charge over an even shorter integration time T.sub.2. If the brightness value assigned to the pixel 350 is high, the pixel 350 will receive the fourth enable signal EN[4] to reset the photosensor 352 near the end of the frame time T.sub.F, so that the photosensor 352 will accumulate charge over the shortest integration time T.sub.4.
[0043] Pixel reset occurs at the end of the frame time TF for a given row. The reset control signal RESET is pulsed at RESET.sub.1 to the gate of the reset transistor 356 to reset the floating diffusion region N. The pixel reset signal V.sub.rst is sampled during RESET.sub.1 by applying the charge on the floating diffusion region to the gate of the source follower transistor 358 to generate the pixel reset signal V.sub.rst. A row select signal ROW is applied to the row select transistor 360 to output the pixel reset signal V.sub.rst. The pixel reset signal V.sub.rst is then stored by column readout circuitry (not shown) connected to a column line, which is connected to the pixel 350.
[0044] After this, the transfer control signal TX and the enable signal EN[1] are pulsed to transfer any charge accumulated from the photosensor 352 to the floating diffusion region N. The charge on the floating diffusion region N is applied to the gate of the source follower transistor 358 to generate the pixel image signal V.sub.sig. The row select signal ROW is applied to the row select transistor 360 to output the pixel image signal V.sub.sig. The pixel image signal V.sub.sig is stored in column circuits (not shown) connected to the column line, which is connected to pixel 350. The next integration period for pixels in a given row starts when EN[1] is off.
[0045] The pixel reset signal V.sub.rst and the pixel image signal V.sub.sig are then subtracted to produce a differential signal and the differential signal is digitized and sent to an image processor. The gain of the digital signal is then adjusted by the image processor using a value that correlates to the brightness value to represent the actual light intensity to which the pixel 350 was exposed.
[0046] The floating diffusion region N may therefore store similar amounts of charge and cause the source follower transistor 358 to produce pixel image signals V.sub.sig with similar values regardless of whether the pixel is exposed to low light, intermediate light, or bright light. Also, resetting the charge at varying times may prevent the floating diffusion region N from becoming saturated and may thus prevent blooming.
[0047] Each of the four zones, 1, 2, 3, and 4, shown in
SNR.sub.dip=10*log(T.sub.1/T.sub.2)
[0048]
[0049]
[0050]
[0051] The pixel 550 is assigned a brightness value and the brightness value is stored to memory as described above. In the illustrated embodiment, the pixel 550 is assigned one of four brightness values.
[0052] A photosensor reset control signal PRST is pulsed four times (once for each of four brightness values that may be assigned) and applied to the gate of the photosensor reset transistor 564.
[0053] A dedicated column controller pulses a first enable signal EN[1] during the first photosensor reset control signal PRST.sub.1 pulse and, depending on the brightness value assigned to the pixel 550, may pulse another enable signal EN[2], EN[3], or EN[4] during the pulsing of one of the second PRST.sub.2, third PRST.sub.3, or fourth PRST4 photosensor reset control signal PRST pulses, respectively. The enable signal EN[1], EN[3], or EN[4] and read signal PRST activate the anti-blooming transistor 554 to reset the charge on the photosensor 552. The enable signal EN[1], EN[2], or EN[4] pulse should be shorter than the photosensor reset control signal PRST pulse to ensure that the anti-blooming transistor 554 is completely off before charge integration begins.
[0054] Similarly to the embodiment described above, the pixel 550 will receive the first enable signal EN[1], and based on the assigned brightness value, may receive a second enable signal EN[2], third enable signal EN[3], or fourth enable signal to reset the photosensor 552 at the beginning, near the middle, towards the end, or near the end, respectively, of the frame time T.sub.F.
[0055] At the end of the frame time T.sub.F, the transfer control signal TX is pulsed and applied to the transfer transistor 562 to transfer any charge accumulated during the integration period from the photosensor 552 to the floating diffusion region N. The charge on the floating diffusion region N is applied to the gate of the source follower transistor 558 to generate the pixel image signal V.sub.sig. The row select signal ROW is applied to the row select transistor 560 to output the pixel image signal V.sub.sig. The pixel image signal V.sub.sig is stored in column circuitry (not shown) connected to a column line, which is connected to the pixel 350.
[0056] The floating diffusion region reset control signal NRST is pulsed and applied to the gate of the reset transistor 556 to reset the floating diffusion region N at the row readout time, which happens once in the frame time T.sub.F. The charge on the floating diffusion region N is applied to the gate of the source follower transistor 558 to generate the pixel reset signal V.sub.rst. A row select signal ROW is applied to the row select transistor 560 to output the pixel reset signal V.sub.rst. The pixel reset signal V.sub.rst is stored in column circuitry (not shown) connected to a column line, which is connected to the pixel 550.
[0057] The pixel reset signal V.sub.rst and the pixel image signal V.sub.sig are then subtracted to produce a differential signal and the differential signal is digitized and sent to an image processor. The gain of the digital signal is then adjusted by the image processor using a value that correlates to the brightness value to represent the actual light intensity to which the pixel 550 was exposed.
[0058] It is desired that the dimensions of the pixel zones be rectangular when a global shutter sensor pixel is used because a global shutter sensor window is rectangular.
[0059] A rolling shutter sensor with shared pixel may also be constructed in accordance with an embodiment.
[0060] The reset control signal RESET is pulsed once for each of the two frame times T.sub.F1 and T.sub.F2 for each brightness value that may be assigned to each pixel. In this embodiment, four brightness values are used, and therefore, eight reset control signals RESET.sub.1, RESET.sub.2, RESET.sub.3, RESET.sub.4, RESET.sub.5, RESET.sub.6, RESET.sub.7, RESET.sub.8 will be pulsed during the frame times T.sub.F1 and T.sub.F2.
[0061] The first transfer control signal TX1 is pulsed and applied to the first photosensor reset transistor 764 at the same time as the reset control signals RESET.sub.3, RESET.sub.5, RESET.sub.7 to turn on the first transfer gate 754 when an enable signal EN is present at the photosensor reset transistor 764, and thus reach the first photosensor 752 while the reset transistor 756 is on. The first transfer control signal TX1 activates the first photosensor reset transistor 764.
[0062] Similarly, the second transfer control signal TX2 is pulsed and applied to the second photosensor reset transistor 765 at the same time as the reset control signals RESET.sub.4, RESET.sub.6, RESET.sub.8 to turn on the second transfer gate 755 when an enable signal EN is present at the photosensor reset transistor 764, and thus reach the second photosensor 753 while the reset transistor 756 is on. The second transfer control signal TX2 activates the second photosensor reset transistor 765.
[0063] A brightness value is assigned to the first photodiode 752 and the second photodiode 753 of the pixel 750. Depending on the brightness values assigned to the first photodiode 752, a dedicated column controller pulses an enable signal EN[3], EN[5], or EN[7] during the pulsing of one of the reset control signals RESET.sub.3, RESET.sub.5, RESET.sub.7 and first transfer control signal TX1. The enable signal EN[3], EN[5], or EN[7] activates the first transfer transistor 754 to transfer any accumulated charge from the first photosensor 752 to the floating diffusion region N, which is then under reset, and thus resets the first photosensor 752 to restart charge integration.
[0064] The same process is conducted for the second photodiode 753, which may be assigned a brightness value different that the one assigned to the first photodiode 752. The dedicated column controller pulses an enable signal EN[4], EN[6], or EN[8] during the pulsing of one of the reset control signals RESET.sub.4, RESET.sub.6, RESET.sub.8 and second transfer control signal TX2 to reset the second photosensor 753 to restart charge integration.
[0065] Similarly to the embodiments described above, the first photosensor reset transistor 764 will receive the first enable signal EN[1], and based on the assigned brightness value, may receive a third enable signal EN[3], fifth enable signal EN[5], or seventh enable signal EN[7], to reset the first photosensor 752 at the beginning, near the middle, towards the end, or near the end, respectively, of the frame time T.sub.F1. The second photosensor reset transistor 765 will receive the second enable signal EN[2], and based on the assigned brightness value, may receive a fourth enable signal EN[4], sixth enable signal EN[6], or eighth enable signal EN[8], to reset the second photosensor 753 at the beginning, near the middle, towards the end, or near the end, respectively, of the frame time T.sub.F2.
[0066] Pixel reset occurs at the end of the frame time T.sub.F1 for a given row. The reset control signal RESET is pulsed at RESET.sub.1 to the gate of the reset transistor 756 to reset the floating diffusion region N. The first pixel reset signal V.sub.rst1 is sampled during RESET] by applying the charge on the floating diffusion region to the gate of the source follower transistor 758 to generate the first pixel reset signal V.sub.rst1. A row select signal ROW is applied to the row select transistor 360 to output the first pixel reset signal V.sub.rst1. The first pixel reset signal V.sub.rst1 is then stored by column readout circuitry (not shown) connected to a column line, which is connected to the pixel 750.
[0067] After this, the first transfer control signal TX1 and the enable signal EN[1] are pulsed to transfer any charge accumulated from the first photosensor 752 to the floating diffusion region N. The charge on the floating diffusion region N is applied to the gate of the source follower transistor 358 to generate the first pixel image signal V.sub.sig1. The row select signal ROW is applied to the row select transistor 760 to output the first pixel image signal V.sub.sig1. The first pixel image signal V.sub.sig1 is stored in column circuits (not shown) connected to the column line, which is connected to pixel 750. The next integration period TF1 for pixels in a given row starts when TX1 is off.
[0068] The first pixel reset signal V.sub.rst1 and the first pixel image signal V.sub.sig1 are then subtracted to produce a differential signal and the differential signal is digitized and sent to an image processor. The gain of the digital signal is then adjusted by the image processor using a value that correlates to the brightness value to represent the actual light intensity to which the first photosensor 752 was exposed.
[0069] A similar process is followed to output the second pixel reset signal V.sub.rst2 during the second reset control signal RESET2, and to output the second pixel image signal V.sub.sig2 during the second transfer control signal TX2 and the second enable pulse EN[2] and further process the signals.
[0070]
[0071] System 900, for example a digital still or video camera system, generally comprises a central processing unit (CPU) 902, such as a microprocessor for conducting camera functions, that communicates with one or more input/output (I/O) devices 906 over a bus 904. Imager 400 also communicates with the CPU 902 over the bus 904. The processor system 900 also includes random access memory (RAM) 910, and can include removable memory 915, such as flash memory, which also communicate with the CPU 902 over the bus 904. The imager 800 may be combined with the CPU processor with or without memory storage on a single integrated circuit or on a different chip than the CPU processor.
[0072] The processes and devices described above illustrate preferred methods and typical devices of many that could be used and produced. However, it is not intended that the present invention be strictly limited to the above-described and illustrated embodiments. Any modification, though presently unforeseeable, of the present invention that comes within the spirit and scope of the following claims should be considered part of the present invention.
[0073] What is claimed as new and desired to be protected by Letters Patent of the United States is: