Variable resolution pixel
09826214 · 2017-11-21
Assignee
Inventors
Cpc classification
G01S7/4915
PHYSICS
H01L27/14609
ELECTRICITY
H01L27/14812
ELECTRICITY
G01S17/894
PHYSICS
H04N25/771
ELECTRICITY
G01S17/36
PHYSICS
H04N23/667
ELECTRICITY
International classification
G01S7/481
PHYSICS
G01S17/36
PHYSICS
Abstract
A photosensor having a plurality of light sensitive pixels each of which comprises a light sensitive region and a plurality of storage regions for accumulating photocharge generated in the light sensitive region, a transfer gate for each storage region that is selectively electrifiable to transfer photocharge from the light sensitive region to the storage region, and an array of microlenses that for each storage region directs a different portion of light incident on the pixel to a region of the light sensitive region closer to the storage region than to other storage regions.
Claims
1. A photosensor having a plurality of light sensitive pixels having variable spatial resolution formed on a substrate, each pixel comprising: a light sensitive region in which incident light generates photocharge carriers; a plurality of storage regions for accumulating photocharge carriers generated in the light sensitive region; a transfer gate associated with each storage region of the plurality of storage regions that is electrifiable to cause photocharge in different size portions of the light sensitive region to drift to the storage region and vary thereby the spatial resolution of the pixel; and an array of microlenses comprising at least one microlens for each storage region of the plurality of storage regions that directs light incident on the at least one microlens to a region of the light sensitive region that is closer to the storage region than to other storage regions of the plurality of storage regions.
2. The photosensor according to claim 1 wherein the array of microlenses comprises a single microlens for each storage region.
3. The photosensor according to claim 1 wherein the microlens array exhibits rotational symmetry.
4. The photosensor according to claim 3 wherein the rotational symmetry has an order equal to a number of the plurality of storage regions.
5. The photosensor according to claim 1 wherein the number of the plurality of storage regions is equal to two.
6. The photosensor according to claim 1 wherein the number of the plurality of storage regions is equal to or greater than four.
7. The photosensor according to claim 1 and comprising a controller that electrifies a transfer gate associated with a storage region to cause photocharge generated in the light sensitive region to drift to the storage region.
8. The photosensor according to claim 7 wherein the controller electrifies a transfer gate of only one storage region with a transfer voltage to cause photocharge generated at substantially any location in the light sensitive region to drift to the one storage region.
9. The photosensor according to claim 7 wherein the controller simultaneously electrifies the transfer gate associated with each storage region with a same transfer voltage to cause photocharge generated at locations in the light sensitive region closest to a storage region to drift to the storage region.
10. The photosensor according to claim 7 wherein the controller electrifies the substrate to shutter the photosensor ON and OFF.
11. The photosensor according to claim 1 wherein the light sensitive region comprises a photodiode.
12. A time of flight (TOF) three dimensional (3D) camera that images a scene to determine distances to features in the scene, the TOF-3D camera comprising: a light source that transmits a train of light pulses to illuminate the scene; a photosensor according to claim 1 that receives light reflected by the features from the transmitted light pulses; and a controller that shutters the photosensor ON and OFF following each light pulse to accumulate photocharge generated in the photodiodes of pixels in the photosensor by light from the light pulses reflected by the features during an exposure period chosen from a plurality of different exposure periods; wherein the controller electrifies transfer gates of different storage regions to accumulate photocharge generated during different exposure periods in different storage regions, determines amounts of accumulated photocharge in different storage regions from a same frame of the photosensor and uses the amounts to determine distances to features in the scene.
13. The TOF-3D camera according to claim 12 wherein the different exposure periods comprise exposure periods that begin at different times following a time at which a light pulse in the train of light pulses is transmitted.
14. The TOF-3D camera according to claim 12 wherein the different exposure periods comprise exposure periods having different durations.
15. The TOF-3D camera according to claim 12 wherein a number of the plurality of different exposure periods is equal to or greater than two.
16. The TOF-3D camera according to claim 15 wherein a number of the plurality of storage regions is equal to or greater than the number of the plurality of different exposure periods.
17. A camera that images a scene to acquire a picture of the scene, the camera comprising: a photosensor according to claim 8 that receives light from the scene; a light meter that determines an intensity of light reaching the camera from the scene; and a controller that controls electrification of transfer gates responsive to intensity of light measure by the light meter.
18. The camera according to claim 17 wherein the controller controls electrification of the transfer gates responsive to a threshold light intensity.
19. The camera according to claim 18 wherein if the measured intensity is less than the threshold the controller electrifies a transfer gate of only one storage region with a transfer voltage.
20. The camera according to claim 19 wherein if the measured intensity is greater than the threshold the controller simultaneously electrifies the transfer gate associated with each storage region with a same transfer voltage.
Description
BRIEF DESCRIPTION OF FIGURES
(1) Non-limiting examples of embodiments of the invention are described below with reference to figures attached hereto that are listed following this paragraph. Identical features that appear in more than one figure are generally labeled with a same numeral in all the figures in which they appear. A label labeling an icon or other graphical indicia representing a given feature of an embodiment of the invention in a figure may be used to reference the given feature. Dimensions of components and features shown in the figures are chosen for convenience and clarity of presentation and are not necessarily shown to scale.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
DETAILED DESCRIPTION
(9)
(10) Each multimode pixel 30 optionally comprises a photodiode 32 and four photoelectron storage regions 41, 42, 43, and 44. A transfer gate 50 overlays each storage region 41, 42, 43, and 44, and optionally a small region of photodiode 32. Components of pixel 30 are optionally formed on a heavily n-doped silicon substrate 31 (not shown) on which an epitaxial p-doped layer (not shown) is formed. Photodiode 32 may comprise a depletion zone generated at a junction of an n-doped region formed in the p-doped epitaxial layer. Storage regions 41, 42, 43, and 44 may be portions of a buried n-doped channel. Transfer gates 50 overlying storage regions 41, 42, 43, and 44 are formed using any of various suitable conducting materials such as a metal, or polysilicon. Each pixel 30 may comprise readout circuitry 34 configured to provide a measure of an amount of photocharge accumulated in each storage region 41, 42, 43, and 44 independent of an amount of photocharge accumulated in other of the storage regions in pixel 30. Whereas photodiode 32 is indicated as rectangular a photodiode in a multimode pixel in accordance with an embodiment of the invention may have a shape other than rectangular. By way of example, the photodiode may have a polygonal shape other than rectangular, or be circular or irregular.
(11) An array of microlenses 60 overlays portions of photodiode 32. Optionally, the array of microlenses comprises a microlens 60 for each given storage region 41, 42, 43, and 44 that directs light incident on the microlens to a region of photodiode 32 closer to the given storage region than to other storage regions. In
(12) In an embodiment of the invention, a controller (not shown in
(13) V.sub.OFF is a voltage more positive than a transfer voltage applied by the controller to a transfer gate 50, and when applied to substrate 31, photoelectrons in multimode pixels 30 drain to substrate 31, are not accumulated in any of storage regions 41, . . . , 44, and are discarded. V.sub.ON is a voltage, optionally a common, ground voltage, which is less positive than a transfer voltage “V.sub.G+” applied by the controller to a transfer gate 50. When the controller applies V.sub.ON to substrate 31 and a transfer voltage V.sub.G+ to a transfer gate 50 associated with a given storage region 41, . . . , 44, of a pixel 30, photoelectrons generated in photodiode 32 do not drain to substrate 31. The transfer voltage V.sub.G+ generates an electric field in photodiode 32 that applies force to photoelectrons in the photodiode which causes the photoelectrons to drift toward and be accumulated in the storage region associated with the transfer gate. By maintaining substrate 31 at voltage V.sub.ON and selectively applying transfer voltages V.sub.G+ to gates 50, the controller may operate multimode photosensor 20 to provide different sequences and types of exposure periods for a camera comprising the multimode photosensor, and provide the camera with different spatial resolutions for acquiring images of a scene.
(14) By way of example,
(15) For the configuration of storage regions 41, . . . , 44, transfer gates 50, and simultaneous electrification of transfer gates 50 by a same transfer voltage V.sub.G+ shown in
(16) Photoelectrons accumulated by each storage region 41, 42, 43, 44 from its associated collection region are generated by light directed to the collection region by microlens 60 overlying the collection region and light incident on the peripheral regions of the collection region. However, as noted above and indicated by the configuration of microlenses 60 shown in
(17)
(18) It is noted that operating in the low spatial resolution mode schematically shown in
(19)
(20) By way of a numerical example, a multimode photosensor 20 may comprise multimode pixels 30 characterized by a pitch less than or equal to about 15 μm (micrometers). Each multimode pixel 30 may comprise a photodiode 32 having a maximum lateral dimension equal to about 8 μm. For pixels 30 having pitches of about 10 μm or about 7 μm, photodiode 32 may have a maximum lateral dimension of about 6 μm or 4.5 μm respectively. A fill factor of a multimode pixel in accordance with an embodiment of the invention, may be equal to or greater than about 70%.
(21)
(22) TOF-3D camera 120, which is represented very schematically, comprises a lens system, represented by a lens 121 that images scene 130 on multimode photosensor 20. Optionally the TOF-3D camera comprises a light source 126, such as for example, a laser or a LED, or an array of lasers and/or LEDs, controllable to illuminate scene 130 with pulses of optionally IR (infrared) light. A controller 124 controls pulsing of light source 126 and imaging of scene 130 by multimode photosensor 20 with light reflected by features in the scene from light pulses emitted by light source 126. Controller 124 optionally applies voltages V.sub.ON and V.sub.OFF to shutter the multimode photosensor ON and OFF respectively. The controller may selectively apply transfer voltages V.sub.G+ to transfer gates 50 associated with different photocharge storage regions 41, 42, 43, and 44 to image scene 130 on multimode photosensor 20 during different exposure periods. The different exposure periods are timed relative to times at which light source 126 transmits light pulses to illuminate scene 130, to acquire data for determining distances to features in scene 130 and acquire a range image of the scene.
(23) In an embodiment of the invention, to acquire the data and thereby distances to features in scene 130, controller 124 turns ON multimode photosensor 20 and controls light source 126 to illuminate scene 130 with a train of light pulses schematically represented in
(24) Following a predetermined delay after transmission of each transmitted light pulse 141, controller 124 applies a configuration of voltages to multimode photosensor 20 to determine an exposure period of multimode photosensor 20 during which multimode photosensor 20 registers light in light pulses reflected from the transmitted light pulse by features in scene 130. In an embodiment, controller 124 applies a transfer voltage V.sub.G+ to a transfer gate 50 associated with at least one storage region 41, 42, 43, or 44 and applies voltages V.sub.ON and V.sub.OFF to substrate 31 (
(25) An amount of light that a given pixel 30 registers during an exposure period from a reflected light pulse reflected from transmitted light pulse 141 by a feature in scene 130 imaged on the given pixel, is substantially proportional to a convolution of the exposure period and the reflected light pulse. The convolution is a function of the predetermined delay between a time of transmission of transmitted light pulse 141 and the exposure period, a distance from TOF-3D camera 120 of the imaged feature, and the shapes of the reflected light pulse and exposure period.
(26) In an embodiment of the invention, controller 124 controls multimode photosensor 20 to register light in reflected light pulses reflected by features of scene 130 during three different type exposure periods. Graphs 181, 182, and 183 in
(27) Graph 181 shown in
(28) Following a delay time T.sub.1, controller 124 applies voltage V.sub.ON (graph line 193) to substrate 31 of multimode photosensor 20 to register light during a first component exposure period of the dual exposure period and then again at a delay time T.sub.4 during a second component exposure period of the dual exposure period. Optionally, the component exposure periods have a duration equal to that of transmitted light pulse 141, and by way of example, T.sub.4−T.sub.1 may be equal to or greater than about 6 ns and less than or equal to about 30 ns. During each of the component exposure periods for which controller 124 applies V.sub.ON to substrate 31, photoelectrons generated anywhere in photodiode 32 of a pixel 30 by light in a light pulse reflected from transmitted light pulse 141 drift to, and are accumulated in, storage region 41 of the pixel. An amount of light that storage region 41 of a given pixel 30 accumulates during the dual exposure period from a light pulse reflected from transmitted light pulse 131 by a feature in scene 130 imaged on the given pixel 30, is substantially proportional to a convolution of the dual exposure period and the reflected light pulse. In an embodiment of the invention controller 124 controls multimode photosensor 20 to accumulate photoelectrons during a dual exposure period for each of a plurality of light pulses 141 in pulse train 140.
(29) Graph 182 in
(30) Graph 183 in
(31) In an embodiment of the invention controller 124 controls multimode photosensor 20 to image scene 130 during an exposure period when the scene is not illuminated with light pulses to determine an amount of background light that reaches TOF-3D camera 120. Optionally controller 124 operates multimode photosensor 20 as schematically illustrated in graph 184 in
(32) Following accumulation of photoelectrons in storage regions 41, 42, 43, and 44, controller 124 acquires a frame of multimode photosensor 20 to acquire voltages that provide measures of amounts of photoelectrons accumulated in storage regions of 41, 42, 43, and 44 of each multimode pixel 30. Controller 124 corrects the measured amounts of photoelectrons accumulated in storage regions 41, 42, and 43 of each pixel 30 for photoelectrons accumulated in the storage regions due to background light responsive to the measured amount of photoelectrons accumulated in storage region 44 of the pixel. The corrected measures for storage regions 41, 42, and 43 of pixel 30 are proportional to the convolutions of light pulses reflected by a feature in scene 130 imaged on the pixel from transmitted light pulses 141 during the dual exposure period, and the second and third type exposure periods respectively. Controller 124 uses the measures of the convolutions to determine a distance to the feature from TOF-3D camera 120.
(33) For example, the corrected measures for storage regions 41, 42, and 43 for a pixel 30 on which feature A of object 132 (
(34) By way of example, let the convolutions determined for photocharge storage regions 41, 42 and 43 of a given pixel 30 imaging a feature in scene 130 be represented by C41, C42, and C43 respectively. Values of C41, C42, and C43 are shown in a graph 185 in
(35) In an embodiment of the invention a photosensor similar to multimode photosensor 20 may be comprised in a camera that operates to acquire pictures of a scene, in accordance with an embodiment of the invention. By way of example,
(36) In an embodiment of the invention a controller (not shown) in smartphone 200 controls multimode photosensor 20 to operate in a high spatial resolution mode or a low spatial resolution mode responsive to a measure of intensity of light collected by smartphone camera 202 from scene 300 and an intensity threshold. The intensity of the collected light may be determined by any suitable light meter and/or application (not shown) comprised in smartphone 200. If the intensity of light is greater than the intensity threshold, the controller may control multimode photosensor 20 to operate in a high spatial resolution mode to image scene 300. If the intensity of collected light is less than the intensity threshold, the controller may control multimode photosensor 20 to operate in the low spatial resolution mode to image scene 300.
(37) There is therefore provided in accordance with an embodiment of the invention a multimode photosensor having a plurality of light sensitive pixels formed on a substrate, each pixel comprising: a light sensitive region in which incident light generates photocharge carriers; a plurality of storage regions for accumulating photocharge carriers generated in the light sensitive region; a transfer gate associated with each storage region of the plurality of storage regions that is electrifiable to cause photocharge in the light sensitive region to drift to the storage region; and an array of microlenses comprising at least one microlens for each storage region of the plurality of storage regions that directs light incident on the at least one microlens to a region of the light sensitive region that is closer to the storage region than to other storage regions of the plurality of storage regions.
(38) Optionally, the array of microlenses comprises a single microlens for each storage region. Alternatively or additionally the microlens array may exhibit rotational symmetry. Optionally, the rotational symmetry has an order equal to a number of the plurality of storage regions. In an embodiment of the invention, the number of the plurality of storage regions is equal to two. In an embodiment of the invention the number of the plurality of storage regions is equal to or greater than four.
(39) In an embodiment of the invention the multimode photosensor comprises a controller that electrifies a transfer gate associated with a storage region to cause photocharge generated in the light sensitive region to drift to the storage region. Optionally, the controller electrifies a transfer gate of only one storage region with a transfer voltage to cause photocharge generated at substantially any location in the light sensitive region to drift to the one storage region. Alternatively or additionally the controller simultaneously electrifies the transfer gate associated with each storage region with a same transfer voltage to cause photocharge generated at locations in the light sensitive region closest to a storage region to drift to the storage region.
(40) In an embodiment of the invention, the controller electrifies the substrate to shutter the multimode photosensor ON and OFF.
(41) In an embodiment of the invention the photosensitive region comprises a photodiode. In an embodiment the photosensitive region comprises a photogate.
(42) There is further provided in accordance with an embodiment of the invention, a time of flight (TOF) three dimensional (3D) camera that images a scene to determine distances to features in the scene, the TOF-3D camera comprising: a light source that transmits a train of light pulses to illuminate the scene; a multimode photosensor in accordance with an embodiment of the invention that receives light reflected by the features from the transmitted light pulses; and a controller that shutters the photosensor ON and OFF following each light pulse to accumulate photocharge generated in the photodiodes of pixels in the multimode photosensor by light from the light pulses reflected by the features during an exposure period chosen from a plurality of different exposure periods; wherein the controller electrifies transfer gates of different storage regions to accumulate photocharge generated during different exposure periods in different storage regions, determines amounts of accumulated photocharge in different storage regions from a same frame of the multimode photosensor and uses the amounts to determine distances to features in the scene.
(43) Optionally, the different exposure periods comprise exposure periods that begin at different times following a time at which a light pulse in the train of light pulses is transmitted. Additionally or alternatively the different exposure periods may comprise exposure periods having different durations. The different exposure periods may comprise exposure periods having different shape.
(44) In an embodiment of the invention, a number of the plurality of different exposure periods is equal to or greater than two. Optionally, a number of the plurality of storage regions is equal to or greater than the number of the plurality of different exposure periods.
(45) There is further provided in accordance with an embodiment of the invention, a camera that images a scene to acquire a picture of the scene, the camera comprising a multimode photosensor in accordance with an embodiment of the invention that receives light from the scene; a light meter that determines an intensity of light reaching the camera from the scene; and a controller that controls electrification of transfer gates responsive to intensity of light measure by the light meter. Optionally, the controller controls electrification of the transfer gates responsive to a threshold light intensity. If the measured intensity is less than the threshold the controller may electrify a transfer gate of only one storage region with a transfer voltage. If the measured intensity is greater than the threshold the controller may simultaneously electrify the transfer gate associated with each storage region with a same transfer voltage.
(46) In the description and claims of the present application, each of the verbs, “comprise” “include” and “have”, and conjugates thereof, are used to indicate that the object or objects of the verb are not necessarily a complete listing of components, elements or parts of the subject or subjects of the verb.
(47) Descriptions of embodiments of the invention in the present application are provided by way of example and are not intended to limit the scope of the invention. The described embodiments comprise different features, not all of which are required in all embodiments of the invention. Some embodiments utilize only some of the features or possible combinations of the features. Variations of embodiments of the invention that are described, and embodiments of the invention comprising different combinations of features noted in the described embodiments.