Imaging apparatus and image sensor including the same
11037976 · 2021-06-15
Assignee
Inventors
Cpc classification
H04N23/57
ELECTRICITY
G03B35/10
PHYSICS
International classification
Abstract
An image sensor includes a substrate, thin lenses disposed on a first surface of the substrate and configured to concentrate lights incident on the first surface, and light-sensing cells disposed on a second surface of the substrate, the second surface facing the first surface, and the light-sensing cells being configured to sense lights passing through the thin lenses, and generate electrical signals based on the sensed lights. A first thin lens and second thin lens of the thin lenses are configured to concentrate a first light and a second light, respectively, of the incident lights onto the light-sensing cells, the first light having a different wavelength than the second light.
Claims
1. An image sensor comprising: a substrate; thin lenses disposed on a first surface of the substrate and configured to concentrate lights incident on the first surface, the thin lenses comprising a first thin lens and a second thin lens; and light-sensing cells disposed on a second surface of the substrate, the second surface facing the first surface, and the light-sensing cells being configured to sense lights passing through the thin lenses and generate electrical signals based on the sensed lights, the light-sensing cells including a first light sensing cell and a second light sensing cell adjacent to the first light sensing cell, wherein each of the thin lenses comprises scatterers, the scatterers including material having a refractive index higher than a refractive index of the substrate, wherein the first thin lens comprises first scatterers, shapes and arrangement of the first scatterers being configured to concentrate a first light of first wavelength among incident light on the first light sensing cell, wherein the second thin lens comprises second scatterers, shapes and arrangement of the second scatterers being configured to concentrate a second light of second wavelength among incident light on the second light sensing cell, and the second wavelength being different to the first wavelength, and wherein the shapes and arrangement of the second scatterers being different from the shapes and arrangements of the first scatterers.
2. The image sensor of claim 1, wherein shapes and arrangement of the first scatterers are further configured to concentrate the first light of first wavelength with a first focal length, and wherein shapes and arrangement of the second scatterers are further configured to concentrate the second light with a second focal length different from the first focal length.
3. The image sensor of claim 2, wherein the thin lenses further comprises: third thin lens comprising third scatterers disposed on the first surface of the substrate, shapes and arrangement of the third scatterers being configured to concentrate the first light with the second focal length; and a fourth thin lens comprising fourth scatterers disposed on the first surface of the substrate, shapes and arrangement of the fourth scatters being configured to concentrate the second light of second wavelength with the first focal length, among lights incident on the first surface.
4. The image sensor of claim 3, wherein the substrate includes plurality of sub-substrate and the first thin lens, the second thin lens, the third thin lens and the fourth thin lens are respectively disposed on a first surface of the each of the sub-substrates, and wherein the light-sensing cells are respectively disposed on a second surface of each of the sub-substrates.
5. The image sensor of claim 3, wherein each of the first scatterers, second scatterers, third scatterers and the fourth scatterers includes material having a refractive index higher than a refractive index of the substrate.
6. The image sensor of claim 3, wherein each of the first scatterers, second scatterers, third scatterers and the fourth scatterers has a pillar structure.
7. The image sensor of claim 3, wherein an interval distance between two adjacent first scatterers and an interval distance between two adjacent third scatterers is less than the first wavelength.
8. The image sensor of claim 7, wherein a height of the first scatterers and the third scatterers is less than the first wavelength.
9. The image sensor of claim 3, wherein an interval distance between two adjacent second scatterers and an interval distance between two adjacent fourth scatterers is less than the second wavelength.
10. The image sensor of claim 9, wherein a height of the second scatterers and the fourth scatterers is less than the second wavelength.
11. The image sensor of claim 3, wherein the first scatterers, the second scatterers, the third scatterers and the fourth scatterers comprise at least one from among silicon, gallium phosphide, SiC, SiN, and TiO2.
12. The image sensor of claim 3, wherein the first scatterers and the third scatterers are different in at least one of shape or arrangement thereof.
13. The image sensor of claim 3, wherein the first scatterers and the fourth scatterers are different in at least one of shape or arrangement thereof.
14. The image sensor of claim 3, wherein the second scatterers and the fourth scatterers are different in at least one of shape or arrangement thereof.
15. The image sensor of claim 3, wherein the second scatterers and the third scatterers are different in at least one of shape or arrangement thereof.
16. The image sensor of claim 1 further comprising light filters, each of the light filters being configured to filter respectively the first light of the first wavelength and the second light of the second wavelength, among incident lights.
17. The image sensor of claim 1 further comprising an image synthesizer configured to generate a multi-color image by synthesizing images of different colors, wherein the first wavelength and the second wavelength corresponds to different color from each other.
18. The image sensor of claim 1 further comprising a depth map calculator configured to calculate a defocusing degree of an image that is produced on each of the light-sensing cells, and calculate depth map information about an image that is produced by the incident lights, based on the defocusing degree.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and/or other aspects will be more apparent by describing exemplary embodiments with reference to the accompanying drawings.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
DETAILED DESCRIPTION
(15) Exemplary embodiments are described in greater detail below with reference to the accompanying drawings.
(16) In the following description, like drawing reference numerals are used for like elements, even in different drawings. The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the exemplary embodiments. However, it is apparent that the exemplary embodiments can be practiced without those specifically defined matters. Also, well-known functions or constructions may not be described in detail because they would obscure the description with unnecessary detail.
(17) As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. Expressions such as “at least one of,” when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list.
(18) In the drawings, the thicknesses of layers and regions are exaggerated for clarity. It will also be understood that when a layer is referred to as being “on” another layer or substrate, it can be directly on the other layer or substrate, or intervening layers may also be present.
(19) The terms used in this specification are those general terms currently widely used in the art in consideration of functions in regard to the inventive concept, but the terms may vary according to the intention of those of ordinary skill in the art, precedents, or new technology in the art. Also, specified terms may be selected by the applicant, and in this case, the detailed meaning thereof will be described in the detailed description. Thus, the terms used in the specification may be understood not as simple names but based on the meaning of the terms and the overall description.
(20) Throughout the specification, it will be understood that when a component is connected to another component, the component may be directly connected as well as electrically connected with another element therebetween.
(21) It will be further understood that the terms “comprises” and/or “comprising” used herein specify the presence of stated features or components, but do not preclude the presence or addition of one or more other features or components. In addition, the terms such as “unit,” “-er (-or),” and “module” described in the specification refer to an element for performing at least one function or operation, and may be implemented in hardware, software, or the combination of hardware and software.
(22) Additionally, it will be understood that although the terms “first,” “second,” etc. may be used herein to describe various components, these components may not be limited by these terms. These components are only used to distinguish one component from another.
(23) Descriptions of embodiments below may not be understood as limiting the scope of right, but those easily inferred by one of ordinary skill in the art may be understood as belonging to the scope or right of the exemplary embodiments. Hereinafter, embodiments will be described in detail by referring to the accompanying drawings for the purpose of describing examples only.
(24)
(25) Referring to
(26) The substrate 110 may have a plate-like shape. The first surface S1 and the second surface S2 of the substrate 110 may be substantially horizontally parallel to each other. However, the first surface S1 and the second surface S2 may not be completely horizontally parallel to each other and may be obliquely parallel to each other. The substrate 110 and the light-sensing cells 130a, 130b, and 130c may be spaced apart from one another with an air layer therebetween. The substrate 110 may include a transparent material. As used herein, the term “transparent material” denotes a material having a high light transmittance. For example, the substrate 110 may include at least one from among Si.sub.3N.sub.4, SiO.sub.2, and a polymer such as PMMA or PDMS. Once a path of incident light changes at the light-sensing cells 130a, 130b, and 130c, the incident light may pass through the substrate 110 and become incident on a light sensing layer 130.
(27) Each of the light-sensing cells 130a, 130b, and 130c may include scatterers from among a plurality of scatterers 122a, 122b, and 122c. The term ‘thin-lens’ refers to an optical device that changes a path of light by a difference in phase delays caused by the scatterers 122a, 122b, and 122c included in the thin-lenses, unlike related art optical lens. Accordingly, a thickness of the thin-lens may be hardly limited compared to that of an optical lens, and the thin-lens may be configured to be thin. The scatterers 122a, 122b, and 122c on surfaces of the thin lenses 120a, 120b, and 120c may be configured to resonate light incident on each of the scatterers 122a, 122b, and 122c. The scatterers 122a, 122b, and 122c may be configured to appropriately delay a transmission phase of the light incident on each of the scatterers 122a, 122b, and 122c.
(28) The scatterers 122a, 122b, and 122c may be arranged on the first surface S1 of the substrate 110 to form a desired wave front of light that transmits from the first surface S1 of the substrate 110. Also, the thin lenses 120a, 120b, and 120c may change a path of transmittant light with respect to incident light by modulating a wave front of light.
(29) At least two from among the thin lenses 120a, 120b, and 120c may be configured to concentrate pieces of light having different wavelength components among the incident light on the light sensing layer 130. For example, a first thin-lens 120a may be configured to concentrate a piece of light having a first wavelength λ.sub.1 among the incident light. Also, a second thin-lens 120b may be configured to concentrate a piece of light having a second wavelength λ.sub.2 among the incident light. Also, a third thin-lens 120c may be configured to concentrate a piece of light having a third wavelength λ.sub.3 among the incident light. However, these are provided as examples for illustrative purpose only, and embodiments are not limited thereto. For example, not all of the first to third thin lenses 120a, 120b, and 120c have to concentrate pieces of light having different wavelengths, and two from among the first, second, and third thin lenses 120a, 120b, and 120c may be configured to concentrate pieces of light having substantially the same wavelength.
(30)
(31) Referring to
(32)
(33) Referring to
(34)
(35) The scatterers 122a, 122b, and 122c may have a shape according to wavelength selectivity of the thin lenses 120a, 120b, and 120c. Here, the term “wavelength selectivity” refers to each of the thin lenses 120a, 120b, and 120c selectively concentrating pieces of light of a predetermined wavelength band on the light sensing layer 130. For example, the scatterers 122a included in the first thin-lens 120a may have a shape appropriate to concentrate pieces of light of the first wavelength λ.sub.1. In one embodiment, a cross-sectional shape of scatterers 122a and a ratio between a width and a height of the scatterers 122a may change. Also, scatterers 122b included in the second thin-lens 120b may have a shape appropriate to concentrate pieces of light of the second wavelength λ.sub.2. Also, scatterers 122c included in the third thin-lens 120c may have a shape appropriate to concentrate pieces of light of the third wavelength λ.sub.3. At least two from among the first, second, and third wavelengths λ.sub.1, λ.sub.2, and λ.sub.3 may be different from each other.
(36)
(37) In
(38) Referring to
(39) A refractive index of a material included in the scatterers 122a may be higher than a refractive index of a material included in the substrate 110. Thus, the substrate 110 may include a material having a relatively low refractive index, and the scatterers 122a may include a material having a relatively high refractive index. For example, the scatterers 122a may include at least one from among crystalline silicon (c-Si), polycrystalline silicon (poly Si), amorphous silicon (amorphous Si), Si.sub.3N.sub.4, GaP, TiO.sub.2, AlSb, AlAs, AlGaAs, AlGaInP, BP, and ZnGeP.sub.2. Also, for example, the substrate 110 may include one from among a polymer such as PMMA or PDMS, Si.sub.3N.sub.4, and SiO.sub.2. An additional clad layer that surrounds and covers the scatterers 122a having a high refractive index on the substrate 110 with the material having a low refractive index may be formed.
(40) The arrangement of the scatterers 122a may be determined according to a wavelength band of light that is concentrated by the first thin-lens 120a. For example, an interval distance T and an arrangement direction of the scatterers 122a included in the first thin-lens 120a may be determined in correspondence to the first wavelength λ.sub.1 of light that is concentrated by the first thin-lens 120a. The interval distance T between the scatterers 122a of the first thin-lens 120a may be smaller than the first wavelength λ.sub.1. In one embodiment, the interval distance T between the scatterers 122a of the first thin-lens 120a may be ¾ of the first wavelength λ.sub.1 or less or ⅔ of the first wavelength λ.sub.1 or less. Also, a height h of the scatterers 122a of the first thin-lens 120a may be smaller than the first wavelength λ.sub.1. For example, the height h of the scatterers 122a of the first thin-lens 120a may be ⅔ of the first wavelength λ.sub.1 or less.
(41)
(42) Referring to
(43) The description of shapes of the scatterers 122a made with reference to
(44) Referring back to
(45) The light-sensing cells 130a, 130b, and 130c may be prepared in correspondence to the thin lenses 120a, 120b, and 120c. For example, a first light-sensing cell 130a may be configured to sense light that is transmitted from the first thin-lens 120a. Also, a second light-sensing cell 130b may be configured to sense light that is transmitted from the second thin-lens 120b. Also, a third light-sensing cell 130c may be configured to sense light that is transmitted from the third thin-lens 120c. The first, second, and third light-sensing cells 130a, 130b, and 130c may be configured to receive light and thus may output first, second, and third images, respectively.
(46) Each of the light-sensing cells 130a, 130b, and 130c may include devices that convert light signals into electrical signals. For example, the light-sensing cells 130a, 130b, and 130c may include CCD sensors or CMOS sensors. Alternatively, the light-sensing cells 130a, 130b, and 130c may include photodiodes that convert light energy into electrical energy.
(47) Because at least two from among the first, second, and third thin lenses 120a, 120b, and 120c have different wavelength selectivities, at least two of the first, second, and third light-sensing cells 130a, 130b, and 130c may be configured to measure images in different colors. Therefore, the first, second, and third images measured by the first, second, and third light-sensing cells 130a, 130b, and 130c, respectively, may be synthesized to obtain a multi-color image.
(48)
(49) In
(50) Referring to
(51) Because locations of the thin-lens 120a, 120b, and 120c are different from each other, light reflected by an object may be incident at different angles to the thin-lens 120a, 120b, and 120c. Thus, images of the object taken from different angles may be obtained from the first, second, and third light-sensing cells 130a, 130b, and 130c, respectively. The image synthesizer 150 may produce a stereo image from the images of the object taken from different angles. During a process of producing the stereo image, the image synthesizer 150 may extract parallax information among the first, second and third images. Also, the image synthesizer 150 may be configured to extract depth information of the object that is shown in the stereo image.
(52)
(53) In
(54) Referring to
(55)
(56) In
(57) Referring to
(58) The first light filter 140a may allow only a predetermined wavelength component from incident light to transmit therethrough according to a wavelength selectivity of the first thin-lens 120a. For example, light of the first wavelength λ.sub.1 from among incident light may transmit through the first light filter 140a, and the first light filter 140a may allow light of the remaining wavelength components to be reflected or absorbed. In the same manner, light of the second wavelength λ.sub.2 from among incident light may transmit through the second light filter 140b, and the second light filter 140b may allow light of the remaining wavelength components to be reflected or absorbed. Also, light of the third wavelength λ.sub.3 from among incident light may transmit through the third light filter 140c, and the third light filter 140c may allow light of the remaining wavelength components to be reflected or absorbed.
(59)
(60)
(61) In
(62) Referring to
(63) The substrate 210 may include a transparent material. As used herein, the term “transparent material” denotes a material having a high light transmittance. For example, the substrate 210 may include at least one from among Si.sub.3N.sub.4, SiO.sub.2, and a polymer such as PMMA or PDMS. Once a path of incident light changes by the thin lenses 220a, 220b, and 220c, the incident light may pass through the substrate 210 and be incident on a light sensing layer 230. The substrate 210, similar to an exemplary embodiment shown in
(64)
(65) Referring to
(66) The thin lenses 220a, 220b, and 220c may include a plurality of scatterers 222a, 222b, and 222c. At least two from among the thin lenses 220a, 220b, and 220c may be configured to concentrate pieces of the incident light on the light-sensing cells 230a, 230b, and 230c to have different focal lengths. For example, the first thin-lens 220a may concentrate pieces of the incident light to have a first focal length f.sub.1 in a direction toward the first light-sensing cell 230a. Also, the second thin-lens 220b may concentrate pieces of the incident light to have a second focal length f.sub.2 in a direction toward the second light-sensing cell 230b. Also, the third thin-lens 220c may concentrate pieces of the incident light to have a third focal length f.sub.3 in a direction toward the third light-sensing cell 230c. This is provided herein as an example only, and exemplary embodiments are not limited thereto. For example, the first through third thin lenses 220a, 220b, and 220c do not necessarily have to concentrate pieces of incident light to have focal lengths that are all different from one another, and two from among the first through third thin lenses 220a, 220b, and 220c may concentrate pieces of incident light to have substantially the same focal length.
(67) Descriptions of exemplary embodiments provided herein with reference to
(68) Shapes of the scatterers 222a, 222b, and 222c may vary depending on focal lengths of the thin lenses 220a, 220b, and 220c. For example, scatterers 222a included in the first thin-lens 220a may have a shape appropriate to concentrate pieces of light to have a first focal length f.sub.1. In one exemplary embodiment, a cross-sectional shape of the scatterers 222a and a ratio between a width and a height of the scatterers 122a may change. Also, scatterers 222b included in the second thin-lens 220b may have a shape appropriate to concentrate pieces of light to have a second focal length f.sub.2. Also, scatterers 222c included in the third thin-lens 220c may have a shape appropriate to concentrate pieces of light to have a third focal length f.sub.3. At least two from among the first through third focal lengths f.sub.1, f.sub.2, and f.sub.3 may be different from each other. Also, interval distances among the scatterers 222a, 222b, and 222c and heights of the scatterers 222a, 222b, and 222c may differ according to focal lengths of the thin lenses 220a, 220b, and 220c.
(69) When the focal lengths of the thin lenses 220a, 220b, and 220c change, images that are defocused to different degrees may be formed on the light-sensing cells 230a, 230b, and 230c. Defocusing degrees of the images formed on the light-sensing cells 230a, 230b, and 230c may differ according to the focal lengths of the thin lenses 220a, 220b, and 220c and distances between an object and the thin lenses 220a, 220b, and 220c. Therefore, when a defocusing degree for each position of an image measured by each of the light-sensing cells 230a, 230b, and 230c is compared with those of images measured by light-sensing cells and then extracted, distances between the thin lenses 220a, 220b, and 220c and the object and a 3-dimensional shape may be obtained.
(70)
(71) Referring to
(72) The depth map calculator 250 may calculate depth map information of an image corresponding to the incident light from the defocusing degree measured by each of the light-sensing cells 230a, 230b, and 230c and the focal length of each of the thin lenses 220a, 220b, and 220c. For example, the depth map calculator 250 may calculate a distance from each of a plurality of points on each of objects or a surface of an object included in the image to each of the thin lenses 220a, 220b, and 220c. In this regard, as the depth map calculator 250 calculates the depth map information, the image sensor may obtain a 3-dimensional image of the object.
(73) The thin lenses 220a, 220b, and 220c may each concentrate pieces of light having a predetermined wavelength component. The thin lenses 220a, 220b, and 220c may function as an optical device with respect to a predetermined wavelength band of incident light. Shapes, a shape of arrangement, interval distances, and heights of the scatterers 222a, 222b, and 222c included in the thin lenses 220a, 220b, and 220c may be determined according to wavelength selectivity of the thin lenses 220a, 220b, and 220c.
(74) For example, to output an image with one color, all the thin lenses 220a, 220b, and 220c may have substantially the same wavelength selectivity. The thin lenses 220a, 220b, and 220c may all concentrate light of substantially the same wavelength component. Also, shapes, a shape of arrangement, interval distances, and heights of the scatterers 222a, 222b, and 222c included in the thin lenses 220a, 220b, and 220c may be determined according to focal lengths of the thin lenses 220a, 220b, and 220c. Heights and interval distances of the scatterers 222a, 222b, and 222c may be smaller than a wavelength of light that is concentrated by the thin lenses 220a, 220b, and 220c.
(75)
(76) Referring to
(77) The thin lenses 220a, 220b, and 220c may each concentrate pieces of light having different wavelengths to have different focal lengths. For example, the first thin-lens 220a may concentrate light having a first wavelength λ.sub.1 to have a first focal length f.sub.1. The scatterers 222a included in the first thin-lens 220a may have a shape of arrangement and interval distances appropriate to concentrate pieces of light having the first wavelength λ.sub.1 to have the first focal length f.sub.1. Also, the second thin-lens 220b may concentrate light having a second wavelength λ.sub.2 to have a second focal length f.sub.2. The scatterers 222b included in the second thin-lens 220b may have a shape of arrangement and interval distances appropriate to concentrate pieces of light having the second wavelength λ.sub.2 to have the second focal length f.sub.2. Also, the third thin-lens 220c may concentrate light having a third wavelength λ.sub.3 to have a third focal length f.sub.3. The scatterers 222c included in the third thin-lens 220c may have a shape of arrangement and interval distances appropriate to concentrate pieces of light having the third wavelength λ.sub.3 to have the third focal length f.sub.3.
(78) Heights and interval distances of the scatterers 222a, 222b, and 222c included in the thin lenses 220a, 220b, and 220c may vary according to wavelength selectivities of 220a, 220b, and 220c, respectively. For example, interval distances between the scatterers 222a and heights of the scatterers 222a in the first thin-lens 220a may be smaller than the first wavelength λ.sub.1. Also, interval distances between the scatterers 222b and heights of the scatterers 222b in the second thin-lens 220b may be smaller than the second wavelength λ.sub.2. Also, interval distances between the scatterers 222c and heights of the scatterers 222c in the third thin-lens 220c may be smaller than the third wavelength λ.sub.3.
(79)
(80) Referring to
(81) The first light filter 240a may transmit a predetermined wavelength component among incident light according to a wavelength selectivity of the first thin-lens 220a. For example, the first light filter 240a may allow light having a first wavelength λ.sub.1 to transmit therethrough and reflect or absorb light of the remaining wavelength components. In the same manner, the second light filter 240b may allow light having a second wavelength λ.sub.2 to transmit therethrough and reflect or absorb light of the remaining wavelength components. Also, the third light filter 240c may allow light having a third wavelength λ.sub.3 to transmit therethrough and reflect or absorb light of the remaining wavelength components. Because the light filters 240a, 240b, and 240c filter wavelengths of incident light, noise light of undesired wavelengths may be prevented from being incident on the light-sensing cells 230a, 230b, and 230c. Also, quality of images obtained from the light-sensing cells 230a, 230b, and 230c may improve. Further, the light-sensing cells 230a, 230b, and 230c each generate images in different colors, and thus a multi-color image may be produced by synthesizing the images.
(82) As described above, according to the one or more of the above exemplary embodiments, an image sensor has been described with reference to
(83) The foregoing exemplary embodiments are examples and are not to be construed as limiting. The present teaching can be readily applied to other types of apparatuses. Also, the description of the exemplary embodiments is intended to be illustrative, and not to limit the scope of the claims, and many alternatives, modifications, and variations will be apparent to those skilled in the art.