OPTICAL FINGERPRINT SENSOR WITH SPOOF DETECTION AND ASSOCIATED METHOD
20230072103 · 2023-03-09
Inventors
Cpc classification
G06F3/04166
PHYSICS
G06V40/1318
PHYSICS
International classification
Abstract
An optical fingerprint sensor with spoof detection includes a plurality of lenses, an image sensor including a pixel array that includes a plurality of first photodiodes and a plurality of second photodiodes, and at least one apertured baffle-layer having a plurality of aperture stops, wherein each second photodiode is configured to detect light having passed through a lens and at least one aperture stop not aligned with the lens along an optical axis. A method for detecting spoof fingerprints detected using an optical fingerprint sensor includes detecting large-angle light incident on a plurality of anti-spoof photodiodes, wherein the plurality of anti-spoof photodiodes is interleaved with a plurality of imaging photodiodes, determining an angular distribution of light based at least in part one the large-angle light, and detecting spoof fingerprints based at least in part on the angular distribution of light.
Claims
1. An optical fingerprint sensor with spoof detection, comprising: a plurality of lenses L.sub.m=0, L.sub.1, . . . L.sub.J-1 with a lens pitch along a horizontal direction that is orthogonal to a lens axis of lens L.sub.0, each lens having a width; an image sensor including a pixel array that includes a plurality of first photodiodes I.sub.m=0, I.sub.1, . . . , I.sub.J-1 with a first photodiode pitch that is equal to the lens pitch in the horizontal direction, a line between a center of a light-sensitive surface of each first photodiode I.sub.m and an optical center of each lens L.sub.m forms an optical axis O.sub.m of a plurality of optical axes O.sub.m=0, O.sub.1, . . . O.sub.J-1; at least one apertured baffle-layer positioned between the image sensor and the plurality of lenses, each of the at least one apertured baffle-layer located at a respective height z.sub.k above the pixel array and each having a respective plurality of aperture stops A.sub.m=0, A.sub.1, . . . A.sub.J-1, each aperture stop A.sub.m being center-aligned with the optical axis O.sub.m; and a plurality of second photodiodes S.sub.m=0, S.sub.1, . . . S.sub.K-1 that is included in the pixel array, the plurality of second photodiodes is intercalated with the plurality of first photodiodes such that a second photodiode S.sub.m is between first photodiode I.sub.m and first photodiode I.sub.m+1 in the horizontal direction, wherein each second photodiode is configured to detect electromagnetic energy having passed through lens L.sub.m and at least one aperture stop A.sub.x≠m not aligned with L.sub.m along optical axis O.sub.m.
2. The optical fingerprint sensor of claim 1, between adjacent aperture stops of the plurality of apertures stops, each of the at least one apertured baffle-layer being opaque to visible electromagnetic energy.
3. The optical fingerprint sensor of claim 2, the at least one aperture stop A.sub.m aligned along the optical axis O.sub.m having respective widths such that at least one aperture stops A.sub.m collectively transmit electromagnetic energy that falls within an acceptance angle, the acceptance angle measured as an angular divergence from the optical axis O.sub.m of rays incident on the center of the light-sensitive surface of the first photodiode I.sub.m.
4. The optical fingerprint sensor of claim 1, each aperture stop of the plurality of aperture stops on each of the at least one apertured baffle-layers being circular in the horizontal plane.
5. The optical fingerprint sensor of claim 1, one of the at least one apertured baffle-layer having a distance z.sub.k equal to less than ten microns and having a plurality of second aperture stops SA.sub.m=0, SA.sub.1, SA.sub.K-1 having a second aperture stop SA.sub.m for each second photodiode S.sub.m, each second aperture stop SA.sub.m center-aligned with a center of a light-sensitive surface of each second photodiode S.sub.m in a direction parallel to the optical axis O.sub.m.
6. The optical fingerprint sensor of claim 1, the at least one apertured baffle-layer comprising four baffle-layers.
7. The optical fingerprint sensor of claim 1, the number first photodiodes, J, being equal to the number of second photodiodes, K.
8. The optical fingerprint sensor of claim 1, the plurality of second photodiodes having a second photodiode pitch that is equal to the lens pitch in the horizontal direction.
9. A method for detecting spoof fingerprints detected using an optical fingerprint sensor, comprising: detecting large-angle light incident on a plurality of anti-spoof photodiodes of a pixel array, large-angle electromagnetic energy being incoming electromagnetic energy incident on a lens above the pixel array with an angle of incidence divergent from the optical axis of the lens by greater than five degrees; wherein the plurality of anti-spoof photodiodes is interleaved with a plurality of imaging photodiodes such that each anti-spoof photodiode of the plurality of anti-spoof photodiodes is between adjacent imaging photodiodes of the plurality of imaging photodiodes; determining an angular distribution of electromagnetic energy based at least in part on the detected large-angle light; and detecting spoof fingerprints based at least in part on the angular distribution of electromagnetic energy.
10. The method of claim 9, the plurality of anti-spoof photodiodes and the plurality of imaging photodiodes being formed in a single pixel array.
11. The method of claim 9, further comprising detecting small-angle light incident on the plurality imaging photodiodes of the pixel array, small-angle light being incoming electromagnetic energy incident on a lens above the pixel array with an angle of incidence divergent from the optical axis of the lens by less than five degrees.
12. The method of claim 11, the step of determining further comprising determining the angular distribution of electromagnetic energy based at least in part on the small-angle light detected.
13. The method of claim 9, further comprising preventing larger-angle light from striking the plurality of imaging photodiodes with a plurality of apertured baffle-layers.
14. The method of claim 9, further comprising directing small-angle light with a plurality of lenses, each lens directing small-angle light toward one imaging photodiode of the plurality of imaging photodiodes.
15. The method of claim 9, further comprising illuminating a fingerprint sample with electromagnetic energy from a display, the plurality of anti-spoof photodiodes and the plurality of imaging photodiodes positioned underneath a glass of the display.
16. The method of claim 15, further comprising illuminating the fingerprint sample with a non-uniform pattern of illumination.
17. The method of claim 9, further comprising applying at least one matching algorithms to the detection of large-angle light.
18. The method of claim 17, the one of more matching algorithms comprising machine learning algorithms.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
DETAILED DESCRIPTION OF THE EMBODIMENTS
[0020] Reference throughout this specification to “one example” or “one embodiment” means that a particular feature, structure, or characteristic described in connection with the example is included in at least one example of the present invention. Thus, the appearances of the phrases “in one example” or “in one embodiment” in various places throughout this specification are not necessarily all referring to the same example. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more examples.
[0021] Spatially relative terms, such as “beneath,” “below,” “lower,” “under,” “above,” “upper,” and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as “below” or “beneath” or “under” other elements or features would then be oriented “above” the other elements or features. Thus, the terms “below” and “under” may encompass both an orientation of above and below. The device may be otherwise oriented (rotated ninety degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly. In addition, it will also be understood that when a layer is referred to as being “between” two layers, it may be the only layer between the two layers, or one or more intervening layers may also be present.
[0022] The term semiconductor substrate may refer to substrates formed using semiconductors such as silicon, silicon-germanium, germanium, gallium arsenide, and combinations thereof. The term semiconductor substrate may also refer to a substrate, formed of one or more semiconductors, subjected to previous process steps that form regions and/or junctions in the substrate. A semiconductor substrate may also include various features, such as doped and undoped semiconductors, epitaxial layers of silicon, and other semiconductor structures formed upon the substrate.
[0023] Throughout this specification, several terms of art are used. These terms are to take on their ordinary meaning in the art from which they come, unless specifically defined herein or the context of their use would clearly suggest otherwise. It should be noted that element names and symbols may be used interchangeably through this document (e.g., Si vs. silicon); however, both have identical meanings.
[0024]
[0025] Optical fingerprint sensor 100 includes a plurality of lenses 170, an image sensor 110, and at least one apertured baffle-layers 160. The plurality of lenses 170 includes J lenses, 170(m=0), 170(1), 170(2) . . . 170(J−1). Each lens 170 has a lens width 172 and the plurality of lenses 172 has a lens pitch 173 along a horizontal direction. The horizontal direction In
[0026] Each apertured baffle-layers 160 is positioned between the plurality of lenses 170 and the image sensor 110. Each of the at least one apertured baffle-layer 160 is located a respective height 162 above the pixel array 112. The embodiment illustrated in
[0027] Each apertured baffle-layer 160 has a respective plurality of apertures stops 164 that contains J aperture stops, 164A(m=0), 164A(1), 164A(2) . . . A164A(J−1). Each aperture stop 164 is center-aligned with a given first photodiode 114 along the corresponding optical axis 176. For example apertures stops 164A(0), 164A(1), and 164A(2) of apertured baffle-layer 160A are center-aligned with respective optical axes 176(0), 176(1), and 176(2). Some optical axes are not illustrated for clarity of illustration. In the embodiment illustrated in
[0028] The pixel array 112 includes the plurality of second photodiodes 118 that contains k photodiodes, 118(k=0), 118(1), 118(2) . . . 118(k−1). The plurality of second photodiodes 118 is intercalated with the plurality of first photodiodes 114 such that a second photodiode 118(k) is between first photodiode 114(m) and first photodiode 114(m+1) in the horizontal direction. Each second photodiode 118 is configured to detect electromagnetic energy having passed through lens L.sub.m and at least one aperture stop A.sub.x≠m not aligned with L.sub.m along the optical axis O.sub.m. This is illustrated in
[0029] Electromagnetic energy detected by the plurality of second photodiodes 118 enters the optical fingerprint sensor 100 with a large angle of incidence with respect to the optical axis 176. This large-angle electromagnetic energy is quantified here as incoming electromagnetic energy incident on lens 170(m) with an angle of incidence divergent from the optical axis 176(m) by greater than five degrees.
[0030] In an embodiment, each of the apertured baffle-layers 160 is opaque to visible electromagnetic energy, for example, light incident on the apertured baffle-layer 160 between adjacent apertures stops of the plurality of aperture stops 164. This reduces the number of paths that incoming electromagnetic energy may take and still be incident on the plurality of first photodiodes 114. As discussed earlier, each apertured baffle-layers 160 helps the optical fingerprint sensor 100 record an image of a fingerprint sample.
[0031]
[0032] Each of the aperture stops 164A(m), 164B(m), and 164C(m) illustrated in
[0033]
[0034] In an embodiment, the number of first photodiodes 314 is equal to the number of second photodiodes 318. Accordingly, the number of lenses 370, the number of apertures stops on each apertured baffle-layer 360, and the number of second aperture stops 368 are also equal, both to each other and to the number of first photodiodes 314 and to the number of second photodiodes 318. More succinctly, the counters above, J and K, are equal. This need not be the case, however. The relative quantity of first photodiodes 314 and second photodiodes 318 may vary without departing from the scope hereof.
[0035]
[0036]
[0037] In block 410, large-angle light incident on a plurality of anti-spoof photodiodes of a pixel array is detected. Large-angle electromagnetic energy is quantified here as incoming electromagnetic energy incident on a lens with an angle of incidence divergent from the optical axis of the lens by greater than five degrees. The plurality of anti-spoof photodiodes is interleaved with a plurality of imaging photodiodes such that each anti-spoof photodiode of the plurality of anti-spoof photodiodes is between adjacent imaging photodiodes of the plurality of imaging photodiodes. In an example of block 410, rays of electromagnetic energy 190 and 192 are detected by second photodiodes (118(1) and 118(2), respectively) of the plurality of second photodiodes 118.
[0038] In block 460, an angular distribution of electromagnetic energy is determined at least in part on the detected large-angle light. In one example of block 460, an angular distribution of electromagnetic energy is determined, at least in part by rays of electromagnetic energy 190 and 192 that are detected by the plurality of second photodiodes 118.
[0039] In block 470, spoof fingerprints are detected based at least in part on the angular distribution of electromagnetic energy.
[0040] In certain embodiments, the method 400 includes one or more additional blocks of the flowchart in
[0041] In block 430, small-angle light incident on the plurality imaging photodiodes of the pixel array is detected, small-angle electromagnetic energy is quantified here as incoming electromagnetic energy incident on a lens with an angle of incidence divergent from the optical axis of the lens by less than five degrees. In an example of block 430, electromagnetic energy is transmitted through lens 170(0) and then passes through aperture stops 164A(0), 164B(0), and 164C(0) before being detected by first photodiode 114(0).
[0042] Block 430 may include block 432, in which the angular distribution of electromagnetic energy is determined at least in part based on the small-angle light detected. In one example of block 432, an angular distribution of electromagnetic energy is determined at least in part based on (i) electromagnetic energy propagating through lens 170(0) and then passes through aperture stops 164A(0), 164B(0), and 164C(0) before being detected by first photodiode 114(0) and (ii) electromagnetic energy 190 and 192 that is detected by second photodiodes (118(1) and 118(2), respectively) of the plurality of second photodiodes 118 of
[0043] In block 434, large-angle light is prevented from striking the plurality of imaging photodiodes using at least one apertured baffle-layer. In an example of block 434, the ray of electromagnetic energy 194 is prevented from reaching the first photodiode 114(m) by the apertured baffle-layer 160A,
[0044] In block 436, small-angle light is directed with a plurality of lenses, in which a lens directs small-angle light toward one imaging photodiode of the plurality of imaging photodiodes. In an example of block 436, electromagnetic energy is transmitted through lens 170(0) and then passes through aperture stops 164A(0), 164B(0), and 164C(0) before being detected by first photodiode 114(0),
[0045] In block 472, at least one matching algorithm is applied to the detected large-angle light. In an embodiment, the at least one matching algorithm includes machine learning algorithms.
[0046]
[0047] Electronic device 502 includes at least one processor 552 communicatively coupled to display 502, optical fingerprint sensor 100/300, and memory 554 storing an application 556 (e.g., software/firmware) that include machine readable instructions that, when executed by processor 552, control display 502 and optical fingerprint sensor 100/300 to capture an image of a finger 508 touched to cover lens 504 proximate optical fingerprint sensor 100/300 to detect when fingerprint sample 508 is a spoof fingerprint.
[0048]
[0049] The pixel array 612 includes a plurality of first photodiodes 614 (shown filled with diagonal lines) and a plurality of second photodiodes 618 (shown filled with dots). The apertured baffle-layer 660D includes a plurality of aperture stops 664D (circular holes), there being one first aperture stop 664D for each first photodiode 614. Apertured baffle-layer 660D further includes a plurality of second aperture stops 668D (rectangular holes), there being one second aperture stop 668D for each second photodiode 618. The apertured baffle-layer 660D is designed to be positioned above the pixel array 612 such (a) that the center of each first aperture stop 664D is center-aligned with a center of a light-sensitive surface (not indicated) of a respective first photodiode 614 in a direction parallel to an optical axis 676 of each first photodiode 614 and (b) that the center of each second aperture stop 668D is center-aligned with a center of a light-sensitive surface (not indicated) of a respective second photodiode 618. The plurality of first aperture stops 664D on apertured baffle-layer 660D permit small angle-angle light (not shown) to be detected by the plurality of first photodiodes 416 and the plurality of second aperture stops 668D on apertured baffle-layer 660D permits large-angle light (not shown) to be detected by the plurality of second photodiodes 618. Due to the relative amount of small-angle light that reaches each first photodiode 614 to large-angle light that reaches each second photodiode 618, the area of each second aperture stop 668D is larger than that of each first aperture stop 664D. In the embodiment illustrated in
[0050] The pixel array 612 is an example of the pixel array 312 of
[0051]
[0052] The pixel array 712 includes a plurality of first photodiodes 714 (shown filled with diagonal lines) and a plurality of second photodiodes 718 (shown filled with dots). The apertured baffle-layer 760D includes a plurality of aperture stops 764D (circular holes), there being one first aperture stop 764D for each first photodiode 714. Apertured baffle-layer 760D further includes a plurality of second aperture stops 768D (rectangular holes), there being one second aperture stop 768D for each second photodiode 718. The apertured baffle-layer 760D is designed to be positioned above the pixel array 712 such (a) that the center of each first aperture stop 764D is center-aligned with a center of a light-sensitive surface (not indicated) of a respective first photodiode 714 in a direction parallel to an optical axis 776 of each first photodiode 714 and (b) that the center of each second aperture stop 768D is center-aligned with a center of a light-sensitive surface (not indicated) of a respective second photodiode. The plurality of first aperture stops 764D on apertured baffle-layer 760D permit small angle-angle light (not shown) to be detected by the plurality of first photodiodes 416 and the plurality of second aperture stops 768D on apertured baffle-layer 760D permits large-angle light (not shown) to be detected by the plurality of second photodiodes 718. Due to the relative amount of small-angle light that reaches each first photodiode 714 to large-angle light that reaches each second photodiode 718, the area of each second aperture stop 768D is larger than that of each first aperture stop 764D. In the embodiment illustrated in
[0053] The pixel array 712 is an example of the pixel array 312 of
[0054] Changes may be made in the above methods and systems without departing from the scope hereof. It should thus be noted that the matter contained in the above description or shown in the accompanying drawings should be interpreted as illustrative and not in a limiting sense. The following claims are intended to cover all generic and specific features described herein, as well as all statements of the scope of the present method and system, which, as a matter of language, might be said to fall therebetween.
Combination of Features
[0055] (A1) In a first aspect, an optical fingerprint sensor with spoof detection includes a plurality of lenses L.sub.m=0, L.sub.1, . . . L.sub.J-1 with a lens pitch along a horizontal direction that is orthogonal to a lens axis of lens L.sub.0, each lens having a width; an image sensor includes a pixel array that includes a plurality of first photodiodes I.sub.m=0, I.sub.1, . . . I.sub.J-1 with a first photodiode pitch that is equal to the lens pitch in the horizontal direction, a line between a center of a light-sensitive surface of each first photodiode I.sub.m and an optical center of each lens L.sub.m forms an optical axis O.sub.m of a plurality of optical axes O.sub.m=0, O.sub.1, . . . O.sub.J-1; at least one apertured baffle-layer positioned between the image sensor and the plurality of lenses, each of the at least one apertured baffle-layer located at a respective height z.sub.k above the pixel array and each having a respective plurality of aperture stops A.sub.m=0, A.sub.1, . . . A.sub.J-1, each aperture stop A.sub.m being center-aligned with the optical axis O.sub.m; and a plurality of second photodiodes S.sub.m=0, S.sub.1, . . . S.sub.K-1 that is included in the pixel array, the plurality of second photodiodes is intercalated with the plurality of first photodiodes such that a second photodiode S.sub.m is between first photodiode I.sub.m and first photodiode I.sub.m+1 in the horizontal direction, wherein each second photodiode is configured to detect electromagnetic energy having passed through lens L.sub.m and at least one aperture stop A.sub.x≠m not aligned with L.sub.m along optical axis O.sub.m
[0056] (A2) In an embodiment of A1, between adjacent aperture stops of the plurality of apertures stops, each of the at least one apertured baffle-layer being opaque to visible electromagnetic energy.
[0057] (A3) In an embodiment of A2, the at least one aperture stop A.sub.m aligned along the optical axis O.sub.m having respective widths such that at least one aperture stops A.sub.m collectively transmit electromagnetic energy that falls within an acceptance angle, the acceptance angle measured as an angular divergence from the optical axis O.sub.m of rays incident on the center of the light-sensitive surface of the first photodiode I.sub.m.
[0058] (A4) In an embodiment of any of A1 through A3, each aperture stop of the plurality of aperture stops on each of the at least one apertured baffle-layers being circular in the horizontal plane.
[0059] (A5) In an embodiment of any of A1 through A4, one of the at least one apertured baffle-layer having a distance z.sub.k equal less than ten microns and having a plurality of second aperture stops SA.sub.m=0, SA.sub.1, . . . SA.sub.K-1 having a second aperture stop SA.sub.m for each second photodiode S.sub.m, each second aperture stop SA.sub.m center-aligned with a center of a light-sensitive surface of each second photodiode S.sub.m in a direction parallel to the optical axis O.sub.m.
[0060] (A6) In an embodiment of any of A1 through A5, the at least one apertured baffle-layer includes four baffle-layers.
[0061] (A7) In an embodiment of any of A1 through A6, the number first photodiodes, J, being equal to the number of second photodiodes, K.
[0062] (A8) In an embodiment of any of A1 through A7, the plurality of second photodiodes having a second photodiode pitch that is equal to the lens pitch in the horizontal direction.
[0063] (B1) In a second aspect, a method for detecting spoof fingerprints detected using an optical fingerprint sensor includes detecting large-angle light incident on a plurality of anti-spoof photodiodes of a pixel array, large-angle light being incoming electromagnetic energy incident on lens above the pixel array with an angle of incidence divergent from the optical axis of the lens by greater than five degrees; wherein the plurality of anti-spoof photodiodes is interleaved with a plurality of imaging photodiodes such that each anti-spoof photodiode of the plurality of anti-spoof photodiodes is between adjacent imaging photodiodes of the plurality of imaging photodiodes; determining an angular distribution of electromagnetic energy based at least in part on the detected large-angle light; and detecting spoof fingerprints based at least in part on the angular distribution of electromagnetic energy.
[0064] (B2) In an embodiment of B1, the plurality of anti-spoof photodiodes and the plurality of imaging photodiodes being formed in a single pixel array.
[0065] (B3) In an embodiment of either B1 or B2, the method further includes detecting small-angle light incident on the plurality imaging photodiodes of the pixel array, small-angle light being incoming electromagnetic energy incident on a lens above the pixel array with an angle of incidence divergent from the optical axis of the lens by greater than five degrees.
[0066] (B4) In an embodiment of B3, the step of determining further includes determining the angular distribution of electromagnetic energy based at least in part on the small-angle light detected.
[0067] (B5) In an embodiment of any of B1 through B4, the method further includes preventing larger-angle light from striking the plurality of imaging photodiodes with a plurality of apertured baffle-layers.
[0068] (B6) In an embodiment of any of B1 through B5, the method further includes directing small-angle light with a plurality of lenses, each lens directing small-angle light toward one imaging photodiode of the plurality of imaging photodiodes.
[0069] (B7) In an embodiment of any of B1 through B6, the method further includes illuminating a fingerprint sample with electromagnetic energy from a display, the plurality of anti-spoof photodiodes and the plurality of imaging photodiodes positioned underneath a glass of the display.
[0070] (B8) In an embodiment of B7, the method further includes illuminating the fingerprint sample with a non-uniform pattern of illumination.
[0071] (B9) In an embodiment of any of B1 through B8, the method further includes applying at least one matching algorithms to the detection of large-angle light.
[0072] (B10) In an embodiment of B9, the one of more matching algorithms includes machine learning algorithms.