Iris image acquisition system

Abstract

An iris image acquisition system for a mobile device, comprises a lens assembly arranged along an optical axis and configured for forming an image comprising at least one iris of a subject disposed frontally to the lens assembly; and an image sensor configured to acquire the formed image. The lens assembly comprises a first lens refractive element and at least one second lens element for converging incident radiation to the first refractive element. The first refractive element has a variable thickness configured to counteract a shift of the formed image along the optical axis induced by change in iris-lens assembly distance, such that different areas of the image sensor on which irises at different respective iris-lens assembly distances are formed are in focus within a range of respective iris-lens assembly distances at which iris detail is provided at sufficient contrast to be recognised.

Claims

1. An image acquisition system for a mobile device, comprising: a lens assembly arranged along an optical axis and configured for forming an image comprising an iris of a subject disposed frontally to the lens assembly; and an image sensor configured to acquire the formed image; wherein: the lens assembly comprises an afocal refractive element and a lens element for converging incident radiation to the refractive element; the refractive element having a thickness that varies based at least in part on a distance of the refractive element from the optical axis; the refractive element configured to counteract a shift of the formed image along the optical axis induced by change in distance between the iris and the lens assembly, the refractive element further configured to cause the iris to be in focus at a first distance from the refractive element and at a second distance from the refractive element, the second distance different from the first distance.

2. The image acquisition system of claim 1, wherein the lens assembly is further configured to cause the formed image at the first distance to be in focus at a first area of the image sensor and to cause the formed image at the second distance to be in focus at a second area of the image sensor.

3. The image acquisition system of claim 1, wherein the refractive element comprises: a first thickness at a first distance from the optical axis; a second thickness at a second distance from the optical axis; and a surface shape that varies continuously from the first distance from the optical axis to the second distance from the optical axis.

4. The image acquisition system of claim 1, wherein said refractive element comprises an axicon optical element.

5. A mobile device comprising the image acquisition system according to claim 1 and further comprising a processor arranged to analyze images acquired from said image sensor to perform biometric recognition.

6. The image acquisition system of claim 1, wherein said refractive element comprises an element with a surface defined by Zernike fringe polynomials.

7. The image acquisition system of claim 6, wherein said refractive element comprises a surface facing said image sensor defined by Zernike fringe polynomials.

8. The image acquisition system of claim 1, wherein said refractive element comprises a first surface and a second surface, the first surface facing the lens element and the second surface facing the image sensor.

9. The image acquisition system of claim 8, wherein the lens element is configured to converge incident radiation on the second surface of the refractive element.

10. The image acquisition system of claim 8, wherein the second surface is spaced a first distance from the image sensor and a second distance from the image sensor, the second distance being different than the first distance.

11. The image acquisition system of claim 1, wherein said lens element comprises an aspheric lens element.

12. The image acquisition system of claim 11, wherein the aspheric lens element is configured to correct optical aberration.

13. The image acquisition system of claim 11, wherein the aspheric lens element comprises an optical element configured to correct an axial colour in the formed image.

14. The image acquisition system of claim 1, wherein said first distance or the second distance comprises 400 mm or less.

15. The image acquisition system of claim 14, wherein said first distance or said second distance is in a range of 200 and 400 mm.

16. The image acquisition system of claim 15, wherein the second distance is along the optical axis and is greater than the first distance.

17. The image acquisition system of claim 1, wherein the refractive element comprises an axicon surface.

18. The image acquisition system of claim 17, wherein the thickness of said refractive element decreases towards the centre of the axicon surface.

19. The image acquisition system of claim 17, wherein said lens assembly has a total track length of 4.9 mm.

20. The image acquisition system of claim 17, wherein said axicon surface comprises at least a first surface facing the image sensor and defined by a first polynomial including first odd aspheric coefficients.

21. The image acquisition system of claim 20, wherein said axicon surface has a second surface opposed to said first surface and defined by a second polynomial comprising second odd-aspheric coefficients.

22. The image acquisition system of claim 21, wherein said first surface comprises a conical surface where a distance of said surface from said image sensor is greatest along said optical axis and said second surfaces comprises a conical surface where a distance of said surface from said image sensor is greatest along said optical axis.

Description

DESCRIPTION OF DRAWINGS

(1) Embodiments of the invention will now be described, by way of example, with reference to the accompanying drawings, in which:

(2) FIG. 1 illustrates imaging of two irises at three different object distances from a lens assembly of an iris image acquisition system according to an embodiment of the present invention;

(3) FIG. 2 illustrates a model of a first embodiment of lens assembly which can be used in an iris image acquisition system according to the present invention;

(4) FIG. 3 illustrates coefficient values for the surfaces of the elements included in the lens assembly of FIG. 2;

(5) FIG. 4 illustrates system data and characteristics for the lens assembly illustrated in FIG. 2;

(6) FIG. 5 illustrates optical characteristics of an iris image acquisition system including the lens assembly illustrated in FIG. 2;

(7) FIG. 6 illustrates a model of a second embodiment of lens assembly which can be used in an iris image acquisition system according to the present invention;

(8) FIG. 7 illustrates coefficient values for the surfaces of the elements included in the lens assembly of FIG. 6;

(9) FIG. 8 illustrates system data and characteristics for the lens assembly illustrated in FIG. 6; and

(10) FIG. 9 illustrates optical characteristics of an iris image acquisition system including the lens assembly illustrated in FIG. 6.

DESCRIPTION OF THE EMBODIMENTS

(11) Referring now to FIG. 1, there is shown schematically an iris image acquisition system 10 according to an embodiment of the present invention. The system 10 comprises a fixed focus lens assembly 12 disposed in front of a fixed position image sensor 14; the assembly 12 is arranged along an optical axis 18 for converging incident radiation towards and forming an image on the sensor 14. The sensor 14 is a planar image sensor, and in some embodiments of the invention it can be an RGBW type sensor, such as a Color Filter Array (CFA) where at least some of the W pixels or sub-pixels are sensitive to NIR radiation (either exclusively or as well as RGB). In other embodiments, an NIR transmission filter with a cut-off wavelength just beyond the required bandwidth can also be used with an image sensor. It will be appreciated that any other type of sensor can be used in the system 10. The system 10 further comprises an NIR illumination source 16 for providing a narrow spectral band (e.g. in the range of approximately 700-960 nm) to illuminate objects disposed frontally to the lens assembly 12.

(12) In any case, the operation of each of the sensor 14 and the source 16 is controlled by a processor 20. The processor 20 can be a dedicated processor or processing module especially arranged to perform biometric recognition of a user of a mobile device including the system 10; or the processor 20 can be a general-purpose processor within a camera of the device and which is arranged to process images acquired from the sensor 14 for the purposes of biometric recognition as well as to run other camera applications.

(13) FIG. 1 also illustrates a pair of irises 30 to be imaged by the system 10, such as the irises of a user of the mobile device including the system 10 (as will be appreciated from the disclosure below, FIG. 1 is schematic and not to scale). The irises 30 are shown at fixed height from an axis 18, and at three different object positions D.sub.obj along the axis 18. For iris imaging, it can be assumed that each of the irises 30 is located at height D.sub.p/2 from the axis 18, where D.sub.p is the inter-pupillary distance which typically ranges from 60 to 80 mm, with an average range of 60-64 mm.

(14) As can be further appreciated from FIG. 1, the field angles between the irises 30 and the axis 18 increase as the irises 30 come closer to the lens assembly 12. As the field angles increase, the height relative the axis 18 of the iris images formed by the lens assembly 12 increases. Thus, a change in D.sub.obj results in a transverse shift relative to the axis 18 of the iris images formed on the image sensor 14.

(15) As expected, a change in D.sub.obj tends to induce a longitudinal shift along the axis 18 of the formed iris images, with the formed iris images coming closer to the lens assembly 12 as D.sub.obj increases. As such, a longitudinal shift can result in a misalignment between the imaged irises and sensor 14, ultimately limiting the available DOF of the system 10.

(16) In order to counteract this longitudinal shift, the lens assembly 12 of the system 10 comprises a dedicated refractive plate 40 arranged closer to the sensor 14 than two other, otherwise conventional type lens elements 41, 42 for converging the incoming radiation towards the plate 40.

(17) In particular, the plate 40 is a negative refracting element having a thickness along the axis 18 which varies according to a distance X from the axis 18. The variable thickness of the plate 40 is delimited by a substantially flat surface 43 and an opposed axicon conical surface 44 having an apex on the axis 18 extending away from the sensor 14.

(18) With reference to FIG. 1, ray bundles 31, 32, 33 generated from the NIR illuminated irises 30 at different distances D.sub.obj are converged towards and pass through the variable thickness of the plate 40 at different heights relative to the axis 18, due to the change in the iris field angles. As such, ray bundles generated from the irises 30 at different distances D.sub.obj pass through different thickness lengths of the plate 40 and, therefore, are subject to a different alteration of their paths towards the sensor 14.

(19) Advantageously, the variable thickness as defined by the delimiting axicon surface 44 is suitable for differently altering the optical paths of the ray bundles generated from the irises 30 at different distances D.sub.obj, such as to counteract a longitudinal shift of such iris images induced by the change in D.sub.obj. (In practice, plate 40 actively introduces an iris image aberration for compensating for the longitudinal iris image shift due to a change in D.sub.obj.) As a result, the formed images of the irises 30 remain focused on the planar surface of the sensor 14, although at different areas of the sensor 14 due to the transverse image shift relative to the axis 18. In particular, with reference to FIG. 1, an inner area of the sensor 14 will be in focus with the formed images of the irises 30 shown farther from the lens assembly 12, an outer concentric area of the sensor 14 will be in focus with the formed images of the irises 30 shown closer to the lens assembly 12, and an intermediate concentric area of the sensor 14 will be in focus with the formed images of the irises 30 shown at an intermediate D.sub.obj from the lens assembly 12.

(20) Thus, the variation in thickness of the plate 40, as defined by the axicon surface 44, ultimately results in an extended continuous DOF for the off-axis pair of irises 30 within a range of distances D.sub.obj.

(21) The use and configuration of an axicon-like refractive element dedicated for extending the DOF for the irises 30 is now disclosed in detail with reference to the lens assembly 12 shown in FIG. 2, which can be used in the system 10. For the purposes of this specification, an “axicon-like refractive element” has at least one “conical-like surface” resembling an axicon surface, but without discontinuities, so that it can be represented by an odd-aspheric polynomial.

(22) In particular, the axicon-like refractive element used in the assembly 12 shown in FIG. 2 is a bi-axicon refractive plate 50, which can be made for example of N-SF5 glass. Again, the plate 50 has no optical power. The change in the plate thickness at different heights from the axis 18 required to correct the longitudinal shift of the imaged irises induced by a change in D.sub.obj is obtained by two opposed axicon surfaces 5a and 6a.

(23) Surface 6a, which is the surface of the assembly 12 closest to the sensor 14, is substantially a negative, rotationally symmetric, conical-like surface having its apex positioned on the axis 18 and extending away from the sensor 14. The shape of surface 6a can be defined by the odd-aspheric polynomial:
z=a.sub.1y+b.sub.1y.sup.2+c.sub.1y.sup.3+d.sub.1y.sup.4+e.sub.1y.sup.5+f.sub.1y.sup.6  (1)

(24) Surface 5a is also a conical-like surface, extending away from the image sensor 14 and having its apex positioned on the axis 18. The shape of surface 6a can be defined by the odd-aspheric polynomial:
z=a.sub.2y+b.sub.2y.sup.2+c.sub.2y.sup.3  (2)

(25) The first linear term of polynomials (1) and (2) describes the inclination angle of the apex of the surfaces 5a and 6a with the axis 18, and the higher order terms determine a continuous surface shape such that the formed iris images remain in continuous focus on the planar surface of the sensor 14 over the extended DOF.

(26) FIG. 3 shows exemplary odd aspheric values calculated for the coefficients a.sub.1, . . . f.sub.1 and a.sub.2, . . . c.sub.2 of polynomials (1) and (2). Nevertheless, it will be appreciated that the illustrated values and the degree for the polynomials (1) and (2) can be different than the ones herein disclosed only for exemplary purposes.

(27) The lens assembly 12 illustrated in FIG. 2 further comprises an air-spaced doublet including two lenses 51, 52 for converging incident radiations towards the plate 50, which can be also be made for example of N-SF5 glass.

(28) The lens 51 comprises a convex aspheric surface 1a, which is the first surface of the assembly 12 reachable by incident radiation, and an opposed concave surface 2a. The lens 52 is arranged along the axis 18 between the lens 51 and the plate 50, and comprises two opposite convex aspherical surfaces 3a and 4a.

(29) It will be further appreciated from FIG. 2 that the lenses 51, 52 are configured to converge incident bundles of rays towards the variable thickness outer peripheral portion of the plate 50. This is because towards the centre of the field of view, the plate 50 performs poorly by comparison to the periphery. Indeed, as the field increases toward the region of interest containing the irises 30, the rms wavefront error falls below the diffraction limit. Since the irises 30 are off-axis objects, it is therefore acceptable to jeopardize the centre of the field of view using the plate 50 in order to increase the optical performances at the periphery of the field where the irises 30 are located.

(30) In addition to converging the incident radiation to the peripheral variable thickness of the plate 50, the lenses 51 and 52 can be configured to correct for optical aberrations.

(31) FIG. 3 also shows exemplary coefficients calculated for describing the even aspheric surfaces 1a, 2a and 3a, 4a of the lenses 51 and 52.

(32) Optical system data and characteristics for the plate 50 and lenses 51 and 52 are given in FIG. 4.

(33) As summarized by data given in FIG. 5, using the lens assembly 12 of FIG. 2 and a commercially available narrow-band NIR LED emitting at a wavelength of 940 nm ±20 nm as illumination source 16, the irises 30 can be imaged in focus with the lens assembly 12 at a across an effective extended DOF ranging from about 220 mm to 400 mm, having a full field of view in object space between about 30 and 40 mm (which is sufficient to image one eye at a time).

(34) Furthermore, the lens assembly 12 has a focal length of about 2.56 mm with an entrance pupil diameter of about 2.2 mm (resulting in a f-number of about 1.16), and a TTL of about 4.9 mm.

(35) It can be therefore appreciated how the system 10 can extend the DOF by comparison to using a conventional lens assembly, while remaining shallow enough to be accommodated in the limited space available in a housing of a smartphone or tablet.

(36) With reference now to FIG. 6, an alternative lens assembly 12 is shown for system 10. In this assembly 12, the refractive element dedicated to extend the DOF is a “Zernike” plate 60 (which can be made for example of N-BK7 or N-SF5 glass). As in the example of FIG. 2, the plate 60 is a negative refracting element having a thickness along the axis 18 which varies continuously, i.e. without sharp changes or interruptions. As will be explained below, again the plate 60 has no optical power.

(37) The change in the plate thickness at different heights from the axis 18 required to correct the longitudinal shift of the imaged irises induced by a change in D.sub.obj is obtained by a Zernike surface 7b, which is the surface of the lens system 12 closest to the sensor 14, opposed to a substantially flat surface 6b.

(38) Zernike fringe polynomials are widely used for describing a surface in freeform optics for example, as disclosed in Fuerschbach, K., Rolland, J. P., and Thompson, K. P., “A new family of optical systems employing—polynomial surfaces,” Optics express 19(22), 21919{21928 (2011) and Broemel, A., Lippmann, U., and Gross, H., “Freeform surface descriptions. part i: Mathematical representations,” Advanced Optical Technologies 6(5), 327{336 (2017).

(39) In particular, Zernike polynomials are useful in freeform design as they are orthogonal and complete polynomials, as disclosed in Ye, J., Chen, L., Li, X., Yuan, Q., and Gao, Z., “Review of optical freeform surface representation technique and its application,” Optical Engineering 56(11), 110901 (2017). The plate 60 can be represented with Zernike polynomials as a circular aperture is most common in photographic optics.

(40) In particular, such a surface shape can be represented using Zernike fringe polynomials according to the following formula:

(41) $z=\frac{{\mathrm{cr}}^2}{1+\sqrt{1-\left(1+k\right)c^2{r}^2}}+\underset{i=1}{\overset{8}{.Math.}}{\alpha }_i{r}^{2i}+\underset{i=1}{\overset{N}{.Math.}}{A}_i{Z}_i\left(\rho ,\varphi \right)$
where c is the curvature of the surface, r is the radius where r.sup.2=x.sup.2+y.sup.2, and k is the conic constant. The aspheric coefficients are denoted by α, and A.sub.i is the coefficient on the i.sup.th Zernike fringe polynomial, as explained in Gross, H., Zugge, H., Peschka, M., and Blechinger, F., “Handbook of optical systems, volume 3: Aberration theory and correction of optical systems,” (2007).

(42) In the specific lens assembly 12 shown in FIG. 2, the plate 60 has no optical power and it is designed without using aspheric coefficients α.sub.i. As such, the shape of surface 7b is only defined by the sum of Zernike fringe terms A.sub.iZ.sub.i(ρ,ϕ) including coma, spherical aberration and trefoil, resulting in a sagittal surface shape.

(43) FIG. 7 shows exemplary coefficients calculated for the Zernike fringe terms defining the surface 7b. Note that surface 7b departs from a rotational symmetry, such as the rotational symmetry of an axicon surface.

(44) Nevertheless, it will be appreciated that the illustrated values and the numbers of Zernike fringe terms can be different than the ones herein disclosed only for exemplary purposes.

(45) The assembly 12 shown in FIG. 6 further comprises an achromatic doublet for axial colour correction including mutually matched lenses 61 and 62, which can be manufactured for example using N-BK7 or N-SF5 glass.

(46) Lens 61 comprises a convex odd aspheric surface 1b, which is the first surface of the assembly 12 reachable by incident radiation, and an opposed convex spherical surface 2b juxtaposed to a shape-matching concave spherical surface 2c of lens 62. Lens 62 further comprises a slightly odd aspheric surface 3b opposed to surface 2c.

(47) A further lens 63 is arranged along the axis 18 between the doublet 61-62 and the plate 60, having a convex odd aspheric surface 4b faced towards surface 3b of the lens 62 and an opposed concave odd surface 5b faced towards the flat surface 6b of the plate 60.

(48) From FIG. 6 it will be further appreciated that lenses 61, 62 and 63 are configured to converge incident bundles of rays towards a variable thickness outer portion 65 of the plate 60, similarly to the ray bundles convergence induced by the assembly 12 shown in FIG. 2.

(49) FIG. 7 also shows exemplary coefficients calculated for describing the odd aspheric surfaces 1b, 3b, 4b and 5b of lenses 62 and 63.

(50) Optical system data and characteristics for the plate 60 and lenses 61, 62 and 63 are given in FIG. 8.

(51) As summarized by data given in FIG. 9, using the lens assembly 12 of FIG. 6 and a commercially available narrow-band NIR LED emitting at a wavelength of 940 nm ±20 nm as illumination source 16, the irises 30 can be imaged in focus with the lens assembly 12 at a distance ranging from about 200 mm to 400 mm, having a full field of view in object space between about 30 and 40 mm.

(52) Furthermore, the lens assembly 12 has a focal length of about 3.39 mm with an entrance pupil diameter of about 2.2 mm (resulting in a f-number of about 1.5), and a TTL of about 4.5 mm.

(53) It can be therefore appreciated how the system 10 can reach a DOF of approximately 70 mm at any point within an extended DOF range 200-400 mm, which results in an extended DOF of 2.8 times than when using a conventional lens assembly, while remaining shallow enough to be accommodated into a smartphone housing.

(54) The limit to which the DOF can be extended is linked to the f-number. The furthest possible object-point from the lens assembly 12 in which the DOF region can extend is determined by the contrast attainable for imaging the irises 30. It is desirable that the lens assembly 12 acquire a minimum 40% contrast for 2 cycles/mm in object space to image the fine structures used in user authentication. The nearest object position to the lens assembly 12 that can be successfully imaged is limited by field aberrations. For a D.sub.obj of 200 mm, the cut-off frequency is 115 cycles/mm.

(55) It will be appreciated that the specific lens arrangements illustrated in FIGS. 1, 2 and 6 as well as the optical characteristics illustrated in FIGS. 3-5 and 7-9 are for exemplary purposes only, and the invention is not to be regarded as being limited to any particular one of these.

(56) In particular, the shape of the refractive element can be different from the shapes of the illustrated plates 40, 50 and 60, but still suitable for defining a variable thickness so as to counteract longitudinal shifting of the imaged irises due to changes in D.sub.obj.

(57) Furthermore, as a variation of the arrangement illustrated in FIG. 6, a plate can be employed having one Zernike surface facing the sensor 14 or two opposed Zernike surfaces.

(58) Regarding the lens stage for converging radiation to the refractive element dedicated to extending the DOF, the number, reciprocal positioning and shape of the lens surfaces can be different than the illustrated ones. For example, different lens materials having a different refractive index and/or Abbe number may be used, yielding different surface shapes. For example, lenses can be added or substituted in order to effect a desired aberration correction of the ray bundles to be converged on the refractive element dedicated to extend the DOF.

(59) As a further variation to the arrangements disclosed above, one or more optical elements, such as positive or negative lenses, can be interposed between the element dedicated to extend the DOF and the sensor 14.

(60) Finally, while the optical system 10 has been described above in terms of a lens assembly 12 for a smartphone type camera and these are typically integrated with such devices, it will be appreciated that in other embodiments of the invention, the optical system could be provided as a discrete or integrated lens accessory for any general purpose mobile device or portable image acquisition device.