DEVICE FOR CAPTURING IMPRESSIONS OF AUTOPODIA AND USE OF SAME
20230386248 · 2023-11-30
Inventors
- Tom MICHALSKY (Zwenkau, DE)
- Undine RICHTER (Jena, DE)
- Philipp Riehl (Jena, DE)
- Daniel Krenzer (Wutha-Farnroda, DE)
- Jörg Reinhold (Jena, DE)
- Jürgen HILLMANN (Jena, DE)
Cpc classification
G09G2320/0233
PHYSICS
G06V40/1318
PHYSICS
International classification
Abstract
A device for displaying information and for the contact-based, simultaneous capture of impressions of a plurality of blood-perfused skin regions of human autopodia, including: a placement surface for placing the autopodia, a display unit which is arranged below the placement surface and which has at least partially transparent display elements which are arranged in grid form and are individually controllable by a control unit, the display elements having display pixels which emit light in a direction of the placement surface. The device also includes optical sensor pixels which detect light incident on the sensor pixels. The sensor pixels may be arranged in a sensor layer arranged under the display unit viewed from direction of the contacting skin region or may be arranged in the display unit between the display elements. A cavity filter for angle selection is arranged in front of the optical sensor pixels.
Claims
1. A device for displaying information and for contact-based, simultaneous capture of impressions of a plurality of blood-perfused skin regions of human autopodia, comprising a placement surface for placing the autopodia, a display unit which is arranged below the placement surface viewed from a direction of a contacting skin region and which has at least partially transparent display elements which are arranged in grid form and are individually controllable by a control unit, the display elements having display pixels which emit light in a direction of the placement surface, optical sensor pixels which detect light incident on the sensor pixels from a direction of the placement surface, and i. the sensor pixels are arranged in a sensor layer arranged under the display unit as viewed from the direction of the contacting skin region, or ii. the sensor pixels are arranged in the display unit between the display elements, at least one cavity filter for angle selection, arranged in front of the optical sensor pixels in a direction of the placement surface.
2. The device according to claim 1, in which the optical sensor pixels are arranged in the display unit between the display elements, wherein one or more pixelated or pixel-shaped cavity filters are associated with each sensor pixel and arranged above the respective sensor pixel.
3. The device according to claim 1, in which the optical sensor pixels are arranged in a sensor layer below the display unit, wherein the at least one cavity filter is formed as a cavity filter layer which is arranged between the display unit and the sensor layer.
4. The device according to claim 1, wherein the display unit comprises actively luminous display pixels, wherein the display unit is configured as an LED unit with display pixels which are formed as LEDs, OLEDs, QLEDs or microLEDs.
5. The device according to claim 1, wherein the display unit comprises passively illuminated display pixels, and a first illumination unit with a transparent light guide layer body and first illuminants is arranged below the display unit and above the at least one cavity filter viewed from the placement surface, and the display pixels are diffusely illuminated by the light guide layer body in a first wavelength range.
6. The device according to claim 5, wherein the display unit is configured as an LC unit with display pixels formed as LC elements.
7. The device according to claim 4, comprising a second illumination unit with second illuminants which are formed for emitting directed light of a predetermined wavelength in a limited angular range of not more than around a predetermined central direction, wherein the central direction is determined depending on the predetermined wavelength of the directed light and on an angle selectivity of the at least one cavity filter for the predetermined wavelength, parallel to a normal of the placement surface.
8. The device according to claim 1, wherein the at least one cavity filter is formed as one or more individual cavity filters, one or more dual-cavity filters or one or more multi-cavity filters and as layer stacks with plane reflector layers and plane cavity layers separating the reflector layers, wherein the layers are arranged parallel to the placement surface, and a thickness of the cavity layers is determined depending on a wavelength range to be transmitted for capturing impressions of the plurality of blood-perfused skin regions of human autopodia and on an angular range to be selected by the cavity layers for this wavelength range.
9. The device according to claim 8, wherein the thickness of the at least one cavity layer is variably adjustable by piezoelectric materials.
10. The device according to claim 8, wherein the reflector layers are configured as Bragg mirrors comprising alternating layers of two dielectrics or a metal.
11. The device according to claim 8, wherein the at least one cavity layer between the reflector layers is metallic or dielectric, wherein, when there is more than one cavity layer, metallic and dielectric layers are combinable for an improved selection of the angular range to be selected.
12. The device according to claim 1, wherein the cavity filter or the cavity filters predominantly reflect light which, in case of active display pixels, is emitted by the latter or which, in case of passive display pixels, is emitted by an illumination unit in a direction of the sensor pixels in order to increase the luminous efficiency.
13. The device according to claim 1, wherein each of the sensor pixels is provided with an additional shutter, which reduces the selected angular range, wherein the additional shutters are alternately arranged along rows and columns in which the sensor pixels are arranged.
14. The device according to claim 1, wherein the optical sensor pixels comprise different color sensor pixels which are alternately arranged in columns and rows in which the sensor pixels are arranged.
15. A method of using the device according to claim 1 for distinguishing whether an object placed on the placement surface is an autopodium or a forgery of an impression of an autopodium, wherein the at least one cavity filter is constructed as a layer stack comprising planar reflector layers and planar cavity layers separating the reflector layers, which reflector layers and cavity layers are arranged parallel to the placement surface, comprising: placing an object is placed on the placement surface switching the optical sensor pixels on to detect light, switching the display pixels in such a way that the display pixels emit light of at least a first wavelength λ.sub.R which corresponds to a central wavelength of the at least one cavity filter, wherein the cavity filter is resonant with light of this first wavelength λ.sub.R and is transparent in a first angular range around a direction perpendicular to the placement surface, capturing a first overall image using the sensor pixels, switching the display pixels such that the display pixels emit light of a second wavelength λ.sub.F which is shorter than the first wavelength λ.sub.R, and wherein the cavity filter is transparent to light of the second wavelength λ.sub.F in a second angular range, wherein the second angular range cuts out a cone or conical ring around the direction perpendicular to the placement surface, capturing a second overall image using the sensor pixels, analyzing the first overall image and second overall image with respect to differences in their image characteristics.
16. A method of using the device according to claim 1 for distinguishing whether an object placed on the placement surface is an autopodium or a forgery of an impression of an autopodium, wherein the at least one cavity filter is constructed as a layer stack comprising planar reflector layers and planar cavity layers separating the reflector layers, which reflector layers and cavity layers are arranged parallel to the placement surface, comprising: placing an object on the placement surface switching the optical sensor pixels on to detect light, switching a first set of display pixels in such a way that the first set of display pixels emits light of at least a first wavelength λ.sub.R which corresponds to a central wavelength of the at least one cavity filter, wherein the cavity filter is resonant with light of this first wavelength λ.sub.R and is selective in a first angular range around a direction perpendicular to the placement surface, switching a second set of display pixels in such a way that the second set of display pixels emits light of a second wavelength λ.sub.F which is shorter than the first wavelength, and wherein the cavity filter is selective for light of the second wavelength λ.sub.F in a second angular range, wherein the second angular range cuts out a cone or cone ring around the direction perpendicular to the placement surface, wherein positions of the first set of display pixels and of the second set of display pixels in the display unit are so determined depending on the first wavelength λ.sub.R and second wavelength λ.sub.F and the respective selective angular ranges that, on the one hand, the light emitted by the first set of display pixels and by the second set of display pixels illuminates the same area of the placement surface from below and, on the other hand, light of the first wavelength λ.sub.R which is incident on the sensor pixels from a direction of the placement surface is detected by a first set of sensor pixels and is captured as a first image, and light of the second wavelength λ.sub.F which is incident on the sensor pixels from a direction of the placement surface is detected by a second set of sensor pixels and is simultaneously recorded as a second image, analyzing the first image and second image with respect to differences in their image characteristics.
17. The method according to claim 16, in which, in order to scan the largest possible portion of the placement surface, the area illuminated from below is successively displaced after the first image and second image have been captured so that the first set of display pixels and the second set of display pixels are also displaced and further first and second images are captured and are combined to form a first aggregate image and a second aggregate image.
18. The method according to claim 16, wherein display pixels of the first set of display pixels and display pixels of the second set of display pixels are distributed in a checkerboard manner, and an allocation to the first set or second set of display pixels is carried out based on color filters.
19. The method according to claim 1, wherein the first angular range and the second angular range have an empty intersection.
20. The method according to claim 15, wherein the second angular range includes angles around and close to the angle of total internal reflection at the placement surface.
21. The method according to claim 15, wherein the first wavelength λ.sub.R is selected from a first wavelength range between 500 nm and 550 nm, while the second wavelength λ.sub.F is selected from a second wavelength range between 450 nm and 480 nm, or the first wavelength λ.sub.R is selected from a first wavelength range between 600 nm and 650 nm, and the second wavelength λ.sub.F is selected from a second wavelength range between 500 nm and 550 nm.
22. The method according to claim 15, wherein the first angular range is selected between 0° and 15° and the second angular range is selected between 30° and an angle which is at most 5° greater than a limiting angle of total internal reflection at the placement surface.
23. The method according to claim 15, wherein more than two overall images are captured and compared for each angular range, wherein all of the overall images are captured with different colors.
24. The method according to claim 15, wherein the intensity or characteristics calculated from intensity, preferably a spatial structure or a latent impression of an autopodium, are used as image characteristics.
25. The method according to claim 15, wherein, as further steps, a comparison of the intensity ratios of the at least two images or overall images with a calibrated threshold range is carried out for detecting forged prints, and/or all of the images or overall images are superposed in order to achieve increased resolution or compensate for sensor defects and other errors in the image recording, and/or when an authorized fingerprint is detected one or more functions are enabled in an appliance in which the device is implemented, and/or the appliance is locked when a forged fingerprint is detected.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0054] The invention will be described in the following referring to exemplary embodiments in the appended drawings which likewise disclose features essential to the invention. These exemplary embodiments are to be considered as merely illustrative and not restrictive. For example, it is not to be construed from a description of an embodiment example having a plurality of elements or components that all of these elements or components are necessary for its implementation. On the contrary, other embodiment examples may also contain alternative elements and components, fewer elements or components, or additional elements or components. Elements or components of various embodiment examples may be combined with one another unless otherwise indicated. Modifications and alterations which are described for one of the embodiment examples may also be applicable to other embodiment examples. To avoid repetition, like or similar elements are designated by like reference numerals in various figures and are not described multiple times. The drawings show:
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
[0065]
DETAILED DESCRIPTION OF THE DRAWINGS
[0066]
[0067] Further, all three configurations comprise optical sensor pixels which detect light that is incident on the sensor pixels from direction of the placement surface 1. In a first alternative, the sensor pixels are arranged in a sensor layer 5 which is arranged under the display unit 4 viewed from the direction of the contacting skin region. This is the case in the devices shown in
[0068] The display unit 4 can essentially be configured in two different ways. In a first configuration, the display unit 4 comprises actively luminous display pixels and is preferably configured as an LED unit. The display pixels can be formed as LEDs, OLEDs, QLEDs or microLEDs. As has already been mentioned, the display unit 4 is partially transparent to light coming from the placement surface 1. In a second configuration, the display unit 4 comprises passively illuminated display pixels and is configured, for example, as an LC unit with display pixels formed as LC elements. This is shown in
[0069] Regardless of whether or not a first illumination unit is provided for illuminating the passively illuminated display pixels, the device can comprise a second illumination unit 9 with second illuminants as is shown schematically in
[0070] The configuration and action of a cavity filter will be described in the following referring to
[0071] The construction of a reflector layer 11 is shown in detail in
[0072] For use in connection with fingerprint checking, an otherwise insignificant property of the cavity filter is utilized, namely, the capability of allowing the transmission of wavelengths only in particular angular ranges, i.e., an angle selection depending on wavelength. As will be explained in the following referring to
[0073] A layer stack which is formed only of reflector layers 11 reflects any light substantially in an angular range from 0° to approximately 40° with respect to the normal of the surface. Inserting the cavity layer 10 between two reflector layers 11 at a resonant wavelength for which the cavity layer 10 is designed leads to an increased transmission through the reflector layers 11. Resonance exists when the light wave is in phase with the starting point after being reflected twice at the reflector layers 11 and after operation through the cavity layer 10. The spectral permittivity of the cavity mode shows a strong angular dependence and shifts to shorter wavelengths because of the altered phase length at oblique incident angles of the light. The displacement in dependence on the angle of incidence increases as the effective refractive index n* of the dielectric structure decreases. For a high-index cavity layer, the effective refractive index n* is given by
n*=√{square root over ((n.sub.Hn.sub.L))} (1),
where n.sub.H is the refractive index of a reflector layer configured as high-index layer 12 and n.sub.L is the refractive index of a reflector layer configured as low-index layer 13, and for a low-index cavity layer is given by
where the angular dependence Δλ(θ.sub.0) of the transmission can be described approximately by the term:
where θ.sub.0 is selected in radiants and no corresponds to the refractive index of the environment of the filter by which is meant the adjoining materials, typically glass in the present application. The same dielectric material as that used for the high-index or low-index reflector layers can be used for the high-index and low-index cavity layers so that at least two materials with different refractive indices are needed for the construction of a dielectric cavity filter.
[0074] The angular dependence Δλ(θ.sub.0) of the transmission of a cavity filter is shown by way of example in
[0075] For the human fingerprint, a period length of approximately 400 μm is measured from ridge to ridge, which corresponds to a spatial frequency of k=2.5 line pairs per millimeter. The point spread function which is given by the reflection of a typical display illumination—i.e., without the use of a cavity filter—on the placement surface 1 yields the curve—shown by a dotted line in
[0076] By using the additional shutter structure as shown in
[0077] Because of the angle selectivity of the cavity filter, it is possible to configure the cavity filter in such a way that recordings can be made in two colors. However, it must be taken into account that the cavity filter is transparent to light of this second color in a different angular range, which is also a precondition for scanning two different zones on the placement surface with light of two colors. The different angle selectivity for different colors is also explained referring to FIG. 4a. A further wavelength range Δλ.sub.F around a second wavelength λ.sub.F is labelled above the wavelength range Δλ.sub.R around the resonant wavelength. This second wavelength λ.sub.F is shorter than the resonant wavelength and, in the example, resides in the blue region at about 460 nm, whereas the resonant wavelength resides in the green region at about 550 nm. For this further wavelength range, the cavity filter is only transparent in an angular range between approximately 25° and 40°, i.e., does not overlap with the angular range for which the cavity filter is transparent in the resonant wavelength. This can be utilized for detecting fake fingerprints as will be explained below referring to
[0078] The device described above can be used to differentiate between an object (finger) placed on the placement surface 1 and a forgery of a fingerprint. A first method for detecting fakes is described referring to
[0079] For the detection of forgeries, it is advantageous when the second angular range for the second wavelength λ.sub.F includes angles which are smaller than the angle of total internal reflection at the placement surface 1, since no light can be transmitted at angles >42° by many displays because of an integrated air layer due to total internal reflection at the interface. When an actual finger is placed on the placement surface 1, the differences between the first overall image and the second overall image are clear. While the first wavelength λ.sub.R can be used for imaging the fingerprint in the first overall image, the detected signal decreases significantly during illumination with the second wavelength λ.sub.F because the total internal reflection is frustrated or significant portions of light are also coupled out at angles close to total internal reflection. In contrast, there is no drop in intensity detectable in a forgery when illuminated with the second wavelength λF.
[0080] Of course, it is also possible to capture and compare more than two overall images per angular range, and all of the overall images are captured with different colors. This increases the accuracy in determining whether or not a forgery is present.
[0081] Since a plurality of images must be captured sequentially in the method described above, this could possibly be perceived as a disadvantage by users of a mobile device. In order to accelerate the detection of forgeries, the method described above can be somewhat modified and a plurality of images can then be captured simultaneously. This will be explained in the following referring to
[0082] In contrast to the method shown in
[0083]
[0084] Another possibility for circumventing sequential recordings is to use color sensors which only detect light for determined spectral ranges instead of expensive monochromatic optical sensors. The optical sensor pixels then comprise different color sensor pixels which are alternately arranged in columns and rows in which the sensor pixels are arranged. If the color to be detected is adapted to the transparent region of the cavity filter, a plurality of overall images can be imaged in a recording and evaluated.
[0085] The comparison of image characteristics after the images have been captured can be used not only to detect forged fingerprints but also, for example, to achieve an increased resolution and compensate for sensor defects or other errors in the image recording by means of superimposing the images or overall images.
[0086] As has already been mentioned, the cavity filter can be designed for a plurality of different angular ranges and wavelength ranges, which should preferably be selected in such a way that the wavelengths are far enough apart to exclude an overlapping of angular ranges.
[0087] By means of the device described above and the method described above, an authentication of multiple fingers, for example, can be integrated in mobile telephones without impairing the quality of the display of information on the display screen. Also, almost the entire surface of the device is available for displaying information because the entire surface of the display screen can be used for detecting the fingerprint and no area need be reserved exclusively for detecting prints. The detection of fingerprints is carried out inconspicuously and is hardly noticed by the user. Integration in thicker display screens is also possible through the use of cavity filters.
REFERENCE NUMERALS
[0088] 1 placement surface [0089] 2 protective layer [0090] 3 touchpad [0091] 4 display unit [0092] 5 sensor layer [0093] 6 cavity filter layer [0094] 7 shutter structure [0095] 8 light guide layer body [0096] 9 second illumination unit [0097] 10 cavity layer [0098] 11 reflector layers [0099] 12 high-index layer [0100] 13 low-index layer [0101] 14 sensor pixel [0102] 15 detection area [0103] 16 shutter/additional shutter [0104] 17 finger