METHOD FOR DETERMINING A MATCH BETWEEN A CANDIDATE FINGERPRINT AND A REFERENCE FINGERPRINT
20220335749 · 2022-10-20
Assignee
Inventors
Cpc classification
International classification
Abstract
Provided is a method for determining a match between a candidate fingerprint and a reference fingerprint characterized by minutiae local features. The method includes extracting several minutiae from the candidate fingerprint, computing from said extracted minutiae a plurality of minutiae local features of the candidate fingerprint, computing a first global matching score between the candidate fingerprint and the reference fingerprint based on the first similarity scores of said matching local feature pairs; computing a second global matching score between the candidate fingerprint and the reference fingerprint based on said computed second similarity scores; and determining a match between the candidate fingerprint and the reference fingerprint comprising: comparing the first and second global matching scores and, comparing the first matching score to a matching threshold. Other embodiments disclosed.
Claims
1. A method for determining a match between a candidate fingerprint and a reference fingerprint characterized by minutiae local features, the method comprising the steps of: extracting several minutiae from the candidate fingerprint; computing from said several minutiae a plurality of minutiae local features of the candidate fingerprint; for at least one local feature pair, called current local feature pair, among a plurality of local feature pairs comprising each a candidate fingerprint local feature and a reference fingerprint local feature: computing a first similarity score evaluating the similarity of the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair, storing said computed first similarity score, determining a match between the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair based on said computed first similarity score; computing a first global matching score between the candidate fingerprint and the reference fingerprint based on the first similarity scores of said matching local feature pairs; for each matching local feature pair, computing a second similarity score evaluating the similarity of the candidate fingerprint local feature and the reference fingerprint local feature of the matching local feature pair; computing a second global matching score between the candidate fingerprint and the reference fingerprint based on said computed second similarity scores; and determining a match between the candidate fingerprint and the reference fingerprint comprising: comparing the first and second global matching scores, and comparing the first matching score to a matching threshold.
2. The method of claim 1, wherein the minutiae local features are a local neighborhood of minutiae.
3. The method of claim 1, wherein the minutiae local features are Delaunay minutiae triangles generated using Delaunay triangulation from extracted minutiae.
4. The method of claim 1, wherein the local features being Delaunay minutiae triangles: computing a similarity score of the candidate fingerprint triangle and the reference fingerprint triangle of the current triangle pair comprises: computing said similarity score based on a edge length difference and/or a minutia edge angle difference and/or a minutia type between the candidate fingerprint triangle and the reference fingerprint triangle of the current triangle pair.
5. The method of claim 1, wherein: the step of determining a match between the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair comprises further: for each local feature pair of the plurality of local feature pairs other than said current local feature pair, called different local feature pair, determining a geometric coherence score evaluating the geometric coherence of the candidate fingerprint local features of the current local feature pair and of the different local feature pair with the reference fingerprint local features of the current local feature pair and of the different local feature pair, computing a global coherence weight for the current local feature pair based on said first similarity score and said geometric coherence scores computed for said current local feature pair, comparing said computed global coherence weight with a predetermined weight threshold. said first or second global matching score between the candidate fingerprint and the reference fingerprint is computed from said first or second similarity scores and from the global coherence weights of the triangle pairs whose computed global coherence weight is above said predetermined weight threshold.
6. The method of claim 5, wherein evaluating the geometric coherence comprises: comparing the relative distance and/or the orientation/relative rotation between the candidate fingerprint local features of the current local feature pair and of the different local feature pair with the relative distance and/or the orientation/relative rotation between the reference fingerprint local features of the current local feature pair and of the different local feature pair.
7. The method of claim 6, wherein the local features being Delaunay minutiae triangles: determining a geometric coherence score evaluating the geometric coherence of the candidate fingerprint triangles of the current triangle pair and of the different triangle pair with the reference fingerprint triangles of the current triangle pair and of the different triangle pair comprises: computing said geometric consistency score based on the variation, between the candidate fingerprint and the reference fingerprint, of the distance between the mass centers of the triangles of the current and of the different triangle pairs and/or based on the variation, between the candidate fingerprint and the reference fingerprint, of the relative orientation between the triangles of the current and of the different triangle pairs.
8. A computer program product directly loadable into a memory of at least one computer, comprising software code instructions for performing the following steps when said product is run on the at least one computer extracting several minutia from the candidate fingerprint; computing from said several minutiae a plurality of minutiae local features of the candidate fingerprint; for at least one local feature pair, called current local feature pair, among a plurality of local feature pairs comprising each a candidate fingerprint local feature and a reference fingerprint local feature: computing a first similarity score evaluating the similarity of the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair, storing said computed first similarity score, and determining a match between the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair based on said computed first similarity score; computing a first global matching score between the candidate fingerprint and the reference fingerprint based on the first similarity scores of said matching local feature pairs; for each matching local feature pair, computing a second similarity score evaluating the similarity of the candidate fingerprint local feature and the reference fingerprint local feature of the matching local feature pair; computing a second global matching score between the candidate fingerprint and the reference fingerprint based on said computed second similarity scores; and determining a match between the candidate fingerprint and the reference fingerprint comprising: comparing the first and second global matching scores, and comparing the first matching score to a matching threshold.
9. A client device configured for determining a match between a candidate fingerprint and a reference fingerprint characterized by minutiae local features, the device comprising a processor, a memory coupled thereto, and an input-output interface coupled thereto, wherein the client device by way of the processor, memory and input-output interface is configured for: extracting several minutiae from the candidate fingerprint; computing from said several minutia a plurality of minutia local features of the candidate fingerprint; for at least one local feature pair, called current local feature pair, among a plurality of local feature pairs comprising each a candidate fingerprint local feature and a reference fingerprint local feature: computing a first similarity score evaluating the similarity of the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair, storing said computed first similarity score, and determining a match between the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair based on said computed first similarity score; computing as first global matching score between the candidate fingerprint and the reference fingerprint based on the first similarity scores of said matching local feature pairs; for each matching local feature pair, computing a second similarity score evaluating the similarity of the candidate fingerprint local feature and the reference fingerprint local feature of the matching local feature pair; computing a second global matching score between the candidate fingerprint and the reference fingerprint based on said second similarity scores; and determining a match between the candidate fingerprint and the reference fingerprint comprising: comparing the first and second global matching scores, and comparing the first matching score to a matching threshold.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0038] The following description and the annexed drawings set forth in detail certain illustrative aspects and are indicative of but a few of the various ways in which the principles of the embodiments may be employed. Other advantages and novel features will become apparent from the following detailed description when considered in conjunction with the drawings and the disclosed embodiments are intended to include all such aspects and their equivalents.
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
[0049] The invention aims at protecting against tampering a matching process trying to determine a matching between a candidate fingerprint and a reference fingerprint, both characterized by a set of minutiae and by local features of these minutiae.
[0050] In an embodiment, minutiae local features are a local neighborhood of the minutiae. For example such a local feature may be information about the fingerprint texture around a minutia, or information about the neighboring minutiae.
[0051] In an embodiment, the minutiae local features are Delaunay minutiae triangles generated using Delaunay triangulation from minutiae extracted from the fingerprints. In the rest of the description, it will be assumed that the minutiae local features are Delaunay minutiae triangles, as an example.
[0052] For that purpose, the main idea of the method according to the invention is to make two times the calculation of the fingerprint matching score of the matching process in order to check that it has not been tampered with. In order to limit the cost of such an additional calculation, an idea of the method according to the invention is to recompute scores only for pairs of minutiae already identified as matching minutiae during the first calculation of a fingerprint matching score.
[0053] As illustrated on
[0054] The matching device is connected to a storage unit 102 for storing reference fingerprints. This storage unit may be integrated in the matching device. Alternatively, as shown on
[0055]
[0056] The matching device may also include input/output means 207 providing interfaces to an administrator of the matching device, such as one or more screens, loudspeakers, a mouse, tactile surfaces, a keyboard etc . . .
[0057] The following paragraphs describe the steps of a method for determining a match between a candidate fingerprint and a reference fingerprint characterized by minutiae local features, performed by the matching device 101 according to a first aspect of the invention as depicted on
[0058] In a first step S1, the matching device extracts several minutiae from the candidate fingerprint. Each minutia may be defined by its coordinates in the fingerprint it is extracted from, by its orientation, and by a type indicating for example whether the minutiae is a ridge ending or a bifurcation.
[0059] In a second step S2, the matching device computes from said extracted minutiae a plurality of minutiae local features of the candidate fingerprint. The minutiae local features may be Delaunay minutiae triangles generated using Delaunay triangulation from the extracted minutiae.
[0063]
[0064] In the following paragraphs, minutiae local features are called “local features”; and a set gathering a local feature of a candidate fingerprint and a local feature of a reference fingerprint is called a “local feature pair”.
[0065] The following steps describe the process applied to at least one local feature pair, called current local feature pair, among the plurality of local feature pairs gathering a local feature of the candidate fingerprint and a local feature of the reference fingerprint. Such steps are preferably applied to most of or all of these local feature pairs.
[0066] In a third step S3, the matching device computes a first similarity score evaluating the similarity of the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair.
[0067] In a fourth step S4, the matching device stores the first similarity score. It may for example be stored in its RAM 203, or its NVM 205.
[0068] When local features are Delaunay minutiae triangles, computing a similarity score of the candidate fingerprint triangle and the reference fingerprint triangle of the current triangle pair may comprise computing a similarity score based on a edge length difference and/or a minutia edge angle difference and/or a minutia type between the candidate fingerprint triangle and the reference fingerprint triangle of the current triangle pair.
[0069] Such third and fourth steps may be repeated for all local feature pairs, i.e. such that a similarity score is computed for each triangle of the candidate fingerprint with all the triangles of the reference fingerprint.
[0070] Given two triangles c and r, the similarity score S.sub.t(c, r) may be defined as.
[0071] where S.sub.t.sup.max is a predefined maximum similarity score; C.sub.d, C.sub.α and C.sub.m are feature costs due to feature dissimilarity of two triangles, C.sub.d.sup.max and C.sub.d.sup.max are predefined cost thresholds.
[0072] The function C.sub.d(c,r) computes the edge length difference costs of the triangles, either as absolute values or as a percentage of the total edge length of the reference or candidate triangles, and may be defined as:
[0073] where d.sub.i.sup.c and d.sub.i.sup.r are edge length of candidate and reference triangles respectively; THD.sub.l is a predefined maximum allowable edge length difference; C.sub.d.sup.u is a unit cost of edge length difference.
[0074] The function C.sub.α(c, r) computes the minutia edge angle difference costs of the triangles:
[0075] where α.sub.i.sup.c and α.sub.i.sup.r may for example be the mean of minutia edge angles at triangle's vertices of candidate and reference triangles respectively; THD.sub.α is the maximum allowable edge length difference; C.sub.α.sup.u is the unit cost of minutia edge angle difference.
[0076] C.sub.m(c, r) computes a minutiae type difference cost defined as:
C.sub.m(c,r)=sum.sub.i=1,2,3{I(m.sub.i.sup.c,m.sub.i.sup.r)×C.sub.m.sup.u}
[0077] where I(m.sub.i.sup.c, m.sub.i.sup.r) is the identity function, C.sub.m.sup.u is the unit cost of minutiae type mismatch.
[0078] Examples of similarity scores computed from the Delaunay triangles of
[0079] Using such formulas, when two triangles of a triangle pair are similar, their similarity score is high. On the other hand, when they are not similar, their similarity score is low or zero.
[0080] At the end of these steps, a triangle of the candidate fingerprint may have a high similarity score with several triangles of the reference fingerprint. On the other hand, some triangle of the candidate fingerprint may have only null similarity scores with all the triangles of the reference fingerprint.
[0081] In a fifth step S5, the matching device determines if the two local features of the current local feature pair match based on the evaluations performed in the previous steps.
[0082] More precisely, the matching device determines a match between the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair depending on the first similarity score computed for the current local feature pair. It may also take into account the results of other intermediate computations described hereafter.
[0083] In order to determine a match between the candidate fingerprint local feature and the reference fingerprint local feature of the current local feature pair, in addition to computing the associated similarity score, the matching device may check the geometric coherence of the current local feature pair with the other existing local feature pairs. In order to do so, the matching device may repeatedly select the current local feature pair and another local feature pair and check if the relative position of the two local features is the same in the candidate fingerprint and in the reference fingerprint. More precisely, the matching device may evaluate for each local feature pair other than the current local feature pair, called different local feature pair, the geometric coherence of the candidate fingerprint local features of the current local feature pair and of the different local feature pair with the reference fingerprint local features of the current local feature pair and of the different local feature pair.
[0084] Such a geometric coherence evaluation of two local features in the candidate fingerprint versus two local features in the reference fingerprint may include comparing the relative distance or relative orientation of the two local features in the candidate fingerprint with the relative distance or relative orientation of the two local features in the reference fingerprint. More precisely, it may comprise comparing the relative distance and/or the orientation/relative rotation between the candidate fingerprint local features of the current local feature pair and of the different local feature pair with the relative distance and/or the orientation/relative rotation between the reference fingerprint local features of the current local feature pair and of the different local feature pair.
[0085] When the local features are Delaunay triangles, such a geometric coherence evaluation may include computing a geometric consistency score based on the variation, between the candidate fingerprint and the reference fingerprint, of the distance between the mass centers of the triangles of the current and of the different triangle pairs and/or based on the variation, between the candidate fingerprint and the reference fingerprint, of the relative orientation between the triangles of the current and of the different triangle pairs.
[0086] For example, if we consider a first triangle pair TP.sub.i,u composed of a triangle i in the candidate fingerprint and a triangle u in the reference fingerprint, and a second triangle pair TP.sub.j,v composed of a triangle j in the candidate fingerprint and a triangle v in the reference fingerprint, a geometric consistency score S.sub.g(TP.sub.i,u,TP.sub.j,v) for these two triangle pairs may be defined as:
S.sub.g(TP.sub.i,u,TP.sub.j,v)=S.sub.dp(TP.sub.i,u,TP.sub.j,v)+S.sub.op(TP.sub.i,u,TP.sub.j,v)
and S.sub.g=max(S.sub.g.sup.min,S.sub.g)
where S.sub.g.sup.min is a minimum value of the geometric consistency score.
[0087] In this formula, S.sub.dp(TP.sub.i,u,TP.sub.j,v) is a distance consistency score which may be defined as:
S.sub.dp(TP.sub.i,u,TP.sub.j,v)=S.sub.dp.sup.max−DP.sup.d(TP.sub.i,u,TP.sub.j,v)×C.sub.dp.sup.u
and S.sub.dp=max(S.sub.dp.sup.min,S.sub.dp)
[0088] where S.sub.dp.sup.max and S.sub.dp.sup.min are predefined maximum and minimum S.sub.dp scores respectively; C.sub.dp.sup.u is the unit cost of distance difference; and DP.sup.d(TP.sub.i,u,TP.sub.j,v) is a distance difference of the two triangle pairs, which may be defined as:
DP.sup.d(TP.sub.i,u,TP.sub.j,v)=abs(d.sub.ij.sup.c−d.sub.uv.sup.r)
[0089] with d.sub.ij.sup.c the distance between the mass centers of the triangles i and j in the candidate fingerprint and d.sub.uv.sup.r the distance between the mass centers of the triangles u and v in the reference fingerprint.
[0090] When the triangles of the current local feature pair truly match and the triangles of the different local feature pair also truly match, the distance between the two local features should be almost the same in the candidate fingerprint and in the reference fingerprint; therefore the distance difference of the two triangle pairs DP.sup.d should be small.
[0091] In the geometric consistency score DP.sup.d(TP.sub.i,u, TP.sub.j,v) formula given above, S.sub.op(TP.sub.i,u, TP.sub.j,v) is an orientation consistency score which may be defined as:
S.sub.op(TP.sub.i,u,TP.sub.j,v)=S.sub.op.sup.max−OP.sup.d(TP.sub.i,u,TP.sub.j,v)×C.sub.op.sup.u
and S.sub.op=max(S.sub.op.sup.min,S.sub.op)
[0092] where S.sub.op.sup.max and S.sub.op.sup.min are predefined maximum and minimum S.sub.dp scores respectively; C.sub.op.sup.u is the unit cost of distance difference and OP.sup.d(TP.sub.i,u,TP.sub.j,v) is an orientation difference of the two triangle pairs, which may be defined as:
OP.sup.d(TP.sub.i,u,TP.sub.j,v)=abs(O.sup.d(T.sub.i.sup.c,T.sub.u.sup.r)−O.sup.d(T.sub.j.sup.c,T.sub.v.sup.r))
where O.sup.d(T.sub.1.sup.c, T.sub.1.sup.r) represents an orientation difference between two triangles and may be defined as the average, among all sides of the triangles, of the difference of orientation of a given triangle side between the two triangles O.sup.d(T.sub.1.sup.c, T.sub.1.sup.r)=avg(α.sub.d1, α.sub.d2, α.sub.d3), with αd.sub.i=α.sub.i.sup.r−α.sub.i.sup.c and α.sub.i.sup.r, respectively α.sub.i.sup.c, the orientation of side i in the reference triangle, respectively candidate triangle, relative to a reference direction, as shown on
[0093] When the triangles of the current local feature pair truly match and the triangles of the different local feature pair also truly match, even if a rotation has been applied to the candidate fingerprint, the orientation difference between the two triangles (one in the candidate fingerprint and one in the reference fingerprint) of the current local feature pair will be the same as the one between the two triangles of the different local feature pair and the orientation difference OP.sup.d(TP.sub.i,u,TP.sub.j,v) should be small.
[0094]
[0095] Such a geometric coherence evaluation may be repeated for all the local feature pairs in order to evaluate the geometric coherence of each local feature pair with all other local feature pairs.
[0096] The determination of a match in the fifth step may then comprise computing a global coherence weight for the current triangle pair based on the similarity score and the geometric consistency scores computed for the current triangle pair and comparing the computed global coherence weight with a predetermined threshold. After its calculation, each global coherence weight may be stored for future use, for example in the RAM memory or in the NVM memory of the matching device.
[0097] In a first embodiment, the global coherence weight may be the sum of all the geometric consistency scores computed for the current triangle pair.
[0098] In a second embodiment, the global coherence weight of the current triangle pair TP.sub.i may be a weighted sum of the geometric consistency scores computed for the current triangle pair: Σ(Sg(TPi, TPj)*St(TPj)), using as weight of the geometric score obtained for the set (TP.sub.i, TP.sub.j) the similarity score of TP.sub.j. Such a weighted sum may be computed iteratively.
[0099] The matching device may finally compare the computed global coherence weight with a predetermined weight threshold.
[0100]
[0101] This step may be repeated in order to determine a global coherence weight for each local feature pair and to determine if the two local features of each pair truly match.
[0102] At the end of the fifth step, the matching device has determined matching local feature pairs, i.e. the local features of the candidate fingerprint matching local features of the reference fingerprint.
[0103] In a sixth step S6, the matching device makes a first determination if the candidate fingerprint matches the reference fingerprint based on the results of the previous steps.
[0104] More precisely, the matching device computes a first global matching score between the candidate fingerprint and the reference fingerprint based on the first similarity scores of the matching local feature pairs. Such a score may also depend on the global coherence weights of the matching triangle pairs.
[0105] For example, such a first matching b my be defined as:
[0106] where W.sub.i is the global coherence weight of local feature pair i, S.sub.i is the similarity score of local feature pair i and M is the total number of triangle pairs. Such a score increases as the number of matching pairs and their similarity score and global coherence weight increases.
[0107] At the end of the sixth step, the matching device has a list of pairs of local features of the candidate fingerprint and the reference fingerprint considered as matching one another; and it made a first estimation whether the candidate fingerprint matches the reference fingerprint or not.
[0108] The next steps add some redundancy to process in order to check that this first estimation is the result of a genuine matching process and not the result of a matching process that has been tampered with.
[0109] In a seventh step S7, the matching device computes for each matching local feature pair a second similarity score evaluating the similarity of the candidate fingerprint local feature and the reference fingerprint local feature of the matching local feature pair. If the matching process has not been altered, the first and second similarity scores should be identical for a given local feature pair.
[0110] This step takes advantage of the determination of the matching local feature pairs performed in the previous steps. It only computes a new similarity score for these matching pairs, without computing anything for the other local feature pairs and without determining again which local feature pairs match. As a result, it requires much less calculation time than applying the third step to all local feature pairs.
[0111] In an eighth step S8, the matching device computes a second global matching score between the candidate fingerprint and the reference fingerprint based on said computed second similarity scores. As in the previous step, if the matching process has not been altered the first and second global matching scores are identical.
[0112] When global coherence weights have been computed for the local feature pairs, the second global matching scores may also depend on these global coherence weights.
[0113] In a first embodiment, the global coherence weights are only computed once and used for both calculations of the first and the second global matching scores.
[0114] In a second embodiment, the eighth step comprises the calculation of new global coherence weights at last for the matching local feature pairs.
[0115] In a ninth step S9, the matching device determines a match between the candidate fingerprint and the reference fingerprint, by: [0116] comparing the first and second global matching scores and, [0117] comparing the first matching score to a matching threshold.
[0118] The matching device may determine a match between the candidate and reference fingerprints only when the first and second global matching scores are equal, and when they are correctly positioned relatively to the matching threshold (for example above).
[0119] According to a second aspect, the invention is also related to a computer program product directly loadable into the memory of at least one computer, comprising software code instructions for performing the steps of the method according to the first aspect as described above when said product is run on the computer.
[0120] According to a third aspect, the invention is also related to client device 101 configured for determining a match between a candidate fingerprint and a reference fingerprint characterized by minutiae local features and comprising a processor 201, a memory 203, 204, 205 and an input-output interface 207 configured for performing the steps of the method according to the first aspect as described here above.
[0121] By performing the proposed matching process, the matching device is able to detect if the determination of a match between the candidate and the reference fingerprint based on the calculation of the first global matching score has been tampered with. In addition, such a process has a much lower cost than a fully redundant process that would perform all the six first steps of the process twice.