COMPUTER-IMPLEMENTED METHOD FOR INDIVIDUALISING A SPECTACLE FRAME ELEMENT BY DETERMINING A PARAMETRIC SUBSTITUTION MODEL OF A SPECTACLE FRAME ELEMENT, AND DEVICE AND SYSTEMS USING SUCH A METHOD
20220252906 · 2022-08-11
Inventors
Cpc classification
G02C13/005
PHYSICS
International classification
Abstract
A spectacle frame element is individualized by adapting a parametric model of the spectacle frame element to the head of a spectacles-wearer. A parametric substitution model, having at least one parameter, for the parametric model of the spectacle frame element is determined by specifying a plurality of instances of the parametric model in the form of realizations of the parametric model using concrete parameter values, at least one basic instance and at least one parametric deformation map for the at least one basic instance are determined from the predefined instances, the at least one parametric deformation map mapping the at least one basic instance to instances of the parametric model, and the parametric substitution model being determined at least from the at least one basic instance and the at least one parametric map.
Claims
1. A computer-implemented method for individualizing a spectacle frame element by fitting a parametric model of the spectacle frame element to the head of a spectacles wearer, the method comprising: determining a parametric equivalent model for the parametric model of the spectacle frame element, the parametric equivalent model having at least one parameter, by virtue of: specifying a plurality of entities of the parametric model in form of realizations of the parametric model with specific parameter values; determining at least one base entity; and determining at least one parametric deformation map for the at least one base entity from the specified plurality of entities, the at least one parametric deformation map mapping the at least one base entity on respective entities of the parametric model, and the parametric equivalent model being determined at least from the at least one base entity and from the at least one parametric deformation map; providing biometric data relating to the head of the spectacles wearer; and determining at least one parameter value for the at least one parameter of the parametric equivalent model of the spectacle frame element by optimizing a function which considers at least one surface point of a determined base entity of the parametric equivalent model of the spectacle frame element and the biometric data provided in relation to the head of the spectacles wearer.
2. A computer-implemented method for individualizing a spectacle frame element by fitting a parametric model of the spectacle frame element to the head of a spectacles wearer, the method comprising: determining a parametric equivalent model for the parametric model of the spectacle frame element, the parametric equivalent model having at least one parameter, by virtue of: specifying a plurality of entities of the parametric model in form of realizations of the parametric model with specific parameter values; determining a set of segments for the parametric model of the spectacle frame element, the specified entities being decomposed into segments from the set of segments; generating segment entities for each segment from the set of segments by selecting entities of a respective segment from the decomposed specified entities; determining at least one base segment entity; determining at least one parametric deformation map for the at least one base segment entity from the segment entities, the at least one parametric deformation map mapping the at least one base segment entity on segment entities of the parametric model; and determining the parametric equivalent model at least from the set of segments and from the at least one base segment entity and the at least one parametric deformation map for each segment from the set of segments; providing biometric data relating to the head of the spectacles wearer; and determining at least one parameter value for the at least one parameter of the parametric equivalent model of the spectacle frame element by optimizing a function which considers at least one surface point of at least one determined base segment entity of the parametric equivalent model of the spectacle frame element and the biometric data provided in relation to the head of the spectacles wearer.
3. A computer-implemented method for individualizing a spectacle frame element by fitting a parametric model of the spectacle frame element to the head of a spectacles wearer, the method comprising: determining a parametric equivalent model for the parametric model of the spectacle frame element, the parametric equivalent model having at least one parameter, by virtue of: determining a set of segments for the parametric model of the spectacle frame element, the parametric segment model from the parametric model of the spectacle frame element being determined for each segment, determining a parametric equivalent model having at least one parameter as a parametric segment equivalent model for each parametric segment model with the computer-implemented method as claimed in claim 1; and determining the parametric equivalent model from at least the set of segments and from the parametric segment equivalent model having at least one parameter; providing biometric data relating to the head of the spectacles wearer; and determining at least one parameter value for the at least one parameter of the parametric equivalent model of the spectacle frame element by optimizing a function which considers at least one surface point of a determined base entity of the at least one segment equivalent model of the parametric equivalent model of the spectacle frame element and the biometric data provided in relation to the head of the spectacles wearer.
4. The method as claimed in claim 2, wherein the segments from the set of segments are labeled as static, movable, or deformable.
5. The method as claimed in claim 4, wherein the parametric deformation maps are linear maps for the segments labeled as static and/or wherein the parametric deformation maps of the segments labeled as movable are affine maps, and/or wherein the parametric deformation maps of the segments labeled as deformable are approximated based on Bézier curves, splines, or NURBS.
6. The method as claimed in claim 2, wherein a method for recognizing points of inflection in signals and/or a mesh segmentation method and/or a multivariate fitting method and/or a skeletonization method and/or a machine learning method is applied during the decomposition of the entities of the parametric model of the spectacle frame element into segments from the set of segments, and/or wherein the segments from the set of segments are arranged hierarchically in a tree structure such that nodes connected in the tree structure are associated with segments with a common cut edge or cut surface in the parametric model, and/or wherein each segment in a tree structure is positioned and oriented relative to its parent segment in a coordinate system, and/or wherein entities of the parametric equivalent model in the form of realizations of the parametric equivalent model are post-processed with specific parameter values based on an algorithm for avoiding discontinuities at segment boundaries.
7. The method as claimed in claim 1, wherein additional features from the group containing ear support points, nose support points, support curves of ends of temples, 3-D lens planes, 3-D boxes, and nose pads are determined for the parametric equivalent model of the spectacle frame element, and/or wherein the parametric deformation maps originate from the group containing affine maps, polynomials, polynomial surfaces, Bézier curves, splines, or NURBS, and/or wherein method steps for determining the parametric equivalent model are iterated.
8. The method as claimed in claim 1, wherein, for determining the parametric equivalent model, a criterion is optimized from the group including weighted sum, average, maximum, and quantile of the distribution of the deviations between surfaces of the specified entities of the parametric model and surfaces of all those entities of the parametric equivalent model of the at least one spectacle frame element which are generable based on the specific parameter values, and/or wherein the specified entities of the parametric model are at least partly post-processed with an algorithm for rectifying errors, for improving a visual impression for the spectacles wearer, and/or for smoothing.
9. The method as claimed in claim 1, wherein the biometric data in relation to the head of the spectacles wearer includes at least one surface point of a representation of the head of the spectacles wearer.
10. The method as claimed in claim 9, wherein the function to be optimized minimizes the distance between point clouds, with a first point cloud containing at least one surface point of a base entity of the parametric equivalent model of the spectacle frame element and a second point cloud containing at least one surface point of the representation of the head of the spectacles wearer.
11. A provision of a parametric equivalent model determined in a method as claimed in claim 1, in a data format that differs from that of the parametric model.
12. A computer-implemented method for representing and/or compressing a given entity of a parametric model of a spectacle frame element in a computer unit on the basis of a parametric equivalent model of the spectacle frame element, the parametric equivalent model having at least one parameter and being determined in a method as claimed in claim 1, the method comprising: determining a respective parameter value for the at least one parameter of the parametric equivalent model of the spectacle frame element by optimizing a criterion from the group comprising weighted sum, average, maximum and quantile of the distribution of the deviations between surfaces of the given entity of the parametric model and surfaces of the entity of the parametric equivalent model generated based on the at least one parameter value; and storing the at least one determined parameter value in a memory of the computer unit.
13. A computer program stored on a non-transitory storage medium and having program code for carrying out all method steps of claim 1 when the computer program is loaded on a computer unit and/or executed on a computer unit.
14. An apparatus for individualizing and fitting a parametric model of a spectacle frame element to the head of a spectacles wearer, the apparatus comprising: a computer unit containing a computer-implemented method as claimed in claim 1 for fitting the parametric model of the spectacle frame element to the head of the spectacles wearer in the computer unit.
15. An apparatus for representing and/or compressing a given entity of a parametric model of a spectacle frame element, the apparatus comprising: a computer unit having a memory, the computer unit containing a computer-implemented method as claimed in claim 12 for representing and/or compressing the given entity in the memory of the computer unit.
16. A system having a device for producing a spectacle frame element that was individualized with the method as claimed claim 1, utilizing the at least one determined parameter value of the parametric equivalent model.
17. A system having a device for grinding spectacle lenses into a spectacle frame element that was individualized as claimed in claim 1, utilizing the at least one determined parameter value of the parametric equivalent model.
18. The method as claimed in claim 9, wherein the biometric data in relation to the head of the spectacles wearer includes a mesh of the head of the spectacles wearer.
19. The method as claimed in claim 3, wherein the segments from the set of segments are labeled as static, movable, or deformable.
20. The method as claimed in claim 19, wherein the parametric deformation maps are linear maps for the segments labeled as static and/or wherein the parametric deformation maps of the segments labeled as movable are affine maps, and/or wherein the parametric deformation maps of the segments labeled as deformable are approximated based on Bézier curves, splines, or NURBS.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0162] Below, exemplary embodiments of the disclosure, which are schematically depicted in the drawings, are described:
[0163]
[0164]
[0165]
[0166]
[0167]
[0168]
[0169]
[0170]
[0171]
[0172]
[0173]
[0174]
[0175]
[0176]
[0177]
[0178]
[0179]
[0180]
[0181]
[0182]
[0183]
[0184]
[0185]
[0186]
[0187]
[0188]
DESCRIPTION OF EXEMPLARY EMBODIMENTS
[0189]
[0190] If these spectacle frame elements 24 are already marked in the CAD model, it is possible to directly select the spectacle frame element 24 for which the parametric equivalent model should be determined. If no markings of individual spectacle frame elements 24 are available, or should this not be desired, it is possible to determine the parametric equivalent model for the entire spectacle frame.
[0191] The method does not require the availability of the parametric model from the frame manufacturer itself—a set of entities 30 is sufficient.
[0192] Entities 30 of the CAD model 22 are preferably available as a mesh 26.
[0193]
[0194]
[0195] The spectacle frame element 24 shown in
[0196] In a first method step 12 of the method 4, entities 30 of the parametric model of the spectacle frame element 24 in the form of the temple are specified. From these specified entities, at least one base entity 38 is determined in a second step 14 and at least one parametric deformation map f(b, α) is determined in a third step 16. The at least one parametric deformation map maps a base entity b on an entity 30 of the parametric equivalent model on the basis of parameters in the form of a parameter vector α. Various entities 30 of the parametric equivalent model can be generated by inserting different parameter values for α; by way of example, the length and/or width of the temples can be varied as a result, so that the spectacle frame element 24 can be fitted to the head of the spectacles wearer.
[0197] The steps of the method 4 for generating the parametric equivalent model of the spectacle frame element 24 can be repeated in a plurality of iterations 18.
[0198]
[0199] The spectacle frame element 24 shown in
[0200] In a first method step 12 of the method 4′, a plurality of entities 30 of the parametric model of the spectacle frame element 24 in the form of the frame front are specified. A set of segments 40 of the parametric model of the spectacle frame element 24 is determined in a second step 13. The specified entities 30 of the parametric model are decomposed into the segments 40 from the set of segments 40 in a further step 15. A set of segment entities 43 is selected from the decomposed specified entities in a next step 17. Thus, for each segment 40 from the set of segments 40, the respective segment 40 is selected from the decomposed specified entities 30 and the selected segments 40 are combined to form a set of specified segment entities 43, for example as shown for the top left part of the frame front in
[0201] In this case, the specified entities 30 can be generated by varying the parameter values for the parameters of the CAD model 22.
[0202] In this case, it is advantageous if the specified entities 30 are available in a single coordinate system 32, as shown in
[0203] Moreover, the specified entities 30 may be pre-processed in a pre-processing step 44 in order to correct errors, for example topological defects such as holes or an irregular triangulation, for example an irregular density or size of the surface triangles, and/or in order to improve the visual impression of the entities 30 for the spectacles wearer. To this end, use can be made of a Poisson surface reconstruction algorithm, for example as described in the article “Poisson Surface Reconstruction,” Michael Kazhdan, Matthew Bolitho and Hugues Hoppe, Proceedings of the fourth Eurographics symposium on Geometry processing, 2006, the entirety of which is referred to herewith and the disclosure of which is included in the description of this disclosure.
[0204] The steps of the method 4′ for generating the parametric equivalent model of the spectacle frame element 24 can be repeated in a plurality of iterations 18.
[0205]
[0206] The spectacle frame element 24 shown in
[0207] A set of segments 40 of the parametric model of the spectacle frame element 24 is determined in a first method step 12 of the method 4.″ Moreover, a parametric segment model is determined for each segment 40 on the basis of the parametric model. To this end, the parametric model can already be available in the form of individual segments, for example in a CAD file which contains a plurality of parts of a spectacle frame. Then, in a further step 19, a parametric segment equivalent model is determined for each parametric segment model by means of a method that was explained above on the basis of
[0208] When determining the elements of the parametric equivalent model, it is advantageous in each case to optimize a criterion from the group comprising weighted sum, average, maximum and quantile of the distribution of the deviations between surfaces of the specified entities 30 of the parametric model and surfaces of all those entities 30 of the parametric equivalent model of the at least one spectacle frame element 24 which are generable on the basis of specific parameter values.
[0209] It is also advantageous if the parametric equivalent model is provided in a data format that differs from that of the parametric model. This is because this allows the parametric equivalent model to be used independently of the program and the data format in which the parametric model is available.
[0210] A set of segments 40 of the parametric model of the spectacle frame element 24 is determined in the second step 13 of the method 10′. This measure is targeted at reproducing the virtual manner of production of the parametric model from the frame manufacturer to the best possible extent.
[0211] To determine the set of segments 40, it is possible to examine the effects of the various parameters of the CAD model 22 created by the frame manufacturer, for example frame size, temple length, bridge width, inclination angle and opening angle, on the geometry of the parametric model of the spectacle frame element 24 on the basis of the specified entities 30 of the parametric model of the spectacle frame element 24, as shown in
[0212] As shown in
[0213] For the segments 40 from the set of segments 40 of the parametric equivalent model of the at least one spectacle frame element 24, it is possible to determine additional features for fitting the latter to the head of the spectacles wearer, for example ear support points for the temples, support curves of the ends of the temples, 3-D lens planes as an approximation for the lenses to be fitted into the spectacle frame, 3-D boxes for approximating the rims of the frame front, nose pads and/or nose support points for the frame front. These additional data may require manual interaction by the user, for example by selecting points or straight lines in the data displayed on a screen.
[0214] In step 15 of the method 10′, the specified entities 30 of the frame front are decomposed into segments 40 from the set of segments 40. The entities 30 can be segmented manually by an input by a user by way of the user interface or segmented automatically by means of an algorithm, as described on the basis of
[0215] By way of example, the frame front is decomposed into the twelve segments shown in
[0216] If the specified entities 30 are available as a mesh 26, it is advantageous if they are partitioned into disjoint segments 40 from the set of segments 40, in such a way that each segment entity 43 consists of a set of surface points 28 that is contiguous in relation to the triangulation of the mesh 26. In this case, the triangulation of the mesh 26 is maintained even after the decomposition of the specified entities 30 into segments 40.
[0217] In the second step 14 of the method 10, at least one base entity 38 is provided on the basis of the specified entities 30 of the parametric model of the spectacle frame element 24, as shown in
[0218] Alternatively, one of the specified entities 30 may also be selected as a base entity 38. In this case, the at least one base entity 38 can be chosen in such a way that further entities 30, for example the remaining specified entities 30, are reproducible with the smallest possible error by an application of the parametric deformation maps.
[0219] The at least one base entity 38 can also be selected on the basis of inputs of a user by way of the user interface or automatically by way of an algorithm. In this case, the algorithm can assess quality criteria, for example the deviation of the entities 30 reproduced on the basis of the parametric equivalent model from the specified entities 30.
[0220] The at least one base segment entity 39 can be determined in the same way from the specified entities 30 that have been decomposed into segments 40, the base segment entities 39.
[0221] In the last step 16 of the method 10, at least one parametric deformation map is determined for the at least one base entity 38 for the purposes of mapping the latter on further entities 30 of the parametric model of the spectacle frame element 24. In this case, the at least one parametric deformation map is defined in the form of a map f(b, α) with parameters α to be determined, which alter the base entity b.
[0222] By way of example, affine maps which describe a rotation, a translation and a scaling of the segments 40 can be chosen as deformation maps.
[0223] It is advantageous if the at least one parametric deformation map of the parametric equivalent model originates from the group comprising affine maps, polynomials, polynomial surfaces, Bézier curves, splines or NURBS.
[0224] In particular, it is advantageous if the segments 40 from the set of segments 40 of the parametric equivalent model are labeled static, movable or deformable.
[0225] It is particularly advantageous if the parametric deformation maps of the segments 40 labeled as static are linear maps, if the parametric deformation maps of the segments 40 labeled as movable are affine maps and if the parametric deformation maps of the segments 40 labeled as deformable are approximated on the basis of polynomials, polynomial surfaces, Bézier curves, splines or NURBS.
[0226] Segments 40 labeled as movable or deformable which do not follow a uniform movement may be connection surfaces between spectacle frame elements 24 and/or segments 40. These comprise contact curves in the respective contact region with the adjacent segment 40. It may be advantageous for these if additional connection conditions in the form of points and normal vectors at a few points of the contact curve are defined.
[0227] At least one base segment entity 39 and at least one parametric deformation map are determined for each segment 40 from the set of segments 40, in such a way that the at least one parametric deformation map maps the base segment entity 39 on further segment entities 43 with as little deviation as possible.
[0228] It is advantageous if an algorithm which minimizes the deviations of entities 30 of the parametric model from all generable entities 30 of the parametric equivalent model is used for determining the elements of the parametric equivalent model of the spectacle frame element 24, in particular the set of the segments 40, the at least one base entity 38 and/or the parametric deformation maps.
[0229] Machine learning methods can be used to determine the elements of the parametric equivalent model, in particular the at least one base entity 38 and the at least one parametric deformation map. This likewise applies to the determination of the at least one base segment entity 39 and the at least one parametric deformation map for the method 10′.
[0230] Preferably, principal component analysis can be used here, as depicted in
f(b,α)=b+Σ.sub.i=1.sup.nα.sub.iv.sub.i.
[0231] If a specific entity 30 of a CAD model 22 of a spectacle frame element 24 is available, the latter can be represented as follows on the basis of the parametric equivalent model of the at least one spectacle frame element 24 for this CAD model 22 of the spectacle frame element 24. Firstly, the entity 30 is decomposed into the segments 40 from the set of segments 40 of the parametric equivalent model of the at least one spectacle frame element 24. Then, a base entity 38 of the parametric equivalent model of the spectacle frame element 24 is chosen. Then, the specific deformation map can be calculated for each of the segments 40, the deformation map mapping the respective segment 40 of the base entity 38 to the corresponding segment 40 of the specific entity 30, for example as described further below on the basis of
[0232]
[0233] The specified entities can be pre-processed in a pre-processing step 44 for the purposes of repairing visual or topological defects.
[0234] As described on the basis of
[0235] If there is no partitioning of the parametric model of the spectacle frame element 24 available, the method 4′ depicted in
[0236] Since a dedicated deformation map is determined independently of the other segments 40 for each segment 40 of the at least one base entity 38 of the spectacle frame element 24, there may be discontinuities 78 at the segment boundaries 41. These can be prevented by a smoothing method which is applied in a post-processing step 46 on the generated meshes 26 of the entities 30, for example a Delta-Mush method as described below on the basis of
[0237]
[0238] The right subtree 58 of the “bridge” node describes the right part of the parametric model of the spectacle frame up to the bridge, the left subtree 58 describes the left part up to the bridge. The two subtrees 58 of the bridge node are symmetric since the two halves of the parametric model of the spectacle frame are also symmetric.
[0239] If a plurality of spectacle frame elements 24 are present, these can also be arranged hierarchically in a tree structure 54, for example as shown in
[0240]
[0241] To this end, the frame manufacturer creates a CAD model 22 of the spectacle frame element 24 with alterable parameters. To determine a parametric equivalent model of the spectacle frame element 24 for this model, a set of specified entities 30 of the CAD model is created for various parameter sets. The parametric equivalent model of the spectacle frame element 24 is calculated from the specified entities 30 on the basis of an above-described method. This parametric equivalent model of the spectacle frame element 24 can be stored in a database 42. A respective parametric equivalent model can then be stored in the database 42 for different CAD models 22 of different spectacle frame elements 24.
[0242] By way of example, this database 42 with parametric equivalent models of spectacle frame elements 24 can be used as follows in a system for individualizing and adapting spectacle frame elements 24:
[0243] In a first step 48, a representation of the head of the spectacles wearer is created by means of a 3-D measurement system on the basis of a head model in a coordinate system. A representation for a specific parameter set is generated for each parametric equivalent model in the database 42. This representation can also be stored together therewith in the database 42 in order to save computation time.
[0244] The spectacles wearer can select a spectacle frame element 24 from the representations of the parametric equivalent models of the various spectacle frame elements 24 in a further step 49. On the basis of the parametric equivalent model, this spectacle frame element 24 can be fitted in a step 50 to the previously created head model by means of algorithms as are described, for example, in EP 3 425 447 A1 or EP 3 425 446 A1, the entirety of which is referred to herewith and the disclosure of which is included in the description of this disclosure.
[0245] To this end, a base entity 38 is selected together with a decomposition of the latter into segments 40 of the parametric equivalent model of the spectacle frame element 24. This is transformed into the coordinate system 32 of the head model. Finally, the parameters of the parametric deformation maps are optimized for each of the segments 40 of the base entity 38, in such a way that the spectacle frame element 24 is fitted to the head model.
[0246] It should be observed that, in principle, in step 50, the parametric equivalent model can also be used to optimally fit the spectacle frame element 24 to the previously created head model manually on the basis of user inputs via a user interface. The parameter values determined in the process are stored for the spectacles wearer.
[0247] Then, a mesh 26 of the spectacle frame element 24 is calculated for the selected parametric equivalent model of the spectacle frame element 24 and the optimized parameter values of this model. This can be indicated in a step 52 in the worn position on the head model of the spectacles wearer.
[0248] Optionally, parameter values of the parametric equivalent model of the spectacle frame element 24 or the position of the rendered spectacle frame element 24 can be fitted to the head model.
[0249] The selected spectacle frame element 24 can then be transmitted to an ordering system.
[0250] If the various spectacle frame elements 24 are stored together with the parametric equivalent models thereof in the ordering system, all that needs to be transferred for an order are the calculated parameter values of the parametric equivalent model, that is to say optionally the index of the selected base entity 38 if a plurality thereof are contained in the model, and the parameter values of the deformation maps, saving transmission time and even being possible in the case of a low-bandwidth Internet connection.
[0251] A computer-implemented method for representing and/or compressing a given entity 30 of a parametric model of a spectacle frame element 24 on the basis of a parametric equivalent model of the spectacle frame element 24 determined in an above-described method, the parametric equivalent model having at least one parameter, in a computer unit is described on the basis of
[0252]
[0253] The algorithm comprises the following steps: projecting the surface points 28 of the mesh 26 of the entity 30 on a plane 60, determining signals 72 at the protection points 62 associated with rims 68, 70 of the entity 30, and determining the points of inflection 74 of these signals 72 and the mean values of the partial signals 76, 76′. The decomposition can then be described using a parameter set of n elements Z⊂.sup.n.
[0254] In the present example of the frame front, the set of segments 40 consists of twelve segments 40. So that the segmentation method is applicable to various entities 30 of the same parametric model, the entities 30 are available in an aligned fashion in a coordinate system 32, as described on the basis of
[0255] The surface points 28 of the mesh 26 of the entity 30 to be decomposed are projected along a spatial axis on a plane 60, as shown in
[0256] Two sets are selected from the projection points 62: the first set 64 contains projection points 62 for surface points 28 of the upper rim 68 of the entity 30 of the CAD model of the frame front shown in
[0257] By way of example, the abscissa can be sensed at regular intervals, for example of 1 mm, to this end.
[0258] To obtain the first set 64 of projection points 62, a set of projection points 62 with a similar abscissa value can be determined for each sensed value on the abscissa, and the projection point 62 with the greatest value on the ordinate axis can be selected therefrom.
[0259] To obtain the second set 66 of projection points 62, a set of projection points 62 with a similar abscissa value can be determined for each sensed value on the abscissa, and the projection point 62 with the smallest value on the ordinate axis can be selected therefrom.
[0260] Then, the entity 30 can be decomposed automatically by means of an algorithm into segments 40 from the set of segments 40 on the basis of the first set 64 and the second set 66 of projection points 62 for an entity 30 of the parametric model of a spectacle frame element 24.
[0261] The upper rim 68 in the plane 60 represented by the first set 64 of projection points 62 as a contour and the lower rim 70 in the plane 60 represented by the second set 66 of projection points 62 as a contour can be considered to be signals 72, for the decomposition of which it is possible to use signal processing algorithms, for example an algorithm for detecting points of inflection 74 as described in the article “Using penalized contrasts for the change-point problem, Marc Lavielle, Signal Processing, 2005, volume 85, pp. 1801-1810,” the entirety of which is referred to herewith and the disclosure of which is included in the description of this disclosure.
[0262] If a signal 72 is available like the signal shown in .fwdarw.
be the continuous signal 72, which adopts the values S(X.sub.1), . . . S(X.sub.n) (vertical axis) at the sampling points X.sub.1, . . . X.sub.n (horizontal axis). It is possible to calculate a point of inflection 74 in the section of the signal 72 containing X.sub.1, . . . X.sub.n, by virtue of minimizing the target function J:
.fwdarw.
.sub.0.sup.+ comprising the sum of the variances of the first partial signal 76 containing X.sub.1, . . . X.sub.k−1 and of the second partial signal 76′ containing X.sub.k, . . . X.sub.n on the basis of the following optimization problem:
[0263] The optimization problem (1) can be modified in such a way that any desired number of points of inflection 74 can be detected in a signal 72.
[0264]
[0265] In
[0266]
[0267]
[0268] The decomposition of an entity 30 of the parametric model of the frame front can for example be described by the following parameter set
Z=(x.sub.1,x.sub.2,x.sub.3,x.sub.32,x.sub.4,x.sub.5,x.sub.6,x.sub.7,x.sub.71,x.sub.8,x.sub.9,Z.sub.1,Z.sub.2,Z.sub.21,Z.sub.3,Z.sub.4) (2)
[0269] with 16 parameter values: [0270] x.sub.1 minimum abscissa coordinate of all projection points 62 [0271] x.sub.9: maximum abscissa coordinate of all projection points 62 [0272] z.sub.1: minimum ordinate coordinate of all projection points 62 [0273] z.sub.4: maximum ordinate coordinate of all projection points 62
[0285]
[0286]
[0287] Since the same decomposition algorithm is applied to all entities 30 of the parametric model of the at least one spectacle frame element 24 or of the parametric equivalent model of the at least one spectacle frame element 24, each segment 40 of the one entity 30 can be directly assigned the corresponding segment 40 in the further entities 30. On the basis of these correspondences, it is possible to determine the parametric deformation maps for mapping the base segment entities 39 to further corresponding segment entities 43.
[0288] To improve the accuracy of the parametric deformation maps, it is possible to optimize the segmentation of the entities 30 by varying the parameter values Z in (2), as shown in
[0289] As an alternative to the detection of points of inflection 74 in signals 72 from rims 68, 70 for the purposes of determining the parameter set Z in (2) for decomposing entities 30 into segments 40 from the set of segments 40, it is possible to use mesh segmentation methods, multivariate fitting methods, skeletonization methods and/or machine learning methods.
[0290] In order to be able to represent an entity 30 of a parametric model of a spectacle frame element 24 on the basis of a parametric equivalent model of the spectacle frame element 24, the decomposition of the entity 30 into the segments 40 from the set of segments 40 must be followed by a determination of the parameter values of the associated parametric deformation maps for each of these segments 40.
[0291] To this end, use can be made of algorithms for aligning 3-D objects which minimize distances between point clouds, for example an iterative closest point (ICP) algorithm as described in the article “S. Rusinkiewicz and M. Levoy, Efficient variants of the ICP algorithm, Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, pp. 145-182, 2001,” the entirety of which is referred to herewith and the disclosure of which is included in the description of this disclosure.
[0292] An assumption can be made that the triangulation of the surface points 28 in the form of the triangular mesh, in particular the topology and the linking of the triangular structure, does not change when the parameter values of the parametric deformation maps are altered. The algorithms for determining the parameter values of the parametric deformation maps, for example the ICP algorithms, can then operate directly on the surface points 28 of the mesh 26. This saves computation time.
[0293]
[0294]
[0295]
[0296] For some spectacle frame elements 24, for example for the temples, the parametric deformation maps for the segments 40 can be chosen particularly easily, for example merely as a combination of a rotation matrix and a translation vector. Then, the parameter values can be determined on the basis of the ICP algorithm.
[0297] In this case, maps of the form
f:.sup.3.fwdarw.
.sup.3, f(x)=R.Math.x+t, R∈SO(3),t∈R.sup.3
[0298] can be chosen as parametric deformation maps, where SO(3) denotes the special orthogonal group of all rotations about the origin in three-dimensional Euclidean space.
[0299] In this case, the following optimization problem is solved iteratively, the optimization problem minimizing the sum, weighted with weights w.sub.i, of the distances of the surface points p.sub.i of the mesh 26 of a base segment entity 39 from the surface points q.sub.i, closest to p.sub.i, of the mesh 26 of the corresponding segment 40 of the further entity 30:
[0300] The weights can be chosen as w.sub.i=1. Alternatively, other weights are also applicable. By way of example, the weight w.sub.i for the points p.sub.i and q.sub.i can be determined on the basis of the angle between the surface normals present at this point:
w.sub.i=p.sub.i.Math.q.sub.i.
[0301] The surface normals for a point can be estimated from the closest neighbors of this point in the point cloud. This type of weighting is described, for example, in the aforementioned article regarding ICP algorithms.
[0302] Alternatively, other ICP variants are also applicable, for example as described in the article “A Method for Registration of 3-D Shapes,” Paul J. Besl and Neil D. McKay, IEEE Transactions on Pattern Analysis and Machine Intelligence, volume 14, edition 2, 1992, the entirety of which is referred to herewith and the disclosure of which is included in the description of this disclosure.
[0303] Advantageous for the speed of the method is the use of the point-to-plane ICP algorithm, for example as described in the article “Kok-Lim Low, Linear Least-Squares Optimization for Point-to-Plane ICP Surface Registration,” Department of Computer Science University of North Carolina at Chapel Hill, February 2004, the entirety of which is referred to herewith and the disclosure of which is included in the description of this disclosure. In this case, it is not the distance between the surface points of the entities that is minimized but the distance between the surface points of one entity and the tangential planes at the closest surface points of the other entity.
[0304]
[0305]
[0306] As an alternative to the ICP algorithms, it is also possible to use other deformation methods for determining the parameter values of the parametric deformation maps, in particular mesh editing methods. In this context, a surface is deformed on the basis of control points by solving a sparsely populated matrix problem. Examples of mesh editing methods include Laplacian surface editing, for example described in the article “Laplacian Surface Editing, O Sorkine, D. Cohen-Or, Eurographics Symposium on Geometry Processing, 2004,” or Poisson surface editing, described in the article “Mesh Editing with Poisson-Based Gradient Field Manipulation, Yizhou Yu et al., ACM SIGGRAPH 2004.”
[0307] The integration of symmetry assumptions in respect of individual segments 40 of the parametric model of the at least one spectacle frame element 24, for example of the left and of the right temple, into the parametric equivalent model of the at least one spectacle frame element 24 is advantageous.
[0308] In the case of a rather small variation of the parametric model of a spectacle frame element 24, the complexity of the parametric equivalent model can be reduced by using a larger set of base entities 38 instead of parametric deformation maps.
[0309] The determined parametric equivalent model for the parametric model of the frame front may contain the following elements with parameters: [0310] the number of segments 40 of the parametric model of the frame front; [0311] the meshes 26 of the at least one base segment entity 39 of the frame front; [0312] the parameter set Z in (2), containing the 16 parameters that describe the boundaries of the twelve segments 40; [0313] 12 rotation matrices and 12 translation vectors with parameters to be determined, which describe the parametric deformation maps for each segment 40 of the base segment entities 39; [0314] parameters of a post-processing step 46.
[0315] The parameter set Z in (2) that describes the decomposition of the parametric model is optional in this case since it has to be recalculated at all times on the basis of the decomposition algorithm and consequently need not be stored as well as a parameter of the parametric equivalent model. This saves transmission time and memory space. However, the additional storage saves computation time.
[0316] For a specific entity 30 of the parametric equivalent model of the frame front, it is sufficient to store the following parameter values: [0317] the index of the respectively selected base segment entity 39 for each segment 40 of the parametric equivalent model if a plurality of base segment entities 39 are available for one segment 40; [0318] the parameter values of the parametric deformation maps.
[0319] These parameter values can be transmitted to video centration equipment. There, the specific entity 30 can be restored merely on the basis of the respective index of the base segment entity 39 and of the parameter values of the parametric deformation maps, and on the basis of the parametric equivalent model, stored there, of the at least one spectacle frame element 24. Consequently, there is no need to transfer the entire mesh 26 of the specific entity 30 or of the parametric equivalent model of the at least one spectacle frame element 24 to the video centration equipment and store it there. The use of the parametric equivalent model consequently saves memory space and transmission time.
[0320] On the basis of the parametric equivalent model, it is possible by selecting parameter values to generate a mesh 26 of a spectacle frame element 24, as shown in
[0321] To avoid discontinuities 78 at segment boundaries 41 that may arise on account of the calculation of the parameter values for the parametric deformation maps being carried out independently for each segment 40, it is possible to use smoothing methods such as, e.g., the Delta Mush method, which is described in the article “Delta Mush: Smoothing Deformations while Preserving Detail, Joe Mancewicz, Matt L. Derksen, Hans Rijpkema, Cyrus A. Wilson, Proceedings of the 4th Symposium on Digital Production, 2014,” the entirety of which is referred to herewith and the disclosure of which is included in the description of this disclosure.
[0322] The Delta Mush method is advantageous over other smoothing methods in that there is only a small change in the mesh 26 on account of smoothing, and so calculations that require particularly high accuracy, for example a virtual centration, are possible even with the parametric equivalent model of the at least one spectacle frame element 24.
[0323]
[0324] A computer program product according to the disclosure contains a computer program with program code for carrying out the aforementioned method steps when the computer program is loaded into a computer unit and/or executed on a computer unit.
[0325] An apparatus for individualizing and fitting a parametric model of a spectacle frame element to the head of a spectacles wearer contains a computer unit, loaded in which there is a computer-implemented method for fitting the parametric model of the spectacle frame element to a representation of the head in a coordinate system.
[0326] An apparatus for representing and/or compressing a given entity of a parametric model of a spectacle frame element contains a computer unit having a memory, loaded in which there is a computer-implemented method for representing and/or compressing the given entity in the memory of the computer unit.
[0327] A system according to the disclosure having a device for producing a spectacle frame element individualized in an above-described method for individualizing a spectacle frame element or for grinding spectacle lenses into a spectacle frame element individualized in an above-described method for individualizing a spectacle frame element uses the at least one determined parameter value of the parametric equivalent model.
[0328] In summary, the following, in particular, should be noted: The disclosure relates to a method 10, 10′ for determining a parametric equivalent model of a spectacle frame element 24 for a parametric model of the spectacle frame element 24 for the purposes of fitting this parametric equivalent model to the head of a spectacles wearer. In this context, at least one base entity 38 is provided by creating at least one entity 30 of the parametric model of the spectacle frame element 24 in the form of a realization of the parametric model of the at least one spectacle frame element 24 on the basis of a set of specific parameter values. At least one parametric deformation map is determined for the at least one base entity 38, the at least one parametric deformation map mapping the at least one base entity 38 on entities 30 of the parametric model, the parametric equivalent model being determined at least from the at least one base entity 38 and from the at least one parametric deformation map. Alternatively, a set of segments 40 can be determined for the parametric model of the spectacle frame element 24. At least one base segment entity 39 and at least one parametric deformation map are determined for each segment 40. The at least one parametric deformation map then maps at least one base segment entity 39 on further segment entities 43 of the parametric model, the parametric equivalent model being determined at least from the set of segments 40 and from the at least one base segment entity 39 and the at least one parametric deformation map for each segment 40 from the set of segments 40.
[0329] Exemplary embodiments are described in the following clauses:
[0330] Clause 1. A computer-implemented method (10) for determining a parametric equivalent model for a parametric model of a spectacle frame element (24), the parametric equivalent model having at least one parameter, wherein
[0331] a plurality of entities (30) of the parametric model are specified in the form of realizations of the parametric model by means of specific parameter values,
[0332] at least one base entity (38) and
[0333] at least one parametric deformation map for the at least one base entity (38) is determined from the specified entities (30), the at least one parametric deformation map mapping the at least one base entity (38) on entities (30) of the parametric model, and the parametric equivalent model being determined at least from the at least one base entity (38) and from the at least one parametric deformation map.
[0334] Clause 2. A computer-implemented method (10) for determining a parametric equivalent model for a parametric model of a spectacle frame element (24), the parametric equivalent model having at least one parameter, wherein
[0335] a plurality of entities (30) of the parametric model are specified in the form of realizations of the parametric model by means of specific parameter values,
[0336] a set of segments (40) is determined for the parametric model of the spectacle frame element (24),
[0337] the specified entities (30) are decomposed into the segments (40) from the set of segments (40),
[0338] segment entities (43) are generated for each segment (40) from the set of segments (40) by virtue of entities (30) of this segment (40) being selected from the decomposed specified entities (30),
[0339] at least one base segment entity (39) and
[0340] at least one parametric deformation map for the at least one base segment entity (39) is determined from these segment entities (43),
[0341] the at least one parametric deformation map mapping the at least one base segment entity (39) on segment entities (43) of the parametric model,
[0342] and the parametric equivalent model being determined at least from the set of segments (40) and from the at least one base segment entity (39) and the at least one parametric deformation map for each segment (40) from the set of segments (40).
[0343] Clause 3. A computer-implemented method (10) for determining a parametric equivalent model for a parametric model of a spectacle frame element (24), the parametric equivalent model having at least one parameter, wherein
[0344] a plurality of entities (30) of the parametric model are specified in the form of realizations of the parametric model by means of specific parameter values,
[0345] a set of segments (40) is determined for the parametric model of the spectacle frame element (24),
[0346] the specified entities (30) are decomposed into the segments (40) from the set of segments (40),
[0347] segment entities (43) are generated for each segment (40) from the set of segments (40) by virtue of entities (30) of this segment (40) being selected from the decomposed specified entities (30),
[0348] a parametric equivalent model having at least one parameter is determined as a segment equivalent model for each segment (40) in a computer-implemented method according to clause 1, the segment entities (43) associated with each segment being used in this context as specified entities,
[0349] and the parametric equivalent model being determined at least from the set of segments (40) and from the parametric segment equivalent models having at least one parameter.
[0350] Clause 4. The method according to clause 2 or 3, characterized in that the segments (40) from the set of segments (40) are labeled as static, movable or deformable.
[0351] Clause 5. The method according to clause 4, characterized in that the parametric deformation maps are linear maps for the segments (40) labeled as static and/or in that the parametric deformation maps of the segments (40) labeled as movable are affine maps and/or in that the parametric deformation maps of the segments (40) labeled as deformable are approximated on the basis of Bézier curves, splines or NURBS.
[0352] Clause 6. The method according to any one of clauses 2 to 5, characterized in that a method for recognizing points of inflection (74) in signals (72) and/or a mesh segmentation method and/or a multivariate fitting method and/or a skeletonization method and/or a machine learning method is applied during the decomposition of entities (30) of the parametric model of the spectacle frame element (24) into segments (40) from the set of segments (40); and/or
[0353] in that the segments (40) from the set of segments (40) are arranged hierarchically in a tree structure (54) in such a way that the nodes (56, 56′) connected in the tree structure (54) are associated with segments (40) with a common cut edge or cut surface in the parametric model;
[0354] and/or
[0355] in that each segment (40) in the tree structure (54) is positioned and oriented relative to its parent segment in a coordinate system (32)
[0356] and/or
[0357] in that entities (30) of the parametric equivalent model in the form of realizations of the parametric equivalent model are post-processed by means of specific parameter values on the basis of an algorithm for avoiding discontinuities (78) at segment boundaries (41).
[0358] Clause 7. The method according to any one of clauses 1 to 6, characterized in that additional features from the group comprising ear support points, nose support points, support curves of the ends of the temples, 3-D lens planes, 3-D boxes, nose pads are determined for the parametric equivalent model of the spectacle frame element (24);
[0359] and/or
[0360] in that the parametric deformation maps originate from the group comprising affine maps, polynomials, polynomial surfaces, Bezier curves, splines or NURBS;
[0361] and/or
[0362] in that method steps for determining the parametric equivalent model are iterated.
[0363] Clause 8. The method according to any one of clauses 1 to 7, characterized in that, for determining the parametric equivalent model, a criterion is optimized from the group comprising weighted sum, average, maximum and quantile of the distribution of the deviations between surfaces of the specified entities (30) of the parametric model and surfaces of all those entities (30) of the parametric equivalent model of the at least one spectacle frame element (24) which are generable on the basis of specific parameter values, and/or
[0364] in that the specified entities (30) of the parametric model are at least partly post-processed by means of an algorithm for rectifying errors and/or for improving the visual impression for the spectacles wearer and/or for smoothing.
[0365] Clause 9. A provision of a parametric equivalent model determined in a method according to any one of clauses 1 to 8, in a data format that differs from that of the parametric model.
[0366] Clause 10. A computer-implemented method for individualizing a spectacle frame element (24) by fitting a parametric model of a spectacle frame element (24) to the head of a spectacles wearer on the basis of a parametric equivalent model of the spectacle frame element (24), the parametric equivalent model having at least one parameter and being determined in a method according to any one of clauses 1 to 8 or provided on the basis of clause 9,
[0367] characterized by
[0368] the determination of a representation of the head in a coordinate system (32) in a computer unit; and
[0369] the determination of a parameter value for the at least one parameter of the parametric equivalent model of the spectacle frame element (24) such that the entity (30) of the parametric equivalent model of the spectacle frame element (24) generated on the basis of this at least one parameter value is fitted to the head.
[0370] Clause 11. A computer-implemented method for representing and/or compressing a given entity (30) of a parametric model of a spectacle frame element (24) in a computer unit on the basis of a parametric equivalent model of the spectacle frame element (24), the parametric equivalent model having at least one parameter and being determined in a method according to any one of clauses 1 to 8 or provided on the basis of the method according to clause 9, characterized by
[0371] the determination of a respective parameter value for the at least one parameter of the parametric equivalent model of the spectacle frame element (24) by optimizing a criterion from the group comprising weighted sum, average, maximum and quantile of the distribution of the deviations between surfaces of the given entity (30) of the parametric model and surfaces of the entity (30) of the parametric equivalent model generated on the basis of this at least one parameter value; and
[0372] the storage of the at least one determined parameter value in a memory of the computer unit.
[0373] Clause 12. A computer program having program code for carrying out all method steps which are specified in any one of clauses 1 to 11 when the computer program is loaded on a computer unit and/or executed on a computer unit.
[0374] Clause 13. An apparatus for individualizing and fitting a parametric model of a spectacle frame element (24) to the head of a spectacles wearer, comprising a computer unit containing a computer-implemented method according to clause 10 for fitting the parametric model of the spectacle frame element (24) to a representation of the head in a coordinate system (32) in the computer unit.
[0375] Clause 14. An apparatus for representing and/or compressing a given entity (30) of a parametric model of a spectacle frame element (24), comprising a computer unit having a memory, the computer unit containing a computer-implemented method according to clause 11 for representing and/or compressing the given entity in the memory of the computer unit.
[0376] Clause 15. A system having a device for producing a spectacle frame element (24) that was individualized in a method according to clause 10 or for grinding spectacle lenses into a spectacle frame element (24) that was individualized according to clause 10, using the at least one determined parameter value of the parametric equivalent model.
[0377] The foregoing description of the exemplary embodiments of the disclosure illustrates and describes the present invention. Additionally, the disclosure shows and describes only the exemplary embodiments but, as mentioned above, it is to be understood that the disclosure is capable of use in various other combinations, modifications, and environments and is capable of changes or modifications within the scope of the concept as expressed herein, commensurate with the above teachings and/or the skill or knowledge of the relevant art.
[0378] The term “comprising” (and its grammatical variations) as used herein is used in the inclusive sense of “having” or “including” and not in the exclusive sense of “consisting only of.” The terms “a” and “the” as used herein are understood to encompass the plural as well as the singular.
[0379] All publications, patents and patent applications cited in this specification are herein incorporated by reference, and for any and all purposes, as if each individual publication, patent or patent application were specifically and individually indicated to be incorporated by reference. In the case of inconsistencies, the present disclosure will prevail.
LIST OF REFERENCE SIGNS
[0380] 2 Method step: specifying a parametric model of a spectacle frame element [0381] 4, 4′, 4″ Method step: determining a parametric equivalent model of the spectacle frame element [0382] 6 Method step: providing biometric data relating to the head of the spectacles wearer [0383] 8 Method step: determining at least one parameter value of the parametric equivalent model by optimizing a function for fitting the parametric equivalent model to the head of the spectacles wearer [0384] 10, 10′, 10″ Method [0385] 12 Method step: specifying entities of the parametric model of the spectacle frame element [0386] 13 Method step: decomposing the parametric model of the spectacle frame element into a set of segments [0387] 14 Method step: determining at least one base entity [0388] 15 Method step: decomposing the specified entities into the segments from the set of segments [0389] 16 Method step: determining at least one parametric deformation map [0390] 17 Method step: selecting segment entities from the decomposed specified entities [0391] 18 Iterating the method steps for optimizing the parametric equivalent model [0392] 20 Method step: determining at least one base segment entity for each segment [0393] 21 Method step: determining at least one parametric deformation map for each base segment entity [0394] 22 CAD model [0395] 24 Spectacle frame element [0396] 26 Mesh [0397] 28 Surface points [0398] 30 Entity [0399] 31 Biometric data [0400] 32 Coordinate system [0401] 34 Plane of symmetry [0402] 36 Centroid [0403] 38 Base entity [0404] 39 Base segment entity [0405] 40 Segment [0406] 41 Segment boundary [0407] 42 Database [0408] 43 Segment entity [0409] 44 Pre-processing step [0410] 46 Post-processing step [0411] 48 Method step: generating a head model [0412] 49 Method step: selecting a base entity [0413] 50 Method step: fitting the parametric equivalent model to the head of a spectacles wearer [0414] 52 Method step: virtual donning and rendering of an entity of a parametric model [0415] 54 Tree structure [0416] 56, 56′ Nodes [0417] 58 Subtree [0418] 60 Plane [0419] 62 Projection points [0420] 64 First set of projection points [0421] 66 Second set of projection points [0422] 68 Upper rim [0423] 70 Lower rim [0424] 72 Signal [0425] 74 Point of inflection [0426] 76, 76′ Partial signal [0427] 78 Discontinuity [0428] C.sub.1, . . . , C.sub.10 Coordinates of detected points of inflection [0429] M.sub.1, . . . , M.sub.13 Mean values of partial signals between points of inflection [0430] f, f.sub.i Parametric deformation map [0431] α, α.sub.i Parameters of the parametric deformation maps [0432] b Base entity [0433] b.sub.i Base segment entity