METHOD FOR RECORDING INDIVIDUAL THREE-DIMENSIONAL OPTICAL IMAGES TO FORM A GLOBAL IMAGE OF A TOOTH SITUATION

Abstract

The invention relates to a method for recording individual three-dimensional optical images to form a global image of a tooth situation comprising an upper jaw and a lower jaw. A first 3D model of a first subsection of the upper jaw and a second 3D model of a second subsection of the lower jaw are produced from the individual images. Subsequently, a geometric positional relationship between the first 3D model and the second 3D model is determined, said positional relationship being determined by using a lateral image and/or using a contact pattern. Said lateral image comprises an image area which comprises at least part of the first subsection of the upper jaw and at least part of the second subsection of the lower jaw. Said contact pattern comprises several contact areas between the upper jaw and the lower jaw. Said contact pattern is measured by means of an occlusion paper.

Claims

1. A method, comprising the steps of: generating a first 3D model of a first subsection of an upper jaw from a portion of a plurality of three-dimensional optical images; generating a second 3D model of a second subsection of a lower jaw from another portion of the plurality of three-dimensional optical images; determining a geometric positional relationship between the first 3D model and the second 3D model based on i. a lateral three-dimensional optical image or ii. a lateral three-dimensional optical image and a contact pattern, wherein the lateral-three dimensional optical image has an image area which at least partially comprise the first subsection of the upper jaw and at least partially comprises the second subsection of the lower jaw, wherein the contact pattern comprises a plurality of contact areas between the upper jaw and lower jaw, and deforming the first 3D model and/or the second 3D model based on the determined geometric positional relationship, wherein the plurality of contact areas respectively correspond to a plurality of local correspondences between the first 3D model and the second 3D model.

2. The method according to claim 1, wherein, in the determining, a plurality of lateral images are used to determine the geometric positional relationship.

3. A method, comprising the steps of: generating a first 3D model of a first subsection of an upper jaw from a portion of a plurality of three-dimensional optical images; generating a second 3D model of a second subsection of a lower jaw from another portion of the plurality of three-dimensional optical images; determining a geometric positional relationship between the first 3D model and the second 3D model based on i. a lateral three-dimensional optical image or ii. a lateral three-dimensional optical image and a contact pattern, wherein the lateral-three dimensional optical image has an image area which at least partially comprises the first subsection of the upper jaw and at least partially comprises the second subsection of the lower jaw, wherein the contact pattern comprises a plurality of contact areas between the upper jaw and lower jaw, and adjusting the first 3D model and/or the second 3D model such that first virtual contact areas on the first 3D model correspond with second virtual contact areas on the second 3D model and/or such that such that a first virtual surface structure of the first 3D model is arranged relative to a second virtual surface structure of the second 3D model.

4. The method according to claim 3, wherein the adjusting further comprises: deforming the first 3D model and/or the second 3D model along a deformation direction such that a first deviation between the first virtual contact areas on the first 3D model and second virtual contact areas on the second 3D model is minimized, and/or deforming the first 3D model and/or the second 3D model such that, a second deviation between an arrangement of a first virtual surface structure of the first 3D model relative to a second virtual surface structure of the second 3D model is minimized, such that the first virtual surface structure of the first 3D model and the second virtual surface structure of the second 3D model are arranged on the lateral three-dimensional optical image.

5. The method according to claim 4, wherein the minimization is achieved using a least squares method.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The invention will be explained with reference to the drawings. In the figures:

[0037] FIG. 1 shows a sketch to illustrate the existing method for registration,

[0038] FIG. 2 shows a sketch to illustrate the determination of the geometric positional relationship between the 3D models,

[0039] FIG. 3 shows the upper jaw and lower jaw from the occlusal direction after marking the contact areas,

[0040] FIG. 4 shows the first 3D model of the upper jaw and the second 3D model of the lower jaw with a registration error,

[0041] FIG. 5 shows the result of the correction from FIG. 4.

EXAMPLE

[0042] FIG. 1 shows a sketch to illustrate the present method for recording individual three-dimensional optical images 1 to form a global image of a tooth situation comprising an upper jaw 2 and a lower jaw 3. During the measurement, a digital camera that is based on a strip projection method or a confocal optical method is moved in a first step along a first direction of movement 5 around the upper jaw 2 in order to measure a first 3D model 6, and then in a second step along a second direction of movement 7 around the lower jaw 3 in order to measure a second 3D model 8. During the measurement, the three-dimensional optical images are generated at regular intervals in time. The individual images can for example be generated at a cyclical frequency between 10 Hz and 20 Hz. Then the individual images 1 are recorded with each other using the overlapping areas 9 that are depicted in dashed lines and combined into the first 3D model 6 and second 3D model 8.

[0043] A computer 10 records the measured data of the digital camera 4, calculates the individual images 1, records the individual images 1, and combines the individual images into the first 3D model 6 and second 3D model 8. The user has the option of moving and rotating the first 3D model 6 and second 3D model 8 by means of a cursor using input means such as a keyboard 11 and a mouse 12 in order to change the direction of observation.

[0044] The first 3D model 6 and first 3D model 8 can comprise the entire upper jaw or lower jaw, or only a subsection.

[0045] To generate the global image of the tooth situation, it is then necessary to determine a geometric positional relationship between the first 3D model 6 and the second 3D model 8.

[0046] FIG. 2 shows a sketch to illustrate the determination of the geometric positional relationship between the 3D models 6 and 8. By using the dental camera 4 from FIG. 1, additional lateral images 20, 21 and 22 generated from a first image direction 23, a second image direction 24 and a third image direction 25. The lateral images 20 and 22 are hence taken from a buccal direction in the area of tooth pairs 16-46 and 26-36 according to the FDI notation. The second lateral image 21 is hence made from a buccal direction in the area of tooth pairs 11-41 and 21-31 according to the FDI notation. Then the lateral images 20, 21 and 22 are searched using a pattern recognition method by means of the computer 10 from FIG. 1 for a first surface structure of the first 3D model and for second surface structure from the second 3D model. The first surface structure or second surface structure can be an individual tooth 26 which in the present case corresponds to tooth 14 according to the FDI notation, a group of teeth 27 that are depicted with dashed lines, and teeth 24, 25 and 26 according to the FDI notation, or a characteristic structure 28 of the gingiva. The positional relationship between the first 3D model 6 and the second 3D model 8 can be determined by using the arrangement of the first surface structure 26, 27 relative to the second surface structure 28 in lateral images 20, 21 and 22. If the first 3D model 6 and/or the second 3D model Bare distorted by a registration error or calibration error, the different lateral images 20, 21 and 22 may provide different, contradictory positional relationships. These contradictions can be used to correct the first 3D model 6 and/or second 3D model 8 in order to generate an error-free global image.

[0047] In addition to the lateral images, an occlusion paper 29 can be placed between the upper jaw 2 and lower jaw 3. Then the upper jaw 2 and lower jaw 3 are brought into the depicted closed-bite position, wherein a colored layer of occlusion paper 29 colors certain contact areas between the upper jaw 2 and lower jaw 3. As in the depicted instance, the occlusion paper 29 can consist of an individual sheet or several strips that are clamped between the upper jaw 2 and lower jaw 3. After the contact areas have been marked with the occlusion paper 29, the upper jaw 2 and lower jaw 3 are measured as depicted in FIG. 1, wherein the first 3D model 6 and the second 3D model are generated with the marked contact areas.

[0048] FIG. 3 shows the upper jaw 2 and lower jaw 3 from the occlusal direction after marking the contact areas 30 using the occlusion paper. The first contact areas 31 on the upper jaw 2 correspond to the second contact areas 32 on the lower jaw 3. The first contact areas 31 and corresponding second contact areas 32 constitute local correspondences that enable the geometric positional relationships to be determined between the first 3D model of the upper jaw 2 and the second 3D model of the lower jaw 3.

[0049] FIG. 4 shows a sketch of the first 3D model 6 of the upper jaw 2 and the second 3D model 8 of the lower jaw 3, wherein the second 3D model 8 significantly deviates from the first 3D model in one area 40 due to a registration error and/or a calibration error. In one area 41, the first 3D model 6 was brought into correspondence with the second 3D model 8. The arrows designate the imaging directions 23, 24 and 25 for the lateral images. The first contact areas 31 hence deviate significantly in the first area 40 from the second contact areas 32 of the second 3D model 8, wherein the first contact areas 31 are brought into correspondence with the second contact areas 32 in the second area. In addition to the contact areas 31 and 32, the lateral images 23 and 24 can also be used to determine the positional relationship and to overlap the two 3D models 6 and 8 in the area 41.

[0050] To correct the registration error and/or the calibration error, the second 3D model 8 is deformed along a deformation direction 42 such that a first deviation between the first contact areas on the first 3D model 6 and second contact areas 32 on the second 3D model 8 is minimized. As an additional criterion for the correction, the lateral image 25 can also be used, wherein a second deviation between the arrangement of a first virtual surface structure 27 of the first 3D model 6 relative to a second virtual surface structure 28 of the second 3D model 8 is minimized by arranging the corresponding surface structures 27 and 28 on the lateral image 25. In this optimization process, the least squares method can be used, for example.

[0051] In the present case, the first 3D model has a greater measuring precision such that the second 3D model 8 subject to the registration error is adapted to the first 3D model 6 along deformation direction 42.

[0052] Alternately, the second 3D model 8 can remain unchanged, and the first 3D model 6 can be adapted thereto.

[0053] Conditions from the lateral images 23, 24 and 25 as well as the conditions from the differences of contact areas 31 and 32 are hence used, in order to correct the registration error and/or calibration error by means of a minimization method.

[0054] FIG. 5 shows the result of the correction from FIG. 4, wherein the first contact areas 31 of the first 3D model 6 and the second contact areas 32 of the second 3D model 8 are caused to overlap both in the first area 40 as well as in the second area 41. The result of the method is hence a global image 50 comprising the first 3D model 6 and the second 3D model 8 which were adapted to each other by means of the contact areas 31 and 32 as well by means of the lateral images 23, 24 and 25 in order to eliminate the registration error.

REFERENCE CHARACTERS

[0055] 1 Individual three-dimensional optical images [0056] 2 Upper jaw [0057] 3 Lower jaw [0058] 4 Dental camera [0059] 5 First direction of movement [0060] 6 First 3D model [0061] 7 Second direction of movement [0062] 8 Second 3D model [0063] 9 Overlapping areas [0064] 10 Computer [0065] 11 Keyboard [0066] 12 Mouse [0067] 13 Cursor [0068] 20-22 Lateral images [0069] 23 First image direction [0070] 24 First image direction [0071] 25 Third image direction [0072] 26 Individual tooth [0073] 27 Group of teeth [0074] 28 Characteristic structure of the gingiva [0075] 29 Occlusion paper [0076] 30 Markings of the contact areas [0077] 31 First contact areas [0078] 32 Second contact areas [0079] 40 First area [0080] 41 Second area [0081] 42 Deformation direction [0082] 50 Global image