DEVICE AND METHOD FOR MATCHING THREE-DIMENSIONAL INTRA-ORAL SCAN DATA USING COMPUTED TOMOGRAPHY IMAGE

Abstract

Disclosed is a device for matching three-dimensional intra-oral scan data, the device comprising a computed tomography (CT) image depth map generation unit, a depth map coordinate difference information determination unit, a depth map correction unit, and an intra-oral scan model recovery unit. The CT image depth map generation unit generates a depth map of a CT frame from a CT image by using information about a single scan frame of the scan data. The depth map coordinate difference information determination unit determines depth map coordinate difference information between the depth map of the CT frame and a depth map of the scan frame. The depth map correction unit corrects the depth map of the scan frame on the basis of the depth map coordinate difference information. The intra-oral scan model recovery unit recovers a three-dimensional intra-oral scan model on the basis of the corrected depth map of the scan frame.

Claims

1. A method of matching three-dimensional (3D) intraoral scan data, comprising: generating a depth map of a computed tomography (CT) frame from a CT image using information about one scan frame of scan data; determining depth map coordinate difference information between the depth map of the CT frame and a depth map of the scan frame; correcting the depth map of the scan frame on the basis of the depth map coordinate difference information; and reconstructing a 3D intraoral scan model on the basis of the corrected depth map of the scan frame.

2. The method of claim 1, wherein the depth map coordinate difference information includes a depth map rotation matrix representing a degree of rotation between the depth map of the CT frame and the depth map of the scan frame, and a depth map translation vector representing a degree of translation between the depth map of the CT frame and the depth map of the scan frame.

3. The method of claim 2, wherein the depth map rotation matrix and the depth map translation vector minimize a sum of differences between the depth map of the CT frame and the depth map of the scan frame.

4. The method of claim 1, further comprising: determining image coordinate difference information between the scan data and the CT image; and matching a coordinate system of the scan data to a coordinate system of the CT image on the basis of the image coordinate difference information.

5. The method of claim 4, wherein the image coordinate difference information includes an image rotation matrix representing a degree of rotation between the scan data and the CT image, and an image translation vector representing a degree of translation between the scan data and the CT image.

6. The method of claim 5, wherein the image rotation matrix and the image translation vector minimize a sum of differences between the scan data and the CT image.

7. The method of claim 1, further comprising: acquiring scan data for an oral cavity of a patient using an intraoral scanner; and acquiring a CT image of the oral cavity of the patient using CT equipment.

8. The method of claim 1, wherein the 3D intraoral scan model is reconstructed by merging point clouds of corrected depth maps of a plurality of frames of the scan data in three dimensions and averaging common parts.

9. The method of claim 1, wherein the information about the scan frame includes information about a position and direction of a camera of the scan frame.

10. The method of claim 1, wherein a size of the depth map of the CT frame is identical to a size of the depth map of the scan frame.

11. A device for matching three-dimensional (3D) intraoral scan data, comprising: a computed tomography (CT) image depth map generation unit configured to generate a depth map of a CT frame from a CT image using information about one scan frame of scan data; a depth map coordinate difference information determination unit configured to determine depth map coordinate difference information between the depth map of the CT frame and a depth map of the scan frame; a depth map correction unit configured to correct the depth map of the scan frame on the basis of the depth map coordinate difference information; and an intraoral scan model reconstruction unit configured to reconstruct a 3D intraoral scan model on the basis of the corrected depth map of the scan frame.

12. The device of claim 11, wherein the depth map coordinate difference information includes a depth map rotation matrix representing a degree of rotation between the depth map of the CT frame and the depth map of the scan frame, and a depth map translation vector representing a degree of translation between the depth map of the CT frame and the depth map of the scan frame.

13. The device of claim 12, wherein the depth map rotation matrix and the depth map translation vector minimize a sum of differences between the depth map of the CT frame and the depth map of the scan frame.

14. An intraoral scanner comprising the device for matching three-dimensional (3D) intraoral scan data according to claim 11.

15. A computed tomography (CT) device comprising the device for matching three-dimensional (3D) intraoral scan data according to claim 11.

16. A computer program stored in a computer-readable medium, wherein, when a command of the computer program is executed, the method according to claim 1 is performed.

Description

DESCRIPTION OF DRAWINGS

[0025] FIG. 1 shows a difference between scan data and a computed tomography (CT) image.

[0026] FIG. 2 is a block diagram of a device for matching three-dimensional (3D) intraoral scan data according to an embodiment of the present invention.

[0027] FIG. 3 is a flowchart illustrating operations of a device for matching 3D intraoral scan data according to an embodiment of the present invention.

[0028] FIG. 4 is a diagram showing an operation process of a device for matching 3D intraoral scan data according to an embodiment of the present invention through an oral cavity image.

[0029] FIG. 5 shows a real frame depth map and a CT image depth map according to an embodiment of the present invention.

MODES OF THE INVENTION

[0030] Hereinafter, embodiments of the present invention that can be easily performed by those skilled in the art will be described in detail with reference to the accompanying drawings. In addition, parts irrelevant to description are omitted in the drawings in order to clearly explain the present invention.

[0031] Next, a device for matching three-dimensional (3D) intraoral scan data according to an embodiment of the present invention will be described with reference to FIG. 2.

[0032] FIG. 2 is a block diagram of a device for matching 3D intraoral scan data according to an embodiment of the present invention.

[0033] As shown in FIG. 2, a device 100 for matching 3D intraoral scan data includes a scan data acquisition unit 110, a computed tomography (CT) image acquisition unit 120, an image coordinate difference information determination unit 130, a coordinate matching unit 140, a CT image depth map generation unit 150, a depth map coordinate difference information determination unit 160, a depth map correction unit 170, and an intraoral scan model reconstruction unit 180.

[0034] The operation of each component of the device 100 for matching 3D intraoral scan data will be described with reference to FIGS. 3 to 5.

[0035] FIG. 3 is a flowchart illustrating operations of the device for matching 3D intraoral scan data according to the embodiment of the present invention, and FIG. 4 is a diagram showing an operation process of the device for matching 3D intraoral scan data according to the embodiment of the present invention through an oral cavity image.

[0036] The scan data acquisition unit 110 acquires scan data for an oral cavity of a patient using an intraoral scanner (S101). The scan data may include a plurality of scan frames. In this specification, since the scan frame is acquired using a scanner, the scan frame is also referred to as a real frame.

[0037] The CT image acquisition unit 120 acquires a CT image of the oral cavity of the patient using CT equipment 20 (S103).

[0038] The image coordinate difference information determination unit 130 determines information about a difference in coordinates between the scan data and the CT image (S105). The information about the difference in coordinates between the scan data and the CT image may be determined using an iterative closest point (ICP) algorithm as shown in Equation 1, and may include a rotation matrix R and a translation vector t that minimize an error E(R,t). The error E(R,t) denotes the sum of differences between point values determined by the rotation matrix R and the translation vector t, wherein the differences between the point values are differences between point values of the scan data and point values of the CT image.

[00001]$\begin{array}{cc}E\left(R,t\right)=\underset{i=1}{\overset{N_S}{.Math.}}\underset{j=1}{\overset{N_C}{.Math.}}{w}_{i,j}{.Math.s_i-\left({\mathrm{Rc}}_j+t\right).Math.}^2& \left[\mathrm{Equation}1\right]\end{array}$

[0039] In Equation 1, Ns denotes the total number of points of the scan data, and N.sub.C denotes the total number of points of the CT image. i denotes a position of one point of the scan data, s.sub.i denotes a value of a point at a position i of the scan data, j denotes a position of one point of the CT image, and c.sub.j denotes a value of a point at a position j of the CT image. ?.sub.i,j denotes a weight, has a value of 1 when a distance between s.sub.i and c.sub.j is closest, and has a value of 0 otherwise.

[0040] The coordinate matching unit 140 matches a coordinate system of the scan data to a coordinate system of the CT image by matching the scan data and the CT image on the basis of the information about the difference in coordinates between the scan data and the CT image (S107).

[0041] The CT image depth map generation unit 150 generates a depth map of a plurality of CT frames from the CT image using a camera position and direction of each of the plurality of frames obtained in the process of reconstructing the scan data (S109). In this case, a size of the depth map of the CT image may be identical to a size of a real frame depth map of the scan data.

[0042] FIG. 5 shows a real frame depth map and a CT image depth map according to an embodiment of the present invention.

[0043] As shown in FIG. 5, a scan frame depth map 503 may be generated from a scan frame 501. Further, a CT frame depth map 507 may be generated from a CT frame 505 corresponding to the scan frame 501 on the basis of a camera position and direction of the scan frame 501. Meanwhile, when the scan frame 501 and the CT frame 505 are matched, a frame 509 corresponding to a scan camera direction D.sub.n may be generated.

[0044] Again, FIG. 3 will be described.

[0045] A difference in position and direction between the CT frame depth map and the real frame depth map means that there is an error in the camera position and direction of each scan frame obtained in the process of reconstructing the scan data. Therefore, in the embodiment of the present invention, the difference in position and orientation between the CT image depth map and the real frame depth map is corrected using an ICP algorithm.

[0046] The depth map coordinate difference information determination unit 160 determines information about a difference in coordinates between a depth map of a CT image and a depth map of a real frame (S111). The information about the difference in coordinates between the depth map of the CT image and the depth map of the real frame may be determined using an ICP algorithm as shown in Equation 2, and may include a rotation matrix R.sub.n and a translation vector t.sub.n for an n.sup.th real frame that minimize an error E.sub.n. The error E.sub.n denotes the sum of differences between point values determined by the rotation matrix R.sub.n and the translation vector t.sub.n, wherein the differences between the point values are differences between point values of the depth map of the real frame and point values of the depth map of the CT frame.

[00002]$\begin{array}{cc}{E}_n\left(R_n,t_n\right)=\underset{i=1}{\overset{N_{D_n^C}}{.Math.}}\underset{j=1}{\overset{N_{D_n^S}}{.Math.}}{w}_{i,j}{.Math.d_{n,i}^C-\left(R_n{d}_{n,j}^S+t_n\right).Math.}^2& \left[\mathrm{Equation}2\right]\end{array}$

[0047] Here, D.sub.n.sup.s denotes a depth map of an n.sup.th real frame, D.sub.n.sup.C denotes a depth map of an n.sup.th CT image, N.sub.D.sub.n.sub.S denotes the total number of pixels of the depth map of the n.sup.th real frame, and N.sub.D.sub.n.sub.C denotes the total number of pixels of the depth map of the n.sup.th CT frame. d.sub.n,i.sup.C denotes a depth value of one point of the depth map of the CT image, and d.sub.n,i.sup.S denotes a depth value of one point of the depth map of the scan data. ?.sub.i,j denotes a weight, has a value of 1 when a distance between d.sub.n,i.sup.S and d.sub.n,i.sup.C is closest, and has a value of 0 otherwise.

[0048] The depth map correction unit 170 corrects the depth map of the real frame on the basis of the information about the difference in coordinates between the depth maps (S113). As shown in Equation 3, the real frame depth map correction unit 160 may correct the depth map D.sub.n.sup.S of the n.sup.th real frame on the basis of the rotation matrix R.sub.n and the translation vector t.sub.n to generate a corrected depth map D.sub.n.sup.s.

D.sub.n.sup.s=R.sub.n(D.sub.n.sup.s)+t.sub.n[Equation 3]

[0049] In this way, when the position and direction of the existing scan camera are corrected using the rotation matrix and translation vector that are obtained for each frame and the depth map of the real frame is corrected, the position and direction of each real frame become the same as those of the CT image, and thus errors in the camera position and direction of each scan frame may be corrected.

[0050] The intraoral scan model reconstruction unit 180 reconstructs a 3D intraoral scan model by merging point clouds of the corrected depth map of the real frame in three dimensions and averaging common parts (S115).

[0051] The device for matching 3D intraoral scan data according to the embodiment of the present invention may be included as a module in a CT device or an intraoral scanner, or may be implemented in software in which CT data and/or intraoral scanner data are used.

[0052] While the present invention has been described with reference to the embodiment illustrated in the accompanying drawings, the embodiment should be considered in a descriptive sense only, and it should be understood by those skilled in the art that various alterations and equivalent other embodiments may be made. Therefore, the scope of the present invention should be defined by only the following claims.