ARTIFICIAL TOOTH MANUFACTURING INFORMATION GENERATION METHOD AND ARTIFICIAL TOOTH MANUFACTURING SYSTEM

Abstract

An artificial tooth manufacturing information generation method is provided. The artificial tooth manufacturing information generation method may include the steps of: photographing a target tooth to acquire a primary image; correcting the primary image to acquire a secondary image; selecting an area including the target tooth from the secondary image to extract a tertiary image; selecting a noise area caused by reflected light from the tertiary image and then correcting the noise area, to acquire a quaternary image; and generating artificial tooth manufacturing information by using a pixel value of the target tooth included in the quaternary image.

Claims

1. An artificial tooth manufacturing information generation method comprising: photographing a target tooth to acquire a primary image; correcting the primary image to acquire a secondary image; selecting an area including the target tooth from the secondary image to extract a tertiary image; selecting a noise area caused by reflected light from the tertiary image and then correcting the noise area, to acquire a quaternary image; and generating artificial tooth manufacturing information by using a pixel value of the target tooth included in the quaternary image.

2. The artificial tooth manufacturing information generation method of claim 1, wherein the acquiring of the primary image includes: acquiring a color patch image by photographing a color patch together with the target tooth, and the acquiring of the secondary image includes: calculating a correction constant for minimizing a difference between a pixel value of the color patch image acquired through the photographing and a unique pixel value of the color patch; and acquiring the secondary image from the primary image by using the correction constant.

3. The artificial tooth manufacturing information generation method of claim 2, wherein the color patch includes a plurality of color blocks arranged separately from each other, and the artificial tooth manufacturing information includes a mixing ratio of the color blocks matching the pixel values of the target tooth included in the quaternary image.

4. The artificial tooth manufacturing information generation method of claim 3, wherein the generating of the artificial tooth manufacturing information includes: dividing the target tooth included in the quaternary image into a plurality of sub-areas; generating a standard pixel value of each of the sub-areas; and generating a mixing ratio of the color blocks matching the standard pixel values for each of the sub-areas.

5. The artificial tooth manufacturing information generation method of claim 4, wherein the dividing of the target tooth included in the quaternary image into the sub-areas includes: setting pixels, which have pixel values of the target tooth within a reference range in the quaternary image, as same sub-areas.

6. The artificial tooth manufacturing information generation method of claim 1, wherein the primary image is acquired by photographing the target tooth using a camera included in the terminal, such that at least one area of a grid displayed on a screen of a terminal overlaps with at least one area of the target tooth.

7. The artificial tooth manufacturing information generation method of claim 1, wherein the tertiary image is extracted by selecting an area including the target tooth from the secondary image through a region proposal convolutional neural network (R-CNN) algorithm.

8. The artificial tooth manufacturing information generation method of claim 1, wherein the tertiary image is extracted by converting RGB values of the secondary image into HSV values, and then selecting an area including the target tooth from the converted secondary image.

9. The artificial tooth manufacturing information generation method of claim 1, wherein the tertiary image is extracted by converting the secondary image to gray scale, and then selecting an area including the target tooth from the converted secondary image.

10. The artificial tooth manufacturing information generation method of claim 1, wherein the acquiring of the quaternary image includes: correcting the noise area by using a histogram of the tertiary image.

11. The artificial tooth manufacturing information generation method of claim 1, wherein the quaternary image is acquired by comparing the tertiary images extracted from the primary images photographed at different angles, selecting the noise area through reflected light generated at different positions, and correcting the noise area.

12. An artificial tooth manufacturing system comprising: a photographing unit for photographing a target tooth to acquire a primary image; a pixel value correction unit for correcting the primary image to acquire a secondary image; a target tooth extraction unit for selecting an area including the target tooth from the secondary image to extract a tertiary image; a reflected light removal unit for selecting a noise area caused by reflected light from the tertiary image and then correcting the noise area, to acquire a quaternary image; and an artificial tooth manufacturing information generation unit for generating artificial tooth manufacturing information by using a pixel value of the target tooth included in the quaternary image.

13. The artificial tooth manufacturing system of claim 12, wherein the photographing unit further acquires a color patch image by photographing a color patch together with the target tooth, and the pixel value correction unit calculates a correction constant for minimizing a difference between a pixel value of the color patch image and a unique pixel value of the color patch, and acquires the secondary image from the primary image by using the correction constant.

14. The artificial tooth manufacturing system of claim 13, wherein the color patch includes a plurality of color blocks arranged separately from each other, and the artificial tooth manufacturing information generation unit generates a mixing ratio of the color blocks matching a pixel value of the target tooth included in the quaternary image.

Description

DESCRIPTION OF DRAWINGS

[0030] FIG. 1 is a flowchart for explaining an artificial tooth manufacturing information generation method according to the embodiments of the present invention.

[0031] FIGS. 2 and 3 are views showing a method of acquiring a primary image according to the embodiments of the present invention.

[0032] FIG. 4 is a view showing a color patch according to the embodiments of the present invention.

[0033] FIG. 5 is a view showing a color patch image according to the embodiments of the present invention.

[0034] FIG. 6 is a view showing a method of acquiring a secondary image according to the embodiments of the present invention.

[0035] FIG. 7 is a view showing a method of acquiring a tertiary image according to the embodiments of the present invention.

[0036] FIG. 8 is a view showing a method of acquiring a quaternary image according to the embodiments of the present invention.

[0037] FIG. 9 is a view showing pixel values of a target tooth included in the quaternary image according to the embodiments of the present invention.

[0038] FIG. 10 is a diagram showing artificial tooth manufacturing information generated using the pixel values of the target tooth included in the quaternary image according to the embodiments of the present invention.

[0039] FIGS. 11 and 12 are diagrams showing that the target tooth included in the quaternary image is divided into a plurality of sub-areas according to the embodiments of the present invention.

[0040] FIG. 13 is a diagram showing artificial tooth manufacturing information for each of the sub-areas according to the embodiments of the present invention.

[0041] FIG. 14 is a photograph of the color patch used in an artificial tooth manufacturing information generation method and an artificial tooth manufacturing system according to the embodiments of the present invention.

[0042] FIG. 15 shows diagrams illustrating color patch images photographed by different cameras according to the embodiments of the present invention.

[0043] FIG. 16 shows diagrams illustrating images corrected by applying correction constants to the color patch images photographed in FIG. 15.

[0044] FIG. 17 shows diagrams illustrating tooth images to which the correction constants are applied according to the embodiments of the present invention.

[0045] FIG. 18 shows pictures acquired by extracting specific areas of teeth through an R-CNN algorithm according to the embodiments of the present invention.

[0046] FIGS. 19 and 20 are diagrams showing a method of extracting a specific area of a tooth by converting RGB values of a tooth image into HSV values according to the embodiments of the present invention.

[0047] FIGS. 21 and 22 are diagrams for explaining a process of using a histogram to remove reflected light appearing on a tooth image according to the embodiments of the present invention.

[0048] FIGS. 23 to 25 are diagrams showing tooth images from which the reflected light has been removed using the histogram according to the embodiments of the present invention.

BEST MODE

Mode for Invention

[0049] Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the technical idea of the present invention is not limited to the exemplary embodiments described herein and may be embodied in other forms. Further, the embodiments are provided to enable contents disclosed herein to be thorough and complete and provided to enable those skilled in the art to fully understand the idea of the present invention.

[0050] In the specification herein, when one component is mentioned as being on another component, it signifies that the one component may be placed directly on the another component or a third component may be interposed therebetween. In addition, in drawings, thicknesses of layers and areas may be exaggerated to effectively describe the technology of the present invention.

[0051] In addition, although terms such as first, second and third are used to describe various components in various embodiments of the present specification, the components will not be limited by the terms. The above terms are used merely to distinguish one component from another. Accordingly, a first component referred to in one embodiment may be referred to as a second component in another embodiment. Each embodiment described and illustrated herein may also include a complementary embodiment. In addition, the term “and/or” is used herein to include at least one of the components listed before and after the term.

[0052] The singular expression herein includes a plural expression unless the context clearly specifies otherwise. In addition, it will be understood that the term such as “include” or “have” herein is intended to designate the presence of feature, number, step, component, or a combination thereof recited in the specification, and does not preclude the possibility of the presence or addition of one or more other features, numbers, steps, components, or combinations thereof. In addition, the term “connection” is used herein to include both indirectly connecting a plurality of components and directly connecting the components.

[0053] In addition, in the following description of the embodiments of the present invention, the detailed description of known functions and configurations incorporated herein will be omitted when it possibly makes the subject matter of the present invention unclear unnecessarily.

[0054] FIG. 1 is a flowchart for describing an artificial tooth manufacturing information generation method according to the embodiments of the present invention. FIGS. 2 and 3 are views showing a method of acquiring a primary image according to the embodiments of the present invention. FIG. 4 is a view showing a color patch according to the embodiments of the present invention. FIG. 5 is a view showing a color patch image according to the embodiments of the present invention. FIG. 6 is a view showing a method of acquiring a secondary image according to the embodiments of the present invention. FIG. 7 is a view showing a method of acquiring a tertiary image according to the embodiments of the present invention. FIG. 8 is a view showing a method of acquiring a quaternary image according to the embodiments of the present invention.

[0055] Referring to FIG. 1, the artificial tooth manufacturing information generation method according to the embodiments of the present invention includes the steps of: photographing a target tooth to acquire a primary image (S100); correcting the primary image to acquire a secondary image (S200); selecting an area including the target tooth from the secondary image to extract a tertiary image (S300); selecting a noise area caused by reflected light from the tertiary image and then correcting the noise area, to acquire a quaternary image (S400); and generating artificial tooth manufacturing information by using a pixel value of the target tooth included in the quaternary image (S500). Hereinafter, each step will be described in detail.

[0056] Primary Image Acquisition Step (S100)

[0057] Referring to FIGS. 2 and 3, a primary image IM.sub.1 may be acquired by photographing a target tooth through a terminal having a screen on which a grid G is displayed. In other words, the primary image IM.sub.1 may be an image acquired by photographing the target tooth. For example, the terminal may be a smartphone. More specifically, the target tooth may be photographed while the grid G is displayed on the screen through the application of the smartphone. for another example, the terminal may be a smart camera, a computer, or the like. The type of the terminal is not limited.

[0058] According to one embodiment, the target tooth may be photographed so that at least one area of the grid G overlap with at least one area of the target tooth. For example, as shown in FIGS. 2 and 3, the grid G may be displayed as a shape of two front teeth. In this case, the target tooth may be photographed so that the grid G overlaps with the two front teeth including the target tooth. On the contrary, for another example, the grid G may be displayed as a shape of entire upper teeth. In this case, the target tooth may be photographed so that the grid G overlap with the entire upper jaw of the target tooth. The shape of the grid G is not limited.

[0059] As described above, when the target tooth is photographed through the terminal on which the grid G is displayed on the screen, the target tooth may be photographed at a predetermined distance. Accordingly, the standardized primary image may be acquired regardless of a terminal type, a photographer, a photographing environment, and the like. In the specification herein, the expression “the standardized primary image may be acquired” may be used as a meaning of ‘the size of the target tooth shown in the photographed primary images and the amount and position of reflected light appearing on the target tooth may be acquired substantially equivalently even when the same target tooth is photographed by different terminals, different photographers, different photographing environments, and the like’.

[0060] On the contrary, when the target tooth is photographed while the grid G is not displayed on the screen, the distance between the terminal and the target tooth may vary. Accordingly, when the terminal type, photographer, photographing environment, and the like vary, the size of the target tooth, the amount and position of reflected light appearing on the target tooth, and the like may vary. Due to this, an error may occur in the artificial tooth manufacturing information described later, and accordingly, the reliability on the artificial tooth manufacturing information may be lowered.

[0061] In addition, according to one embodiment, a tooth may be photographed together with a color patch CP as shown in FIG. 2. An achromatic background plate may be used as a background of the color patch CP and the tooth. In other words, the tooth and the color patch CP may be simultaneously photographed so that the achromatic background plate serves as a background. A color patch image CPI acquired by photographing the color patch CP will be described below with reference to FIGS. 4 and 5.

[0062] Referring to FIGS. 4 and 5, not only the primary image IM.sub.1 but also the color patch image CPI may be further acquired through the terminal. The color patch image CPI may be an image acquired by photographing the color patch CP.

[0063] According to one embodiment, the color patch CP may include a plurality of color blocks arranged separately from each other. For example, as shown in FIG. 4, the color patch CP may include first to ninth color blocks CB.sub.1 to CB.sub.9. For example, the first to ninth color blocks CB.sub.1 to CB.sub.9 as materials used for manufacturing artificial teeth may have different colors and transparency. On the contrary, for another example, the color patch CP may include a larger number of color blocks or a smaller number of color blocks than the color blocks described above. In other words, the number of color blocks included in the color patch CP is not limited.

[0064] As described above the color patch CP includes the first to ninth color blocks CB.sub.1 to CB.sub.9, so that first to ninth color block images CBI.sub.1 to CBI.sub.9 corresponding to the first to ninth color blocks CB.sub.1 to CB.sub.9 may appear, respectively, in the color patch image CPI acquired by photographing the color patch CP.

[0065] Secondary Image Acquisition Step (S200)

[0066] Referring to FIG. 6, the primary image IM.sub.1 may be corrected to obtain a secondary image IM.sub.2. More specifically, the secondary image IM.sub.2 may be acquired by applying a correction constant to the primary image IM.sub.1.

[0067] According to one embodiment, the correction constant may be a constant for minimizing a difference between a pixel value (for example, rgb value) of the color patch image CPI and a unique pixel value (for example, rgb value) of the color patch CP. In other words, when the correction constant is applied to the pixel value of the color patch image CPI, the pixel value of the color patch image CPI may substantially match the pixel value of the color patch CP.

[0068] Accordingly, the secondary image IM.sub.2 acquired by applying the correction constant to the primary image IM.sub.1, may have a pixel value after the pixel value of the primary image IM.sub.1 is corrected.

[0069] For example, the correction constant may be calculated through the following <Equation 1> to <Equation 4>.

[00001]$\begin{array}{cc}\left[\begin{array}{cccc}{r}_0& g_0& b_0& 1\\ r_1& g_1& b_1& 1\\ .& .& .& .\\ .& .& .& .\\ r_8& g_8& b_8& 1\end{array}\right]*M=\left[\begin{array}{ccc}{r}_0^{\prime }& g_0^{\prime }& b_0^{\prime }\\ r_1^{\prime }& g_1^{\prime }& b_1^{\prime }\\ .& .& .\\ .& .& .\\ r_8^{\prime }& g_8^{\prime }& b_8^{\prime }\end{array}\right]& .Math.\mathrm{Equation}1.Math.\end{array}$

[0070] (r0 g0 b0˜r8 g8 b8: pixel values of the first to ninth color blocks in the color patch image, r′0 g′0 b′0˜r′8 g′8 b′8: unique pixel values of the first to ninth color block images, and M: correction constant)

[00002]$\begin{array}{cc}T*M=S& .Math.\mathrm{Equation}2.Math.\end{array}$$T=\left[\begin{array}{cccc}{r}_0& g_0& b_0& 1\\ r_1& g_1& b_1& 1\\ .& .& .& .\\ .& .& .& .\\ r_8& g_8& b_8& 1\end{array}\right]$$S=\left[\begin{array}{ccc}{r}_0^{\prime }& g_0^{\prime }& b_0^{\prime }\\ r_1^{\prime }& g_1^{\prime }& b_1^{\prime }\\ .& .& .\\ .& .& .\\ r_8^{\prime }& g_8^{\prime }& b_8^{\prime }\end{array}\right]$$\begin{array}{cc}\left(T^{\prime }*T\right)*M=T^{\prime }*S& .Math.\mathrm{Equation}3.Math.\end{array}$

[0071] (Tt: inverse matrix of T)

M=(T′*T).sup.−1*T′*S  <Equation 4>

[0072] As a result, the secondary image IM.sub.2 may have pixel values standardized by the correction constant. In this specification, the expression ‘the image has a standardized pixel value’ may be used as a meaning of ‘pixel values of a plurality of photographed images are substantially constant even when the same target tooth is photographed by different terminals, different photographing environments, and the like’. Accordingly, the reliability on the artificial tooth manufacturing information described later may be improved.

[0073] Unlike the above description, when the primary image IM.sub.1 is not corrected through the correction constant, pixel values of the primary image IM.sub.1 may be different from each other due to the terminal type, photographing environment, and the like. Accordingly, when the artificial tooth manufacturing information described later is acquired through the uncorrected first image IM.sub.1, an error may occur in the artificial tooth manufacturing information described later, and accordingly, the reliability on the artificial tooth manufacturing information may be lowered.

[0074] Tertiary Image Acquisition Step (S300)

[0075] Referring to FIG. 7, an area including the target tooth may be selected from the secondary image IM.sub.2 to extract a tertiary image IM.sub.3. According to one embodiment, the area including the target tooth may be an area for a single tooth in the secondary image IM.sub.2. Accordingly, the tertiary image IM.sub.3 may indicate an image of the single tooth. For example, as shown in FIG. 7, an image of one front tooth may be extracted from the secondary image IM.sub.2. Accordingly, the tertiary image IM.sub.3 may indicate an image of one front tooth. In other words, a specific tooth (for example, one front tooth) may be extracted from the secondary image IM.sub.2 in which a plurality of teeth and gums are shown together, so that the tertiary image IM.sub.3 may be acquired.

[0076] According to one embodiment, the tertiary image IM.sub.3 may be extracted by selecting an area including the target tooth from the secondary image IM.sub.2 through a deep learning scheme. For example, the deep learning scheme may include a region proposal convolutional neural network (R-CNN) algorithm. The R-CNN algorithm trains and recognizes while focusing regions based on the existing CNN algorithm, and has an improved object recognition rate compared to the existing deep learning schemes, so that extraction accuracy for a specific tooth may be improved.

[0077] On the contrary, according to another embodiment, the tertiary image IM.sub.3 may be extracted by converting RGB values of the secondary image IM.sub.2 into HSV values, and then selecting an area including the target tooth from the converted secondary image. More specifically, RGB values of the secondary image may be converted into HSV values to find a range of values occupied by the area to be extracted, and the area to be extracted may be separated from a peripheral area, so that the tertiary image IM.sub.3 may be extracted. When the RGB values are converted into the HSV values, brightness, saturation, and hue are displayed on one axis, so that a specific area can be easily extracted.

[0078] On the contrary, according to another embodiment, the tertiary image IM.sub.3 may be extracted by converting the secondary image into gray scale, and then selecting the area including the target tooth from the converted secondary image IM.sub.2. In the secondary image IM.sub.2 converted to the gray scale, white areas may be emphasized and red areas may be ignored, so that teeth may be efficiently distinguished from gums.

[0079] Quaternary Image Acquisition Step (S300)

[0080] Referring to FIG. 8, a quaternary image IM.sub.4 may be acquired by selecting a noise area due to the reflected light RL in the tertiary image IM.sub.3 and correcting the noise area. In other words, the quaternary image IM.sub.4 may be an image acquired by removing the reflected light RL from the tertiary image IM.sub.3.

[0081] According to one embodiment, the noise area may be corrected using a histogram of the tertiary image IM.sub.3. More specifically, a white peak value may be found from distribution values of the histogram of the tertiary image IM.sub.3, and then a color gamut on the right side of the white peak value may be removed, so that the noise area may be corrected.

[0082] On the contrary, according to another embodiment, the reflected light RL generated at different positions among the tertiary images IM.sub.3 photographed at different angles may be compared, so that the noise area may be corrected. More specifically, the noise area may be corrected by obtaining color information on the area covered by the reflected light RL in the tertiary image IM.sub.3 extracted from a plurality of primary images photographed at different positions in which the reflected light RL is generated.

[0083] Artificial Tooth Manufacturing Information Generation Step (S500)

[0084] FIG. 9 is a view showing pixel values of a target tooth included in the quaternary image according to the embodiments of the present invention. FIG. 10 is a diagram showing artificial tooth manufacturing information generated using the pixel values of the target tooth included in the quaternary image according to the embodiments of the present invention. FIGS. 11 and 12 are views showing that the target tooth included in the quaternary image is divided into a plurality of sub-areas according to the embodiments of the present invention. FIG. 13 is a diagram showing artificial tooth manufacturing information for each of the sub-areas according to the embodiments of the present invention.

[0085] Referring to FIGS. 9 and 10, artificial tooth manufacturing information may be generated by using pixel values of the target tooth included in the quaternary image IM.sub.4. According to one embodiment, the artificial tooth manufacturing information may include a mixing ratio of the color blocks CB.sub.1 to CB.sub.9 matching the pixel values of the target tooth included in the quaternary image IM.sub.4.

[0086] More specifically, when the color blocks CB.sub.1 to CB.sub.9 included in the color patch CP are mixed with each other, a specific pixel value may be generated. Accordingly, the pixel value of the target tooth included in the quaternary image IM.sub.4 may be implemented through the mixing ratio of the color blocks CB.sub.1 to CB.sub.9.

[0087] For example, as shown in FIG. 10, an R.sub.1G.sub.1B.sub.1 pixel value of the quaternary image IM.sub.4 may be implemented by mixing 10% of the first color block CB.sub.1, 8% of the second color block CB.sub.2, 3% of the third color block CB.sub.3, 12% of the fourth color block CB.sub.4, 2% of the fifth color block CB.sub.5, 20% of the sixth color block CB.sub.6, 15% of the seventh color block CB.sub.7, 17% of the eighth color block CB.sub.8, and 13% of the ninth color block CB.sub.9.

[0088] On the contrary, an R.sub.2G.sub.2B.sub.2 pixel value of the quaternary image IM.sub.4 may be implemented by mixing 8% of the first color block CB.sub.1, 12% of the second color block CB.sub.2, 10% of the third color block CB.sub.3, 3% of the fourth color block CB.sub.4, 17% of the fifth color block CB.sub.5, 13% of the sixth color block CB.sub.6, 2% of the seventh color block CB.sub.7, 20% of the eighth color block CB.sub.8, and 5% of the ninth color block CB.sub.9. The above-described mixing ratios of the color blocks CB.sub.1 to CB.sub.9 are exemplary, and the mixing ratio of the color blocks CB.sub.1 to CB.sub.9 for implementing a pixel value may be different from the above.

[0089] As a result, the artificial tooth manufacturing information may be generated for each pixel value of the target tooth included in the quaternary image IM.sub.4. However, when the artificial tooth manufacturing information is generated for each pixel value of the target tooth as described above, data overload may occur, and it may be significantly difficult to manufacture artificial teeth using the above information. Accordingly, the target tooth included in the quaternary image IM.sub.4 may be divided into specific areas, and the artificial tooth manufacturing information may be generated for the divided area.

[0090] Referring to FIGS. 11 to 13, the target tooth included in the quaternary image IM.sub.4 may be divided into a plurality of sub-areas. For example, as shown in FIGS. 11 and 12, the target tooth included in the quaternary image IM.sub.4 may be divided into first to sixth sub-areas SA1 to SA6. The number of the sub-areas is exemplary, and may be divided more or less than the above-described first to sixth sub-areas SA1 to SA6.

[0091] According to one embodiment, as shown in FIG. 11, pixels having pixel values of the target tooth within a reference range in the quaternary image IM.sub.4 may be set as the same sub-area. In other words, the areas having similar pixel values in the target tooth may be set as the same sub-area. For example, pixels having pixel values of the target tooth within a first reference range may be set as a first sub-area SA1, pixels having pixel values of the target tooth within a second reference range may be set as a second sub-area SA2, pixels having pixel values of the target tooth within a third reference range may be set as a third sub-area SA3, pixels having pixel values of the target tooth within a fourth reference range may be set as a fourth sub-area SA4, pixels having pixel values of the target tooth within a fifth reference range may be set as a fifth sub-area SA5, and pixels having pixel values of the target tooth within a sixth reference range may be set as a sixth sub-area SA6. On the contrary, according to another embodiment, as shown in FIG. 12, the target tooth may be divided into predetermined arbitrary areas in the quaternary image IM.sub.4. The method for dividing the sub-areas is not limited.

[0092] After the sub-areas are divided, each standard pixel value of the sub-areas may be generated. According to one embodiment, the standard pixel value may be an average value of pixel values included in the sub-area.

[0093] Referring to FIG. 13, the artificial tooth manufacturing information may be generated for each of the sub-areas. In other words, a mixing ratio of the color blocks CB.sub.1 to CB.sub.9 matching the standard pixel values of the sub-areas may be generated.

[0094] The artificial tooth manufacturing information may be provided to users (for example, dental technicians) who manufacture artificial teeth. The users may manufacture artificial teeth based on the artificial tooth manufacturing information. More specifically, the users may determine colors of the artificial tooth based on the artificial tooth manufacturing information. Accordingly, the artificial tooth manufactured based on the artificial tooth manufacturing information may have a constant color and transparency regardless of the experience and career of the user who manufactures the artificial tooth.

[0095] Unlike the above description, the existing artificial teeth have been subject to colors of the artificial teeth through the subjective determination of the user who manufactures the artificial teeth (for example, the confirmation using the user's eyes). Accordingly, a color mismatch occurs. In order to solve the above problem, equipment for distinguishing a tooth color has been developed to prevent the intervention by the subjective determination of the user who manufactures the artificial tooth. However, the existing equipment for distinguishing a tooth color has complex configurations, and is sold at a high price, and accordingly, it is not easy to substantially apply the equipment.

[0096] However, the artificial tooth manufacturing information generation method according to the embodiments of the present invention includes: photographing a target tooth to acquire the primary image IM.sub.1; correcting the primary image IM.sub.1 to acquire the secondary image IM.sub.2; selecting an area including the target tooth from the secondary image IM.sub.2 to extract the tertiary image selecting a noise area caused by reflected light from the tertiary image IM.sub.3 and then correcting the noise area, to acquire the quaternary image IM.sub.4; and generating artificial tooth manufacturing information by using a pixel value of the target tooth included in the quaternary image IM.sub.4.

[0097] In addition, the acquiring of the primary image IM.sub.1 may include acquiring a color patch image CPI by photographing the color patch CP together with the target tooth, and the acquiring of the secondary image IM.sub.2 may include calculating a correction constant for minimizing a difference between a pixel value of the color patch image CPI acquired through the photographing and a unique pixel value of the color patch CP; and acquiring the secondary image IM.sub.2 from the primary image IM.sub.1 by using the correction constant.

[0098] In addition, the color patch CP may include a plurality of color blocks CB.sub.1 to CB.sub.9 arranged separately from each other, and the artificial tooth manufacturing information may include a mixing ratio of the color blocks CB.sub.1 to CB.sub.9 matching the pixel values of the target tooth included in the quaternary image IM.sub.4.

[0099] Accordingly, when an artificial tooth is manufactured through the artificial tooth manufacturing information, the subjective determination of a user who manufactures the artificial tooth (for example, the confirmation using the user's eyes) is minimized, so that an artificial tooth with a minimized difference in color, shape, and transparency of an original tooth can be manufactured regardless of the experience and career of the user who manufactures the artificial tooth.

[0100] In addition, since the artificial tooth manufacturing information may be easily generated using a generalized smartphone, the method according to the present invention can be easily used by anyone, and can be used at a significantly lower cost compared to the existing tooth color discrimination apparatus.

[0101] The artificial tooth manufacturing information generation method according to the embodiments of the present invention has been described. Hereinafter, the artificial tooth manufacturing system according to the embodiments of the present invention will be described.

[0102] The artificial tooth manufacturing system according to the embodiments of the present invention may include a photographing unit, a pixel value correction unit, a target tooth extraction unit, a reflected light removal unit, and an artificial tooth manufacturing information generation unit. Hereinafter, each component will be described.

[0103] The photographing unit may photograph a target tooth to acquire a primary image. According to one embodiment, the primary image may be acquired by photographing the target tooth through a terminal in which a grid is displayed on a screen. More specifically, the target tooth may be photographed, such that at least one area of the grid overlaps with at least one area of the target tooth.

[0104] In addition, the photographing unit may photograph a color patch to acquire a color patch image. According to one embodiment, the color patch may include a plurality of color blocks arranged separately from each other. For example, the color patch may include first to ninth color blocks. The first to ninth color blocks as materials used for manufacturing artificial teeth may have different colors. On the contrary, for another example, the color patch may include a larger number of color blocks or a smaller number of color blocks than the color blocks described above. In other words, the number of color blocks included in the color patch is not limited. When the color patch includes first to ninth color blocks, first to ninth color block images corresponding to the first to ninth color blocks may be displayed, respectively, in the color patch image.

[0105] The pixel value correction unit may correct the primary image to acquire a secondary image. In addition, the pixel value correction unit may calculate a correction constant for minimizing a difference between a pixel value of the color patch image and a unique pixel value of the color patch. The method of calculating the correction constant may be the same as the method of calculating the correction constant in the secondary image acquisition step as described with reference to FIG. 6. Accordingly, a detailed description will be omitted.

[0106] The correction constant may be applied to correct the primary image. In other words, the secondary image may be acquired by applying a correction constant to the primary image. As a result, the secondary image may have pixel values standardized by the correction constant. Accordingly, the reliability on the artificial tooth manufacturing information described later may be improved.

[0107] The target tooth extraction unit may select an area including the target tooth from the secondary image to extract a tertiary image. According to one embodiment, the area including the target tooth may be an area for a single tooth in the secondary image. Accordingly, the tertiary image may indicate an image of the single tooth.

[0108] According to one embodiment, the tertiary image may be extracted by selecting an area including the target tooth from the secondary image IM.sub.2 through a deep learning scheme. On the contrary, according to another embodiment, the tertiary image may be extracted by converting RGB values of the secondary image IM.sub.2 into HSV values, and then selecting an area including the target tooth from the converted secondary image. On the contrary, according to another embodiment, the tertiary image IM.sub.3 may be extracted by converting the secondary image into gray scale, and then selecting the area including the target tooth from the converted secondary image IM.sub.2.

[0109] The reflected light removal unit may select a noise area caused by reflected light from the tertiary image and then correct the noise area, to acquire a quaternary image. In other words, the quaternary image may be an image acquired by removing the reflected light from the tertiary image.

[0110] According to one embodiment, the noise area may be corrected using a histogram of the tertiary image. On the contrary, according to another embodiment, the noise region may be corrected by comparing the reflected light generated at different positions among the tertiary images photographed at different angles.

[0111] The artificial tooth manufacturing information generation unit may generate artificial tooth manufacturing information by using a pixel value of the target tooth included in the quaternary image. According to one embodiment, the artificial tooth manufacturing information may include a mixing ratio of the color blocks matching the pixel values of the target tooth included in the quaternary image.

[0112] More specifically, when the color blocks included in the color patch are mixed with each other, a specific pixel value may be generated. Accordingly, the pixel value of the target tooth included in the quaternary image may be implemented through a mixing ratio of the color blocks. As a result, the artificial tooth manufacturing information may be generated for each pixel value of the target tooth included in the quaternary image. However, since data overload may occur when the artificial tooth manufacturing information is generated for each pixel value of the target tooth, the target tooth included in the quaternary image may be divided into specific areas, and the artificial tooth manufacturing information may be generated for the divided area.

[0113] According to one embodiment, pixels having pixel values of the target tooth within a reference range in the quaternary image may be set as the same sub-area. For example, pixels having pixel values of the target tooth within a first reference range may be set as a first sub-area, and pixels having pixel values of the target tooth within a second reference range may be set as a second sub-area. On the contrary, according to another embodiment, the target tooth may be divided into predetermined areas in the quaternary image.

[0114] After the sub-areas are divided, each standard pixel value of the sub-areas may be generated. According to one embodiment, the standard pixel value may be an average value of pixel values included in the sub-area.

[0115] The artificial tooth manufacturing information may be generated for each of the sub-areas. In other words, a mixing ratio of the color blocks matching the standard pixel values of the sub-areas may be generated. Accordingly, the above-mentioned data overload problem may be solved.

[0116] As a result, the artificial tooth manufacturing system according to the embodiments of the present invention may include: the photographing unit for photographing the target tooth to acquire the primary image; the pixel value correction unit for correcting the primary image to acquire the secondary image; the target tooth extraction unit for selecting an area including the target tooth from the secondary image to extract the tertiary image; a reflected light removal unit for selecting a noise area caused by reflected light from the tertiary image and then correcting the noise area, to acquire the quaternary image; and the artificial tooth manufacturing information generation unit for generating the artificial tooth manufacturing information by using a pixel value of the target tooth included in the quaternary image.

[0117] In addition, the photographing unit may further acquire a color patch image by photographing a color patch together with the target tooth, and the pixel value correction unit may calculate a correction constant for minimizing a difference between a pixel value of the color patch image and a unique pixel value of the color patch, and acquire the secondary image from the primary image by using the correction constant.

[0118] In addition, the color patch may include a plurality of color blocks arranged separately from each other, and the artificial tooth manufacturing information generation unit may generate a mixing ratio of the color blocks matching a pixel value of the target tooth included in the quaternary image.

[0119] Accordingly, when an artificial tooth is manufactured through the artificial tooth manufacturing information, the subjective determination of a user who manufactures the artificial tooth (for example, the confirmation using the user's eyes) is minimized, so that an artificial tooth with a minimized difference in color, shape, and transparency of an original tooth can be manufactured regardless of the experience and career of the user who manufactures the artificial tooth.

[0120] The artificial tooth manufacturing system according to the embodiments of the present invention has been described. Hereinafter, specific experimental examples of the artificial tooth manufacturing information generation method and the artificial tooth manufacturing system according to the embodiments of the present invention will be described.

[0121] FIG. 14 is a photograph of the color patch used in the artificial tooth manufacturing information generation method and the artificial tooth manufacturing system according to the embodiments of the present invention.

[0122] FIG. 14 photographs and shows a color patch used in the artificial tooth manufacturing information generation method and the artificial tooth manufacturing system according to the embodiments of the present invention. As shown in FIG. 14, it is confirmed that the color patch used in the artificial tooth manufacturing information generation method and the artificial tooth manufacturing system includes a plurality of color blocks arranged separately from each other, and the color blocks represent colors different from each other.

[0123] FIG. 15 shows diagrams illustrating color patch images photographed by different cameras according to the embodiments of the present invention. FIG. 16 shows diagrams illustrating images corrected by applying correction constants to the color patch images photographed in FIG. 15.

[0124] FIG. 15(a) shows the color patch of FIG. 14 photographed using a smartphone (Galaxy) made by Samsung company, and FIG. 15(b) shows the color patch of FIG. 14 photographed using a smartphone (iPhone) made by Apple company. As shown in FIGS. 15(a) and 15(b), it is confirmed that the color of the photographed image may be expressed differently depending on the type of smartphone even when the same color patch is used. In other words, it can be seen that the pixel value of the photographed image is different depending on the type of smartphone.

[0125] Referring to FIG. 16(a), the image photographed in FIG. 15(a) is corrected by applying the correction constant thereto, and referring to FIG. 16(b), the image photographed in FIG. 15(b) is corrected by applying the correction constant thereto. As shown in FIGS. 16(a) and 16(b), it is confirmed that the photographed images express colors similar to each other when being corrected through the correction constant. In other words, it can be seen that, when the image is corrected through the correction constant described in the artificial tooth manufacturing information generation method and the artificial tooth manufacturing system according to the embodiments of the present invention, the corrected image has a standardized pixel value.

[0126] FIG. 17 shows diagrams illustrating tooth images to which the correction constants are applied according to the embodiments of the present invention.

[0127] FIG. 17(a) shows teeth photographed using the smartphone (iPhone). Referring to FIG. 17(b), the photographed image in FIG. 17 is corrected by applying the correction constant thereto. As shown in FIGS. 17(a) and 17(b), it is confirmed that the colors of the teeth are corrected when the correction constant is applied to the tooth images. More specifically, the corrected tooth image is corrected in RGB values, white balance and the like.

[0128] FIG. 18 show pictures acquired by extracting specific areas of teeth through an R-CNN algorithm according to the embodiments of the present invention.

[0129] Referring to FIG. 18, teeth in different positions are photographed and then the R-CNN algorithm is applied to each tooth, thereby extracting only the specific tooth to be extracted. As shown in FIG. 18, it is confirmed that, when the R-CNN algorithm is applied, images only for the specific teeth are extracted while excluding parts other than the specific teeth (such as gums and surrounding teeth).

[0130] FIGS. 19 and 20 are diagrams showing a method of extracting a specific area of a tooth by converting RGB values of a tooth image into HSV values according to the embodiments of the present invention.

[0131] Referring to FIGS. 19 and 20, a teeth image is photographed and RGB values of the photographed teeth image are converted into HSV values, thereby extracting a specific tooth. More specifically, referring to FIGS. 19(a) and 19(b), a range of values occupied by a specific tooth portion is found by converting RGB values into HSV values. Referring to FIGS. 20(a) and 20(b), the specific tooth is extracted by distinguishing the peripheral area from the specific tooth area to be extracted from the teeth image by using the HSV values. As shown in FIGS. 19 and 20, it can be seen that, the RGB values of the teeth image is converted into the HSV values, and thus the image of the specific tooth is extracted.

[0132] FIGS. 21 and 22 are diagrams for explaining a process of using a histogram to remove reflected light appearing on a tooth image according to the embodiments of the present invention. FIGS. 23 to 25 are views showing tooth images from which the reflected light has been removed using the histogram according to the embodiments of the present invention.

[0133] Referring to FIGS. 21 and 22, a white peak value is found from distribution values of the histogram of the tooth image, and then a color gamut on the right side of the white peak value is removed. FIG. 21(a) shows an image of a tooth having reflected light, FIG. 21(b) is an image showing a state acquired by removing the color gamut of the right side of the white peak value among the distribution values of the histogram of the tooth image having the reflected light, and FIG. 22 shows a histogram of the tooth image having the reflected light. Thereafter, as shown in FIG. 21(b), the reflected light is removed by filling an empty space (white space) with a surrounding color.

[0134] Referring to FIGS. 23 to 25, reflected light is removed with respect to different teeth by using the method described in FIGS. 21 and 22. In each drawings, (a) shows a state before the reflected light is removed, and (b) shows a state after the reflected light is removed. As shown in FIGS. 23 to 25, it can be seen that the reflected light is easily removed using the histogram.

[0135] Although the present invention has been described in detail using exemplary embodiments, the scope of the present invention is not limited to the specific embodiments, and shall be interpreted by the appended claims. In addition, it will be apparent that a person having ordinary skill in the art may carry out various deformations and modifications for the embodiments described as above within the scope without departing from the present invention.

INDUSTRIAL APPLICABILITY

[0136] The technical idea according to the embodiments of the present application, may be applied to an artificial tooth manufacturing system and an artificial tooth manufacturing method by generating artificial tooth manufacturing information.