METHOD FOR AUTOMATIC SEGMENTATION OF FUZZY BOUNDARY IMAGE BASED ON ACTIVE CONTOUR AND DEEP LEARNING

Abstract

The present invention discloses a method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning. In the method, firstly, a fuzzy boundary image is segmented using a deep convolutional neural network model to obtain an initial segmentation result; then, a contour of a region inside the image segmented using the deep convolutional neural network model is used as an initialized contour and a contour constraint of an active contour model; and the active contour model drives, through image characteristics of a surrounding region of each contour point, the contour to move towards a target edge to derive an accurate segmentation line between a target region and other background regions. The present invention introduces an active contour model on the basis of a deep convolutional neural network model to further refine a segmentation result of a fuzzy boundary image, which has the capability of segmenting a fuzzy boundary in the image, thus further improving the accuracy of segmentation of the fuzzy boundary image.

Claims

1. A method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning, comprising the following steps: S1, segmenting a fuzzy boundary image using a deep learning model to obtain an initialized target segmentation result; and S2, fine-tuning the segmentation result of the model using an active contour model to obtain a more accurate normal boundary and fuzzy boundary segmentation result, the step specifically comprising: S2.1, initializing the active contour model using a region boundary in the initialized target segmentation result obtained in S1 to construct an initial level set; S2.2, using the level set to represent an energy function, and obtaining a partial differential equation for curve evolution through the energy function; S2.3, performing a judgment of a region in which a contour point is located; and S2.4, after determining a region in which each contour point is located, calculating a value of the partial differential equation and evolving a contour through iterations until a maximum number of iterations is reached or the contour changes slightly or does not change, and then completing the segmentation.

2. The method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning of claim 1, wherein in step S2.1, the initial level set ϕ.sub.1(x,y) of the active contour model is constructed from the segmentation result of the deep learning model, and the initial level set is defined as follows: ${\varphi }_I\left(x,y\right)=\{\begin{array}{c}D\left(x,y\right),R\left(x,y\right)=0\\ -D\left(x,y\right),R\left(x,y\right)=1\end{array}$ where R(x,y)={0,1} is the segmentation result of the deep learning model, R(x,y)=0 indicates that a point (x,y) belongs to a target region, and R(x,y)=1 indicates that the point (x,y) belongs to a non-target region; and points at a demarcation between the target region and the non-target region form a target boundary B, and D(x,y) is the shortest distance between each point (x,y) on the image and the target boundary B.

3. The method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning of claim 1, wherein in step S2.2, a total of three parts are included in the energy function: 1) the perimeter and area of the contour; 2) a contour local region energy; and 3) a contour constraint energy; and the whole energy function is defined as follows: $F=u.Math.\mathrm{Length}\left(C\right)+v.Math.\mathrm{Area}\left(\mathrm{inside}\left(C\right)\right)+{\lambda }_1\left(\underset{p\in B\left(C\right)}{.Math.}{\int }_{\mathrm{ia}\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^2\mathrm{dxdy}+\underset{p\in B\left(C\right)}{.Math.}{\int }_{\mathrm{ia}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.\mathrm{dxdy}\right)+{\lambda }_2\left(\underset{p\in N\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\mathrm{dxdy}+\underset{p\in F\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\mathrm{dxdy}\right)+\frac{{\lambda }_3}{2}{\left(C-C_0\right)}^2$ where C denotes a current segmentation contour, C.sub.0 denotes an initialized segmentation contour, Length(C) denotes the perimeter of the contour C, Area(inside(C)) denotes the area of a region inside the contour C, μ.sub.0(x,y) is a pixel intensity of a source image I at (X,y), c.sub.1 is a pixel intensity average inside the contour C, c.sub.2 is a pixel intensity average outside the contour C, p is a point on the contour C, p ∈N(C) indicates that the contour point p is in a target edge region, p ∈F(C) indicates that the contour point p is in a foreground (target) region, p ∈B(C) indicates that the contour point p is in a background region, ia(p) is a point that is in the surrounding of the contour point p and inside the contour C, oa(p) is a point that is in the surrounding of the contour point p and outside the contour C, c.sub.ip is a pixel intensity average of points that satisfy ia(p), c.sub.op, is a pixel intensity average of points that satisfy oa(p), the surrounding of the contour point p refers to being in the range of a circle with P as the center and R as the radius; and a first term and a second term in the energy function denote the perimeter and area of the contour and serve to keep the contour continuous and smooth and are related only to the size and shape of the contour itself; a third term and a fourth term in the energy function denote a contour local region energy and serve to cause the contour to evolve towards a target boundary and is related to image data; and a fifth term in the energy function denotes a contour constraint energy and serves to limit the evolution of a current contour towards a region that greatly deviates from the initialized contour, and u, v, λ.sub.1, λ.sub.2, λ.sub.3 are coefficients of the corresponding energy terms.

4. The method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning of claim 3, wherein in the energy function F, a level set method is used to denote the contour C as well as the inside and outside of the contour; and in the level set method, the contour C in an image domain Ω is denoted as a zero level set, i.e., ϕ=0, which is defined as follows: $\{\begin{array}{c}C=\left\{\left(x,y\right)\in \Omega :\varphi \left(x,y\right)=0\right\}\\ \mathrm{inside}\left(C\right)=\left\{\left(x,y\right)\in \Omega :\varphi \left(x,y\right)>0\right\}\\ \mathrm{outside}\left(C\right)=\left\{\left(x,y\right)\in \Omega :\varphi \left(x,y\right)<0\right\}\end{array};$  the zero level set, i.e., ϕ=0, is used to denote the contour C; a Heaviside function H and a Dirac function δ.sub.0 are defined as follows: $H\left(z\right)=\{\begin{array}{cc}1,& \mathrm{if}z\ge 0\\ 0& \mathrm{if}z<0\end{array},{\delta }_0\left(z\right)=\frac{d}{\mathrm{dz}}H\left(z\right);$ H is used to denote the inside and outside of the contour C: $\{\begin{array}{c}\mathrm{inside}\left(C\right)=H\left(\varphi \left(x,y\right)\right)=1\\ \mathrm{outside}\left(C\right)=H\left(\varphi \left(x,y\right)\right)=0\end{array};$ the level set ϕ, the function H, and the function δ.sub.0 are used to denote the perimeter and area of the contour: $\mathrm{Length}\left\{\varphi =0\right\}={\int }_{\Omega }.Math.\nabla H\left(\varphi \left(x,y\right)\right).Math.\mathrm{dxdy}={\int }_{\Omega }{\delta }_0(\varphi \left(x,y\right).Math.\nabla \varphi \left(x,y\right).Math.\mathrm{dxdy};\mathrm{and}$ $\mathrm{Area}\left\{\varphi >0\right\}={\int }_{\Omega }H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy};$ the contour constraint energy is the difference between the current contour C and the initialized contour C.sub.0, and is denoted using the level set ϕ, the function H, and ϕ.sub.1, and the contour constraint energy is denoted as the difference between the current level set ϕ and the initialized level set ϕ.sub.1:
(C−C.sub.0).sup.2=∫.sub.Ω(H(ϕ(x,y)))−H(ϕ.sub.1(x,y)).sup.2dxdy; the contour local region energy is the sum of energies inside and outside the surrounding of all contour points; an energy of surrounding regions of the contour is calculated by calculating, separately for each contour point, energies inside and outside the contour in a local region of the contour point using a local calculation method and then superimposing the energies to obtain an overall energy; and after being denoted using the level set ϕ and the function H, terms in the energy of the surrounding regions of the contour are defined as follows: $\underset{p\in N\left(C\right)}{.Math.}{\int }_{\mathrm{ia}\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^2\mathrm{dxdy}=\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^{2}H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy};$ $\underset{p\in B\left(C\right)}{.Math.}{\int }_{\mathrm{ia}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.\mathrm{dxdy}=\underset{p\in B\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy};$ $\underset{p\in N\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\mathrm{dxdy}=\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy};\mathrm{and}$ $\underset{p\in F\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\mathrm{dxdy}=\underset{p\in F\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}$ where for a point p(x.sub.p, y.sub.p) on the contour point C, ϕ(p)=0; a(p) denotes a point that is in the surrounding of the contour point p, the surrounding of the contour point p referring to being in the range of a circle with P as the center and R as the radius; ia(p) denotes a point that is in the surrounding of the contour point p and inside the contour C, and for a point a(x.sub.a, y.sub.a) satisfying ia(p), ϕ(x.sub.a, y.sub.a)>0 and √{square root over ((x.sub.a−x.sub.p).sup.2+(y.sub.a−y.sub.p).sup.2)}≤R; and oa(p) denotes a point that is in the surrounding of the contour point p and outside the contour C, and for a point a(x.sub.a,y.sub.a) satisfying oa(p), ϕ(x.sub.a,y.sub.a)<0 and √{square root over ((x.sub.a−x.sub.p).sup.2+(y.sub.a−y.sub.p).sup.2)}≤R.

5. The method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning of claim 3, wherein after denoting the energy terms using the level set method, the energy function F is defined as: $F=\mu {\int }_{\Omega }{\delta }_0\left(\varphi \left(x,y\right)\right).Math.\nabla \varphi \left(x,y\right).Math.\mathrm{dxdy}+v{\int }_{\Omega }H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}+{\lambda }_1(\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^{2}H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}+\underset{p\in B\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}+{\lambda }_2(\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}+\underset{p\in F\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}+\frac{{\lambda }_3}{2}{\int }_{\Omega }\left(H\left(\varphi \left(x,y\right)\right)\right)-{H\left({\varphi }_I\left(x,y\right)\right)}^2\mathrm{dxdy}$ where c.sub.1 is the pixel intensity average inside the contour C, and c.sub.2 is the pixel intensity average outside the contour c.sub.ip which satisfy, respectively: c.sub.1(ϕ)=average (u.sub.0) in {ϕ≥0}, c.sub.2(ϕ)=average (u.sub.0) in {ϕ<0}; and c.sub.1 and c.sub.2 are defined through the level set as follows: $c_1=\frac{{\int }_{\Omega }{u}_0\left(x,y\right)H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}}{{\int }_{\Omega }H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}};\mathrm{and}$ $c_2=\frac{{\int }_{\Omega }{u}_0\left(x,y\right)\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}}{{\int }_{\Omega }\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}}$ where c.sub.ip is a pixel intensity average of points satisfying ia(p) and c.sub.op is a pixel intensity average of points satisfying oa(p); and c.sub.ip(φ)=average(μ.sub.0) in {a(p) and φ≥0} and c.sub.op(φ)=average(μ.sub.0) in {a(p) and φ<0} are defined as follows: $c_{\mathrm{ip}}=\frac{{\int }_{a\left(p\right)}{u}_0\left(x,y\right)H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}}{{\int }_{a\left(p\right)}H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}};\mathrm{and}$ $c_{\mathrm{op}}=\frac{{\int }_{a\left(p\right)}{u}_0\left(x,y\right)\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}}{{\int }_{a\left(p\right)}\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}};$ and a partial differential equation for curve evolution is obtained from the energy function F by means of a Euler-Lagrange variational method and a gradient descent flow as follows: $\frac{\partial \varphi }{\partial t}={\delta }_{\epsilon }\left[u\mathrm{div}\left(\frac{\nabla \varphi }{.Math.\nabla \varphi .Math.}\right)-v-{\lambda }_1\left(\underset{p\in N\left(C\right),\left(x,y\right)\in a\left(p\right)}{.Math.}{\left(u_0\left(x,y\right)-c_{\mathrm{ip}}\right)}^2-\underset{p\in B\left(C\right),\left(x,y\right)\in a\left(p\right)}{.Math.}{\left(u_0\left(x,y\right)-c_{\mathrm{ip}}+c_1\right)}^2\right)+{\lambda }_2\left(\underset{p\in N\left(C\right),\left(x,y\right)\in a\left(p\right)}{.Math.}{\left(u_0\left(x,y\right)-c_{\mathrm{ip}}\right)}^2-\underset{p\in F\left(C\right),\left(x,y\right)\in a\left(p\right)}{.Math.}{\left(u_0\left(x,y\right)-c_{\mathrm{ip}}+c_2\right)}^2\right)+{\lambda }_3\left(H_{\epsilon }\left(\varphi \right)-H_{\epsilon }\left({\varphi }_I\right)\right)\right],$ where $H_{\epsilon }\left(z\right)=\frac{1}{2}\left(1+\frac{2}{\pi }\arctan \left(\frac{z}{\epsilon }\right)\right),{\delta }_{\epsilon }\left(z\right)=\frac{\epsilon }{\pi \left({\epsilon }^2+z^2\right)},$ and (x,y)∈a(p) indicates that the point (x,y) is in the surrounding of the contour point p, the surrounding of the contour point p referring to being in the range of a circle with p as the center and R as the radius; and in the process of curve evolution, the level set of the nth iteration is ϕ″ and the level set of the (n+1)th iteration is ${\varphi }^{n+1}={\varphi }^n+\Delta t\frac{\partial \varphi }{\partial t},$ and partial derivatives in the horizontal direction and the vertical direction of a two-dimensional image are calculated using a finite difference approach.

6. The method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning of claim 1, wherein in step S2.3, it is judged whether the contour point p is in a target edge region or a non-target edge region by the difference between pixel intensities inside and outside the contour, and the specific method is as follows: in the fuzzy boundary image, the difference between the pixel intensity averages inside and outside the surrounding of the contour is larger in the target edge region, while the difference between the pixel intensity averages inside and outside the surrounding of the contour is smaller in the non-target edge region; and when the contour point p is in the non-target edge region, the values of c.sub.ip and c.sub.op are close to each other, i.e., c.sub.ip≈c.sub.op, |c.sub.ip−c.sub.op|≤c.sub.d, c.sub.d being a threshold for judging whether c.sub.ip is close to c.sub.op, and the judgment is performed through the following steps: S2.3.1, calculating the difference d.sub.p between c.sub.ip and c.sub.op for each contour point on the contour in counterclockwise order, and constructing a closed-loop queue D in an order obtained through d.sub.p; S2.3.2, smoothing the closed-loop queue D using a Gaussian filter of width R; S2.3.3, searching for a fragment ΔC that is longer than 2R and satisfies d.sub.p≤c.sub.d in the closed-loop queue D; and S2.3.4, if there exists a fragment satisfying step S2.33, all contour points in the fragment are in the non-target edge region and the other contour points are in the target edge region; and the sum of energies inside the contour in local regions of contour points in the target edge region is as follows: $\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^{2}H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy};$ and the sum of energies outside the contour in local regions of contour points in the target edge region is as follows: $\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}.$

7. The method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning of claim 6, wherein in response to the contour point p being in the non-target edge region, it is further determined whether the contour point p is in a foreground region or a background region; and since the characteristics of a surrounding region of a contour point are similar to those of a region in which the contour point is located, the fuzzy boundary image is divided into several subregions according to image characteristics, and then, for these subregions, it is determined whether the contour point p is in the foreground region or the background region, and the specific method is as follows: S2.3.5, firstly, dividing the fuzzy boundary image into several subregions according to image characteristics, and determining a subregion O in which the contour fragment ΔC is located: S2.3.6, establishing a two-dimensional coordinate system in the image subregion O with the coordinate position of a contour point in the middle of the contour fragment ΔC as the center point center (x.sub.0, y.sub.0) of a two-dimensional Gaussian function ƒ(x,y), with ⅙ of the maximum distance of x.sub.0 from a boundary of the subregion as the standard deviation σ.sub.x as of the X-axis portion of the Gaussian function, and with ⅙ of the maximum distance of y.sub.0 from the boundary of the subregion as the standard deviation σ.sub.y of the Y-axis portion of the Gaussian function; and assigning a weight w.sub.ij to each point in the subregion using the two-dimensional Gaussian function and normalizing weights w.sub.ij for the inside and outside of the contour, respectively, to obtain normalized weights w.sub.ij_in for the inside of the contour and normalized weights w.sub.ij_out for the outside of the contour; S2.3.7, calculating averages c.sub.o1 and c.sub.o2 for the inside and outside of the contour in the subregion O using the normalized weights w.sub.ij_in and w.sub.ij_out and a pixel intensity μ.sub.0(i,j), wherein when the point (i,j) is inside the contour in the subregion O), $c_{o1}=\frac{.Math.w_{\mathrm{ij\_in}}.Math.{\mu }_0\left(i,j\right)}{N},$ N being the number of points inside the contour in the subregion O; and when the point (i,j) is outside the contour in the subregion O, $c_{o^2}=\frac{.Math.w_{\mathrm{ij\_out}}.Math.{\mu }_0\left(i,j\right)}{M},$ M being the number of points outside the contour in the subregion O; and S2.3.8, calculating a pixel intensity average m.sub.Δc, of surrounding regions of all contour points in the contour fragment ΔC, and comparing the differences between m.sub.Δc and c.sub.o1 and c.sub.o2, wherein if |m.sub.Δc−c.sub.o1|≤|m.sub.Δc−c.sub.o2|, the contour points in the contour fragment ΔC are in the foreground region, and otherwise in the background region.

8. The method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning of claim 7, wherein if the contour point p is in the foreground region, the direction of evolution of the contour point p is towards the outside of the contour, wherein in the energy function, the correction of the direction of evolution is embodied in increasing the energy of the outside of the contour in a local region of the foreground contour point, with the increased energy being defined as: $\underset{p\in F\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy};$ and if the contour point p is in the background region, the direction of evolution of the contour point p is towards the inside of the contour, wherein in the energy function, the correction of the direction of evolution is embodied in increasing the energy of the inside of the contour in a local region of the background contour point, with the increased energy being defined as: $\underset{p\in B\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}).$

9. The method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning of claim 1, wherein in step S2.4, the contour is evolved through iterations of ${\varphi }^{n+1}={\varphi }^n+\Delta t\frac{\partial \varphi }{\partial t}$ until a maximum number of iterations iter is reached or the contour changes slightly or does not change, where 200≤iter≤10000; and a contour change $\Delta h=\underset{i,j}{.Math.}\left(.Math.H\left({\varphi }_{i,j}^{n+1}\right)-H\left({\varphi }_{i,j}^n\right).Math.\right),$ which indicates changing of the contour, and the iteration stops in response to a plurality of successive slight changes of the contour.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0044] FIG. 1 illustrates a thyroid ultrasonic image, which is an original fuzzy boundary image, in an embodiment of the present invention.

[0045] FIG. 2 illustrates a middle boundary label image of the embodiment of the present invention, where the white line indicates the schematic diagram of a thyroid region.

[0046] FIG. 3 illustrates a schematic diagram of the result of segmenting the thyroid region based on a U-Net deep convolutional neural network in the embodiment of the present invention.

[0047] FIG. 4 illustrates a schematic diagram of the result of segmenting the thyroid region based on a deep model U-Net and an active contour model in the embodiment of the present invention.

[0048] FIG. 5 illustrates a schematic diagram of a local region of a contour point p in the embodiment of the present invention.

[0049] FIG. 6 illustrates a schematic diagram of a thyroid ultrasonic transverse scanned image and the division of subregions in the embodiment of the present invention.

[0050] FIG. 7 illustrates a schematic diagram of a thyroid ultrasonic longitudinal scanned image and the division of subregions in the embodiment of the present invention.

[0051] FIG. 8 illustrates a flowchart of steps of the embodiment of the present invention.

DETAILED DESCRIPTION

[0052] The specific implementation of the present invention will be further described with reference to the drawings and embodiments below, which, however, should not be construed as a limitation on the implementation and scope of protection of the present invention. It should be noted that details which are not set forth below can be implemented by those skilled in the art with reference to the prior art.

Embodiment

[0053] A method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning, as shown in FIG. 8, includes the following steps:

[0054] In S1, for a fuzzy boundary image, such as a thyroid ultrasonic image shown in FIG. 1, a thyroid region is segmented using a trained U-Net convolutional neural network model to obtain a U-Net segmentation result image.

[0055] In S2, the segmentation result of the model is fine-tuned using an active contour model to obtain a more accurate normal boundary and fuzzy boundary segmentation result, as shown in FIG. 8, the step specifically including the following steps:

[0056] In S2.1, the active contour model is initialized using a boundary of the thyroid region in FIG. 3 to construct an initial level set ϕ.sub.1(x,y); parameters of the active contour model are set as follows: μ=1,v=0, λ.sub.1=1, λ.sub.2=1, λ.sub.3=1, Δt=0.1, R=8, c.sub.d=8, ε=1; and the initial level set is defined as follows:

[00022]${\varphi }_I\left(x,y\right)=\{\begin{array}{c}D\left(x,y\right),R\left(x,y\right)=0\\ -D\left(x,y\right),R\left(x,y\right)=1\end{array}$

[0057] where R(x,y)={0,1} is the segmentation result of the deep learning model, R(x,y)=0 indicates that a point (x,y) belongs to a target region, and R(x,y)=1 indicates that the point (x,y) belongs to a non-target region; and points at a demarcation between the target region and the non-target region form a target boundary B, and D(x,y) is the shortest distance between each point (x,y) on the image and the target boundary B.

[0058] In S2.2, the level set is used to represent an energy function, and a partial differential equation for curve evolution is obtained through the energy function, where

[0059] a total of three parts are included in the energy function: 1) the perimeter and area of the contour; 2) a contour local region energy; and 3) a contour constraint energy; and

[0060] the whole energy function is defined as follows:

[00023]$F=u.Math.\mathrm{Length}\left(C\right)+v.Math.\mathrm{Area}\left(\mathrm{inside}\left(C\right)\right)+{\lambda }_1\left(\underset{p\in N\left(C\right)}{.Math.}{\int }_{\mathrm{ia}\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^2\mathrm{dxdy}+\underset{p\in B\left(C\right)}{.Math.}{\int }_{\mathrm{ia}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.\mathrm{dxdy}\right)+{\lambda }_2\left(\underset{p\in N\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\mathrm{dxdy}+\underset{p\in F\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\mathrm{dxdy}\right)+\frac{{\lambda }_3}{2}{\left(C-C_0\right)}^2$

[0061] where C denotes a current segmentation contour, C.sub.0 denotes an initialized segmentation contour, Length (C) denotes the perimeter of the contour C, Area(inside(C)) denotes the area of a region inside the contour C, μ.sub.0(x,y) is a pixel intensity of a source image I at (x,y), c.sub.1 is a pixel intensity average inside the contour C, c.sub.2 is a pixel intensity average outside the contour C, p is a point on the contour C, p ∈N(C) indicates that the contour point p is in a target edge region, p ∈F(C) indicates that the contour point p is in a foreground (target) region, p ∈B(C) indicates that the contour point p is in a background region, ia(p) is a point that is in the surrounding of the contour point p and inside the contour C, oa(p) is a point that is in the surrounding of the contour point p and outside the contour C, c.sub.ip is a pixel intensity average of points that satisfy ia(p), c.sub.op is a pixel intensity average of points that satisfy oa(p), the surrounding of the contour point p refers to being in the range of a circle with P as the center and R as the radius; and a first term and a second term in the energy function denote the perimeter and area of the contour and serve to keep the contour continuous and smooth and are related only to the size and shape of the contour itself; a third term and a fourth term in the energy function denote a contour local region energy and serve to cause the contour to evolve towards a target boundary and is related to image data; and a fifth term in the energy function denotes a contour constraint energy and serves to limit the evolution of a current contour towards a region that greatly deviates from the initialized contour, and u, v, λ.sub.1, λ.sub.2, λ.sub.3 are coefficients of the corresponding energy terms.

[0062] Further, in the energy function F, a level set method is used to denote the contour C as well as the inside and outside of the contour; and in the level set method, the contour C in an image domain Ω is denoted as a zero level set, i e., ϕ=0, which is defined as follows:

[00024]$\{\begin{array}{c}C=\left\{\left(x,y\right)\in \Omega :\varphi \left(x,y\right)=0\right\}\\ \mathrm{inside}\left(C\right)=\left\{\left(x,y\right)\in \Omega :\varphi \left(x,y\right)>0\right\}\\ \mathrm{outside}\left(C\right)=\left\{\left(x,y\right)\in \Omega :\varphi \left(x,y\right)>0\right\}\end{array};$

[0063] the zero level set, i.e., ϕ=0, is used to denote the contour C;

[0064] a Heaviside function H and a Dirac function δ.sub.0 are defined as follows:

[00025]$H\left(z\right)=\{\begin{array}{cc}1,& \mathrm{if}z\ge 0\\ 0,& \mathrm{if}z<0\end{array},{\delta }_0\left(z\right)=\frac{d}{\mathrm{dz}}H\left(z\right);$

[0065] H is used to denote the inside and outside of the contour C

[00026]$\{\begin{array}{c}\mathrm{inside}\left(C\right)=H(\varphi \left(x,y\right)=1\\ \mathrm{outside}\left(C\right)=H(\varphi \left(x,y\right)=0\end{array};$

the level set ϕ, the function H and the function δ.sub.0 are used to denote the perimeter and area of the contour:

[00027]$\mathrm{Length}\left\{\varphi =0\right\}={\int }_{\Omega }.Math.\nabla H\left(\varphi \left(x,y\right)\right).Math.\mathrm{dxdy}={\int }_{\Omega }{\delta }_0\left(\varphi \left(x,y\right)\right).Math.\nabla \varphi \left(x,y\right).Math.\mathrm{dxdy};\mathrm{and}$$\mathrm{Area}\left\{\varphi >0\right\}={\int }_{\Omega }H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy};$

[0066] the contour constraint energy is the difference between the current contour C and the initialized contour C.sub.0, and is denoted using the level set ϕ, the function H, and ϕ.sub.1, and the contour constraint energy is denoted as the difference between the current level set ϕ and the initialized level set ϕ.sub.1:

(C−C.sub.0).sup.2=∫.sub.Ω(H(ϕ(x,y)))−H(ϕ.sub.1(x,y)).sup.2dxdy;

[0067] the contour local region energy is the sum of energies inside and outside the surrounding of all contour points; an energy of surrounding regions of the contour is calculated by calculating, separately for each contour point, energies inside and outside the contour in a local region of the contour point using a local calculation method and then superimposing the energies to obtain an overall energy; and after being denoted using the level set ϕ and the function H, terms in the energy of the surrounding regions of the contour are defined as follows:

[00028]$\underset{p\in N\left(C\right)}{.Math.}{\int }_{\mathrm{ia}\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^2\mathrm{dxdy}=\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^{2}H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy};\underset{p\in B\left(C\right)}{.Math.}{\int }_{\mathrm{ia}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.\mathrm{dxdy}=\underset{p\in B\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy};\underset{p\in N\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\mathrm{dxdy}=\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy};\mathrm{and}\underset{p\in F\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\mathrm{dxdy}=\underset{p\in F\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}$

[0068] where for a point p(x.sub.p,y.sub.p) on the contour point C, ϕ(p)=0 a(p) indicates a point that is in the surrounding of the contour point p, the surrounding of the contour point p referring to being in the range of a circle with P as the center and R as the radius; ia(p) denotes a point that is in the surrounding of the contour point p and inside the contour C and for a point a(x.sub.a, y.sub.a) satisfying ia(p), ϕ(x.sub.a,y.sub.a)>0 and √{square root over ((x.sub.a−x.sub.p).sup.2+(y.sub.a−y.sub.p).sup.2)}≤R, and oa(p) denotes a point that is in the surrounding of the contour point p and outside the contour C and for a point al(x.sub.a,y.sub.a) satisfying oa(p), ϕ(x.sub.a,y.sub.a)≤0 and √{square root over ((x.sub.a−x.sub.p).sup.2+(y.sub.a−y.sub.p).sup.2)}≤R.

[0069] Further, after denoting the energy terms using the level set method, the energy function F is defined as:

[00029]$F=\mu {\int }_{\Omega }{\delta }_0\left(\varphi \left(x,y\right)\right).Math.\nabla \varphi \left(x,y\right).Math.\mathrm{dxdy}+v{\int }_{\Omega }H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}+{\lambda }_1\left(\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^{2}H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}+\underset{p\in B\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}\right)+{\lambda }_2\left(\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}+\underset{p\in F\left(C\right)}{.Math.}{\int }_{\mathrm{oa}\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}\right)+\frac{{\lambda }_3}{2}{\int }_{\Omega }\left(H\left(\varphi \left(x,y\right)\right)\right)-{H\left({\varphi }_I\left(x,y\right)\right)}^2\mathrm{dxdy}$

[0070] where c.sub.1 is the pixel intensity average inside the contour C, and c.sub.2 is the pixel intensity average outside the contour C, which satisfy, respectively: c.sub.1(ϕ)=average (μ.sub.0) in {ϕ≥0}, c.sub.2 (ϕ)=average (μ.sub.0) in {ϕ<0 } and c.sub.1 and c.sub.2 are defined through the level set ϕ as follows:

[00030]$c_1=\frac{{\int }_{\Omega }{u}_0\left(x,y\right)H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}}{{\int }_{\Omega }H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}};\mathrm{and}{c}_2=\frac{{\int }_{\Omega }{u}_0\left(x,y\right)\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}}{{\int }_{\Omega }\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}}$

where c.sub.ip is a pixel intensity average of points satisfying ia(p) and c.sub.op is a pixel intensity average of points satisfying oa(p); and c.sub.ip average(μ.sub.0) in {a(p) and φ≥0} and c.sub.op(φ)=average(μ.sub.0) in {a(p) and φ<0} are defined as follows:

[00031]$c_{\mathrm{ip}}=\frac{{\int }_{a\left(p\right)}{u}_0\left(x,y\right)H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}}{{\int }_{a\left(p\right)}H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}};\mathrm{and}{c}_{\mathrm{op}}=\frac{{\int }_{a\left(p\right)}{u}_0\left(x,y\right)\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}}{{\int }_{a\left(p\right)}\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}};$

[0071] a partial differential equation for curve evolution is obtained from the energy function F by means of a Euler-Lagrange variational method and a gradient descent flow as follows:

[00032]$\frac{\partial \varphi }{\partial t}={\delta }_{\epsilon }\left[u\mathrm{div}\left(\frac{\nabla \varphi }{.Math.\nabla \varphi .Math.}\right)-v-{\lambda }_1\left(\underset{p\in N\left(C\right),\left(x,y\right)\in a\left(p\right)}{.Math.}{\left(u_0\left(x,y\right)-c_{\mathrm{ip}}\right)}^2-\underset{p\in B\left(C\right),\left(x,y\right)\in a\left(p\right)}{.Math.}{\left(u_0\left(x,y\right)-c_{\mathrm{ip}}+c_1\right)}^2\right)+{\lambda }_2\left(\underset{p\in N\left(C\right),\left(x,y\right)\in a\left(p\right)}{.Math.}{\left(u_0\left(x,y\right)-c_{\mathrm{ip}}\right)}^2-\underset{p\in F\left(C\right),\left(x,y\right)\in a\left(p\right)}{.Math.}{\left(u_0\left(x,y\right)-c_{\mathrm{ip}}+c_2\right)}^2\right)+{\lambda }_3\left(H_{\epsilon }\left(\varphi \right)-H_{\epsilon }\left({\varphi }_I\right)\right)\right]$

[0072] where

[00033]$H_{\epsilon }\left(z\right)=\frac{1}{2}\left(1+\frac{2}{\pi }\arctan \left(\frac{z}{\epsilon }\right)\right),{\delta }_{\epsilon }\left(z\right)=\frac{\epsilon }{\pi \left({\epsilon }^2+z^2\right)},$

and (x,y)∈a(p) indicates that the point (x,y) is in the surrounding of the contour point p, the surrounding of the contour point p referring to being in the range of a circle with P as the center and R as the radius; and in the process of curve evolution, the level set of the nth iteration is ϕ″ and the level set of the (n+1)th iteration is

[00034]${\varphi }^{n+1}={\varphi }^n+\Delta t\frac{\partial \varphi }{\partial t},$

and partial derivatives in the horizontal direction and the vertical direction of a two-dimensional image are calculated using a finite difference approach.

[0073] In S2.3, a judgment of a region in which a contour point is located is performed. As shown in FIG. 5, the black line block denotes an image region, the closed black curve is the contour C, the region inside the contour C is denoted as Inside (C), the region outside of the contour C is denoted as Outside (C), a point p is a point on the contour C, ia(p) is a region in the surrounding of the contour point p and inside the contour C, oa(p) is a region in the surrounding of the contour point p and outside the contour C, and the surrounding of the contour point p refers to being in the range of a circle with P as the center and R as the radius, such as the circle drawn by the black dashed line in the figure.

[0074] It is judged whether the contour point p is in a target edge region or a non-target edge region by the difference between pixel intensities inside and outside the contour, and the specific method is as follows: in the fuzzy boundary image, the difference between the pixel intensity averages inside and outside the surrounding of the contour is larger in the target edge region, while the difference between the pixel intensity averages inside and outside the surrounding of the contour is smaller in the non-target edge region; and when the contour point p is in the non-target edge region, the values of c.sub.ip and c.sub.op, are close to each other, i.e., c.sub.ip˜c.sub.op, |c.sub.ip−c.sub.p|≤c.sub.d, c.sub.d being a threshold for judging whether c.sub.ip is close to c.sub.op, and as shown in FIG. 8, the judgment is performed through the following steps:

[0075] in S2.3.1, the difference d.sub.p between c.sub.ip, and c.sub.op for each contour point on the contour is calculated in counterclockwise order, and a closed-loop queue D is constructed in an order obtained through d.sub.p;

[0076] in S2.3.2, the closed-loop queue D is smoothed using a Gaussian filter of width R;

[0077] in S2.3.3, a fragment ΔC that is longer than 2R and satisfies d.sub.p≤c.sub.d is searched for in the closed-loop queue D; and

[0078] in S2.3.4, if there exists a fragment satisfying step S2.3.3, all contour points in the fragment are in the non-target edge region and the other contour points are in the target edge region; and the sum of energies inside the contour in local regions of contour points in the target edge region is as follows:

[00035]$\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}.Math.}^{2}H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy};$

[0079] the sum of energies outside the contour in local regions of contour points in the target edge region is as follows:

[00036]$\underset{p\in N\left(C\right)}{.Math.}{\int }_{a\left(p\right)}{.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}.Math.}^2\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy}.$

[0080] Further, in response to the contour point p being in the non-target edge region, it is further determined whether the contour point p is in a foreground region or a background region; and since the characteristics of a surrounding region of a contour point are similar to those of a region in which the contour point is located, the fuzzy boundary image is divided into several subregions according to image characteristics, and then, for these subregions, it is determined whether the contour point p is in the foreground region or the background region. In this embodiment, thyroid ultrasonic images are used as test images. The thyroid ultrasonic images are classified into a transverse scanned image and a longitudinal scanned image, as shown in FIGS. 6 and 7. The left and right segmentation line in FIG. 6 separates the bronchial and carotid regions, and the upper and lower segmentation line reduces the effect of acoustic attenuation, where the pixel intensity in part of the thyroid ultrasonic image decreases with depth and the upper part is generally brighter than 1R the lower part, while dividing the muscle region. The upper and lower segmentation line in FIG. 7 similarly reduces the effect of acoustic attenuation while dividing the muscle region. In these subregions, for the subregions A, B, C, and D, it is determined whether the contour point p is in the foreground region or the background region, and the specific steps are as follows:

[0081] in S2.3.5, firstly, the fuzzy boundary image is divided into several subregions according to image characteristics, and a subregion O ∈{A, B, C, D} in which the contour fragment ΔC is located is determined;

[0082] in S23.6, a two-dimensional coordinate system is established in the image subregion O with the coordinate position of a contour point in the middle of the contour fragment ΔC as the center point center(x.sub.0,y.sub.0), thus obtaining a two-dimensional Gaussian function

[00037]$f\left(x,y\right)=\exp \left(-\left(\frac{{\left(x-x_0\right)}^2}{2{\sigma }_x^2}+\frac{{\left(y-y_0\right)}^2}{2{\sigma }_y^2}\right)\right),$

with ⅙ of the maximum distance of x.sub.0 from a boundary of the subregion as the standard deviation a, of the X-axis portion of the Gaussian function, and with ⅙ of the maximum distance of y, from the boundary of the subregion as the standard deviation σ.sub.y of the Y-axis portion of the Gaussian function; and a weight IV, is assigned to each point in the subregion using the two-dimensional Gaussian function and weights W, for the inside and outside of the contour are normalized, respectively, to obtain normalized weights w.sub.ij_in for the inside of the contour and normalized weights w.sub.ij_out for the outside of the contour;

[0083] in S2.3.7, averages c.sub.o1 and c.sub.o2 for the inside and outside of the contour in the subregion O are calculated using the normalized weights w.sub.ij_in and w.sub.ij_out and a pixel intensity μ.sub.0(i,j), where when the point (i,j) is inside the contour in the subregion O,

[00038]$c_{o1}=\frac{.Math.w_{\mathrm{ij\_in}}.Math.{\mu }_0\left(i,j\right)}{N},$

N being the number of points inside the contour in the subregion O; and when the point (I,j) is outside the contour in the subregion O,

[00039]$c_{o2}=\frac{.Math.w_{\mathrm{ij\_out}}.Math.{\mu }_0\left(i,j\right)}{M},$

M being the number of points outside the contour in the subregion O; and

[0084] in S2.3.8, a pixel intensity average mA of surrounding regions of all contour points in the contour fragment ΔC is calculated, and the differences between m.sub.Δc and c.sub.o1 and c.sub.o2 are compared, where if mA|m.sub.Δc−c.sub.o1|≤|m.sub.Δc−c.sub.o2| the contour points in the contour fragment ΔC are in the foreground region, and otherwise the contour points are in the background region; and

[0085] if the contour point p is in the foreground region, the direction of evolution of the contour point p is towards the outside of the contour, wherein in the energy function, the correction of the direction of evolution is embodied in increasing the energy of the outside of the contour in a local region of the foreground contour point, with the increased energy being defined as:

[00040]$\underset{p\in F\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{op}}+c_2.Math.\left(1-H\left(\varphi \left(x,y\right)\right)\right)\mathrm{dxdy};$

[0086] if the contour point p is in the background region, the direction of evolution of the contour point p is towards the inside of the contour, wherein in the energy function, the correction of the direction of evolution is embodied in increasing the energy of the inside of the contour in a local region of the background contour point, with the increased energy being defined as:

[00041]$\underset{p\in B\left(C\right)}{.Math.}{\int }_{a\left(p\right)}.Math.{\mu }_0\left(x,y\right)-c_{\mathrm{ip}}+c_1.Math.H\left(\varphi \left(x,y\right)\right)\mathrm{dxdy}).$

[0087] In S2.4, after determining a region in which each contour point is located, a value of the partial differential equation is calculated, and a contour is evolved through iterations of

[00042]${\varphi }^{n+1}={\varphi }^n+\Delta t\frac{\partial \varphi }{\partial t}$

until a maximum number of iterations iter 1000 is reached or the contour changes slightly or does not change, and then the segmentation is completed, where a contour change

[00043]$\Delta h=\underset{i,j}{.Math.}\left(.Math.H\left({\varphi }_{i,j}^{n+1}\right)-H\left({\varphi }_{i,j}^n\right).Math.\right),$

which indicates changing of the contour, and the iteration stops in response to a plurality of successive slight changes of the contour.

[0088] In this embodiment, FIG. 2 illustrates a standard segmented image, labeled by an experienced doctor. The segmentation result of U-Net in FIG. 3 presents problems of segmentation errors and under-segmentation. However, after using the active contour model, as shown in FIG. 4, regions with segmentation errors are removed from the result image and the contour is enabled to expand outward in the fuzzy region to cover part of the under-segmented region.

[0089] The purpose of the method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning is to enable the segmentation model to segment fuzzy boundary regions while fine-tuning the segmentation contour so that the segmentation contour is as close to the target boundary as possible. The present invention adopts a combination of a deep convolutional network model and an active contour model to enable the model to achieve accurate segmentation results. The experimental data of the present invention are thyroid ultrasonic images, and the data set contains 309 images, of which 150 are used as the training set and the remaining 159 are used as the test set. The U-Net model is trained using the 150 training images, and the trained model segments the 159 test images, and then the U-Net segmentation results are further fine-tuned using the active contour model. The quantitative indexes of the segmentation results are as follows:

[00044]$\mathrm{Accuracy}=\frac{\mathrm{TP}+\mathrm{TN}}{A_P+A_N},\mathrm{PPV}=\frac{\mathrm{TP}}{\mathrm{TP}+\mathrm{FP}},\mathrm{and}\mathrm{IoU}=\frac{\mathrm{TP}}{\mathrm{FN}+\mathrm{TP}+\mathrm{FP}}$

where TP, TN, FP, FN, A.sub.p,and A.sub.N denote True Positive, True Negative, False Positive, False Negative, All Positive, and All Negative, respectively. The average quantitative indexes obtained after segmentation of the 159 images are as shown in Table 1.

TABLE-US-00001 TABLE 1 Quantitative index Accuracy PPV IOU U-Net 0.9922 0.9090 0.8872 The present 0.9933 0.9278 0.9026 invention

[0090] As can be seen from the above table, the present invention combines the U-Net model and the active contour model, and achieves a higher accuracy of pixel classification in terms of fine-grained segmentation compared to the approach in which only the U-Net model is used, where Accuracy reaches 0.9933; 0.9278 of the region segmented as the thyroid is the correct thyroid region, with an improvement of 2.78% in accuracy; and the intersection over union of the region that is divided as the thyroid versus the true thyroid region is 0,9026, with an improvement of 1.54% compared to the approach in which only the U-Net model is used. The improvements of the present invention regarding the quantitative indexes Accuracy, PPV, and IOU indicate that the present invention can further improve the accuracy of target segmentation in fuzzy images and can yield fine and accurate segmentation results for fuzzy boundaries. In the present invention, the use of an active contour model based on U-Net leads to better fuzzy boundary image segmentation results. The method for automatic segmentation of a fuzzy boundary image based on active contour and deep learning has the capability of segmenting a fuzzy boundary in a fuzzy boundary image while fine-tuning the segmentation contour to cause the contour to move close to the target boundary.