GABOR WAVELET-FUSED MULTI-SCALE LOCAL LEVEL SET ULTRASONIC IMAGE SEGMENTATION METHOD

Abstract

Disclosed is a Gabor wavelet-fused multi-scale local level set ultrasonic image segmentation method. In the method, non-uniformity of the grayscale of an ultrasonic image is taken as a texture having cluttered directions, the multi-directional property of Gabor wavelets is used to process the image, and intermediate images in different filtering directions are fused by taking maximum values, so as to obtain an intermediate image having a weakened texture effect and an enhanced difference between a foreground and a background. For the feature of a weak edge of an ultrasonic image, a concept of multi-scale is used to improve the conventional LIC method, Gaussian convolution kernels having different variances are set, and a final edge is obtained by means of average fusion.

Claims

1. An image segmentation method, comprising the following steps: step S1: obtaining an original image to be processed; step S2: performing filtering decomposition on the original image by using multi-directional Gabor wavelets, to obtain a plurality of intermediate images; step S3: fusing the plurality of intermediate images by taking maximum values, to obtain an enhanced image; step S4: constructing a corresponding level set energy equation for the intermediate images; step S5: optimizing parameters of the energy equation to enable an energy function to take a minimum value, to obtain an accurate position of an edge; and step S6: repeating step S5 until the energy function takes the minimum value to obtain a final edge.

2. The image segmentation method according to claim 1, wherein a change function of the multi-directional Gabor wavelets in step S2 is:
g.sub.q(x,y)=g(x cos θ+y sin θ,−x sin θ+y cos θ), wherein g(x, y) is a Gabor function in a two-dimensional space; g.sub.q(x, y) is a multi-directional Gabor wavelet transformation template, where x and y are coordinates in two directions of the template; θ=qπ/, represents a total quantity of directions in wavelet transformation, and q is a direction parameter; and convolution is performed on Gabor wavelets in different directions with the original image to obtain the plurality of intermediate images, as shown by the following formula:
I.sub.q(x,y)=I(x,y)*g.sub.q(x,y) q=0,1, . . . Q−1 wherein I(x, y) is original image data, and I.sub.q(x, y) is intermediate image data.

3. The image segmentation method according to claim 1, wherein a fusion equation for fusing the plurality of intermediate images in step S3 is as follows:
I′(x,y)=max {I.sub.q(x,y), q=0,1, . . . Q−1} where I′(x, y) is the fused image data.

4. The image segmentation method according to claim 1, wherein the energy equation comprises: an energy functional item related to the image itself, a length regularization item for keeping edge smoothness by limiting an edge length, and a distance regularization item for keeping a level set equation from reinitialization.

5. The image segmentation method according to claim 4, wherein it is assumed that an image having non-uniform grayscale is a result obtained after a grayscale offset item and an actual image are weighted and summed with noise added therein, and Gaussian templates having different variances are constructed to calculate the energy functional item; and the Gaussian templates are as follows: $K_{{\sigma }_p}\left(u\right)=\{\begin{array}{cc}\frac{1}{a}{e}^{-{.Math.u.Math.}^2/2{\sigma }_{p^2}},& .Math.u.Math.\le \rho \\ 0,& .Math.u.Math.>\rho \end{array},$ where σ.sub.p=σ.sub.0×p; σ.sub.p is a variance of a different scale, and σ.sub.0 is a minimum variance, K.sub.σ.sub.p(u) is a Gaussian filter kernel having a different variance, and p is a different scale and the form of the energy equation is as follows:
(ϕ,c,b)=ε(ϕ,c,b)+ν(ϕ)+μ(ϕ), wherein (ϕ, c, b) is a constructed energy function, ε(ϕ, c, b) is the energy functional item related to the image itself, L(ϕ) is the length regularization item used for forcing level set contour to be smooth by limiting an arc length thereof, R(ϕ) is the distance regularization item that keeps a level set function stable during iteration in order to keep a level set from reinitialization, and ν and μ are respectively corresponding weighting factors; $\epsilon =\frac{1}{P}\int \underset{p=1}{\overset{P}{.Math.}}\underset{i=1}{\overset{2}{.Math.}}\left(\int K_{{\sigma }_p}\left(y-x\right){.Math.I^{\prime }\left(x\right)-b_p\left(y\right)c_{i,p}.Math.}^2\mathrm{dy}\right)\left(M_i\left(\varphi \left(x\right)\right)\right)\mathrm{dx},$ wherein P is a quantity of different scales, K.sub.σ.sub.p(u) is a multi-scale circular neighborhood template, M.sub.1(ϕ)=H(ϕ), and M.sub.2(ϕ)=1H(ϕ); and H(x) is a Heaviside function; M.sub.1(ϕ) and M.sub.2(ϕ) respectively correspond to an edge inside and an edge outside of the image. L(ϕ) and R.sub.p(ϕ) are the two regularization items, L(ϕ) is the length regularization item used for calculating a length of a zero-level contour of a level set equation ϕ and forcing level set contour to be smooth by limiting an arc length thereof; and an expression of the length regularization item is as follows:
(ϕ)=∫|∇H(ϕ)|dx where R(ϕ) is the distance regularization item that keeps a level set function stable during iteration in order to keep a level set from reinitialization, and an expression of the distance regularization item is as follows: $ℛ\left(\varphi \right)=\int p\left(.Math.\nabla \varphi .Math.\right)\mathrm{dx}$ $p\left(s\right)=\{\begin{array}{cc}\frac{1}{{\left(2\pi \right)}^2}\left(1-\cos \left(2\pi s\right)\right),& s\le 1\\ \frac{1}{2}{\left(s-1\right)}^2,& s\ge 1\end{array},$ where p(s) represents a part of a regularization item equation, where s represents the absolute value of an edge gradient of the image.

6. The image segmentation method according to claim 5, wherein ϕ, c, b are optimized to enable the energy function to take the minimum value, the three parameters are respectively optimized, and during optimization of one parameter, values of the other two parameters are firstly fixed, the level set equation ϕ is optimized by using a Euler-Lagrange formula, c and b are optimized by using a partial differential equation, and an optimization equation for ϕ is as follows: $\frac{\partial \varphi }{\partial t}=-\frac{1}{P}\delta \left(\varphi \right)\underset{p=0}{\overset{P-1}{.Math.}}\left(e_{1,p}-e_{2,p}\right)+v\delta \left(\varphi \right)\mathrm{div}\left(\frac{\nabla \varphi }{.Math.\nabla \varphi .Math.}\right)+\mu \mathrm{div}\left(d\left(.Math.\nabla \varphi .Math.\right)\nabla \varphi \right)$ $e_{i,p}=\int K_{{\sigma }_p}\left(y-x\right){.Math.I\left(x\right)-b_p\left(y\right)c_{i,p}.Math.}^2\mathrm{dy},i=1,2,$ where $\frac{\partial \varphi }{\partial t}$ represents performing iteration on the level set equation, P represents a scale, δ(ϕ) is an impulse function, and ν and μ respectively represent the corresponding weighting factors, and div represents a difference operation; e.sub.i,p is an energy factor related to a distance constructed in a different scale; and ϕ and b are fixed, and c is optimized by the following equation: $c_{i,p}=\frac{\int \left(b_p*K_{{\sigma }_p}\right)*I*M_i\left(\varphi \left(y\right)\right)\mathrm{dy}}{\int \left({b_p}^2*K_{{\sigma }_p}\right)M_i\left(\varphi \left(y\right)\right)\mathrm{dy}},i=1,2,$ where b.sub.p is a grayscale offset field calculated in the scale p; and c.sub.i,p is an image corrected by using the grayscale offset field in the scale p, and includes an inside part and an outside part of the level set; and ∅and c are fixed, and b is optimized by the following equation: $b_p=\frac{(I.Math.{.Math.}_{i=1}^2{c}_{i,p}{M}_i\left(\varphi \left(y\right)\right)*K_{{\sigma }_p}}{({.Math.}_{i=1}^2{c}_{i,p}^2{M}_i\left(\varphi \left(y\right)\right)*K_{{\sigma }_p}},$ where b.sub.p is the grayscale offset field calculated in the scale p, and K.sub.σ.sub.P is the Gaussian filter kernel having a different variance.

7. An image processing apparatus, comprising: a storage medium configured to store an image to be processed; and a processor configured to: obtain the image to be processed from the storage medium; perform filtering decomposition on the original image by using multi- directional Gabor wavelets, to obtain a plurality of intermediate images; fuse the plurality of intermediate images by taking maximum values, to obtain an enhanced image; construct a corresponding level set energy equation for the intermediate images; optimize parameters of the energy equation to enable an energy function to take a minimum value, to obtain an accurate position of an edge; and repeat optimizing the parameters of the energy equation until the energy function takes the minimum value to obtain a final edge.

8. An ultrasonic imaging apparatus, comprising: an ultrasonic probe configured to emit an ultrasonic wave to an object under test, receive a reflected ultrasonic wave reflected by the object under test, and generate an echo signal corresponding to the reflected ultrasonic wave; a generation part configured to generate an ultrasonic image related to the object under test according to the echo signal; and a processing part configured to: obtain the image to be processed from the storage medium; perform filtering decomposition on the original image by using multi-directional Gabor wavelets, to obtain a plurality of intermediate images; fuse the plurality of intermediate images by taking maximum values, to obtain an enhanced image; construct a corresponding level set energy equation for the intermediate images; optimize parameters of the energy equation to enable an energy function to take a minimum value, to obtain an accurate position of an edge; and repeat optimizing the parameters of the energy equation until the energy function takes the minimum value to obtain a final edge.

9. The ultrasonic imaging apparatus of claim 8, wherein the ultrasonic imaging apparatus is part of an ultrasonic endo scope that further comprises an insertion part and a control part.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0041] FIG. 1 is a schematic flowchart of an image segmentation method according to the present application.

[0042] FIG. 2 is a schematic structural diagram of an image processing apparatus according to the present application.

[0043] FIG. 3 is a schematic structural diagram of an ultrasonic imaging apparatus according to the present application.

DETAILED DESCRIPTION

[0044] An image segmentation method, an image processing apparatus, and an ultrasonic imaging apparatus according to the present application are described below with reference to the accompanying drawings.

Embodiment 1

[0045] An implementation procedure of the image segmentation method in this embodiment is shown in FIG. 1.

[0046] Step 1: Read an acquired original ultrasonic image. In a preferred embodiment, the ultrasonic image is a two-dimensional ultrasonic image of a stomach cross-section.

[0047] Step 2: Filter the image by using a multi-directional Gabor filter. A Gabor function in a two-dimensional space is shown in the following formula:

[00007]$ℊ\left(x,y\right)=\frac{1}{2{\mathrm{\pi \sigma }}_x{\sigma }_y}\exp \left[-\frac{1}{2}\left(\frac{x^2}{{\sigma }_x^2}+\frac{y^2}{{\sigma }_y^2}\right)\right]\times \exp \left(2\pi \mathrm{jWx}\right).$

[0048] In the formula, σ.sub.x and σ.sub.y respectively represent broadenings of a Gaussian function in an x direction and a y direction, and W represents a frequency bandwidth of a Gabor wavelet. A multi-directional Gabor wavelet transformation function may be represented as:

g.sub.q(x,y)=g(x cos θ+y sin θ, −x sin θ+y cos θ)

[0049] where, g(x, y) is a Gabor function in a two-dimensional space; g.sub.q(x, y) is a multi-directional Gabor wavelet transformation template, where x and y are coordinates in two directions of the template; θ=qπ/, and represents a total quantity of directions in wavelet transformation; and convolution is performed on Gabor wavelets in different directions with the original image to obtain the plurality of intermediate images, as shown by the following formula:

I.sub.q(x,y)=I(x,y)*g.sub.q(x,y)q=0,1, . . . Q−1,

[0050] I(x, y) is the original image data and I.sub.q(x, y) is intermediate image data.

[0051] Step S3: To keep as many details as possible of the original image and enhance a difference between a foreground to be segmented and a background, fuse the plurality of intermediate images by taking maximum values, to obtain an enhanced image.

I′(x,y)=max{I.sub.q(x,y),q=0,1, . . . , Q−1},

where I′(x, y) is the fused image data.

[0052] Step S4: Construct a corresponding level set energy equation for the intermediate images. The energy equation of the entire image is formed by three parts, which include: an energy functional item related to the image itself, a length regularization item for keeping edge smoothness by limiting an edge length, and a distance regularization item for keeping a level set equation from reinitialization. It is assumed that an image having non-uniform grayscale is a result obtained after a grayscale offset item and an actual image are weighted and summed with noise added therein, and Gaussian templates having different variances are constructed to calculate the energy functional item. The Gaussian templates are as follows:

[00008]$K_{{\sigma }_p}\left(u\right)=\{\begin{array}{cc}\frac{1}{a}{e}^{-{.Math.u.Math.}^2/2{\sigma }_{p^2}},& .Math.u.Math.\le \rho \\ 0& .Math.u.Math.>\rho \end{array},$

where σ.sub.p=σ.sub.0×p, σ.sub.p is a variance of a different scale, and σ.sub.0 is a minimum variance, and p is the different scale, K.sub.σ.sub.p is a Gaussian filter kernel having a different variance. The form of the entire energy equation is as follows:

(ϕ,c,b)=ε(ϕ,c,b)+ν(ϕ)+μ(ϕ),

where (ϕ,c,b) is a constructed energy function, ε(ϕ, c, b) is the energy functional item related to the image itself, L(ϕ) is the length regularization item used for forcing level set contour to be smooth by limiting an arc length thereof, R(ϕ) is the distance regularization item that keeps a level set function stable during iteration in order to keep a level set from reinitialization, and ν and μ are respectively corresponding weighting factors;

[00009]$\epsilon =\frac{1}{P}\int \underset{p=1}{\overset{P}{.Math.}}\underset{i=1}{\overset{2}{.Math.}}\left(\int K_{{\sigma }_p}\left(y-x\right){.Math.I^{\prime }\left(x\right)-b_p\left(y\right)c_{i,p}.Math.}^2\mathrm{dy}\right)\left(M_i\left(\varphi \left(x\right)\right)\right)\mathrm{dx},$

where P is a quantity of different scales, M.sub.1(ϕ)=H(ϕ), M.sub.2(ϕ)=1−H(ϕ). H(x) is a Heaviside function. M.sub.1(ϕ) and M.sub.2(ϕ) respectively correspond to an edge inside and an edge outside of the image. In the formula, (ϕ)=∫|∇H(ϕ)|dx, (ϕ)=∫p(|∇ϕ|)dx. A functional form of p(s) is as follows:

[00010]$p\left(s\right)=\{\begin{array}{cc}\frac{1}{{\left(2\pi \right)}^2}\left(1-\cos \left(2\pi s\right)\right),& s\le 1\\ \frac{1}{2}{\left(s-1\right)}^2,& s\ge 1\end{array},$

where p(s) represents a part of a regularization item equation, where s represents the absolute value of an edge gradient of the image.

[0053] Step 5: Optimize ϕ, c, b, to enable the energy function to take the minimum value, the three parameters are respectively optimized, and during optimization of one parameter, values of the other two parameters are firstly fixed, the level set equation ϕ is optimized by using a Euler-Lagrange formula, c and b are optimized by using a partial differential equation, and an optimization equation for ϕ is as follows:

[00011]$\frac{\partial \varphi }{\partial t}=-\frac{1}{P}\delta \left(\varphi \right)\underset{p=0}{\overset{P-1}{.Math.}}\left(e_{1,p}-e_{2,p}\right)+v\delta \left(\varphi \right)\mathrm{div}\left(\frac{\nabla \varphi }{.Math.\nabla \varphi .Math.}\right)+\mu \mathrm{div}\left(d\left(.Math.\nabla \varphi .Math.\right)\nabla \varphi \right)$$e_{i,p}=\int K_{{\sigma }_p}\left(y-x\right){.Math.I\left(x\right)-b_p\left(y\right)c_{i,p}.Math.}^2\mathrm{dy},i=1,2,$

where

[00012]$\frac{\partial \varphi }{\partial t}$

represents performing iteration on the level set equation, P represents a scale, δ(ϕ) is an impulse function, and ν and μ respectively represent the corresponding weighting factors, and div represents a difference operation; e.sub.i,p is an energy factor related to a distance constructed in a different scale; and ϕ and b are fixed, and c is optimized by the following equation:

[00013]$c_{i,p}=\frac{\int \left(b_p*K_{{\sigma }_p}\right)*I*M_i\left(\varphi \left(y\right)\right)\mathrm{dy}}{\int \left({b_p}^2*K_{{\sigma }_p}\right)M_i\left(\varphi \left(y\right)\right)\mathrm{dy}},i=1,2,$

where b.sub.p is a grayscale offset field calculated in the scale p; and c.sub.i,p is an image corrected by using the grayscale offset field in the scale p, and includes an inside part and an outside part of the level set;
ϕ and c are fixed, and b is optimized by the following equation:

[00014]$b_p=\frac{(I.Math.{.Math.}_{i=1}^2{c}_{i,p}{M}_i\left(\varphi \left(y\right)\right)*K_{{\sigma }_p}}{({.Math.}_{i=1}^2{c}_{i,p}^2{M}_i\left(\varphi \left(y\right)\right)*K_{{\sigma }_p}},$

where b.sub.p is the grayscale offset field calculated in the scale p, and K.sub.σ.sub.p is the Gaussian filter kernel having a different variance.

[0054] Step S6: Repeat the calculation of the optimization equations in step S5 until the energy function takes the minimum value to obtain a final edge.

Embodiment 2

[0055] As shown in FIG. 2, this embodiment provides an image processing apparatus, including a storage part and a processing part. The storage part is configured to store an image to be processed.

[0056] The processing part is configured to obtain edge information in the image in the storage apparatus by using the method in any implementation in Embodiment 1.

Embodiment 3

[0057] As shown in FIG. 3, this embodiment provides an ultrasonic imaging apparatus, including an ultrasonic probe, a generation part, and a processing part.

[0058] The ultrasonic probe is configured to emit an ultrasonic wave to an object under test, receive a reflected ultrasonic wave reflected by the object under test, and generate an echo signal corresponding to the reflected ultrasonic wave.

[0059] The generation part is configured to generate an ultrasonic image related to the object under test according to the echo signal.

[0060] The processing part is configured to obtain edge information in the ultrasonic image by using the method in any implementation in Embodiment 1.

[0061] A person skilled in the art can understand that although the image segmentation method in the above embodiments uses an ultrasonic image as a processing object, the present application is not limited to thereto. That is, in addition to using an ultrasonic image as a processing object, the image segmentation method in the embodiments of the present application can also process various grayscale images suitable for processing by using the method, for example, a CT image generated by an X-ray computed tomography device, an X-ray image generated by an X-ray diagnostic device, and an MR image generated by a magnetic resonance imaging device.

[0062] Several embodiments of the present application are described with respect to the present application. However, these embodiments are shown as examples and are not intended to limit the scope of the present application. These new embodiments may be implemented in various other ways, and various omissions, substitutions, and changes can be made without departing from the scope of the main idea of the present application. These embodiments and variations thereof fall within the scope and the main idea of the present application and fall within the scope of the prevent application and its equivalents as set forth in the claims.