Uncertainty maps for segmentation in the presence of metal artifacts
09730663 · 2017-08-15
Assignee
Inventors
Cpc classification
A61B6/5258
HUMAN NECESSITIES
International classification
A61B6/00
HUMAN NECESSITIES
Abstract
When performing model-based segmentation on a 3D patient image (80), metal artifacts in the patient image (80), caused by metal in the patient's body, are detected, and a metal artifact reduction technique is performed to reduce the artifact(s) by interpolation projection data in the region of the artifact(s). The interpolated data is used to generate an uncertainty map for artifact-affected voxels in the image, and a mesh model (78) is conformed to the image to facilitate segmentation thereof. Internal and external energies applied to push and pull the model (78) are weighted as a function of the uncertainty associated with one or more voxels in the image (80). Iteratively, mathematical representations of the energies and respective weights are solved to describe an updated model shape that more closely aligns to the image (80).
Claims
1. A system for image segmentation in the presence of metal artifacts, including: a model generator that receives patient image data and stores trained models of anatomical structures; a voxel analyzer that determines whether metal artifacts are present in one or more voxels in the patient image data; a processor that executes a metal artifact reduction algorithm and generates an uncertainty map with corrected voxel data incorporated therein for a patient image generated from the patient image data, wherein the uncertainty map indicates a likelihood of metal contamination for corrected voxels representing boundary surfaces of one or more remote organs in other parts of the patient image; and a segmentation tool that: conforms a trained model of an anatomical structure corresponding to the patient image; segments the patient image using a model-based segmentation technique; and evaluates the uncertainty map derived by the processor; wherein the segmentation tool applies an internal force along a surface normal vector in a surface region in which the feature is located; and wherein the segmentation tool applies an external force along the vector; and wherein the internal force increases and the external force decreases as a function of an increase in the likelihood of metal contamination associated with each corrected voxel.
2. The system according to claim 1, wherein the model has a triangulated mesh surface.
3. The system of claim 1, wherein a feature on the surface of the model is selected at least one of automatically or in response to user input.
4. The system according to claim 1, wherein the segmentation tool balances the internal force and the external force to align the surface region to a surface of the patient image.
5. The system according to claim 1, wherein the total energy applied to the feature through the internal and external forces is expressed as E.sub.total=w.sub.int×E.sub.int+w.sub.ext×E.sub.ext, wherein E.sub.total is total energy, E.sub.int is internal energy, E.sub.ext is external energy, w.sub.int is an internal energy weight, and w.sub.ext is an external energy weight, and wherein
6. The system according to claim 5, wherein w.sub.ext is 1, and wherein the segmentation tool applies increased internal force to compensate for a detected metal artifact.
7. The system according to claim 1, wherein the model generator includes: a routine for determining whether a voxel is affected by a metal artifact; a routine for quantitatively predicting a level to which the voxel is affected by the metal artifact; a routine for interpolating projection data and updating the voxel with the interpolated projection data; and a routine for deforming the model to the patient image.
8. A method of performing model-based segmentation in the system of claim 1, including: determining whether a voxel is affected by a metal artifact; quantitatively predicting a level to which the voxel is affected by the metal artifact; interpolating projection data and updating the voxel with the interpolated projection data; and deforming the model to the patient image.
9. A processor for performing model-based segmentation, the processor being configured to: receive a patient image of a region of a patient that includes a metal object; generate an uncertainty map for the patient image indicative of a likelihood of metal contamination of corrected voxels in the patient image due to metal object reconstruction artifacts; segment the patient image; employ the uncertainty map when segmenting a portion of the patient image displaced from the metal object using model-based segmenting; compute external and internal energies to be applied to each triangle of a model surface using respective best features and weights, wherein the internal energy increases and the external energy decreases as a function of an increase in the likelihood of metal contamination associated with each corrected voxel; and model the internal energy as:
10. The processor according to claim 9, further configured to overlay a mesh model on the patient image and align corresponding features in the model and the patient image.
11. The processor according to claim 10, further configured to apply external forces to the mesh model to pull one or more features on the surface of the mesh model inward toward corresponding image features.
12. The processor according to claim 11, further configured to apply internal forces to the mesh model surface to pull one or more features outward toward corresponding image features.
13. The processor according to claim 12, further configured to weight the internal forces as a function of a degree to which voxels in the one or more features are affected by the metal.
14. The processor according to claim 9, wherein the model-based segmenting includes: assigning a best feature and a feature weight to each triangle of a plurality of triangles that comprise the surface of the mesh model; modeling the external an internal energies as mathematical equations; solving the mathematical equations; and updating the shape of the mesh model as a function of the equation solutions.
15. The processor according to claim 14, further configured to model the external energy as:
16. The processor according to claim 14, further configured to iteratively perform the acts of claim 14, until the mesh model conforms to the patient image.
17. The method of claim 9, further including reducing metal artifacts in the patient image.
18. A system that facilitates model-based segmentation using uncertainty maps, including: a processor configured to: generate patient image data; reconstruct the patient image data into a 3D patient image; detect metal artifacts in one or more voxels in the 3D patient image; generate an uncertainty map with interpolated data that reduces the metal artifacts, wherein the uncertainty map indicates a likelihood of metal contamination of corrected voxels representing boundary surfaces of one or more remote organs in other parts of the 3D patient image; weight features associated with regions of a surface of a mesh model; and segment the 3D patient image using model-base segmentation to conform the mesh model to the 3D patient image.
19. A method of performing model-based segmentation, comprising: generating, via a diagnostic imaging device, a diagnostic image of an organ or region of a subject, which image has metal artifacts; selecting a model of the imaged organ or region; applying, via a processor, a first energy on the model, which urges the model to hold its initial shape; applying, via a processor, a second energy on the model, which urges the model to deform into alignment with corresponding interfaces in the diagnostic image; on an image voxel by image voxel basis, adjusting the first and second energies in accordance with the degree of metal artifacting, such that the magnitude of the first energy relative to the second energy increases for voxels with a higher degree of metal artifacting, and the magnitude of the second energy relative to the first force increases for voxels with a lower degree of metal artifacting; and computing the external and internal energies to be applied to a model surface using respective best features and weights; and model the internal energy as:
20. A system for image segmentation in the presence of metal artifacts, including: a model generator that receives patient image data and stores trained models of anatomical structures; a voxel analyzer that determines whether metal artifacts are present in one or more voxels in the patient image data; a processor that generates an uncertainty map, which indicates a likelihood of metal contamination for corrected voxels representing surface boundaries in the patient image, without changing the patient image data; and a segmentation tool that: conforms a trained model of an anatomical structure corresponding to the patient image by applying external and internal energies to each triangle of the model surface; segments the patient image using a model-based segmentation technique; and evaluates the uncertainty map derived by the processor; wherein the internal energy is modeled as:
Description
(1) The innovation may take form in various components and arrangements of components, and in various steps and arrangements of steps. The drawings are only for purposes of illustrating various aspects and are not to be construed as limiting the invention.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13) The systems and methods described herein facilitate segmenting an image of soft tissue whose surface boundaries are artifacted and rendered uncertain by artifacts from a metal object in other regions of an imaged subject. For example, a metal ball in a hip replacement can cause a starburst-like artifact across an image of a patient's pelvic region, partially obscuring organs of interest (e.g., bladder, prostate, etc.). Not only does the metal project artifacts into remote areas of the image, the artifact obscures the precise position of the metal itself. To improve image appearance, others have proposed trying to identify the exact location of the metal object, using this information to estimate a correction to the unreconstructed data, and reconstructing the corrected data. This and other techniques remove all or most of the starburst-like artifacts and display a reduced or substantially unartifacted image. However, due to the uncertainty associated with the identification of the true size and location of the metal object, and uncertainties in other parts of the correction process, there remains uncertainty regarding the accuracy of the boundary surfaces of the remote organs in other parts of the image. The technique(s) described herein control or adjust for the uncertainty regarding the true location of the boundary surfaces of the remote organs during segmentation of these remote organs. In a first described embodiment, the remote organs are segmented by overlaying a mesh model having the shape of a normal organ. Opposing forces are applied to the mesh model. One force is applied to move the surface of the mesh model into alignment with surface boundaries in the image. The other force is applied to hold the mesh in the nominal organ shape. The relative magnitudes of these forces are adjusted in accordance with the uncertainty. It will be appreciated that this embodiment is applicable to uncertainties due to other factors, and does not require performing a metal artifact correction technique as a preliminary step.
(14) Now turning to
(15) A metal identification protocol is applied by the processor 18, in conjunction with the SID 12, to identify the location of the metal. Once the metal is identified, the voxel analyzer 22 qualitatively predicts whether each voxel is contaminated by the metal artifacts. The greater the likelihood that a voxel is contaminated by metal artifacts, the more the external energy is reduced by the weighting module 24. In this manner, the shape of the model becomes the predominant force where there is increased uncertainty regarding voxels of the diagnostic image.
(16) In another embodiment, the techniques for locating the metal objects in the image also provide for removing the metal image and removing the artifacts from the image. In this scenario, the artifacts are removed by estimating or guessing which structure should replace the artifact. For example, metal artifacts can be removed by deconstructing the image into sinograms, replacing data in the sinograms in the metal shadow by interpolated data, and reconstructing the image. Thus, the artifact-corrected images can contain uncertainties, although the uncertainties are distributed differently than in the artifact contaminated image.
(17) According to an example, a selected organ model with a triangulated mesh surface, and a set of adaptation parameters is selected from the memory 20. When the model generator receives a data set from the SID and/or the reconstruction processor, (e.g., a CT image, MR image, 3D anatomical image, etc.), the processor executes an objective function E.sub.total=w.sub.int×E.sub.int+w×.sub.ext×E.sub.ext, wherein E.sub.total is total energy, E.sub.int is internal energy, E.sub.ext is external energy, w.sub.int is an internal energy weight, w.sub.ext is an external energy weight. The external energy is
(18)
where r({circumflex over (x)}.sub.t) represents the reliability of the external energy or force (e.g., a fraction of original data contributing locally to the image) and is spatially variant, N.sub.Δ is the number of triangles in the mesh surface, w.sub.t is the feature strength of a triangle t, {tilde over (x)}.sub.t is the coordinates of the best feature for triangle t, and {circumflex over (x)}.sub.t is the coordinates of the center of triangle t.
(19) In one embodiment, scaling the objective function (E.sub.total) does not change the location of the minimum (1/w.sub.ext)×E.sub.total=(w.sub.int/w.sub.ext)×E.sub.int+E.sub.ext. Therefore, w.sub.ext can be set to 1 without constraining the problem, and the objective function becomes: E.sub.totalw.sub.int×E.sub.int+E.sub.ext.
(20)
(21)
(22)
(23)
(24) As illustrated, a feature 102 is weak (e.g., in terms of external energy) since the features of the model and image are substantially parallel and aligned, and a reconfigured mesh does not intersect a best feature, thus the external energy applied to the feature 102 is small. Feature 104 has a large external energy contribution since the reconfigured mesh intersects the best feature of the image. Feature 106 has a moderate external energy contribution because the reconfigured mesh is near the best feature in this region.
(25) External energy is determined by the equation:
(26)
where E.sub.ext is external energy, N.sub.Δ is the number of triangles in the mesh surface, w.sub.t is the feature strength of a triangle t, {tilde over (x)}.sub.t is the coordinates of the best feature for triangle t, and {circumflex over (x)}.sub.t is the coordinates of the center of triangle t.
(27)
(28) Internal energy is mathematically described as:
(29)
wherein E.sub.int is internal energy, N.sub.edges is the number of edges in the mesh, {right arrow over (x)}.sub.e is a vector representing edge e, s is a mean mesh scaling factor, R is the mean mesh rotation vector, and {right arrow over (x)}.sub.e.sup.0 is a mean mesh vector representing edge e.
(30)
(31)
(32)
(33)
(34)
(35) At 166, contaminated voxel data is replaced with interpolated data in an uncertainty map of the patient image. The updated model is then deformed to the image using model-based segmentation to segment the image, at 168.
(36)