Method and computer program product for generating a high resolution 3-D voxel data record by means of a computer
10319120 · 2019-06-11
Assignee
Inventors
- Sven Simon (Ludwigsburg, DE)
- Steffen Kieβ (Schorndorf, DE)
- Jürgen Hillebrand (Stuttgart-Vahingen, DE)
- Jajnabalkya Guhathakurta (Stuttgart, DE)
Cpc classification
G06T11/008
PHYSICS
G06T11/005
PHYSICS
G06T11/006
PHYSICS
International classification
Abstract
The present invention relates to a method and a computer program product for generating a high-resolution three-dimensional (3D) voxel data set of an object. The high-resolution three-dimensional (3D) voxel data set is generated with the aid of a computed tomography scanner. In some aspects of the present disclosure a 3D image data set is generated by acquiring computed tomography images of the object. In other aspects of the present disclosure the 3D voxel data set of the object is generated with the aid of an image data reconstruction algorithm.
Claims
1. A method for generating a high-resolution three-dimensional (3D) voxel data set of an object, the method comprising: generating, by a computing device, a 3D image data set by arranging the object in a standard position between an X-ray source and a detector of the computing device and measuring a plurality of standard computed tomography images of the object; generating a two-dimensional (2D) image data set by arranging the object in a high-resolution position, whose distance from the X-ray source is smaller in comparison with the standard position, and measuring one or more additional high-resolution images of the object, wherein the one or more additional high-resolution images measured for the 2D image data set have a higher resolution in comparison with the plurality of standard computed tomography images measured for the 3D image data set; and utilizing an image data reconstruction algorithm to generate, based on the generated 3D image data set and the generated 2D image data set, the 3D voxel data set of the object, wherein both the 3D image data set generated from the measured standard images in the standard position and the 2D image data set generated from the measured high-resolution images in the high-resolution position form an input data set for the image data reconstruction algorithm.
2. The method according to claim 1, wherein the generating the 3D image data set further comprises: rotating the object by a predetermined angle.
3. The method according to claim 1, wherein the image data reconstruction algorithm is based on a maximum likelihood expectation maximization algorithm.
4. The method according to claim 1, wherein the image data reconstruction algorithm comprises a calculation of a normalization volume data set as a sum of a normalization volume data set associated with the 3D image data set and a normalization volume data set associated with the 2D image data set, wherein the normalization volume data set associated with the 2D image data set is weighted with a weighting factor.
5. The method according to claim 1, wherein the image data reconstruction algorithm comprises a calculation of a projection associated with the 3D image data set and a projection associated with the 2D image data set.
6. The method according to claim 5, further comprising: dividing each pixel of the generated 3D image data set by a corresponding pixel of the projection associated with the 3D image data set, thereby obtaining a modulated projection associated with the 3D image data set; and dividing each pixel of the generated 2D image data set by the corresponding pixel of the projection associated with the 2D image data set, thereby obtaining a modulated projection associated with the 2D image data set.
7. The method according to claim 6, further comprising: calculating a back projection based on the modulated projection associated with the 3D image data set and the modulated projection associated with the 2D image data set.
8. The method according to claim 7, wherein the back projection is calculated as a sum of a first back projection associated with the 3D image data set and a first back projection associated with the 2D image data set, and wherein the first back projection associated with the 2D image data set is weighted with a weighting factor.
9. A non-transitory computer readable storage medium having a computer program product comprising machine-readable program code stored therewith that, when executed, causes a computer at least to perform: generating a 3D image data set by arranging an object in a standard position between an X-ray source and a detector of a computing device and measuring a plurality of standard computed tomography images of the object; generating a two-dimensional (2D) image data set by arranging the object in a high-resolution position, whose distance from the X-ray source is smaller in comparison with the standard position, and measuring one or more additional high-resolution images of the object, wherein the one or more additional high-resolution images measured for the 2D image data set have a higher resolution in comparison with the plurality of standard computed tomography images measured for the 3D image data set; and utilizing an image data reconstruction algorithm to generate, based on the generated 3D image data set and the generated 2D image data set, a 3D voxel data set of the object, wherein both the 3D image data set generated from the measured standard images in the standard position and the 2D image data set generated from the measured high-resolution images in the high-resolution position form an input data set for the image data reconstruction algorithm.
10. The computer program product recited in claim 9, wherein the machine-readable program code, when executed, further causes the computer to: rotate the object by a predetermined angle.
11. The computer program product recited in claim 9, wherein the image data reconstruction algorithm is based on a maximum likelihood expectation maximization algorithm.
12. The computer program product recited in claim 9, wherein the image data reconstruction algorithm comprises a calculation of a normalization volume data set as a sum of a normalization volume data set associated with the 3D image data set and a normalization volume data set associated with the 2D image data set, wherein the normalization volume data set associated with the 2D image data set is weighted with a weighting factor.
13. The computer program product recited in claim 9, wherein the image data reconstruction algorithm comprises a calculation of a projection associated with the 3D image data set and a projection associated with the 2D image data set.
14. The computer program product recited in claim 13, wherein the machine-readable program code, when executed, further causes the computer to: divide each pixel of the generated 3D image data set by a corresponding pixel of the projection associated with the 3D image data set, thereby obtaining a modulated projection associated with the 3D image data set; and divide each pixel of the generated 2D image data set by the corresponding pixel of the projection associated with the 2D image data set, thereby obtaining a modulated projection associated with the 2D image data set.
15. The computer program product recited in claim 14, wherein the machine-readable program code, when executed, further causes the computer to: calculate a back projection based on the modulated projection associated with the 3D image data set and the modulated projection associated with the 2D image data set.
16. The computer program product recited in claim 15, wherein the back projection is calculated as a sum of a first back projection associated with the 3D image data set and a first back projection associated with the 2D image data set, and wherein the first back projection associated with the 2D image data set is weighted with a weighting factor.
17. The method according to claim 1, wherein the generating the 2D image data set further comprises: displacing the object in a plane arranged perpendicular to a longitudinal axis of the computing device.
18. The computer program product recited in claim 9, wherein the generating the 2D image data set further comprises: displacing the object in a plane arranged perpendicular to a longitudinal axis of the computing device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) These and other objects, features, aspects, and advantage of the present disclosure will become better understood with regard to the following description, claims, and drawings. The present disclosure is illustrated by way of example, and not limited by, the accompanying figures in which like numerals indicate similar elements. Moreover, a list of reference numerals and corresponding explanations are provided in Table I.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
DETAILED DESCRIPTION
(13) The following abbreviations, symbols and signs are used in the present description: u and v denote the position of a pixel in a 2D image; a is an index specifying an image in an image sequence; x, y and z describe the position of a voxel in a volume or voxel data set; n denotes the current iteration step; input denotes an image sequence which is recorded by a computed tomography scanner and which is used as input data set for the MLEM; input(u, v, a) describes an attenuation of X-ray radiation for the pixels (u, v) of the image a; vol.sub.0 denotes the starting or initial result volume; vol.sub.n denotes the result volume after the n-th iteration step; normseq, proj and proj* denote temporary image sequences; backproj and backprojnorm denote temporary volume or voxel data sets; norm is a normalization volume; P(V) denotes an image sequence generated by a forward projection of the volume V; P.sup.T(I) denotes a volume generated by an unfiltered back projection of the image sequence I.
(14)
(15) As illustrated in
(16) Step 6 illustrated in
(17) The input data for the reconstruction process comprise an image sequence acquired by the detector of the computed tomography scanner or a series of images, wherein the series typically comprises approximately 1800 images. In addition, the input data also comprise metadata describing the position and the recording angle of the object for each image of the series. The output or result data of the reconstruction process comprise a voxel or volume data set describing the attenuation of the X-ray radiation for each voxel of the object.
(18) The basic methods of projection, unfiltered back projection, filtered back projection and of the MLEM algorithm are described in greater detail below.
(19) Projection:
(20) Projection is a process in which an image sequence is calculated on the basis of a volume data set. The projection proj=P(vol) is calculated by the following steps i) and ii), wherein the calculation is carried out for all images a of the image sequence and for all pixels (u, v) per image, wherein a{1, . . . , numImages} with the number numImages of images in the series and wherein (u, v){1, . . . , numPixelU}{1, . . . , numPixelV} with the number numPixelu of pixels u and the number numPixelv of pixels v:
(21) i) Calculating the 3D coordinate point (det.sub.x, det.sub.y, det.sub.z) which corresponds to the detector pixel (u, v) using the geometry or the metadata of the image a;
(22) ii) Calculating the line integral from the position of the X-ray source (src.sub.x, src.sub.y, src.sub.z) to the position of the detector (det.sub.x, det.sub.y, det.sub.z) by means of trilinear interpolation and storage of the result for the current pixel:
(23)
Unfiltered Back Projection:
(24) The unfiltered back projection calculates the volume data set on the basis of an image sequence. This operation is thus the transposed operation of projection. The unfiltered back projection is calculated with the aid of the following steps: i) Setting all voxels of the result data set vol to 0:
vol(x,y,z):=0(10); ii) For all images a{1, . . . , numImages} and all voxels (x,y,z){1, . . . , numVoxelX}{1, . . . , numVoxelY}{1, . . . , numVoxelZ} of the result volume: a) Calculating the point (u, v) on the detector on which a line running through the X-ray source src and the point (x, y, z) impinges (i.e. calculating the point of intersection of the line with the detector plane); the geometry or the metadata of the image a are used for the calculation; b) Adding the value at (u, v) to the current value of the output or result voxel using a bilinear interpolation, wherein the value 0 is used provided that (u, v) lines outside the input image:
vol(x,y,z):=vol(x,y,z)+proj(u,v,a)(11).
Filtered Back Projection:
(25) The unfiltered back projection described above has the disadvantage that the resulting image is blurred and/or that fine details are indiscernible. Therefore, in computed tomography a filtered back projection is usually used in which firstly a digital filter, in particular a high-pass filter, is applied to the input data before the unfiltered back projection, as described above, is performed.
(26) Maximum Likelihood Expectation Maximization (MLEM):
(27) An alternative to filtered back projection is iterative methods in which an initial estimation for the volume data set is iteratively improved. Such iterative solutions have the advantage of lower noise and are therefore used primarily in techniques such as positron emission tomography in which the signal-to-noise ratio is very low. One iterative method is MLEM. In MLEM the problem of CT reconstruction is defined and iteratively solved by means of a linear equation system:
A.Math.vol=input(12),
wherein A represents a matrix describing the projection operation, i.e. A.Math.vol=P(vol).
(28) The individual steps during the MLEM reconstruction are as follows: i) Calculating a normalization volume data set norm as unfiltered back projection of an image sequence, wherein all pixels have a value of 1:
normseq(u,v,a):=1(13),
norm:=P.sup.T(normseq)(14); ii) Selecting a starting or initial volume vole, wherein normally all voxels are set to the value 1 and setting the current iteration index to 0:
vol.sub.0(x,y,z):=1(15),
n:=0(16); iii) Calculating a projection of the current volume:
proj:=P(vol.sub.n)(17); The way in which the projection is calculated has already been explained further above in the section Projection. iv) Dividing each pixel in the input image sequence input by the corresponding pixel in the image sequence proj from step iii):
(29)
backproj:=P.sup.T(proj*)(19); The way in which the unfiltered back projection is calculated has already been explained further above in the section Unfiltered Back Projection. vi) Dividing each voxel in backproj by the corresponding voxel in the normalization volume
(30)
vol.sub.n+1(x,y,z)=vol.sub.n(x,y,z).Math.backprojnorm(x,y,z)(21); viii) Increasing the iteration index of the current iteration:
n:=n+1(22); ix) If n is less than the maximum number of iteration steps, go to step iii).
(31) It has been recognized in the context of the present invention that the reconstruction of the CT images can be further improved by additional images also being integrated into the MLEM process besides the standard CT images. In particular, the inventors have recognized that the addition of further images can increase the quality of the solution of the MLEM iteration process by additional equations, which provide additional information about the volume, being added to the MLEM equation system.
(32) Consequently, according to the invention, the computed tomography scanner records not only the standard CT images, i.e. the images conventionally used for generating a 3D voxel data set, but also high-resolution 2D additional images as well. All recorded images, i.e. both the standard CT images and the additional images, can then be used and processed as input data in a correspondingly modified MLEM algorithm. In other words, during the reconstruction the 2D image data set generated by means of the high-resolution additional images can be integrated into the low-resolution 3D image data set generated by means of the standard CT images.
(33)
(34)
(35)
(36) It has been found in the context of the present invention that the MLEM algorithm is suitable for the image data reconstruction algorithm 30, which can process both the standard images and the additional images to form a high- or higher-resolution 3D voxel data set in comparison with conventional methods, in which algorithm, however, the individual steps described above must be at least partly modified or extended on account of the additional images additionally acquired. In particular, the MLEM algorithm must be modified in such a way that both the 3D image data set and the 2D image data set can be used as input data.
(37) The individual steps of a modified MLEM with resolution improvement are as follows: i) Calculating a normalization volume data set norm as unfiltered back projection of an image sequence, wherein all pixels have a value of 1:
normseq.sub.1(u,v,a):=1(23),
normseq2(u,v,a):=1(24),
norm:=P.sub.1.sup.T(normseq.sub.1)+w.Math.P.sub.2.sup.T(normseq.sub.2)(25).
(38) As already mentioned in conjunction with equation (1), the index 1 in equations (23) and (25) relates to the 3D image data set, i.e. the image data set having standard resolution. The index 2 correspondingly relates to the 2D image data set, i.e. the image data set having higher resolution. normseq.sub.1 thus denotes a normalized image sequence of the 3D image data set and normseq.sub.2 denotes a normalized image sequence of the 2D image data set. In equation (25), which is identical to equation (1), w denotes a weighting factor with which the additional images can be weighted in comparison with the standard images, i.e. in terms of their relevance within the algorithm. ii) Selecting a starting or initial volume vol.sub.0, wherein all voxels are normally set to the value 1, and setting the current iteration index to 0:
vol.sub.0(x,y,z):=1(26),
n:=0(27); iii) Calculating projections of the current volume; also see formulae (3) and (4):
proj.sub.1:=P.sub.1(vol.sub.n)(28),
proj.sub.2:=P.sub.2(vol.sub.n)(29); The way in which the projections are calculated has already been explained further above in the section Projection. iv) Dividing each pixel in the input image sequence input by the corresponding pixel in the image sequence proj from step iii):
(39)
backproj:=P.sub.1.sup.T(proj.sub.1*)+P.sub.2.sup.T(proj.sub.2*)(32); The way in which the unfiltered back projection is calculated has already been explained further above in the section Unfiltered Back Projection. vi) Dividing each voxel in backproj by the corresponding voxel in the normalization volume:
(40)
vol.sub.n+1(x,y,z)=vol.sub.n(x,y,z).Math.backprojnorm(x,y,z)(34); viii) Increasing the iteration index of the current iteration:
n:=n+1(35); ix) If n is less than the maximum number of iteration steps, go to step iii).
(41)
(42)
(43)
(44)
(45)
(46) The examinations of the modulation transfer function and of the contrast ratio on the basis of line pairs, as illustrated in
(47)
(48) TABLE-US-00001 TABLE 1 List of Reference Signs with Descriptors Ref- erence Nu- meral Description 1 Acquiring CT images from different perspectives by means of CT 2 Image sequence 3 CT reconstruction/unfiltered or filtered back projection/MLEM 4 Voxel or volume data set 5 Further processing 6 Projection 10 3D image data set 20 2D image data set 30 Image data reconstruction algorithm 40 High-resolution 3D voxel or volume data set 50 X-ray source 60 Object carrier 70 Detector 80 Object (e.g. printed circuit board) 100 Providing the 3D image data set and the 2D image data set 101 Initial value (e.g. 1) 102 Input data set 103 Output or result volume data set 104 Input data set divided by projection/image sequence ratio 105 Projection 106 Transposed projection 107 Transposed projection 108 Back projections 109 Normalization volume 110 Back projection divided by normalization volume/volume ratio 112 Output or result data set of the (n + 1)-th iteration step 200 Simulated modulation transfer function for a conventional CT measurement 205 Simulated line pair contrast for a conventional CT measurement 210 Simulation modulation transfer function for a CT measurement according to the present disclosure 215 Simulated line pair contrast for a CT measurement according to the present disclosure 220 Simulation modulation transfer function for a conventional CT measurement 225 Simulated line pair contrast for a conventional CT measurement 230 Simulated modulation transfer function for a CT measurement according to the present disclosure 235 Simulated line pair contrast for a CT measurement according to the present disclosure