SHARPNESS PRESERVING RESPERATORY MOTION COMPENSATION
20230214974 · 2023-07-06
Inventors
- Sven Kabus (Hamburg, DE)
- Rolf Dieter BIPPUS (HAMBURG, DE)
- Heike CAROLUS (AHRENSBURG, DE)
- Dennis HEIJTEL (BEST, NL)
- Matthijs KRUIS (BEST, NL)
- Amy PERKINS (PHILADELPHIA, PA, US)
- Steffen RENISCH (HAMBURG, DE)
- Andre Frank SALOMON (AACHEN, DE)
Cpc classification
G06T11/005
PHYSICS
G06T7/30
PHYSICS
International classification
Abstract
A method and system are provided for reconstructing a motion-compensated nuclear image of a subject, as well as an arrangement for method. The reconstruction method comprises receiving nuclear image data the acquiring a nuclear image, and a computer program for carrying out the for multiple motion states, reconstructing the data into an image for each motion state, and calculating a deformation vector field for each state for mapping the image onto a reference motion state. Calculating the deformation vector field comprises providing an initial vector field, defining at least one rigid region of the subject, incorporating that rigid region into the initial vector field, and calculating the deformation vector field with the incorporated rigid region. The method further comprises mapping the reconstructed image of each motion state onto the reference state using the deformation vector fields; and combining the mapped images into a motion-compensated nuclear image.
Claims
1. A method for reconstructing a motion-compensated nuclear image of a subject, the method comprising: receiving nuclear image data for multiple motion states of the subject; reconstructing the nuclear image data into a nuclear image for each motion state; calculating a deformation vector field for each motion state for mapping the reconstructed nuclear image of that motion state onto a reference motion state, wherein calculating the deformation vector field comprises the steps of: providing an initial deformation vector field for each motion state, defining at least one rigid region of the subject; incorporating defined rigid region into the initial deformation vector field; and calculating the deformation vector field with the incorporated rigid region; the method further comprising mapping the reconstructed nuclear image of each motion state onto the reference motion state using the deformation vector fields; and combining the mapped nuclear images of the multiple motion states into a motion-compensated nuclear image.
2. The method according to claim 1, wherein the method further comprises receiving structural image data of the subject and the at least rigid region is defined using the structural image data.
3. The method according to claim 2, further comprising segmenting the structural image data to define the rigid region as a region of interest, preferably by segmenting the structural image data into binary mask or a region of interest contour.
4. The method according to claim 1, wherein the defined rigid region is incorporated by inserting it directly into the deformation vector field.
5. The method according to claim 1, wherein the defined rigid region is incorporated into the deformation vector field indirectly by inserting it into the elasticity matrix.
6. The method according to claim 1, further comprising adjusting a transition region between the boundary of the rigid region and an adjacent region.
7. The method according to claim 6, wherein adjusting the boundary region comprises one or more of: applying a smoothing filter to the transition region of the deformation vector field; assigning an elasticity to the transition region of the elasticity matrix that is higher than the elasticity of the adjacent region.
8. The method according to claim 1, wherein the defined rigid region is incorporated by constraining the step of calculating the deformation vector field such that the voxels directly adjacent to the boundary of the rigid region with an adjacent region are only allowed to be displaced parallel to the boundary.
9. The method according to claim 1, wherein defining the at least one rigid region comprises analyzing the deformation vector field and the defined rigid region is incorporated into the analyzed vector field by adjusting the elasticity matrix.
10. The method according to claim 9, wherein the steps of defining the at least one rigid region, incorporating the defined rigid region into the analyzed vector field by adjusting the elasticity matrix and calculating an updated deformation vector field are performed iteratively until a stopping criterion has been met.
11. A system for reconstructing a motion-compensated nuclear image of a subject, wherein the system comprises: a nuclear image reconstruction unit comprising an input for receiving nuclear image data for multiple motion states of the subject, and the reconstruction unit being configured to reconstruct the nuclear image data into a nuclear image for each motion state; a deformation vector field calculator configured to calculate a deformation vector field for each motion state for mapping the reconstructed nuclear image of that motion state onto a reference motion state, the deformation vector field calculator comprising: a rigid region detector, comprising an input for receiving structural image data, the rigid region detector being configured to define one or more rigid regions of the subject using the structural image data; a deformation vector field processor configured to provide an initial deformation vector field for each motion state, to incorporate the defined rigid region into the initial deformation vector fields, and to calculate updated deformation vector fields with the incorporated rigid region; the system further comprising a nuclear image assembly unit configured to map the reconstructed nuclear image of each motion state onto the reference motion state using the updated deformation vector fields, and being further configured to combine the mapped nuclear images of the multiple motion states into a motion-compensated nuclear image.
12. The system according to claim 11, further comprising a display for displaying the motion-compensated nuclear image.
13. Arrangement for acquiring a nuclear image of a subject comprising: a nuclear imaging device for acquiring nuclear image data of the subject the system of claim 11 for reconstructing the nuclear image of the subject.
14. The arrangement of claim 13, further comprising a structural imaging device for acquiring structural image data of the subject.
15. A computer program product comprising instructions for causing a processor to carry out the method according to claim 1, when the computer program is executed.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0023] In the following drawings:
[0024]
[0025]
[0026]
[0027]
[0028]
DETAILED DESCRIPTION OF THE INVENTION
[0029] In the examples below, the nuclear imaging or functional imaging is described with reference to an exemplary application of PET imaging. It is however to be understood that the functional imaging technique is not restricted to this example and alternative emission tomography imaging techniques such as SPECT imaging could also be used.
[0030] Further, in the examples below, the structural imaging that is performed to obtain information on the anatomy of the subject, is described with reference to an exemplary application of CT imaging. It is however also to be understood that the structural imaging technique is not restricted to this example and alternatives such as MR imaging or ultrasound imaging could also be used.
[0031]
[0032] The arrangement 100 has an imaging apparatus 110 that acquires image data of a subject. In
[0033] The system 120 for reconstructing a motion-compensated nuclear image of a subject comprises a nuclear image reconstruction unit 121, a deformation vector field (DVF) calculator 122, and a nuclear image assembly unit 129.
[0034] The nuclear image reconstruction unit 121 in this example is a unit for PET image reconstruction. The unit has an input for receiving nuclear image data 112 in the form of PET data for multiple motion states of the subject. The PET data may be in any for that is suitable for use by the reconstruction unit 121, for example list-mode data or sinogram data. The nuclear image data is sorted, or binned, into multiple motion states of the subject. The states can be defined based on the breathing cycle of the patient. When the heart is an organ of interest, the states can alternatively be fined based on the cardiac motion cycle of the patient. The number of states can be two, for example maximum inhale or exhale by the subject, but is preferably more.
[0035] The reconstruction unit 121 is configured to reconstruct the nuclear image data 112 into a nuclear image for each motion state. For this purpose the unit may comprise a dedicated reconstruction algorithm. Quality of the reconstructed image can be improved by additionally using the structural image data 113 for calculating attenuation and scatter correction as a part of the image reconstruction for each motion state.
[0036] The DVF calculator 122 is configured to calculate a DVF for each motion state for mapping the reconstructed nuclear image of that motion state onto a the reference motion state. One of the motion states in the nuclear image data can be selected as a reference motion state. Alternatively, when structural data 113 is separately acquired, the reference motion state preferably corresponds to the motion state in which the structural image data 113 is acquired. In practical situations, the structural image data can usually be acquired quickly in a single motion state. This applies in particular to CT image acquisition. A further option is to separately define a reference state that does not correspond to the motion states of the image data acquisition. For example, a reference state can be defined such that the images are all deformed towards the center of the motion pattern and can be said to meet each other in the middle.
[0037] For this purpose of calculating each DVF, the DVF calculator 122 comprises a rigid region detector 123 and a DVF processor 124.
[0038] Rigid region detector 123 comprises an input for receiving structural image data and is configured to define one or more rigid regions of the subject using the structural image data. Rigid regions can, for example be detected by using a segmentation device. Such a device can identify the rigid anatomical regions automatically or semi-automatically and/or can have a user-interface to allow an operator to delineate the regions manually. The output of such a segmentation device can be a binary mask of the rigid region or a region of interest contour.
[0039] DVF processor 124 is configured to provide an initial DVF 125 for each motion state, to incorporate the defined rigid region 126 into each of the initial DVFs, and to calculate updated DVFs 127 with the incorporated rigid region. The reconstructed nuclear image of each motion stated and its corresponding DVF to map it to the reference state are the input for the nuclear image assembly unit 129.
[0040] Nuclear image assembly unit 129 is configured to map the reconstructed nuclear image of each motion state onto the reference motion state by using the updated deformation vector fields. The assembly unit 129 is further configured to combine the mapped nuclear images of the multiple motion states into a motion-compensated nuclear image. This combining can, for example, be done by adding the individual mapped images to create a sum image as the motion-compensated nuclear image. Alternatively, the images can be combined by calculating the mean of the mapped images to create an average image as the motion-compensated nuclear image.
[0041]
[0042] The method for reconstructing the image starts with receiving nuclear image data 210 of the subject. The image data is for multiple motion states of the subject, meaning it is grouped into groups, also commonly referred to as “gates” or “bins”. The data of each group was acquired when the subject was in the corresponding motion state. Such data is also referred to as gated nuclear image data. Next, the nuclear image data is reconstructed into a nuclear image for each motion state 220. In the example of
[0043] Next, DVFs are calculated for each motion state 240. The DVFs are used to map the reconstructed nuclear image of the respective motion state onto a reference motion state. As explained above in relation to the system, the reference state can for example be a state selected from the gated nuclear image data, a separately defined state, or the motion state at which the structural image data was acquired.
[0044] Calculating the DVF for each motion state 240 further involves the steps of providing an initial deformation vector field 241 for each motion state and defining at least one rigid region in the subject 242. The defined rigid region is then incorporated into the initial deformation vector field 243 and the deformation vector field is calculated with the incorporated rigid region 244.
[0045] The final reconstructed nuclear image is then assembled 250 by mapping the reconstructed nuclear image of each motion state onto the reference motion state using the deformation vector fields and then combining the mapped nuclear images of the multiple motion states into a motion-compensated nuclear image.
[0046]
[0047] In this example the motion state of the CT image is used as the reference motion state. Rigid regions are detected by segmenting the CT image data 342. The result of the segmentation is a binary mask indicating the location of one or more rigid regions. Such a binary mask can be the direct output of a segmentation algorithm. Alternatively, the output of the segmentation algorithm can be a region-of-interest contour of the one or more rigid regions. In that case, detecting the rigid regions involves an additional step of transforming the contour into a binary mask. The binary mask indicating the location of the rigid region is provided as input to define the rigid region in the DVF.
[0048] In calculating the DVFs for each motion state, an initial DVF is provided. In the approach illustrated here, providing the initial DVF is done by calculating the DVF for each motion state in a known manner 341 where all tissue is considered to be soft tissue having the same elasticity and without taking any rigid regions into account. To define the one or more rigid regions, the binary mask indicating the location of the rigid region is inserted into the initial DVF directly 343 and a region between the boundary of the rigid region and an adjacent region is defined and adjusted to calculate the DVF 344. This will be further explained with reference to
[0049] When the DVF for each motion state has been calculated, the motion-compensated nuclear image is assembled 350. The calculated DVFs are used to map the reconstructed PET image of each motion state 320 onto the motion state of the CT image data 351. The mapped PET images of the multiple motion states are then combined into a motion-compensated PET image by calculating the sum of the mapped images 352. In this example the summed image is then further normalized into clinical standard uptake value units 353 to form the final motion-compensated PET image.
[0050]
[0051]
[0052]
[0053] In the example of
[0054] In a further alternative approach, the defined rigid region can be incorporated into the final DVF by constraining the step of calculating the deformation vector field such that the voxels directly adjacent to the boundary of the rigid region with an adjacent region are only allowed to be displaced parallel to the boundary. This can, for example, be done by only allowing these voxels to be displaced such that the displacement vector component in normal direction to the boundary is continuous across the boundary. In this approach, the rigid region is for example supplied to the DVF calculation algorithm as an additional input in the form of a binary mask. Voxels corresponding to the rigid region are fixed in place.
[0055] Voxels on the boundary between soft tissue and the rigid region are uncoupled from the rigid region and additionally allowed only to move in a direction parallel to the boundary surface. The other voxels corresponding to the further soft tissue are allowed to displace as usual. In this way, the anatomical sliding surface between rigid regions and adjacent soft tissue is modelled more accurately.
[0056]
[0057] In this example, the reference motion state is a separately pre-defined motion state. This has the advantage of allowing for a fully automated reconstruction method with an approach that is consistent and independent of characteristics that are particular to the subject.
[0058] Calculation of the DVF is initiated by providing an initial DVF 541. This can be a zero-field representing no deformation as a starting point, or a reference DVF that is retrieved from a database. Next, the rigid region is detected by analyzing the properties of the DVF 542. This is preferably done by using vector operators. For example, a shear or strain map of the DVF can be generated. A local region of high shear is an indicator for a transition between regions with different types of tissue. The shear values of the DVF thereby provide an estimate of possible locations that corresponds to a rigid region. There may be one rigid region in the nuclear image, such as the spine adjacent to the lungs, but there can also be additional regions that are part of the image, such as part of the ribcage and/or the pelvis.
[0059] This approach further has a checking step for determining if a region is indeed rigid. For example, a standard model of the behavior of the lungs could be used as a reference, or an organ atlas. If earlier structural images are available of the subject these could also be used.
[0060] The detected rigid region is then incorporated into the analyzed DVF by adjusting the elasticity matrix 543. This is done by allowing spatial variation in the elasticity matrix, in particular by increasing the elasticity where high local shear motion is detected. Local increased elasticity in turn allows for the shear component to further increase. This has the advantage that the DVF motion increasingly approximates a sliding surface in accordance with subject anatomy. An updated DVF is then calculated using the adjusted elasticity matrix 544.
[0061] The steps of analyzing the current DVF 542, adjusting the elasticity matrix 543, and calculating an updated DVF 544 are repeated until a stopping criterion has been met 545. Various stopping criteria can be contemplated in this context. For example, iterations can be stopped when the estimated location of the rigid region no longer changes. Or, for example, when the amount of changes in the updated DVF as compared to the previous DVF fall below a pre-determined threshold. As an alternative example, iterations can also be stopped when local high shear values in the DVF reach a predetermined maximum. An additional or alternative option is to pre-define a maximum number of iterations.
[0062] When the DVF for each motion state has been calculated, the motion-compensated image is assembled 550. The calculated DVFs are used to map the reconstructed nuclear image of each motion state onto the pre-defined reference state 551. The mapped nuclear images of the multiple motion states are then combined into the motion-compensated nuclear image by calculating the mean of the mapped images 552.
[0063] Any of the method steps disclosed herein, may be recorded in the form of a computer program comprising instructions which when executed on a processor cause the processor to carry out such method steps. The instructions may be stored on a computer program product. The computer program product may be provided by dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared. Furthermore, embodiments of the present invention can take the form of a computer program product accessible from a computer-usable or computer-readable storage medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer readable storage medium can be any apparatus that may include, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or apparatus or device, or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory “RAM”, a read-only memory “ROM”, a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk-read only memory “CD-ROM”, compact disk-read/write “CD-R/W”, Blu-Ray™ and DVD. Examples of a propagation medium are the Internet or other wired or wireless telecommunication systems.
[0064] Variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. It is noted that the various embodiments may be combined to achieve further advantageous effects.
[0065] In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality.
[0066] A single unit or device may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
[0067] Any reference signs in the claims should not be construed as limiting the scope.