IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD
20220114772 · 2022-04-14
Assignee
Inventors
Cpc classification
G06T2211/441
PHYSICS
G01T1/2985
PHYSICS
G06T11/006
PHYSICS
International classification
Abstract
An image processing apparatus includes a first image creation unit, a second image creation unit, and a CNN processing unit. The first image creation unit creates a first tomographic image of an m-th frame using a data group in list data included in the m-th frame. The second image creation unit creates a second tomographic image using a data group in the list data having a data amount larger than that of the data group used in creating the first tomographic image. The CNN processing unit inputs the second tomographic image to a CNN, outputs an output tomographic image from the CNN, trains the CNN based on a comparison between the output tomographic image and the first tomographic image, and repeats the training operation to generate the output tomographic image in each training.
Claims
1: An image processing apparatus for creating a tomographic image after noise removal processing based on list data collected by a radiation tomography apparatus, the apparatus comprising: a first image creation unit configured to divide the list data into a plurality of frames in a collection order, and perform reconstruction processing for each of the plurality of frames using a data group in the list data included in the frame to create a first tomographic image of the frame; a second image creation unit configured to perform reconstruction processing using a data group in the list data having a data amount larger than that of the data group used in creating the first tomographic image of each frame in the first image creation unit to create a second tomographic image; and a CNN processing unit configured to generate a plurality of output tomographic images by, for each of the plurality of frames, repeatedly inputting the second tomographic image to a convolutional neural network, outputting an output tomographic image from the convolutional neural network, and training the convolutional neural network based on a comparison between the output tomographic image and the first tomographic image.
2: The image processing apparatus according to claim 1, further comprising an image selection unit configured to select, for each of the plurality of frames, one output tomographic image from the plurality of output tomographic images as the tomographic image after the noise removal processing.
3: The image processing apparatus according to claim 2, wherein the image selection unit is configured to select, for each of the plurality of frames, the one output tomographic image from the plurality of output tomographic images based on a comparison between the output tomographic image and the second tomographic image.
4: The image processing apparatus according to claim 1, wherein the second image creation unit is configured to use, in creating the second tomographic image corresponding to the first tomographic image of each frame, a data group including the data group used in creating the first tomographic image of the frame in the first image creation unit.
5: The image processing apparatus according to claim 1, wherein the second image creation unit is configured to use, in creating the second tomographic image corresponding to the first tomographic image of each frame, a data group before and after the data group used in creating the first tomographic image of the frame in the first image creation unit.
6: A radiation tomography system comprising: a radiation tomography apparatus configured to collect list data for reconstructing a tomographic image of an object; and the image processing apparatus according to claim 1 configured to create the tomographic image after the noise removal processing based on the list data collected by the radiation tomography apparatus.
7: An image processing method for creating a tomographic image after noise removal processing based on list data collected by a radiation tomography apparatus, the method comprising: performing a first image creation of dividing the list data into a plurality of frames in a collection order, and performing reconstruction processing for each of the plurality of frames using a data group in the list data included in the frame to create a first tomographic image of the frame; performing a second image creation of performing reconstruction processing using a data group in the list data having a data amount larger than that of the data group used in creating the first tomographic image of each frame in the first image creation to create a second tomographic image; and performing CNN processing of generating a plurality of output tomographic images by, for each of the plurality of frames, repeatedly inputting the second tomographic image to a convolutional neural network, outputting an output tomographic image from the convolutional neural network, and training the convolutional neural network based on a comparison between the output tomographic image and the first tomographic image.
8: The image processing method according to claim 7, further comprising performing an image selection of selecting, for each of the plurality of frames, one output tomographic image from the plurality of output tomographic images as the tomographic image after the noise removal processing.
9: The image processing method according to claim 8, wherein in the image selection, for each of the plurality of frames, the one output tomographic image is selected from the plurality of output tomographic images based on a comparison between the output tomographic image and the second tomographic image.
10: The image processing method according to claim 7, wherein in the second image creation, in creating the second tomographic image corresponding to the first tomographic image of each frame, a data group including the data group used in creating the first tomographic image of the frame in the first image creation is used.
11: The image processing method according to claim 7, wherein in the second image creation, in creating the second tomographic image corresponding to the first tomographic image of each frame, a data group before and after the data group used in creating the first tomographic image of the frame in the first image creation is used.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
DESCRIPTION OF EMBODIMENTS
[0044] Hereinafter, embodiments of an image processing apparatus and an image processing method will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same elements will be denoted by the same reference signs, without redundant description. The present invention is not limited to these examples.
[0045]
[0046] The radiation tomography apparatus 2 is an apparatus for collecting list data for reconstructing a tomographic image of an object. Examples of the radiation tomography apparatus 2 include a PET apparatus and a SPECT apparatus. Hereinafter, the radiation tomography apparatus 2 will be described as a PET apparatus.
[0047] The radiation tomography apparatus 2 includes a detection unit having a plurality of small radiation detectors arranged around a measurement space in which the object is placed. The radiation tomography apparatus 2 detects a photon pair having an energy of 511 keV, which is generated by electron-positron annihilation in the object into which a positron-emitting isotope (RI source) is introduced, by a coincidence method using the detection unit, and accumulates coincidence information. Further, the radiation tomography apparatus 2 outputs, as the list data, data in which accumulated many pieces of coincidence information are arranged in time series to the image processing apparatus 10.
[0048] The list data includes identification information and detection time information of a pair of radiation detectors used in coincidence detection of the photon pair. The list data may further include energy information of photons detected by each radiation detector and detection time difference information of a pair of radiation detectors.
[0049] The image processing apparatus 10 reconstructs a tomographic image based on the list data. As techniques for reconstructing a tomographic image based on list data, a maximum likelihood expectation maximization (ML-EM) method, and a successive approximation type image reconstruction technique based on a block iterative method obtained by improving the above method are known. Further, as the successive approximation type image reconstruction technique by the block iterative method, an ordered subset ML-EM (OSEM) method, a row-action maximum likelihood algorithm (RAMLA) method, a dynamic RAMLA (DRAMA) method, and the like are known. Further, the image processing apparatus 10 creates a tomographic image after noise removal processing using a convolutional neural network (CNN).
[0050] The first image creation unit 11 divides the list data into a plurality of frames (first to M-th frames) in a collection order, performs reconstruction processing for each of the plurality of frames using a data group included in the m-th frame in the list data, and creates a first tomographic image D.sub.m of the m-th frame. The first tomographic images D.sub.1 to D.sub.M are dynamic PET images.
[0051] The second image creation unit 12 creates a second tomographic image S.sub.m by performing reconstruction processing using a data group having a data amount larger than that of the data group used in creating the first tomographic image D.sub.m of the m-th frame in the list data in the first image creation unit 11. The second tomographic image S.sub.m may be a static PET image. The second tomographic image may be created for each frame, may be created in common for all frames, or may be created in common for some frames.
[0052] The first image creation unit 11 and the second image creation unit 12 may be provided in common or may be provided separately.
[0053] As illustrated in
[0054] The output tomographic image O.sub.m,n is an output tomographic image output from the CNN after (n−1) times of training of the CNN using the first tomographic image D.sub.m and the second tomographic image S.sub.m for the m-th frame. The output tomographic image O.sub.m,1 is an output tomographic image output from the CNN in a state where no training has been performed.
[0055] The image selection unit 14 selects, for each of the first to M-th frames, any one output tomographic image from the plurality of output tomographic images O.sub.m,1 to O.sub.m,N as the tomographic image after the noise removal processing. Preferably, the image selection unit 14 selects one output tomographic image from the plurality of output tomographic images O.sub.m,1 to O.sub.m,N based on a comparison between the output tomographic image O.sub.m,n and the second tomographic image S.sub.m.
[0056] For example, an output tomographic image that minimizes the error between the output tomographic image O.sub.m,n and the second tomographic image S.sub.m may be selected, or any one output tomographic image in one or two or more output tomographic images with which the error between the output tomographic image O.sub.m,n and the second tomographic image S.sub.m becomes a threshold value or less may be selected. Further, a doctor, an operator, or the like may select one output tomographic image from the plurality of output tomographic images O.sub.m,1 to O.sub.m,N.
[0057] The storage unit 15 stores the list data, and stores the first tomographic image D.sub.m and the second tomographic image S.sub.m of each frame. Further, the storage unit 15 stores the plurality of output tomographic images O.sub.m,1 to O.sub.m,N of each frame, and stores the output tomographic image selected from them.
[0058]
[0059] In the list data acquisition step S10, the list data collected by the radiation tomography apparatus 2 is acquired. In the first image creation step S11, the list data is divided into the plurality of frames (first to M-th frames) in the collection order, and for each of the plurality of frames, reconstruction processing is performed using a data group included in the m-th frame in the list data to create the first tomographic image D.sub.m of the m-th frame. In the second image creation step S12, reconstruction processing is performed using a data group in the list data having a data amount larger than that of the data group used in creating the first tomographic image D.sub.m of the m-th frame in the first image creation unit 11 to create the second tomographic image S.sub.m. The first image creation step S11 and the second image creation step S12 may be performed in an arbitrary order or may be performed in parallel.
[0060] In the CNN processing step S13, for each of the first to M-th frames, the second tomographic image S.sub.m is input to the CNN, and the output tomographic image O.sub.m is output from the CNN. The CNN is trained based on a comparison between the output tomographic image O.sub.m and the first tomographic image D.sub.m. The above training operation is repeated to generate the output tomographic image O.sub.m,n in each training operation. In the image selection step S14, for each of the first to M-th frames, one output tomographic image is selected from the plurality of output tomographic images O.sub.m,1 to O.sub.m,N as the tomographic image after the noise removal processing.
[0061]
[0062]
[0063] It is preferable that the second tomographic image S.sub.m corresponding to the first tomographic image D.sub.m of the m-th frame is created using a data group with a data amount that is twice or more the data group of the m-th frame. The second tomographic image S.sub.m corresponding to the first tomographic image D.sub.m of the m-th frame may be created using a data group including the data group of the m-th frame, or may be created using a data group before and after the data group of the m-th frame.
[0064]
[0065] Therefore, in a period from the time immediately after the input of the RI source and in which the acquisition frequency of the coincidence information is high, the period of each frame is set to be relatively short, and in a subsequent period in which the acquisition frequency of the coincidence information gradually decreases, the period of each frame is set to be relatively long. Further, it is known that the tomographic image is significantly different between the period from the time immediately after the input of the RI source until the acquisition frequency of the coincidence information reaches the peak (before the time Tp) and the period after the peak (after the time Tp).
[0066] Accordingly, when the m-th frame is before the time Tp (blood flow dependent region) in
[0067] When the m-th frame is after the time Tp (PET ligand dynamic dependent region) in
[0068] In the second image creation unit 12 (second image creation step S12), the second tomographic image S.sub.m corresponding to the first tomographic image D.sub.m of the m-th frame is preferably created by performing normalization such that the maximum pixel value of the second tomographic image S.sub.m is equal to the maximum pixel value of the first tomographic image D.sub.m. That is, it is preferable to use a normalized second tomographic image S.sub.m expressed by the following Formula (1). MaxD.sub.m is the maximum pixel value in the first tomographic image D.sub.m of the m-th frame. MaxS.sub.m is the maximum pixel value in the second tomographic image S.sub.m corresponding to the first tomographic image D.sub.m of the m-th frame.
[0069] Next, simulation results will be described.
[0070]
[0071] Based on the above numerical phantom, a sinogram ((b) in
[0072] A noise-added sinogram ((c) in
[0073]
[0074]
[0075]
[0076]
[0077] Both indexes of PSNR and SSIM show better performance for the noise removal processing of the present embodiment compared with the noise removal processing of the first and second comparative examples. For other frames also, the noise removal processing of the present embodiment has better performance.
[0078] Next, an example will be described. In this example, a rhesus monkey brain with .sup.18F-FDG was used as the object. As the PET apparatus, an animal PET apparatus (SHR-38000) manufactured by Hamamatsu Photonics K.K. was used. The transmission measurement was performed for 30 minutes, the emission measurement was performed for 90 minutes, and absorption correction was performed on the emission measurement result based on the transmission measurement result. The list data was divided into first to thirtieth frames. The reconstructed image of each frame was created by the DRAMA method.
[0079]
[0080]
[0081] The above example also shows better performance for the noise removal processing of the present example compared with the noise removal processing of the first and second comparative examples. Further, in
[0082]
[0083] The present invention is not limited to the above embodiments and configuration examples, and various modifications are possible. For example, the radiation tomography apparatus 2 is a PET apparatus in the above embodiment, but may be a SPECT apparatus.
[0084] The image processing apparatus of the above embodiment is an apparatus for creating a tomographic image after noise removal processing based on list data collected by a radiation tomography apparatus, and includes (1) a first image creation unit for dividing the list data into a plurality of frames in a collection order, and performing reconstruction processing for each of the plurality of frames using a data group in the list data included in the frame to create a first tomographic image of the frame; (2) a second image creation unit for performing reconstruction processing using a data group in the list data having a data amount larger than that of the data group used in creating the first tomographic image of each frame in the first image creation unit to create a second tomographic image; and (3) a CNN processing unit for generating a plurality of output tomographic images by, for each of the plurality of frames, repeatedly inputting the second tomographic image to a convolutional neural network, outputting an output tomographic image from the convolutional neural network, and training the convolutional neural network based on a comparison between the output tomographic image and the first tomographic image.
[0085] The above image processing apparatus may further include an image selection unit for selecting, for each of the plurality of frames, one output tomographic image from the plurality of output tomographic images as the tomographic image after the noise removal processing. In this case, the image selection unit may select, for each of the plurality of frames, the one output tomographic image from the plurality of output tomographic images based on a comparison between the output tomographic image and the second tomographic image.
[0086] In the above image processing apparatus, the second image creation unit may use, in creating the second tomographic image corresponding to the first tomographic image of each frame, a data group including the data group used in creating the first tomographic image of the frame in the first image creation unit. Further, the second image creation unit may use, in creating the second tomographic image corresponding to the first tomographic image of each frame, a data group before and after the data group used in creating the first tomographic image of the frame in the first image creation unit.
[0087] The radiation tomography system of the above embodiment includes a radiation tomography apparatus for collecting list data for reconstructing a tomographic image of an object; and the image processing apparatus of the above configuration for creating the tomographic image after the noise removal processing based on the list data collected by the radiation tomography apparatus.
[0088] The image processing method of the above embodiment is a method for creating a tomographic image after noise removal processing based on list data collected by a radiation tomography apparatus, and includes (1) a first image creation step of dividing the list data into a plurality of frames in a collection order, and performing reconstruction processing for each of the plurality of frames using a data group in the list data included in the frame to create a first tomographic image of the frame; (2) a second image creation step of performing reconstruction processing using a data group in the list data having a data amount larger than that of the data group used in creating the first tomographic image of each frame in the first image creation step to create a second tomographic image; and (3) a CNN processing step of generating a plurality of output tomographic images by, for each of the plurality of frames, repeatedly inputting the second tomographic image to a convolutional neural network, outputting an output tomographic image from the convolutional neural network, and training the convolutional neural network based on a comparison between the output tomographic image and the first tomographic image.
[0089] The above image processing method may further include an image selection step of selecting, for each of the plurality of frames, one output tomographic image from the plurality of output tomographic images as the tomographic image after the noise removal processing. In this case, in the image selection step, for each of the plurality of frames, the one output tomographic image may be selected from the plurality of output tomographic images based on a comparison between the output tomographic image and the second tomographic image.
[0090] In the above image processing method, in the second image creation step, in creating the second tomographic image corresponding to the first tomographic image of each frame, a data group including the data group used in creating the first tomographic image of the frame in the first image creation step may be used. Further, in the second image creation step, in creating the second tomographic image corresponding to the first tomographic image of each frame, a data group before and after the data group used in creating the first tomographic image of the frame in the first image creation step may be used.
INDUSTRIAL APPLICABILITY
[0091] The present invention can be used as an apparatus and a method capable of creating a noise-removed tomographic image with high performance based on list data collected by a radiation tomography apparatus.
REFERENCE SIGNS LIST
[0092] 1—radiation tomography system, 2—radiation tomography apparatus, 10—image processing apparatus, 11—first image creation unit, 12—second image creation unit, 13—CNN processing unit, 14—image selection unit, 15—storage unit.