Radiation Image Processing System And Radiation Image Processing Apparatus
20170360392 · 2017-12-21
Assignee
Inventors
Cpc classification
A61B6/5288
HUMAN NECESSITIES
G16H50/20
PHYSICS
A61B6/5211
HUMAN NECESSITIES
A61B6/463
HUMAN NECESSITIES
International classification
Abstract
A radiation image processing system, including: an image analysis section which performs image analysis to a plurality of frame images that is obtained by moving image imaging of a target site having periodicity in a movement or frame images that are obtained after image processing based on the frame images obtained by the moving image imaging and which determines a period of the movement; and a reproduction range setting section which sets a range of frame images to be reproduced and displayed among the frame images based on an analysis result of the period determined by the image analysis section.
Claims
1. A radiation image processing system, comprising: an image analysis section which performs image analysis to a plurality of frame images that is obtained by moving image imaging of a target site having periodicity in a movement or frame images that are obtained after image processing based on the frame images obtained by the moving image imaging and which determines a period of the movement; and a reproduction range setting section which sets a range of frame images to be reproduced and displayed among the frame images based on an analysis result of the period determined by the image analysis section.
2. The radiation image processing system according to claim 1, wherein the reproduction range setting section sets the range so that the range is a range of frame images which are obtained by dynamic imaging of a chest of a subject or frame images which are obtained after image processing based on the frame images obtained by the dynamic imaging, the range includes at least one period of breathing, and a breathing phase of a head frame image in the range nearly matches a breathing phase of an end frame image in the range.
3. The radiation image processing system according to claim 1, wherein the reproduction range setting section sets the range so that the range is a range of frame images which are obtained by dynamic imaging of a chest of a subject or frame images which are obtained after image processing based on the frame images obtained by the dynamic imaging, the range includes at least one period of heartbeat, and a heartbeat phase of a head frame image in the range nearly matches a heartbeat phase of an end frame image in the range.
4. The radiation image processing system according to claim 2, wherein when there is a plurality of candidates for the end frame image in the range, the reproduction range setting section sets a frame image which is captured later to be the end frame image in the range, and when there is a plurality of candidates for the head frame image in the range, the reproduction range setting section sets a frame image which is captured earlier to be the head frame image in the range.
5. The radiation image processing system according to claim 2, wherein the reproduction range setting section sets the head frame image in the range and the end frame image in the range based on a morphology value of a body part captured in each of the frame images, a change speed of the morphology value or both of the morphology value and the change speed of the morphology value.
6. The radiation image processing system according to claim 5, wherein the morphology value is any of positions of a lung apex, a diaphragm, a rib, a clavicle, a thorax, a shoulder, an arm, an abdomen, a heart wall and an aortic arch in each of the frame images, a width, a height and an area of a lung in each of the frame images, and a width, a height and an area of a heart in each of the frame images.
7. The radiation image processing system according to claim 5, wherein the change speed of the morphology value is any of change speeds of positions of a lung apex, a diaphragm, a rib, a clavicle, a thorax, a shoulder, an arm, an abdomen, a heart wall and an aortic arch in each of the frame images, a change speed of a width, a change speed of a height and a change speed of an area of a lung in each of the frame images, and a change speed of a width, a change speed of a height and a change speed of an area of a heart in each of the frame images.
8. The radiation image processing system according to claim 2, wherein the reproduction range setting section sets the head frame image in the range and the end frame image in the range based on a density value of a pixel in each of the frame images, a change speed of the density value or both of the density value and the change speed of the density value.
9. The radiation image processing system according to claim 8, wherein the density value is an analysis value of a density value of each pixel in a target region which includes a part of any of a lung apex, a diaphragm, a rib, a clavicle, a thorax, a shoulder, an arm, an abdomen, a heart, an alveolus, a bronchus, a pulmonary artery and an aortic arch captured in each of the frame images.
10. The radiation image processing system according to claim 8, wherein the change speed of the density value is a change speed of an analysis value of a density value of each pixel in a target region which includes a part of any of a lung apex, a diaphragm, a rib, a clavicle, a thorax, a shoulder, an arm, an abdomen, a heart, an alveolus, a bronchus, a pulmonary artery and an aortic arch captured in each of the frame images.
11. The radiation image processing system according to claim 9, wherein the analysis value is any of an average value, a median value, a mode value, an integration value, a minimum value and a maximum value of the density value of each pixel in the target region.
12. The radiation image processing system according to claim 1, further comprising a display section which displays the frame images in the range set by the reproduction range setting section by reproducing the frame images.
13. The radiation image processing system according to claim 12, wherein the display section displays the frame images in the range by performing loop reproduction of the frame images.
14. The radiation image processing system according to claim 13, wherein the display section displays a number of periods corresponding to the range simultaneously with reproduction of the frame images.
15. A radiation image processing apparatus, comprising: an image analysis section which performs image analysis to a plurality of frame images that is obtained by moving image imaging of a target site having periodicity in a movement or frame images that are obtained after image processing based on the frame images obtained by the moving image imaging and which determines a period of the movement; and a reproduction range setting section which sets a range of frame images to be reproduced and displayed among the frame images based on an analysis result of the period determined by the image analysis section.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0014] The above and other objects, advantages and features of the present invention will become more fully understood from the detailed description given hereinafter and the appended drawings which are given by way of illustration only, and thus are not intended as a definition of the limits of the present invention, and wherein:
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
[0030] Hereinafter, an embodiment of a radiation image processing system and a radiation image processing apparatus according to the present invention will be described with reference to the drawings.
[0031] Hereinafter, description will be made for a case where after-mentioned image analysis section and reproduction range setting section are configured in a single apparatus (that is, a case where the radiation image processing apparatus includes the image analysis section and the reproduction range setting section). However, for example, though not shown in the drawings, it is also possible to configure at least the image analysis section and the reproduction range setting section as separate apparatuses and connect the apparatuses via a network or the like to configure a system (that is, as the radiation image processing system).
[0032] Hereinafter, description will be made for a case where a display section is formed integrally with the image analysis section and the reproduction range setting section. However, though not shown in the drawings, it is also possible to configure the display section separate from the image analysis section and the reproduction range setting section and connect the sections via a network or the like to configure a system (that is, as the radiation image processing system).
[Configuration of Radiation Image Processing Apparatus (Radiation Image Processing System)]
[0033] The configuration of a radiation image processing apparatus 1 (or radiation image processing system 1, hereinafter, the same applies) in the embodiment will be described.
[0034] Furthermore, the CPU 10 is connected to an input section 14 which is configured by including a keyboard, a mouse, a touch panel and such like, a display section 15 which is configured by including a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display) or the like, and such like. The CPU 10 is also connected to a storage section 16 which is configured by including a non-volatile semiconductor memory, an HDD (Hard Disk Drive) or the like.
[0035] The radiation image processing apparatus 1 can also be configured as a dedicated apparatus, not as a general-purpose computer as described above. Though not shown in the drawings, it is also possible to have a configuration including an image capturing apparatus which performs dynamic imaging, a control apparatus such as a console which controls the image capturing, an image storage database for storing a plurality of frame images which were captured and such like via a network N in addition to the radiation image processing apparatus 1.
[0036] In the embodiment, the CPU 10 of the radiation image processing apparatus 1 is configured to function as the image analysis section and the reproduction range setting section according to the present invention, and the display section 15 is configured to function as the display section according to the present invention. Hereinafter, the image analysis section 10, the reproduction range setting section 10 and the display section 15 will be described.
[Configuration of Image Analysis Section]
[0037] Hereinafter, description will be made first for the configuration of the image analysis section 10, that is, processing which is performed in the image analysis section 10. In the embodiment, the image analysis section 10 performs image analysis to each of a plurality of frame images P obtained by moving image imaging of a target site having periodicity in a movement and determines the period τ of the movement. As the method for determining the movement period τ by the image analysis section 10, there can be adopted methods described in International Publication No. 2009/090894, Japanese Patent Application Laid Open Publication No. 2009-273671 and Japanese Patent Application Laid Open Publication No. 2009-153678, for example.
[0038] At that time, a plurality of frame images P which is a target of the image analysis may be obtained by moving image imaging of a target site having periodicity in a movement as described above. That is, for example, the frame images P may be obtained by dynamic imaging of a lung, a heart or the like as shown in
[0039] Furthermore, the plurality of frame images P which is a target of the image analysis may be frame images P obtained after image processing such as frame images P (see
[0040] In the embodiment, the image analysis section 10 calculates a morphology value α of a body part such as a lung, a heart or the like captured in each of the frame images P and a change speed Δα of the morphology value α.
[0041] The image analysis section 10 can be configured to calculate any of positions in each of the frame images P of a lung apex, a diaphragm, a rib, a clavicle, a thorax, a shoulder, an arm, an abdomen, a heart wall and an aortic arch as shown in
[0042] In the embodiment, the image analysis section 10 sets a target region ROI in each of the frame images P as shown in
[0043] As the density value β, the image analysis section 10 can calculate an analysis value (any of average value, median value, mode value, integration value, minimum value and maximum value) of a density value β of each pixel in the target region ROI including a part of any of the lung apex, diaphragm, rib, clavicle, thorax, shoulder, arm, abdomen, heart, alveolus, bronchus, pulmonary artery and aortic arch captured in each of the frame images P.
[0044] As the change speed Δβ of the density value β, the change speed of the analysis value of the above density value β can be calculated. Hereinafter, in the embodiment, the density value β and the change speed Δβ of the density value β respectively represent the analysis value of the above density value β and the change speed of the analysis value of the density value β.
[Configuration of Reproduction Range Setting Section]
[0045] Next, the configuration of the reproduction range setting section 10, that is, processing performed in the reproduction range setting section 10 will be described. Hereinafter, the function of the radiation image processing apparatus 1 or the radiation image processing system 1 in the embodiment will be described together.
[0046] The reproduction range setting section 10 sets the range of frame images P to be reproduced and displayed on the display section 15 among the frame images P on the basis of the analysis result of the period τ determined by the image analysis section 10.
[0047] In the embodiment, the reproduction range setting section 10 sets the range of frame images P to be reproduced and displayed among the plurality of frame images P, which were obtained by moving image imaging, by setting a head frame image Pin in the range (that is, the frame image Pin to be displayed first in the reproduction display, hereinafter, simply referred to as a head frame Pin) and an end frame image Pfi in the range (that is, frame image Pfi to be displayed last in the reproduction display, hereinafter, simply referred to as an end frame Pfi).
[0048] Hereinafter, setting processing of the range of frame images P to be reproduced and displayed by the reproduction range setting section 10 will be specifically described.
[0049] In a case where the target site is a lung L in such a way, since the doctor cannot perform diagnosis and such like by watching the dynamic state of the lung L unless the frame images P are reproduced for the number of frames of one period or more of the breathing. Thus, the reproduction range setting section 10 sets the range of reproduction and display by targeting the frame images P including at least one period of breathing.
[0050] Though not shown in the drawings, in a case where the target site is a heart H (see
[0051] In the embodiment, the reproduction range setting section 10 sets the above range so that the breathing phase (heartbeat phase in a case where the target site is the heart H, the same applies, hereinafter) of the head frame Pin in the range nearly matches the breathing phase of the end frame Pfi in the range in the graph shown in
[Range Setting Method 1]
[0052] At that time, as shown in
[Range Setting Method 2]
[0053] The range can be set by setting the head frame Pin of the reproduction display range and the end frame Pfi in the range also on the basis of the above-mentioned change speed Δα of the morphology value α (that is, change speed Δy of the height y of the lung L which is the morphology value α in the embodiment).
[0054] For example, in a case where the morphology value α changes for each of the frame images P as shown in
[0055] As shown in
[Range Setting Method 3]
[0056] As described above, the range of frame images P to be reproduced and displayed can be set by setting the head frame Pin and the end frame Pfi only on the basis of the morphology value α or only on the basis of the change speed Δα of the morphology value α. However, as shown in
[0057] In this case, as the end frame Pfi, there is set a frame image P having the same or nearly same height y (that is, morphology value α) of the lung L as the height y of lung L in the head frame Pin and having the same or nearly same change speed (that is, change speed of the morphology value α) of the height y of the lung L. That is, as shown in
[0058] Thus, by such a configuration, it is possible to set the end frame Pfi with more accuracy and accurately set, as the end frame Pfi in the range when reproducing and displaying a plurality of frame images P obtained by moving image imaging of a target site having periodicity in a movement, the frame image P in which the target site moves (expansion, deflation or the like) similarly to the head frame Pin (the morphology of target site is changing similarly).
[0059] For example, when loop reproduction is performed for frame images P in the range, the movements of lung L are displayed so as to be naturally connected even if the head frame Pin is reproduced following the end frame Pfi. Thus, it is possible to reproduce (loop reproduction) the frame images P accurately without making the user such as a doctor experience a feeling of strangeness, decreasing the accuracy in diagnosis or generating wrong diagnosis when reproduction or loop reproduction is performed for the frame images P.
[0060] Though the above description is made for a case where the target site is a lung L, the same configuration is also possible for cases where the target site is a heart H, a hand, a leg, a neck and such like. Though the above description is made for a case where the reproduction range setting section 10 sets the range of frame images P to be reproduced and displayed on the basis of the morphology value α and/or the change speed Δα of the morphology value α, the same configuration as the above configuration is also possible for a case where the reproduction range setting section 10 sets the range of frame images P to be reproduced and displayed on the basis of the above-mentioned density value β and/or the change speed of the density value β.
[0061] Furthermore, even when the frame images P are the frame images P obtained after image processing as shown in
[Processing in a Case where there is a Plurality of Candidates for Frame Image P to be Set]
[0062] As described above, in a case where the head frame Pin is selected, the reproduction range setting section 10 automatically sets the end frame Pfi and sets the range of frame images P to be reproduced and displayed. However, though the description is omitted, in a case where the end frame Pfi is selected, the reproduction range setting section 10 similarly automatically sets the head frame Pin and sets the range of frame images P to be reproduced and displayed.
[0063] At that time, as shown in
[0064] In this case, when the end frame Pfi (end frame fi in the right side in
[0065] The reproduction display (loop reproduction) of frame image P is performed for a doctor to see the frame images P and determine whether the patient has abnormality or a disease at the target site as described above, and the abnormality and the disease are possibly captured clearly in a later period. Thus, the range of frame images P to be reproduced and displayed may be a range including as many periods τ as possible.
[0066] Thus, in a case where there is a plurality of candidates for the end frame Pfi in the range of frame images P to be reproduced and displayed, it is preferable that the reproduction range setting section 10 sets the end frame Pfi which was captured later as the end frame Pfi in the range.
[0067] When the end frame Pfi is selected, in a case where there is a plurality of candidates for the head frame Pin in the range of frame images P to be reproduced and displayed, it is preferable that the reproduction range setting section 10 sets the head frame Pin which was captured earlier as the head frame Pin in the range for the same reason as the above case.
[How to Select Head Frame Pin and End Frame Pfi]
[0068] In the embodiment, as described above, when the head frame Pin or the end frame Pfi is selected, the reproduction range setting section 10 sets the end frame Pfi or the head frame Pin as described above and sets the range of frame images P to be reproduced and displayed.
[0069] The head frame Pin and the end frame Pfi may be selected by a doctor, a radiologist or the like who is a user selecting arbitrary one of the plurality of frame images P, and may be selected on a graph such as
[0070] The reproduction range setting section 10 may automatically select a frame image P at the resting inspiratory phase or the resting expiratory phase or an arbitrary frame image P. At that time, for example, the reproduction range setting section 10 may refer to the disease of the patient to automatically select the head frame Pin and the end frame Pfi.
[0071] That is, though the same also applies to a case of selecting by a user, for example, in a case where the disease of patient is a restrictive disease such as pneumonia and pulmonary fibrosis, emphysema, atelectasis or the like, since the ability to take air into lungs is decreased, there may be selected, as the head frame Pin or the end frame Pfi, a frame image P at or near the phase from which air is taken into the lungs such as the resting expiratory phase (for example, see
[0072] By such a configuration, since the frame images P are reproduced (loop reproduction) from a phase from which the air is taken into lungs of the patient, the doctor easily evaluates the ventilation function such as the difficulty in taking air into lungs by watching the reproduced frame images P.
[0073] Also, for example, in a case where the disease of patient is an obstructive disease such as asthma and chronic obstructive pulmonary disease (COPD), since the ability to take air out from lungs is decreased, there may be selected, as the head frame Pin or the end frame Pfi, a frame image P at or near the phase from which air is taken out from the lungs such as the resting inspiratory phase (for example, see
[0074] By such a configuration, since the frame images P are reproduced (loop reproduction) from a phase from which the air is taken out from lungs of the patient, the doctor easily evaluates the ventilation function such as the difficulty in taking air out from lungs by watching the reproduced frame images P.
[Reproduction and Display on Display Section]
[0075] In the embodiment, the frame images P in the range (that is, from the head frame Pin to the end frame Pfi) which was set by the reproduction range setting section 10 as described above are reproduced and displayed on the display section 15 as shown in
[0076] Though each of the frame images P may be displayed once on the display section 15 from the head frame Pin to the end frame Pfi, the frame images P from the head frame Pin to the end frame Pfi may be reproduced by loop reproduction to be displayed.
[0077] By such a configuration, loop reproduction is performed to frame images P in a state in which the end frame Pfi of a loop and the head frame Pin of the next loop are smoothly connected to each other. This avoids the state in which the lung L or the like which is being reproduced and displayed appears to discontinuously move and unnaturally twitch. Thus, loop reproduction can be performed in a state in which the lung L naturally moves.
[0078] In a case where the lung L or the like unnaturally moves due to a disease or the like, the unnatural movement is truly reproduced in the embodiment. That is, the radiation image processing system 1 or the radiation image processing apparatus 1 in the embodiment prevents the target site from moving unnaturally at the connection part of frames when performing loop reproduction by connecting the end frame Pfi of a loop to the head frame Pin of the next loop. In a case where the target site has an unnatural movement due to a disease or the like, the radiation image processing system 1 or the radiation image processing apparatus 1 in the embodiment does not remove the unnatural movement when performing reproduction and display.
[0079] In the embodiment, since the end frame Pfi of a loop is naturally connected to the head frame Pin of the next loop as described above, the doctor or the like watching it possibly loses the number of periods of frame images P under loop reproduction and repeated display.
[0080] Thus, as shown in
[Effect]
[0081] As described above, according to the radiation image processing system 1 and the radiation image processing apparatus 1 in the embodiment, the image analysis section 10 performs image analysis to a plurality of frame images P (or frame images P (see
[0082] When a plurality of frame images P obtained by moving image imaging of a target site (lung L, heart H, hand, leg, neck or the like) having periodicity in a movement is reproduced, the movements of the target site are displayed so as to be connected to each other naturally and smoothly. Thus, when the frame images P are reproduced or loop reproduction is performed for the frame images P, the user such as a doctor does not experience a feeling of strangeness, the accuracy of diagnosis is not decreased and wrong diagnosis is not generated, and thus, the frame images P can be accurately reproduced (loop reproduction can be accurately performed).
Modification Examples
[0083] In the embodiment, as described above, the image analysis section 10 and the reproduction range setting section 10 read out a plurality of frame images P obtained by moving image imaging from an image storage database or the like, once store the frame images P in the storage section 16 (see
[0084] Thus, after the head frame Pin and the end frame Pfi are set as described above, the frame images P before the head frame Pin and frame images P after the end frame Pfi may be deleted from the storage section 16 and removed from the target of processing. By such a configuration, unnecessary frame images P are deleted and the data amount can be reduced.
[0085] In a case where the frame rate of moving image imaging is less than 10 fps (especially less than 5 fps), when the frame images P are reproduced and displayed, the frame images P are reproduced as in frame advance, and the target site does not appear to smoothly move. Thus, when loop reproduction is performed for such frame images P, for example, the target site such as lung L and heart H appears to twitch or discontinuously move each time the frame is switched. Thus, the doctor or the like does not experience a feeling of strangeness since he/she sees the moving image as such.
[0086] Thus, there may be a configuration of not applying the present invention to frame images of such a moving image, that is, a moving image captured at a frame rate of less than 10 fps (or less than 5 fps). There is no sense in applying the present invention to such frame images P since the movements of the target site are not smoothly connected to each other between the end frame Pfi and the head frame Pin of the next loop. By such a configuration, the burden on the reproduction range setting section 10 and such like can be reduced for the amount of reduced wasteful processing.
[0087] Furthermore, the image analysis section 10, the reproduction range setting section 10 and such like may perform the above processing only when instructed by a doctor or the like who is a user. By such a configuration, the burden on the reproduction range setting section 10 and such like can be reduced.
[0088] Along with the above embodiment, or independently from the above embodiment, the following configuration, for example, may be also applied for making the user such as a doctor recognize that that the loop reproduction returned to a first frame image P of the loop when loop reproduction is performed for frame images P. In a case where the following configuration is applied to the embodiment, the “first frame image P of the loop” and the “last frame image P of the loop” in the following description respectively indicate the above “head frame Pin” and “end frame Pfi”. However, in a case where the following configuration is applied independently from the embodiment, the “first frame image P of the loop” and the “last frame image P of the loop” in the following description may not necessarily be the above “head frame Pin” and the “end frame Pfi”.
[0089] For example, when loop reproduction is performed for the frame images P in a range on the display section 15, the portion around the frame image P is displayed so as to be colored, and the color around the frame image P gradually changes as the frame image P to be displayed is switched from the first frame image P of the loop to the last frame image P of the loop. By setting the first frame image P of the loop and the last frame image P of the loop to have entirely different colors (colors not similar to each other), when the loop reproduction is performed, the color around the frame image P changes to an entirely different color at the time when the loop reproduction returns to the first frame image P of the loop. Thus, the user can recognize that the loop reproduction returned to the first frame image P of the loop.
[0090] After the last frame image P of a loop is displayed, sound may be made at the time when the first frame image P of the next loop is displayed. Furthermore, a progress bar may be displayed near the frame image P under loop reproduction or a seek bar B may be displayed as shown in
[0091] Furthermore, after the last frame image P of a loop is displayed, at the time when the first frame image P of the next loop is displayed, an interval (temporary stop, decrease in reproduction speed or the like) may be provided in loop reproduction. By such a configuration, the user can surely recognize that the loop reproduction returned to the first frame image P of the loop.
[0092] The present invention is not limited to the above embodiment, modification examples and such like, and changes can be appropriately made within the scope of the present invention.