Apparatus for the detection of opacities in X-ray images
11058383 ยท 2021-07-13
Assignee
Inventors
- JENS VON BERG (HAMBURG, DE)
- STEWART YOUNG (HAMBURG, DE)
- DANIEL BYSTROV (HAMBURG, DE)
- Nataly Wieberneit (Hamburg, DE)
Cpc classification
A61B6/5205
HUMAN NECESSITIES
International classification
A61B6/00
HUMAN NECESSITIES
Abstract
The present invention relates to an apparatus for the detection of opacities in X-ray images. It is described to provide (210) an analysis X-ray image of a region of interest of an analyzed body part. A model of a normal region of interest is provided (220), wherein the model is based on a plurality of X-ray images of the region of interest. At least one abnormality is detected (230) in the region of interest of the analyzed body part, the detection comprising comparing the analysis X-ray image of the region of interest and the model of the normal region of interest. Information is output (240) on the at least one abnormality.
Claims
1. A system for detecting opacities in two-dimensional (2D) radiograph X-ray images, the system comprising: first processor circuitry configured to provide an analysis 2D radiograph X-ray image; an apparatus comprising: second processor circuitry configured to: receive the analysis 2D radiograph X-ray image of a region of interest of an analyzed body part; receive a model of a normal region of interest, wherein the model is based on a plurality of 2D radiograph X-ray images of the region of interest that is normal and does not suffer from abnormalities, wherein the model contains statistical information on a normal healthy population, and wherein the plurality of 2D radiograph X-ray images of the region of interest, on which the model of the normal region is based, have been intensity normalized; detect at least one abnormality in the region of interest of the analyzed body part, wherein the detection comprises: intensity normalizing the analysis 2D radiograph X-ray image, suppressing at least some bone related imagery in the analysis 2D radiograph X-ray image, and comparing the analysis 2D radiograph X-ray image and the model; and output information on the at least one abnormality; and a display configured to output the analysis 2D radiograph X-ray image comprising the information on the at least one abnormality.
2. A method for detecting opacities in clinical two-dimensional (2D) radiograph X-ray images, comprising: providing an analysis 2D radiograph X-ray image of a region of interest of an analyzed body part; providing a model of a normal region of interest, wherein the model is based on a plurality of 2D radiograph X-ray images of the region of interest that is normal and does not suffer from abnormalities, wherein the model contains statistical information on a normal healthy population, and wherein the plurality of 2D radiograph X-ray images of the region of interest, on which the model of the normal region is based, have been intensity normalized; detecting at least one abnormality in the region of interest of the analyzed body part, wherein the detecting comprises: intensity normalizing the analysis 2D radiograph X-ray image, comparing the analysis 2D radiograph X-ray image and the model, and suppressing at least some bone related imagery in the analysis 2D radiograph X-ray image; and outputting information on the at least one abnormality.
3. An apparatus for detecting opacities in clinical two-dimensional (2D) radiograph X-ray images, comprising: processor circuitry configured to: receive an analysis 2D radiograph X-ray image of a region of interest of an analyzed body part; receive a model of a normal region of interest, wherein the model is based on a plurality of 2D radiograph X-ray images of the region of interest that is normal and does not suffer from abnormalities, wherein the model contains statistical information on a normal healthy population, and wherein the plurality of 2D radiograph X-ray images of the region of interest, upon which the model of the normal region is based, have been intensity normalized; detect at least one abnormality in the region of interest of the analyzed body part, wherein the detection comprises: intensity normalizing the analysis 2D radiograph X-ray image, suppressing at least some bone related imagery in the analysis 2D radiograph X-ray image, and comparing the analysis 2D radiograph X-ray image and the mode; and output information on the at least one abnormality.
4. The apparatus according to claim 3, further comprising determining at least one deviation between at least one intensity in the region of interest of the analysis 2D radiograph X-ray image and a corresponding at least one intensity in the normal region of interest of the model.
5. The apparatus according to claim 3, wherein model data of the model comprises at least one average intensity based on corresponding intensities in the plurality of 2D radiograph X-ray images of the region of interest, the model data comprising at least one standard deviation intensity based on the corresponding intensities in the plurality of 2D radiograph X-ray images of the region of interest; and wherein the analysis 2D radiograph X-ray image and the model are compared based on at least one intensity value in the region of interest of the analysis 2D radiograph X-ray image, the at least one average intensity value in the normal region of interest of the model, and the at least one standard deviation intensity in the normal region of interest of the model.
6. The apparatus according to claim 5, wherein the analysis 2D radiograph X-ray image and the model are compared by determining a difference between an intensity at a spatial position in the analysis 2D radiograph X-ray image and an average intensity at a corresponding spatial position in the model, wherein the processor is further configured to determine a ratio between the difference and a standard deviation in intensity at the corresponding spatial position in the model.
7. The apparatus according to claim 3, further comprising determining at least one score based on at least one intensity in the region of interest of the analysis 2D radiograph X-ray image and a corresponding at least one intensity in the normal region of interest of the model.
8. The apparatus according to claim 7, wherein the at least one score is indicative that at least one abnormality is detected in the region of interest of the analyzed body part.
9. The apparatus according to claim 7, further comprising delineating at least one area of the region of interest of the analysis 2D radiograph X-ray image based on the at least one score.
10. The apparatus according to claim 3, wherein the plurality of 2D radiograph X-ray images of the region of interest upon which the model is based have had at least some bone related imagery suppressed.
11. The apparatus according to claim 3, wherein detecting the at least one abnormality in the region of interest of the analyzed body part comprises a registration of the region of interest of the analysis 2D radiograph X-ray image to the normal region of interest of the model.
12. The apparatus according to claim 3, wherein the comparing of the analysis 2D radiograph X-ray image and the model includes comparing: the analysis 2D radiograph X-ray image that had the at least some bone related imagery suppressed, and the model, wherein the plurality of 2D radiograph X-ray images of the region of interest upon which the model is based had at least some bone related imagery suppressed.
13. A non-transitory computer-readable medium having one or more executable instructions stored thereon, which, when executed by processor circuity, cause the processor circuitry to perform a method for detecting opacities in clinical two-dimensional (2D) radiograph X-ray images, the method comprising: providing an analysis 2D radiograph X-ray image of a region of interest of an analyzed body part; providing a model of a normal region of interest, wherein the model is based on a plurality of 2D radiograph X-ray images of the region of interest that is normal and does not suffer from abnormalities, wherein the model contains statistical information on a normal healthy population, and wherein the plurality of 2D radiograph X-ray images of the region of interest, upon which the model of the normal region is based, have been intensity normalized; detecting at least one abnormality in the region of interest of the analyzed body part, wherein the detection comprises: intensity normalizing the analysis 2D radiograph X-ray image, comparing the analysis 2D radiograph X-ray image and the model, and suppressing at least some bone related imagery in the analysis 2D radiograph X-ray image; and outputting information on the at least one abnormality.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Exemplary embodiments will be described in the following with reference to the following drawings:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
DETAILED DESCRIPTION OF EMBODIMENTS
(9)
(10) In an example, the analysis image is a radiograph, or attenuation X-ray image. In an example, the analysis image is a dark field image. In an example, the analysis image is a phase contrast image. In an example, the plurality of images comprises radiographs, or attenuation X-ray images. In an example, the plurality of images comprises dark field images. In an example, the plurality of images comprises phase contrast images.
(11) In an example, the region of interest relates to a lung.
(12) In an example, the at least one abnormality relates to one or more pulmonary diseases. In an example, the at least one abnormality relates to tuberculosis. In other words, a pulmonary disease such as tuberculosis could have resulted in the at least one abnormality.
(13) According to an example, the comparison between the analysis X-ray image of the region of interest and the model of the normal region of interest comprises the processing unit being configured to determine at least one deviation between at least one intensity in the region of interest of the analysis X-ray image and a corresponding at least one intensity in the normal region of interest of the model.
(14) According to an example, model data comprises at least one average intensity based on corresponding intensities in the plurality of X-ray images of the region of interest. The model data also comprises at least one standard deviation in intensity, based on the corresponding intensities in the plurality of X-ray images of the region of interest. The comparison between the analysis X-ray image of the region of interest and the model of the normal region of interest is then based on at least one intensity value in the region of interest of the analysis X-ray image and on the at least one average intensity value in the normal region of interest of the model and on the at least one standard deviation intensity in the normal region of interest of the model.
(15) According to an example, the comparison between the analysis X-ray image of the region of interest and the model of the normal region of interest comprises the processing unit being configured to determine a difference between an intensity at a spatial position in the analysis X-ray image of the region of interest and an average intensity at a corresponding spatial position in the model of the normal region of interest. The comparison also comprises the processing unit being configured to determine a ratio between this difference and a standard deviation in intensity at the corresponding spatial position in the model of the normal region of interest.
(16) According to an example, the detection of at least one abnormality in the region of interest of the analyzed body part comprises the processing unit being configured to determine at least one score based on at least one intensity in the region of interest of the analysis X-ray image and a corresponding at least one intensity in the normal region of interest of the model.
(17) According to an example, a score is used to indicate that at least one abnormality has been detected in the region of interest of the analyzed body part.
(18) In an example, the indication comprises utilisation of a colour to mark an abnormality. In an example, the specific colour being used can be linked to the score. In this way, a simple colour coding can be used to help indicate a severity of the abnormality. For example, for a score that is only just above a threshold value a yellow colour could be used to indicate the abnormality, whilst for a score that is significantly greater than the threshold a bright red colour could be used to mark the abnormality. In this manner, not only is a simple means provided to indicate that there is abnormality and indicate its location, a simple means is provided to indicate the possible severity of the abnormality. In this way, an unskilled person in the field is able to prioritise cases that have been indicated as having abnormalities.
(19) According to an example, the processing unit is configured to delineate at least one area of the region of interest of the analysis X-ray image on the basis of the at least one score.
(20) According to an example, detection of the at least one abnormality in the region of interest of the analyzed body part comprises the processing unit being configured to a suppress at least some bone related imagery in the analysis X-ray image.
(21) According to an example, the plurality of X-ray images of the region of interest, upon which the model of the normal region is based, have had at least some bone related imagery suppressed.
(22) According to an example, detection of the at least one abnormality in the region of interest of the analyzed body part comprises the processing unit being configured to intensity normalize the analysis X-ray image.
(23) According to an example, the plurality of X-ray images of the region of interest, upon which the model of the normal region is based, have been intensity normalized. According to an example, detection of the at least one abnormality in the region of interest of the analyzed body part comprises a registration of the region of interest of the analysis X-ray image to the normal region of interest of the model.
(24) In an example, the plurality of X-ray images of the region of interest, upon which the model of the normal region is based, have been registered to one another.
(25)
(26) In an example, the input unit 20 is an image acquisition unit of the at least one acquisition unit 110.
(27) In an example, the at least one image acquisition unit is configured to acquire the plurality of X-ray images of the region of interest.
(28) In an example, the at least one image acquisition unit comprises a grating based differential phase contrast and dark field X-ray imaging device. In an example, the at least one image acquisition unit comprises an interferometer arrangement.
(29) In an example, the at least one image acquisition unit comprises an X-ray imaging device. For example, the device can be a tomography arrangement, or a CT arrangement.
(30) In an example, the at least one image acquisition unit is a standard radiography device, with transmitted intensities of radiation providing information on attenuation through the object.
(31) In an example, the at least one image acquisition unit can operate in a Differential phase contrast imaging (DPCI) mode.
(32) In an example, the at least one image acquisition unit generates an attenuation image, relating to the detection of intensity (intensity) values of X-rays with and without the object in the examination region.
(33) In an example, the at least one image acquisition unit generates a phase contrast (or differential phase) image, relating to the detection of the phases of the X-rays with and without the object in the examination region. In an example, the at least one image acquisition unit generates a dark field (or de-coherence) image, relating to the detection of fringe visibilities of the X-rays with and without the object in the examination region.
(34) In an example, the output unit outputs an absorption (or attenuation) image. In an example, the output unit outputs a phase contrast (or differential phase) image. In an example, the output unit outputs a dark field image.
(35) In an example, the output unit outputs data on a monitor such as a visual display unit or on a number of separate monitors. For example, attenuation, phase contrast and dark field images can be presented on a monitor.
(36) In an example, the system has useful application in a clinical environment such as a hospital. In an example, the system can be used for the detection of pulmonary diseases, in mammography, diagnostic radiology and interventional radiology for the medical examination of patients.
(37) In an example, the system has useful application in an industrial environment, for example in non-destructive testing (e.g. analysis as to composition, structure and/or qualities of biological as well non-biological samples) as well as security scanning (e.g. scanning of luggage in airports).
(38)
(39) in a providing step 210, also referred to as step a), providing an analysis X-ray image of a region of interest of an analyzed body part;
(40) in a providing step 220, also referred to as step b), providing a model of a normal region of interest, wherein the model is based on a plurality of X-ray images of the region of interest;
(41) in a detecting step 230, also referred to as step c), detecting at least one abnormality in the region of interest of the analyzed body part, the detection comprising comparing the analysis X-ray image of the region of interest and the model of the normal region of interest; and
(42) in an outputting step 240, also referred to as d), outputting information on the at least one abnormality.
(43) In step a), the providing can be from an input unit 20 to a processing unit 30.
(44) In step b), the providing can be from the input unit to the processing unit.
(45) In step c), the detecting can be performed by the processing unit.
(46) In step d), the outputting can be performed by an output unit.
(47) In an example, step c) comprises determining of at least one deviation between at least one intensity in the region of interest of the analysis X-ray image and a corresponding at least one intensity in the normal region of interest of the model.
(48) In an example, the model provided in step b) comprises model data comprising at least one average intensity based on the corresponding intensities in the plurality of X-ray images of the region of interest and the model data comprises at least one standard deviation intensity based on the corresponding intensities in the plurality of X-ray images of the region of interest. In step c) the comparison between the analysis X-ray image of the region of interest and the model of the normal region of interest can then be based on at least one intensity value in the region of interest of the analysis X-ray image and on the at least one average intensity value in the normal region of interest of the model and on the at least one standard deviation intensity in the normal region of interest of the model.
(49) In an example, step c) comprises determining a difference between an intensity at a spatial position in the analysis X-ray image of the region of interest and an average intensity at a corresponding spatial position in the model of the normal region of interest and comprises determining a ratio between this difference and a standard deviation in intensity at the corresponding spatial position in the model of the normal region of interest.
(50) In an example, step c) comprises determining at least one score based on at least one intensity in the region of interest of the analysis X-ray image and a corresponding at least one intensity in the normal region of interest of the model.
(51) In an example, a score is used to indicate that at least one abnormality has been detected in the region of interest of the analyzed body part.
(52) In an example, step c) comprises delineating at least one area of the region of interest of the analysis X-ray image on the basis of the at least one score.
(53) In an example, step c) comprises suppressing at least some bone related imagery in the analysis X-ray image.
(54) In an example, step c) comprises normalizing of at least one intensity of the analysis X-ray image.
(55) In an example, step c) registering the region of interest of the analysis X-ray image to the normal region of interest of the model.
(56) Examples of the apparatus, system and method for the detection of opacities in X-ray images will now be described in more detail in conjunction with
(57) Several existing alternative approaches for the automated detection of tuberculosis lesions in chest radiographs have been proposed, based upon automated measurement of different image features, including texture features (see the paper by van Ginneken, Bram, et al. Automated Scoring of Chest Radiographs for Tuberculosis Prevalence Surveys: A Combined Approach. Proc. Fifth International Workshop on Pulmonary Image Analysis. 2013), and shape features of opacities. The shape of the lung fields has also been proposed as a basis for TB detection (see the paper by van Ginneken et al and the paper by Jaeger, Stefan, et al. Detecting tuberculosis in radiographs using combined lung masks. Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE. IEEE, 2012), whereby opacities adjacent to the pleura yield an indirect indicator for the presence of parenchymal lesions. However, the results of computer aided decision systems based on a variety of technical features are hard to verify by the user. Intuitive indicators of the analysis results are crucial in order to establish the confidence of the user in the results, and this is therefore a significant limitation of such approaches. Furthermore, the training of these algorithms typically requires a large number of annotated images. Also, the specifically trained algorithms turn out to be very sensitive to external parameters like noise, several kinds of image artefacts, and image post-processing parameters. Therefore, it is not straightforward to apply the trained algorithm to images from different sets of images obtained under deviating conditions to the training set, as is required in real world situations.
(58) The apparatus, system and method for the detection of opacities in X-ray images described here addresses these issues, as discussed above in relation to
(59) The radiological manifestation of TB in the lung is caused by localised accumulation of fluids or fibrous tissue at locations where lung parenchyma was present prior to infection. This change in the physiological properties of the lung tissues causes localised opacity (due to an increased absorption of X-rays) to be present in the chest x-ray image. Automated detection of opacities in areas of the radiograph corresponding to the lung fields, as provided by the apparatus here described, is a very direct and physiologically plausible approach to detect tuberculosis in chest radiographs automatically.
(60) To achieve this, a number of complications have to be taken into account, in order that such opacities relating to abnormalities can be identified. Complications that are addressed by the apparatus, system and method for the detection of opacities in X-ray images include:
(61) i. Bones overlaid with the lung field also impose opacities stronger than those induced by tuberculosis;
(62) ii. According to different acquisition protocols (exposure) and patient properties (weight/size) image intensities in the lung field may vary significantly stronger than by variations induced by tuberculosis and therefore counteracts quantitative comparison between images; and
iii. The root of the pulmonary vessel tree (hilus) imposes strong opacities.
(63) Similar issue arise in the detection of other pulmonary diseases, and in the analysis of mammograms for example.
(64)
(65) 1. Pre-processing of a chest radiograph;
(66) 2. Comparison of a chest radiograph with a Normal Model;
(67) 3. Detection of abnormalities in a chest radiograph; and
(68) 4. Classification of detected abnormalities from chest radiograph
(69) In essence, the approach enables a direct comparison of chest radiographs to one another, and thereby a method to enable comparing an unseen image with a multitude of known images. The selection of the images can be performed by an expert, and thereby evaluated according to some pre-defined set of inclusion criteria, and the information derived from this image database forms the basis of a comparison analysis to detect deviations from the expectations encoded in this database.
(70) Specific steps of the detailed workflow shown in
(71) Pre-Processing
(72) In order to account for the complications (i and ii) outlined above, pre-processing is performed for each image: The following pre-processing steps are applied:
(73) 1. Segmentation of the lung fields;
(74) 2. Bone suppression;
(75) 3. Intensity normalization of the lung fields; and
(76) 4. Spatial normalization of the lung fields.
(77)
(78) Normal Model
(79) A statistical model is built from a collection of normal cases (defined as radiologically normal, meaning no significant radiological findings were observed by experts in the images) describing the intensity distribution (average av_i(x) and standard deviation stddev(x)) at any location in the atlas. This model provides a confidence interval of the expected intensity in the atlas space for normals based on average and standard derivation (See
(80) Abnormality Detection
(81) An image, acquired for example from a subject in the field and can be considered to be an analysis X-ray image, is analyzed by:
(82) 1. Pre-Processing it; and
(83) 2. Detecting any abnormal image location.
(84) The deviation from the confidence interval (z score at x) at any position in the lung field is detected:
z(
(85) where I(
(86) The result is illustrated in
(87) Classification
(88) An overall abnormality score Z is calculated on the entire lung fields by counting all locations x with z(x)>s and normalizing this to the number of locations in the lung field to account for the lung size. Z provides an appropriate decision criterion regarding the abnormality of a specific chest radiograph.
(89) Summary
(90) Below is provided a brief overview, including additional details relating to specific steps, of the model building, abnormality detection and rating, that have been described above in detail. The pre-processing outlined above can be an important pre-requisite step for this purpose. In some situations it is applied to all images included in the analysis (both to reference image(s) during a training phase to build the model, and to the unseen image during detection) in the same manner. Steps are further detailed here:
(91) Lung field segmentation is achieved by a method described in the paper by D. Barthel and J. von Berg. Robust automatic lung field segmentation on digital chest radiographs. Int J CARS, 4(Suppl 1):326-327, 2009. Other known methods of segmentation can be used.
(92) Bone suppression can also achieved by known methods, for example as described in the following sources: von Berg and Neitzel. Bone Suppression in X-ray radiograms. World patent WO 2011/077334; Jens von Berg, Stewart Young, Heike Carolus, Robin Wolz, Axel Saalbach, Alberto Hidalgo, Ana Gimenez, and Tomas Franquet, A novel bone suppression method that improves lung nodule detection, International Journal of Computer Assisted Radiology and Surgery, pp. 1-15, 2015; and von Berg, Levrier, Carolus, Young, Saalbach, Laurent, and, Florent. Decomposing the bony thorax in radiographs. In Proc of ISBI 2016 in print.
(93) Intensity normalization can be achieved by determining an intensity quantile q of the lung fields, e.g. at 7.5% of the intensity range, the dark part of the lung fields. Normalization thus means to subtract q from the image (and add a constant in order not to get negative image intensities). This is a very simple method in contrast to others that are based on the analysis of complex texture and shape features.
(94) Space normalization can be performed based upon the lung field contours made from a discrete set of step points. An average lung field model is built on a training set. This establishes the definition of the atlas (reference) space. All images can then be spatially aligned with this atlas space via a warping of the original image to co-align the lungs with those of the model. A B-spline method can be applied as described in the paper by Rueckert, Daniel, et al. Nonrigid registration using free-form deformations: application to breast MR images. Medical Imaging, IEEE Transactions on, 1999, 18[8], p. 712-721. Other approaches, such as k-nearest neighbour interpolation, could be applied.
(95) Thus, an apparatus, system and method for the detection of opacities in X-ray images described here can be applied to automatically classify images having a high probability of being abnormal. This can serve as an automatic step to select interesting cases from a data base. It can be also used to identify patients having a certain risk of suffering from pulmonary diseases like Tuberculosis. In a screening scenario these patients could then be subject to further diagnostic testing with other means like a sputum test or a gene test. Also, visualizations like those in
(96) In another exemplary embodiment, a computer program or computer program element is provided that is characterized by being configured to execute the method steps of the method according to one of the preceding embodiments, an appropriate system.
(97) The computer program element might therefore be stored on a computer unit, which might also be part of an embodiment. This computing unit may be configured to perform or induce performing of the steps of the method described above. Moreover, it may be configured to operate the components of the above described apparatus. The computing unit can be configured to operate automatically and/or to execute the orders of a user. A computer program may be loaded into a working memory of a data processor. The data processor may thus be equipped to carry out the method according to one of the preceding embodiments.
(98) This exemplary embodiment of the invention covers both, a computer program that right from the beginning uses the invention and computer program that by means of an update turns an existing program into a program that uses invention.
(99) Further on, the computer program element might be able to provide all necessary steps to fulfill the procedure of an exemplary embodiment of the method as described above.
(100) According to a further exemplary embodiment of the present invention, a computer readable medium, such as a CD-ROM, is presented wherein the computer readable medium has a computer program element stored on it which computer program element is described by the preceding section.
(101) A computer program may be stored and/or distributed on a suitable medium, such as an optical storage medium or a solid state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless telecommunication systems.
(102) However, the computer program may also be presented over a network like the World Wide Web and can be downloaded into the working memory of a data processor from such a network. According to a further exemplary embodiment of the present invention, a medium for making a computer program element available for downloading is provided, which computer program element is arranged to perform a method according to one of the previously described embodiments of the invention.
(103) It has to be noted that embodiments of the invention are described with reference to different subject matters. In particular, some embodiments are described with reference to method type claims whereas other embodiments are described with reference to the device type claims. However, a person skilled in the art will gather from the above and the following description that, unless otherwise notified, in addition to any combination of features belonging to one type of subject matter also any combination between features relating to different subject matters is considered to be disclosed with this application. However, all features can be combined providing synergetic effects that are more than the simple summation of the features.
(104) While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive. The invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing a claimed invention, from a study of the drawings, the disclosure, and the dependent claims.
(105) In the claims, the word comprising does not exclude other elements or steps, and the indefinite article a or an does not exclude a plurality. A single processor or other unit may fulfill the functions of several items re-cited in the claims. The mere fact that certain measures are re-cited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.