Identification and analysis of lesions in medical imaging
09953413 ยท 2018-04-24
Assignee
Inventors
Cpc classification
G06T2207/10096
PHYSICS
A61B6/504
HUMAN NECESSITIES
International classification
Abstract
A method for automated classification of curve patterns associated with dynamic image data of a lesion in a subject in order to determine characteristics of the lesion. The method comprising the steps of loading the image data into an electronic memory means, producing a plot of signal intensity profile, converting the signal intensity profile into a contrast enhancement profile, detecting a reference enhancement profile having a highly positive slope over an initial enhancement period followed by a decreasing profile portion, deriving signature curve types based on the reference enhancement profile, classifying an enhancement curve for each pixel in a selected ROI into one of the derived signature curve types using all available time points and displaying a grid-plot of the classified enhancement curves for all pixels in the selected ROI, wherein the overall display of curves and heterogeneity provides visual indication of the characteristics of the lesion.
Claims
1. A method for automated classification of curve patterns associated with dynamic image data of a lesion in a subject in order to determine characteristics of the lesion by operating a computer program in a computer, comprising the steps of: (a) loading the image data into an electronic memory means; (b) producing a plot of signal intensity profile; (c) converting the signal intensity profile into a contrast enhancement profile; (d) before classifying a set of enhancement curves, detecting a subject-dependent reference vascular enhancement profile (RVE) Y.sub.ref(t) for an imaged volume, wherein the imaged volume includes different tissue types including lesion and non-lesion tissue by: i. calculating an initial enhancement index map Y.sub.i(x,y,z), and a washout map Y.sub.O(x,y,z) representing the decreasing profile portion, for every pixel (x,y,z) of the imaged volume; ii. finding all pixels collectively noted as XYZ such that Y.sub.i(XYZ)>f*max(Yi) and Y.sub.O(XYZ)>0, where f is an adjustable masking threshold; iii. calculating the RVE by averaging the contrast enhancement profiles from all pixels of XYZ with a predefined masking threshold value; (e) deriving four signature curves representing enhancement curve patterns including slow, persistent, plateau and washout types based on the detected RVE for the subject and the following relationships:
2. A method according to claim 1 wherein prior to detecting a reference vascular enhancement profile, the method comprises the steps of detecting a pre-contrast baseline and the initial enhancement period by said computer program: (a) calculating the mean signal intensity of the entire volume of contrast at each time point to obtain a mean signal intensity time-curve S(t); (b) estimating a mean enhancement time-curve Y(t)=S(t)S(t.sub.0), where t0 represents the time point for a first pre-contrast scan; (c) finding a maximum uptake slope at time point t.sub.s and a maximum enhancement Y.sub.max=max{Y(t)}; (d) searching backward from t.sub.s to find the first occurring time point t.sub.1 such that t.sub.0t.sub.1<t.sub.s and Y(t.sub.1)<a %*Y.sub.max where a % is a fraction value that is adjustable; and (e) setting the initial enhancement period between t.sub.1 and t.sub.2=t.sub.s+(t.sub.st.sub.1) and find an initial enhancement index time point at t.sub.2.
3. A method according to claim 1 wherein the results of the segmentation analysis and curve classification include the lesion volume and the percentage contribution from pixels with each type of enhancement curves respectively.
4. A method according to claim 1 wherein the results of the segmentation analysis and curve classification of all pixels are stored in a color-coded curve pattern map for display as a color overlay on top of a raw image of the lesion.
5. A computer program embodied on a non-transitory computer-readable medium for automated classification of curve patterns associated with dynamic image data of a lesion in a subject, wherein the computer program instructs a processor to: (a) load the image data into an electronic memory means; (b) produce a plot of signal intensity profile; (c) convert the signal intensity profile into a contrast enhancement profile; (d) before classifying a set of enhancement curves, detect a subject-dependent reference vascular enhancement profile (RVE) Y.sub.ref(t) for an imaged volume, wherein the imaged volume includes different tissue types including lesion and non-lesion tissue by: i. calculating an initial enhancement index map Y.sub.i(x,y,z), and a washout map Y.sub.O(x,y,z) representing the decreasing profile portion, for every pixel (x,y,z) of the imaged volume; ii. finding all pixels collectively noted as XYZ such that Y.sub.i(XYZ)>f*max(Yi) and Y.sub.O(XYZ)>0, where f is an adjustable masking threshold; iii. calculating the RVE by averaging the contrast enhancement profiles from all pixels of XYZ with a predefined masking threshold value; (e) derive four signature curves representing enhancement curve patterns including slow, persistent, plateau and washout types based on the detected RVE for the subject and the following relationships:
6. A system for automated classification of curve patterns associated with dynamic image data of a lesion in a subject in order to determine characteristics of the lesion, the system comprising: A scanner for providing a dynamic image scan of the subject; A processor linked to the scanner for retrieving the image data from the scan; the processor further configured to execute a computer program in a computer that: (a) loads the image data into an electronic memory means; (b) produces a plot of signal intensity profile; (c) converts the signal intensity profile into a contrast enhancement profile; (d) before classifying a set of enhancement curves, detects a subject-dependent reference vascular enhancement profile (RVE) Y.sub.ref(t) for an imaged volume, wherein the imaged volume includes different tissue types including lesion and non-lesion tissue by: i. calculating an initial enhancement index map Y.sub.i(x,y,z), and a washout map Y.sub.O(x,y,z) representing the decreasing profile portion, for every pixel (x,y,z) of the imaged volume, ii. finding all pixels collectively noted as XYZ such that Y.sub.i(XYZ)>f*max(Yi) and Y.sub.O(XYZ)>0, where f is an adjustable masking threshold; iii. calculating the RVE by averaging the contrast enhancement profiles from all pixels of XYZ with a predefined masking threshold value; (e) derives four signature curves representing typical enhancement curve patterns including slow, persistent, plateau and washout types based on the detected RVE for the subject and the following relationships:
7. A system according to claim 6 wherein prior to detecting a reference vascular enhancement profile, the processor detects a pre-contrast baseline and the initial enhancement period comprising the steps of: (a) calculating the mean signal intensity of the entire volume of contrast at each time point to obtain a mean signal intensity time-curve S(t); (b) estimating a mean enhancement time-curve Y(t)=S(t)S(t.sub.0), where t.sub.0 represents the time point for a first pre-contrast scan; (c) finding a maximum uptake slope at time point ts and a maximum enhancement Y.sub.max=max{Y(t)}; (d) searching backward from t.sub.s to find the first occurring time point t.sub.1 such that t.sub.0t.sub.1<t.sub.s and Y(t.sub.1)<a %*Y.sub.max where a % is a fraction value that is adjustable; and (e) setting the initial enhancement period between t.sub.1 and t.sub.2=t.sub.s+(t.sub.st.sub.1) and find an initial enhancement index time point at t.sub.2.
8. A system according to claim 6 wherein the results of the segmentation analysis and curve classification include the lesion volume and the percentage contribution from pixels with each type of enhancement curves respectively.
9. A method according to claim 1 wherein prior to classifying an enhancement curve, the method further comprises the steps of selecting an enhancement curve from a pixel or a ROI, and setting it as one of the signature curves for the purpose of correlation analysis.
10. A system according to claim 6 wherein prior to the processor classifying an enhancement curve further comprises the steps of the processor selecting an enhancement curve from a pixel or a ROI, and setting it as one of the signature curves for the purpose of correlation analysis.
11. A method according to claim 1 wherein the correlation analysis includes a rank correlation with respect to the signature curves in order to obtain correlation coefficients and statistical p-values.
12. A system according to claim 6 wherein the correlation analysis includes a rank correlation with respect to the signature curves in order to obtain correlation coefficients and statistical p-values.
13. A method according to claim 1 further comprising performing a second correlation analysis that differs from the first correlation analysis when multiple enhancement curves correspond to the same maximum coefficient value.
14. A system according to claim 6 wherein the processor is further configured to perform a second correlation analysis that differs from the first correlation analysis when multiple enhancement curves correspond to the same maximum coefficient value.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
(2) The invention will hereinafter be described in a preferred embodiment, by way of example only, with reference to the drawings wherein:
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
DETAILED DESCRIPTION OF PREFERRED EMBODIMENT
(12) The present invention is particularly applicable to dynamic MRI, CT, NM and PET imaging systems, for example dynamic MRI of the breast. Raw data and/or images collected by a scan, such as from a MRI scanner 20, CT scanner 25, NM scanner 30 or PET scanner 35 are forwarded to a data storage system 40 in the form of a Picture Archiving Communications System (PACS) in
(13) The user will first use the computer software to instruct the computer processor or workstation 50 to load the dynamic image data into a memory of the computer processor 50. The processor may apply image registration to the data if it is applicable by configuration to a particular organ, such as of the brain, or by user instruction. Image registration is where images are aligned to account for motion correction in situations where a ROI of the subject moves due to respiratory or other functions of the subject. The processor then detects the pre-contrast baseline and the rapid initial enhancement phase, and converts the signal intensity profile of the data to the contrast enhancement profile depending on the type of image data loaded. The processor further detects a subject-dependent reference time-curve and then derives signature curves of enhancement patterns for a classification system. Thereafter automated classification and segmentation analyses are applied to a region of interest of the subject, such as a suspicious lesion in the breast. The results are then displayed on the processor to the user.
(14) The method can be configured to apply a motion correction method depending on the specific function and organ being studied. A typical dynamic imaging data consisting of a series of 3-dimensional (3D) scans are acquired over a period of time. During acquisition, at least one scan is acquired before contrast injection and at least two scans after the injection. A dynamic imaging data acquisition usually takes several tens of seconds to several tens of minutes depending on the specific protocol used, and patient motion during the acquisition period can occur. To accurately evaluate the contrast enhancement patterns of different tissue types, image alignment or registration of the imaged volume over time is desired, particularly for accurate diagnosis of small-size lesions. Different kinds of motion correction method can be applied depending on the specific organ being studied. For example, a conventional rigid body image registration method can be applied automatically for the brain. However, for some body organs such as the breast, kidney or liver, non-uniform distortions are normally expected due to local tissue stretching associated with cardiac and/or respiratory motion. Some nonlinear motion compensation methods recognizable by persons skilled in the art may be used such as a non-rigid registration well known in medical imaging and remote sensing fields.
(15) The process of detecting the pre-contrast baseline and the rapid initial enhancement phase involves the following steps of:
(16) (1) Calculating the mean signal intensity of the entire volume at each time point to obtain a mean signal intensity time-curve S(t), as shown by 76 in
(17) (2) Estimating a mean enhancement time-curve Y(t)=S=S(t)S(t.sub.0), where t.sub.0 represents the time point for the first pre-contrast scan;
(18) (3) Finding the maximum uptake slope at time point t.sub.s and the maximum enhancement Y.sub.max=max{Y(t)};
(19) (4) Searching backward from t.sub.s to find the first occurring time point t.sub.1 such that t.sub.0t.sub.1t.sub.s and Y(t.sub.1)<a %*Y.sub.max where a % is used for example and the fraction value can be adjusted by configuration, such as 10%;
(20) (5) Setting the initial enhancement period between t.sub.1 and t.sub.2=t.sub.s+(t.sub.st.sub.1) and find the initial enhancement index time point at t.sub.2>t.sub.s.
(21) The process of further detecting a subject-dependent reference time-curve and derives signature enhancement patterns includes the following steps of:
(22) (6) Calculating the mean baseline image S.sub.b(x, y, z) covering the time points from t.sub.0 to t.sub.1 for every pixel of (x, y, z) respectively;
(23) (7) Calculating the initial enhancement index map as Y.sub.i(x, y, z)=S(x, y, z, t.sub.2)S.sub.b(x, y, z) and the washout map as Y.sub.o(x, y, z)=S(x, y, z, t.sub.2)S(x, y, z, t.sub.3), where t.sub.3 represents the last time point of the dynamic data. Alternatively by configuration, the relative enhancement maps Y.sub.i(x, y, z)=S(x, y, z, t.sub.2)/S.sub.b(x, y, z)1 and Y.sub.o(x, y, z)=S(x, y, z, t.sub.2)/S(x, y, z, t.sub.3)1 can be used for the same purpose;
(24) (8) Finding all the pixels collectively noted as XYZ satisfying the criteria of Y.sub.i(XYZ)>f*max(Y.sub.i) and Y.sub.o(XYZ)>0, where f can be adjusted as a masking threshold. For example, a reference time-curve Y.sub.ref(t) can be calculated by averaging those pixels with f=80% to represent the mean vascular enhancement profile with a strong and rapid initial uptake followed by late washout, as shown by the thick dotted curve 80 in
(25) (9) Deriving four types of signature curves to represent the enhancement patterns as illustrated in
(26)
Where Y.sub.2(t) represents type II curve 82 with slow sustained enhancement (Slow), Y.sub.3(t) represents type III curve 84 with rapid initial and sustained late enhancement (Sustained/Persistent), Y.sub.4(t) represents type IV curve 86 with rapid initial and stable late enhancement (Plateau) and Y.sub.5(t) represents type V curve 88 with rapid initial and decreasing late enhancement (Washout).
(27) The initial enhancement index time point (t.sub.2) may be fixed by configuration for a specific data acquisition protocol. Further, the user may have the option to select a preferred time-curve from a pixel or a ROI, and set it as one of the signature curves described above.
(28) The automated classification is applied to all pixels in a region of interest of the subject, such as a suspicious lesion in the breast. Pixels whose initial enhancement are below certain threshold (for example, Y.sub.i(XYZ)<10%*max(Y.sub.i) where the threshold percentage value can be adjusted by configuration) are classified as no enhancement type I and not included for further classification analysis. The time-curve of each candidate pixel is subject to a Spearman's rank correlation with each of the four signature curves (Y.sub.2, Y.sub.3, Y.sub.4 and Y.sub.5) to obtain correlation coefficients (cc) and statistical probability (p-value) respectively. The cc value ranges from 1 to 1, representing complete negative and positive linear relationships between two variables while a cc value of 0 means no linear relationship between the two variables. The smaller the p-value, the more significant the result is said to be. If the p-value is less than the significance level, the result is termed as statistically significant. The default level of significance (p value) is 5%, and the user can select other popular levels (1% or 0.1%) by configuration. For each pixel, a determination is made of the unique curve type corresponding to the maximum cc value. In the situation where multiple curve types produce the same maximum cc value, a further Pearson's correlation is applied to further determine the type also corresponding to the maximum Pearson's cc value. The classified curve type and corresponding p-value are recorded for each candidate pixel. The results are then displayed on the processor to the user.
(29) The process of displaying the results involves an intuitive interface displaying the enhancement index map in MIP mode as shown in
(30) The user may have the option to apply the cluster analysis to each suspicious lesion highlighted by a ROI one by one, or to all lesions located within the boundary of a selected ROI.
(31) With reference to
(32) This embodiment has been described using an example of a dynamic MRI of the breast. The invention is equally applicable to other disease such as prostate cancer, brain tumor or diseases in other body organs, not just of humans but animals as well, and using CT or NM or PET scans. Further the invention can be extended by combining the detailed kinetic and morphologic information in order to provide optimal discrimination between benign and malignant disease.
(33) It will be appreciated by persons skilled in the art that numerous variations and/or modifications may be made to the invention as shown in the specific embodiments without departing from the scope of the invention as broadly described. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive.