QUALITY CONTROL OF IMAGE REGISTRATION
20170364774 · 2017-12-21
Inventors
Cpc classification
G06F18/2135
PHYSICS
G06F18/217
PHYSICS
G06V10/7715
PHYSICS
G06F18/2185
PHYSICS
International classification
Abstract
An imaging quality control system (80) employing an imaging quality controller (84) and a monitor (81). In operation, the imaging quality controller (84) executes an image processing of subject image data of the anatomical object (e.g., subject non-segmentation-based or segmentation-based image registration of US, CT and/or MRI anatomical images), and assessing an accuracy of the image processing of the subject image data of the anatomical object as a function of a subject Eigen weight set relative to a training Eigen range set (e.g., previously registered or segmented US, CT and/or MRI anatomical images). The subject Eigen weight set is derived from the subject image data of the anatomical object, and the training Eigen range set is derived from training image data of anatomical object. The monitor (81) displays the assessment of the accuracy of the image processing of the subject image data of the anatomical object by the imaging quality controller (84).
Claims
1. An imaging quality control system, comprising: an imaging quality controller operable to execute an image processing of subject image data of an anatomical object, wherein the image processing is at least one of a non-segmentation-based image registration and a segmentation-based image registration, wherein the imaging quality controller is further operable to assess an accuracy of the image processing of the subject image data of the anatomical object as a function of a subject Eigen weight set relative to a training Eigen weight range set, wherein the subject Eigen weight set is derived from the subject image data of the anatomical object, and wherein the training Eigen weight range set is derived from multiple training image data of the anatomical object; and a monitor in communication with the imaging quality controller to display an assessment of the accuracy of the image processing of the subject image data of the anatomical object by the imaging quality controller.
2. The imaging quality control system of claim 1, wherein the subject image data includes one of subject ultrasound data, subject computed tomography data and subject magnetic resonance imaging data.
3. The imaging quality control system of claim 2, wherein the multiple training image data includes one of multiple training ultrasound data, multiple training computed tomography data and multiple training magnetic resonance imaging data.
4. The imaging quality control system of claim 1, each image data includes at least one of a transformation matrix and a segmented anatomical object.
5. The imaging quality control system of claim 1, wherein the imaging quality controller is operable to extract a subject Eigen mode set from the subject image data.
6. The imaging quality control system of claim 5, wherein the imaging quality controller is operable to compute the subject Eigen weight set as a function of the subject Eigen mode set.
7. The imaging quality control system of claim 1, wherein the imaging quality controller is operable to compute a metric distance between the subject Eigen weight set and the training Eigen weight range set.
8. The imaging quality control system of claim 1, wherein the imaging quality controller is operable to assess a degree of membership of the subject Eigen weight set within the training Eigen weight range set.
9. The imaging quality control system of claim 8, wherein the imaging quality controller is operable to delineate an accurate image processing of the subject image data responsive to the subject Eigen weight set including a specific degree of membership within the training Eigen weight range set.
10. The imaging quality control system of claim 1, wherein the imaging quality controller is operable to delineate an inaccurate image processing of the subject image data responsive to the subject Eigen weight set excluding a specific degree of membership within the training Eigen weight range set.
11. An imaging quality controller, comprising: an image processing module operable to execute an image processing of subject image data of an anatomical object; wherein the image processing is at least one of a non-segmentation-based image registration and a segmentation-based image registration; and a quality assessment module operable to assess an accuracy of the image processing of the subject image data of the anatomical object by the image processing module as a function of a subject Eigen weight set relative to a training Eigen weight range set, wherein the subject Eigen weight set is derived from the subject image data of the anatomical object, and wherein the training Eigen weight range set is derived from multiple training image data of the anatomical object.
12. The imaging quality controller of claim 11, wherein the quality assessment module is operable to extract a subject Eigen mode set from the subject image data; and wherein the quality assessment module is operable to compute the subject Eigen weight set as a function of the subject Eigen mode set.
13. The imaging quality controller of claim 11, wherein the quality assessment module is operable to compute a metric distance between the subject Eigen weight set and the training Eigen weight range set.
14. The imaging quality controller of claim 11, wherein the quality assessment module is operable to assess a degree membership of the subject Eigen weight set within the training Eigen weight range set.
15. The imaging quality controller of claim 14, wherein the quality assessment module is operable to delineate an accurate image processing of the subject image data responsive to the subject Eigen weight set including a specific degree of membership within the training Eigen weight range set; and wherein the quality assessment module is operable to delineate an inaccurate image processing of the subject image data responsive to the subject Eigen weight set excluding the specific degree of membership within the training Eigen weight range set.
16. (canceled)
17. (canceled)
18. (canceled)
19. (canceled)
20. (canceled)
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0019] To facilitate an understanding of the present invention, an example of a three (3) Eigen mode implementation of an imaging quality control will now be described in connection with
[0020] For purposes of the present invention, the terms of the art related to Eigen physics including, but not limited to “Eigen mode extraction” and “Eigen weight computation”, are to be interpreted as known in the art of the present invention and exemplary described herein.
[0021] Referring to
[0022] Single Imaging Modality.
[0023] By example, as shown in
[0024] The quality relevance assessment may involve a computation of a metric distance between the subject Eigen weight set 10 of {ω.sub.SD1,ω.sub.SD2,ω.sub.SD3} and training Eigen weight range set 11 of {[ω.sub.MIN1,ω.sub.MAX1],[ω.sub.MIN2,ω.sub.MAX2],[ω.sub.MIN3,ω.sub.MAX3]}.
[0025] More particularly, the metric distance computation may involve a determination of a degree of membership of the subject Eigen weight set 10 of {ω.sub.SD1,ω.sub.SD2,ω.sub.SD3} and training Eigen weight range set 11 of {[ω.sub.MIN1,ω.sub.MAX1],[ω.sub.MIN2,ω.sub.MAX2],[ω.sub.MIN3,ω.sub.MAX3]}. For purposes of the present invention, the phrase “degree of membership” broadly encompasses a simple or biased accounting of a number of subject Eigen weights which are members of corresponding training Eigen weight ranges.
[0026] For example, the accounting may involve a determination of whether: [0027] (1) subject Eigen weight of ω.sub.SD1 is or is not a member of training Eigen weight range [ω.sub.MIN1,ω.sub.MAX1]; [0028] (2) subject Eigen weight of ω.sub.SD2 is or is not a member of training Eigen weight range [ω.sub.MIN2,ω.sub.MAX2]; and [0029] (3) subject Eigen weight of ω.sub.SD1 is or is not a member of training Eigen weight range [ω.sub.MIN3,ω.sub.MAX3].
[0030] With a simple accounting, the higher the number of Eigen weights that are members of corresponding Eigen weight ranges, then the higher the accuracy of the image processing (e.g., registration or segmentation).
[0031] With a biased accounting, the more variable Eigen weight(s) being member(s) of corresponding Eigen weight range(s) as compared to the less variable Eigen weight(s) being member(s) of corresponding Eigen weight range(s) indicates a higher accuracy of the image processing.
[0032] Dual Imaging Modality.
[0033] By further example, as shown in
[0034] The quality relevance may be assessed of subject Eigen weight set 13 of {ω.sub.DD4,ω.sub.DD5,ω.sub.DD6} computed from three (3) Eigen modes EM.sub.DD4-EM.sub.DD6 of the subject mesh distance to a training Eigen weight range set 14 of
{[ω.sub.MIN4,ω.sub.MAX4],[ω.sub.MIN5,ω.sub.MAX5],[ω.sub.MIN6,ω.sub.MAX6]} computed from three (3) identical Eigen modes EM.sub.TD4-EM.sub.TD6 of the training mesh distances.
[0035] The quality relevance assessment may involve a computation of a metric distance between the subject Eigen weight set 13 of {ω.sub.DD4,ω.sub.DD5,ω.sub.DD6} and training Eigen weight range set 14 of {[ω.sub.MIN4,ω.sub.MAX4],[ω.sub.MIN5,ω.sub.MAX5],[ω.sub.MIN6,ω.sub.MAX6]}.
[0036] More particularly, the metric distance computation may involve a determination of a degree of membership of the subject Eigen weight set 13 of {ω.sub.DD4,ω.sub.DD5,ω.sub.DD6} and training Eigen weight range set 14 of {[ω.sub.MIN4,ω.sub.MAX4],[ω.sub.MIN5,ω.sub.MAX5],[ω.sub.MIN6,ω.sub.MAX6]}. Again, for purposes of the present invention, the phrase “degree of membership” broadly encompasses a simple or biased accounting of a number of subject Eigen weights which are members of corresponding training Eigen weight ranges.
[0037] For example, the accounting may involve a determination of whether: [0038] (1) subject Eigen weight of ω.sub.DD4 is or is not a member of training Eigen weight range [ω.sub.MIN4,ω.sub.MAX4]; [0039] (2) subject Eigen weight of ω.sub.DD5 is or is not a member of training Eigen weight range [ω.sub.MIN5,ω.sub.MAX5]; and [0040] (3) subject Eigen weight of ω.sub.DD6 is or is not a member of training Eigen weight range [ω.sub.MIN6,ω.sub.MAX6].
[0041] With a simple accounting, the higher the number of Eigen weights that are members of corresponding Eigen weight ranges, then the higher the accuracy of the image processing (e.g., registration or segmentation).
[0042] With a biased accounting, the more variable Eigen weight(s) being member(s) of corresponding Eigen weight range(s) as compared to the less variable Eigen weight(s) being member(s) of corresponding Eigen weight range(s) indicates a higher accuracy of the image processing.
[0043] From the description of
[0044]
[0045] A stage S22 of flowchart 20 encompasses an Eigen mode extraction of training image data TD.sub.1-TD.sub.3 resulting in a series of Eigen modes EM.sub.1-EM.sub.3 as shown. In practice, the extraction is performed within statistical analysis framework, preferably a Principal Component Analysis (“PCA”) as shown.
[0046] Within the same statistical analysis framework, a stage S24 of flowchart 20 encompasses an Eigen weight computation resulting in a Eigen mode series of weights ω for each training image data TD as shown.
[0047] A stage S26 of flowchart 20 encompasses a formulation of a Eigen weight range for each Eigen mode EM based on a pooling of all weights w. In practice, each Eigen weight range consists of a minimum Eigen weight ω.sub.MIN and a maximum Eigen weight ω.sub.MAX delineated from a plausible range of variation of each Eigen mode EM.
[0048] For example, a lowest Eigen weight ω among Eigen weights ω.sub.TD11-WTD33 may be initially selected as the minimum Eigen weight ω.sub.MIN, and a highest Eigen weight ω among Eigen weights ω.sub.TD11-WTD33 may be initially selected as the maximum Eigen weight ω.sub.MAX. If this range is deemed plausible based on a probability analysis of Eigen weights ω.sub.TD11-WTD33, then the lowest Eigen weight ω and the highest Eigen weight ω define the range. Otherwise, the next lowest Eigen weight ω and/or the next highest Eigen weight ω are selected until the probability analysis indicates a plausible range.
[0049]
[0050] A stage S32 of flowchart 30 encompasses an Eigen mode extraction of subject image data SD.sub.1-SD.sub.3 resulting in the series of Eigen modes EM.sub.1-EM.sub.3 as shown. In practice, the extraction is performed within the same statistical analysis framework as the training image data TD.sub.1-TD.sub.3 of
[0051] Within the same statistical analysis framework, a stage S34 of flowchart 230 encompasses an Eigen weight computation resulting in a Eigen mode series of weights ω for subject image data SD as shown.
[0052] A stage S36 of flowchart 30 encompasses a computation of an Eigen weight distance between the subject Eigen weight set {ω.sub.SD1,ω.sub.SD2,ω.sub.SD3} and the training Eigen weight ranges set {[ω.sub.MIN1,ω.sub.MAX1],[ω.sub.MIN2,ω.sub.MAX2],[ω.sub.MIN3,ω.sub.MAX3]} involving a determination of whether: [0053] (1) subject Eigen weight of ω.sub.SD1 is or is not a member of training Eigen weight range [ω.sub.MIN1,ω.sub.MAX1]; [0054] (2) subject Eigen weight of ω.sub.SD2 is or is not a member of training Eigen weight range [ω.sub.MIN2,ω.sub.MAX2]; and [0055] (3) subject Eigen weight of ω.sub.SD3 is or is not a member of training Eigen weight range [ω.sub.MIN3,ω.sub.MAX3].
[0056] In a simple accounting mode, all Eigen weights required to be a member of a corresponding training Eigen weight range to automatically or provisionally delineate the segmentation or registration transformation of subject image data SD as being accurate for image processing purposes.
[0057] In a biased accounting mode where Eigen weight ω.sub.SD1 is the more Eigen weight as compared to Eigen weights ω.sub.SD2 and ω.sub.SD3, then Eigen weight ω.sub.SD1 is required to be a member of training Eigen weight range [ω.sub.MIN1,ω.sub.MAX1] or Eigen weights ω.sub.SD2 and ω.sub.SD3 are required to be members of respective training Eigen weight range [ω.sub.MIN2,ω.sub.MAX2] and [ω.sub.MIN3,ω.sub.MAX3] to automatically or provisionally delineate the segmentation or registration transformation of subject image data SD as being accurate for image processing purposes.
[0058] A stage S38 of flowchart 30 encompasses an automatic or a system operator determination of an accuracy of the segmentation or registration transformation of subject image data SD. For the automatic mode, the system operator will be informed of the accuracy determination and further image processing of subject image data SD will be prohibited. For the provisional mode, an graphical user interface information of the distance computation of stage S36 will be displayed whereby the system operator may select whether or not to proceed with further imaging processing of subject image data SD.
[0059]
[0060] A stage S42 of flowchart 40 encompasses an Eigen mode extraction of training image data TD.sub.4-TD.sub.6 resulting in a series of Eigen modes EM.sub.4-EM.sub.6 as shown. In practice, the extraction is performed within statistical analysis framework, preferably a Principal Component Analysis (“PCA”) as shown.
[0061] Within the same statistical analysis framework, a stage S44 of flowchart 40 encompasses an Eigen weight computation resulting in a Eigen mode series of weights ω for each training image data TD as shown.
[0062] A stage S46 of flowchart 40 encompasses a formulation of a Eigen weight range for each Eigen mode EM based on a pooling of all weights w. In practice, each Eigen weight range consists of a minimum Eigen weight ω.sub.MIN and a maximum Eigen weight ω.sub.MAX delineated from a plausible range of variation of each Eigen mode EM.
[0063] For example, a lowest Eigen weight ω among Eigen weights ω.sub.TD11-WTD33 may be initially selected as the minimum Eigen weight ω.sub.MIN, and a highest Eigen weight ω among Eigen weights ω.sub.TD44-WTD66 may be initially selected as the maximum Eigen weight ω.sub.MAX. If this range is deemed plausible based on a probability analysis of Eigen weights ω.sub.TD44-WTD66, then the lowest Eigen weight ω and the highest Eigen weight ω define the range. Otherwise, the next lowest Eigen weight ω and/or the next highest Eigen weight ω are selected until the probability analysis indicates a plausible range.
[0064]
[0065] A stage S52 of flowchart 50 encompasses an Eigen mode extraction of subject image data DD.sub.4-DD.sub.6 resulting in the series of Eigen modes EM.sub.4-EM.sub.6 as shown. In practice, the extraction is performed within the same statistical analysis framework as the training image data TD.sub.4-TD.sub.6 of
[0066] Within the same statistical analysis framework, a stage S54 of flowchart 250 encompasses an Eigen weight computation resulting in a Eigen mode series of weights ω for subject image data DD as shown.
[0067] A stage S56 of flowchart 50 encompasses a computation of an Eigen weight distance between the subject Eigen weight set {ω.sub.DD4,ω.sub.DD5,ω.sub.DD6} and the training Eigen weight ranges set {[ω.sub.MIN4,ω.sub.MAX4],[ω.sub.MIN5,ω.sub.MAX5],[ω.sub.MIN6,ω.sub.MAX6]} involving a determination of whether: [0068] (1) subject Eigen weight of ω.sub.DD4 is or is not a member of training Eigen weight range [ω.sub.MIN4,ω.sub.MAX4]; [0069] (2) subject Eigen weight of ω.sub.DD5 is or is not a member of training Eigen weight range [ω.sub.MIN5,ω.sub.MAX5]; and [0070] (3) subject Eigen weight of ω.sub.DD6 is or is not a member of training Eigen weight range [ω.sub.MIN6,ω.sub.MAX6].
[0071] In a simple accounting mode, all Eigen weights required to be a member of a corresponding training Eigen weight range to delineate the segmentation or registration transformation of subject image data DD as being accurate for image processing purposes.
[0072] In a biased accounting mode where Eigen weight ω.sub.DD4 is the more Eigen weight as compared to Eigen weights ω.sub.DD5 and ω.sub.DD6, then Eigen weight wpm is required to be a member of training Eigen weight range [ω.sub.MIN4,ω.sub.MAX4] or Eigen weights ω.sub.DD5 and ω.sub.DD6 are required to be members of respective training Eigen weight range [ω.sub.MIN5,ω.sub.MAX5] and [ω.sub.MIN6,ω.sub.MAX6] to delineate the segmentation or registration transformation of subject image data DD as being accurate for image processing purposes.
[0073] A stage S58 of flowchart 50 encompasses an automatic or a system operator determination of an accuracy of the segmentation or registration transformation of subject image data SD. For the automatic mode, the system operator will be informed of the accuracy determination and further image processing of subject image data SD will be prohibited. For the provisional mode, an graphical user interface information of the distance computation of stage S56 will be displayed whereby the system operator may select whether or not to proceed with further imaging processing of subject image data SD.
[0074] From the description of
[0075] To further explain non-segmentation-based image registration, by example, an intensity-based image registration may be executed on CT-MRI anatomical images, MRI-MRI anatomical images or CT-CT anatomical images prior to the training phase of flowchart 20 (
[0076] Executing flowchart 20 or flowchart 40 thereafter involves a PCA of the transformations, which results in a number of Eigen modes and corresponding Eigen weights. From the Eigen weights, plausible minimum and maximum Eigen weights are derived for the PCA components. More particularly, assuming a first mode of PCA captures the scale differences between the two registered images, then the minimum and maximum training Eigen weights possible within the population are definable.
[0077] Prior to the subject phase of flowchart 30 or flowchart 50, a transformation is calculated from an intensity-based image registration of the subject anatomical images of intra-operative CT to pre-operative MRI, intra-operative MRI to pre-operative MRI or intra-operative CT to pre-operative CT. Executing flowchart 30 or flowchart 50 thereafter involves an extraction of Eigen weights from a projection along PCA modes and a determination if the subject Eigen weights are within the minimum and maximum training Eigen weights.
[0078] If the subject Eigen weights of the transformations are within the minimum and maximum training Eigen weights, then the intensity-based image registration of the subject anatomical images of intra-operative CT to pre-operative MRI, intra-operative MRI to pre-operative MRI, intra-operative CT to pre-operative CT registration is deemed accurate.
[0079] Otherwise, if the subject Eigen weights of the transformations are NOT within the minimum and maximum training Eigen weights, then the intensity-based image registration of the subject anatomical images of intra-operative CT to pre-operative MRI, intra-operative MRI to pre-operative MRI or intra-operative CT to pre-operative CT is deemed inaccurate or raises a flag for operator consideration.
[0080] In practice, an imaging quality control system of the present invention may employ segregated or integrated subsystems for performing the training phase and the subject phase of the imaging quality control system as exemplarily shown in
[0081] Referring to
[0082] Imaging quality controller 84 includes and/or is accessible by an operating system (not shown) as known in the art for controlling various graphical user interfaces, data and images on monitor 81 as directed by a workstation operator (e.g., a doctor, technician, etc.) via a keyboard, buttons, dials, joysticks, etc. of interface platform 82, and for storing/reading data as programmed and/or directed by the workstation operator of interface platform 82.
[0083] Workstation 83 may be connected/coupled to one or more training imaging modalities 60 or data storage devices (not shown) as known in the art to input training image data 61 to be processed by imaging quality controller 84. Additionally, workstation 83 may be connected/coupled to one or more subject imaging modalities 70 or data storage devices (not shown) as known in the art to input subject image data 71 to be processed by imaging quality controller 84.
[0084] Imaging quality controller 84 employs an image processing module 85 for executing various image processing techniques including, but not limited to, a non-segmentation-based image registration and a segmentation-based image registrations.
[0085] Imaging quality controller 84 further employs a quality training module 86 for executing flowcharts 20 (
[0086] Imaging quality controller 84 further employs a quality assessment module 87 for executing flowcharts 30 (
[0087] Imaging quality controller 84 controls a display of an imaging quality notice 88 on monitor 81 for an automatic assessment mode or a graphical user interface 84 for an operator selection mode.
[0088] Referring to
[0089] Furthermore, as one having ordinary skill in the art will appreciate in view of the teachings provided herein, features, elements, components, etc. described in the present disclosure/specification and/or depicted in the
[0090] Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (e.g., any elements developed that can perform the same or substantially similar function, regardless of structure). Thus, for example, it will be appreciated by one having ordinary skill in the art in view of the teachings provided herein that any block diagrams presented herein can represent conceptual views of illustrative system components and/or circuitry embodying the principles of the invention. Similarly, one having ordinary skill in the art should appreciate in view of the teachings provided herein that any flow charts, flow diagrams and the like can represent various processes which can be substantially represented in computer readable storage media and so executed by a computer, processor or other device with processing capabilities, whether or not such computer or processor is explicitly shown.
[0091] Furthermore, exemplary embodiments of the present invention can take the form of a computer program product or application module accessible from a computer-usable and/or computer-readable storage medium providing program code and/or instructions for use by or in connection with, e.g., a computer or any instruction execution system. In accordance with the present disclosure, a computer-usable or computer readable storage medium can be any apparatus that can, e.g., include, store, communicate, propagate or transport the program for use by or in connection with the instruction execution system, apparatus or device. Such exemplary medium can be, e.g., an electronic, magnetic, optical, electromagnetic, infrared or semiconductor system (or apparatus or device) or a propagation medium. Examples of a computer-readable medium include, e.g., a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), flash (drive), a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk read only memory (CD-ROM), compact disk read/write (CD-R/W) and DVD. Further, it should be understood that any new computer-readable medium which may hereafter be developed should also be considered as computer-readable medium as may be used or referred to in accordance with exemplary embodiments of the present invention and disclosure.
[0092] Having described preferred and exemplary embodiments of novel and inventive system and method for quality control of non-segmented and segmented image registration, (which embodiments are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons having ordinary skill in the art in light of the teachings provided herein, including the
[0093] Moreover, it is contemplated that corresponding and/or related systems incorporating and/or implementing the device or such as may be used/implemented in a device in accordance with the present disclosure are also contemplated and considered to be within the scope of the present invention. Further, corresponding and/or related method for manufacturing and/or using a device and/or system in accordance with the present disclosure are also contemplated and considered to be within the scope of the present invention.