AUTOMATED QUALITATIVE DESCRIPTION OF ANATOMICAL CHANGES IN RADIOTHERAPY
20220054861 · 2022-02-24
Inventors
- MARIA LUIZA BONDAR (WAALRE, NL)
- Matthieu Frédéric Bal (Geldrop, NL)
- ALFONSO AGATINO ISOLA (EINDHOVEN, NL)
Cpc classification
A61N5/1049
HUMAN NECESSITIES
International classification
Abstract
A system and a method for monitoring anatomical changes in a subject in radiation therapy are provided, as well as an arrangement for medical imaging and analysis and a computer program product for carrying out the method. For monitoring anatomical changes in a subject in radiation therapy, the following steps are performed. First anatomical image data and subsequent anatomical image data of the subject are received. The first anatomical image data and the subsequent anatomical image data are analyzed. This analysis comprises registering the subsequent anatomical data to the first anatomical data. Changes between the first anatomical image data and the subsequent anatomical image data are identified as change states, and the identified change states are matched to corresponding qualitative descriptions. A monitoring report is provided, which comprises the qualitative descriptions of the identified changes.
Claims
1. System for monitoring anatomical changes in a subject in radiation therapy, the system comprising: an analysis unit, comprising an input configured to receive first anatomical image data and subsequent anatomical image data of the subject, which analysis unit is at least configured to register the subsequent anatomical data to the first anatomical data; a change state identification unit configured to identify changes between the first anatomical image data and the subsequent anatomical image data as change states; a qualitative translator configured to match the identified change states to corresponding qualitative descriptions; a reporting unit configured to provide a monitoring report comprising qualitative descriptions of the identified change states.
2. The system according to claim 1, wherein the change state identification unit comprises at least one qualitative spatial reasoning algorithm, which qualitative spatial reasoning algorithm is preferably an RCC-8 calculus algorithm and/or a Cardinal spatial reasoning algorithm.
3. The system according to claim 1, wherein the analysis unit further comprises an input configured to receive dose distribution data of a treatment plan of the subject; and the change state identification unit is additionally or alternatively configured to identify changes between the dose distribution data and subsequent anatomical image data as change states.
4. The system according to claim 1, wherein the qualitative translator is configured to match the identified change states to the corresponding qualitative descriptions by using a look-up table.
5. The system according to claim 1, wherein the corresponding qualitative descriptions are natural language descriptions and/or graphic images, preferably in the form of pictograms.
6. The system according to claim 1, wherein the reporting unit comprises a display configured to visually display the monitoring report.
7. The system according to claim 6, wherein the display is configured to visually display the monitoring report in the form of a graphical user interface.
8. The system according to claim 7, wherein graphical user interface comprises at least one control for selecting the information to be displayed as part of the monitoring report.
9. Method for monitoring anatomical changes in a subject in radiation therapy, the method comprising the steps of: receiving first anatomical image data and subsequent anatomical image data of the subject; analyzing the first anatomical image data and the subsequent anatomical image data, wherein analyzing comprises registering the subsequent anatomical data to the first anatomical data; identifying changes between the first anatomical image data and the subsequent anatomical image data as change states; matching the identified change states to corresponding qualitative descriptions; and providing a monitoring report comprising qualitative descriptions of the identified changes.
10. The method according to claim 9, wherein the step of identifying changes comprises supplying the first anatomical image data and the subsequent anatomical image data to at least one qualitative spatial reasoning algorithm, which qualitative spatial reasoning algorithm is preferably an RCC-8 calculus algorithm and/or a Cardinal spatial reasoning algorithm.
11. The method according to claim 9, wherein the step of receiving first and subsequent anatomical image data of the subject further comprises receiving dose distribution data of a treatment plan of the subject; and wherein the step of identifying changes additionally or alternatively comprises identifying changes between the dose distribution data and subsequent anatomical image data as change states.
12. The method according to claim 9, wherein the step of analyzing the anatomical image data further comprises obtaining quantitative image data, which quantitative image data preferably comprises at least one of a region of interest size, a region of interest size change, the distance a region of interest has shifted, the total radiation dose a region of interest has received.
13. The method according to claim 12, wherein the monitoring report further comprises at least one quantitative description of at least one of the identified changes.
14. Arrangement for medical imaging and analysis comprising: one or more imaging devices configured to provide images of a subject to be treated; a contouring tool configured to provide anatomical image data based on the images provided by the one or more imaging devices; the system of claim 1 for monitoring anatomical changes in a subject in radiation therapy.
15. A computer program product comprising instructions for causing a processor to carry out the method according to claim 9, when the computer program is executed.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0023] In the following drawings:
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
DETAILED DESCRIPTION OF THE INVENTION
[0030]
[0031] In the arrangement for medical imaging and analysis 100, a planning image 101 is acquired of the subject to be treated by an imaging device 102. The image can be a computed tomography image (CT), magnetic resonance image (MR), positron emission tomography (PET) image, another medical image, or a combined image, such as a combined PET/CT or PET/MR image. In
[0032] During the course of treatment, at least one subsequent image 105 of the subject is acquired. This image may be acquired with the same imaging device 102 as the planning image, but can also be acquired using one or more alternative imaging devices 106. Such an alternative imaging device can be CT, MR or other medical imaging device. In a preferred embodiment, the subsequent image is acquired using a second medical imaging device 106 that is either a cone-beam CT (CBCT) or planar x-ray imaging device configured to image the subject in the treatment room. The advantage of this setup is that the image can be used for monitoring of anatomical changes in the subject as well as setup of the subject for delivery of the radiation therapy treatment fraction.
[0033] In the subsequent image 105 the ROIs are also delineated using the contouring tool 103 to provide subsequent anatomical image data 107. Contouring can be done from scratch, as in the planning image, manually, automatically, or semi-automatically, with user interaction. Contouring of the subsequent image can also be done by automatically propagating the contours from the planning image 101 to the subsequent image 105 by using the process of deformable image registration. When this process is used, the user preferably has the option of approving and/or manually correcting the automatically propagated contours.
[0034] Next, the anatomical image data 104 and 107 is analyzed in order to monitor anatomical changes in the subject. This is done using a system for monitoring anatomical changes 110 in radiation therapy. The system comprises an analysis unit 111, a change state identification unit 112, a qualitative translator 113 and a reporting unit 114. The analysis unit 111 comprises an input configured to receive the first anatomical image data 104 and the subsequent anatomical image data 107 of the subject.
[0035] The analysis unit 111 is at least configured to register the subsequent anatomical image data 107 to the first anatomical image data 104. As explained above, the first, planning image 101 may be acquired using a different imaging device 102 from the device 106 used for acquisition of the subsequent image 105. Also, the position of the subject in an imaging device will vary slightly for each acquisition of an image. As a result, the frame of reference for the anatomical image data can vary for each image as well as the scale. However, in order to make an accurate and reliable comparison, both the first anatomical image 104 data and the subsequent anatomical image data 107 should have the same frame of reference. To be able to detect changes that are due to changes in the subject's anatomy and not the circumstances under which the image was acquired, the images should have the same scale in size and have the same coordinate system. For this purpose, the subsequent image and its anatomical image data, need to be matched to the first anatomical image and its anatomical image data in scale and frame of reference. This matching process is referred to as “registration”. Registering the subsequent anatomical image data to the first anatomical image data can be done by identifying and matching anatomical landmarks. Anatomical landmarks are structures in the subject's anatomy that are known to have very little or no changes in the time frame of the radiotherapy, such as for example bone structures. The anatomical landmarks can be part of the anatomical image data in the form of contours, e.g. contours of the bone structures that are part of the images. The subsequent anatomical image data is then scaled, translated and rotated until the size and location of the anatomical landmarks corresponds as closely as possible to the size and location of the anatomical landmarks in the first anatomical image data. Preferably this registration is automated.
[0036] The analysis unit 111 may further be configured to quantify anatomical changes between the first anatomical image data and the second anatomical image data. This quantification can be absolute, for example the size of the shift of an OAR in millimeters. The quantification can also be relative, for example the percentage a TS has shrunk. In particular, the analysis unit 111 may be further configured to perform the optional additional analysis method steps that will be described below in reference to
[0037] The change state identification unit 112 is configured to identify changes between the first anatomical image data 104 and the subsequent anatomical image data 107 as change states. Change states are a number of predefined categories wherein changes are grouped according to their characteristics. A change state is identified by assigning the category that best corresponds to the characteristics of the change between the first anatomical image data and the subsequent anatomical image data. . The change states may be based on categories with characteristics that have been pre-defined by as user, but can also be based on a spatial model or size model. A spatial model defines changes states according to the possible relations between two regions. The number and nature of the change states of the model will depend on the characteristics of interest. The model or models used to identify the change states can be chosen accordingly.
[0038] For example, the shift of an ROI may be the characteristic of interest. In this case, changes can be categorized or modelled according to the shifts' size or direction. A well-known model for directions are the compass directions, which define four change states: north, south, east and west. The size of shift can be categorized using ranges defined by the user, for example defining three change states: small, medium and large. In an alternative example, the overlap of an ROI with its original position be of interest. A simple overlap model defines four change states: full overlap, partial overlap, touching, and no overlap. In a further alternative example, the change in size of an ROI may be the characteristic of interest. For this example a simple model defines three change states: growth, shrinkage and no change.
[0039] The qualitative translator 113 is configured to match the change states that have been identified by the change state identification unit 112 to corresponding qualitative descriptions. Preferably, the qualitative descriptions provide an indication of the characteristics of the change state. For example: “the OAR has shifted left”, or “the TS has shrunk”. More preferably, the qualitative descriptions reflect how a physician would describe the characteristics of the change when monitoring the patient during treatment. The qualitative translator 113 is preferably configured to match the identified change states to the corresponding qualitative descriptions by using a look-up table. A look-up table provides an easy way of consistently using the same qualitative description for each change state when it is detected.
[0040] The reporting unit 114 is configured to provide a monitoring report comprising the qualitative descriptions of the identified change states. In the example of
[0041] In the exemplary embodiment illustrated in
[0042] In an embodiment of the monitoring system 110, the change state identification unit 112 comprises at least one qualitative spatial reasoning algorithm, which qualitative spatial reasoning algorithm is preferably an RCC-8 calculus algorithm and/or a Cardinal spatial reasoning algorithm. Qualitative spatial reasoning is an area of artificial intelligence that deals with the problem of generating a qualitative description that summarizes similar quantitative measurements.
[0043]
[0044]
[0045] As shown in the left side of
[0046] The right side of
[0047]
[0048] The change states of the RCC-8 calculus model are, from top to bottom and left to right in
[0049] In
[0050] For the case when there are no changes in the subjects' anatomy, and one or more ROIs are substantially identical in the first and subsequent anatomical image data, this is also identified as a change state. A matching qualitative example description for this state is “no change for ROI”. In
[0051]
[0052] The method for monitoring anatomical changes in a subject in radiation therapy 300 according to the invention comprises a step of receiving first anatomical image data and subsequent anatomical image data of the subject 310, and a step of analyzing the first anatomical image data and the subsequent anatomical image data 320, wherein the step of analyzing comprises registering the subsequent anatomical data to the first anatomical data. The method further comprises a step of identifying changes 330 between the first anatomical image data and the subsequent anatomical image data as change states, and a step of matching the identified change states to corresponding qualitative descriptions 340. The method also comprises a step of providing a monitoring report 350 comprising qualitative descriptions of the identified changes.
[0053]
[0054] The method for monitoring the anatomical changes in the subject is preceded by the steps of obtaining first anatomical image data 301 and subsequent anatomical data 302. The method is also preceded by determining a treatment plan of the subject comprising dose distribution data 401.
[0055] The method for monitoring anatomical changes in a subject in radiation therapy 400 according to the invention comprises a step of receiving data 410. This step of receiving data 410 comprises receiving first anatomical image data and subsequent anatomical image data of the subject, and further comprises receiving dose distribution data of the treatment plan of the subject.
[0056] The method then comprises a step of analyzing the data 420 that has been received. This step of analyzing the data comprises registering the subsequent anatomical data to the first anatomical data 421. In the exemplary embodiment shown in
[0057] The method further comprises a step of identifying changes in the received data as change states 430. Changes are identified between the first anatomical image data and the subsequent anatomical image data 431, and are additionally or alternatively identified between the dose distribution data and subsequent anatomical image data 432. In both steps, either the first anatomical image data or the dose distribution data and the subsequent anatomical image data are preferably supplied to one or more spatial reasoning algorithms.
[0058] The monitoring method of the exemplary embodiment of
[0059] At step 440 of the method, quantitative data obtained from the analysis as well as the identified change states, and the identified risk factor are collected and combined. The identified changes are matched to corresponding descriptions. This step comprises matching the identified changes states to corresponding qualitative descriptions 441. The qualitative descriptions can be supplemented with quantitative data 442, where applicable, as well as the identified risk factor 443. Preferably, quantitative data is used to supplement qualitative natural language descriptions of identified changes, for example “the tumor TS has shrunk by 10%”, or “organ OAR has shifted left by 5mm into the high-dose region”. The risk factor determined at 426 can also be indicated separately, for example as “high”, “medium”, or “low”, but can preferably also added to a pictographic qualitative description in the form of a color coding, such as red for high, yellow for medium and green for low. Quantitative data can also be used to supplement pictographic information, for example to illustrate the relative size of the elements of the pictogram.
[0060] At step 444 the data that has been collected and combined is further used to identify if the current patient status requires review and follow-up by a physician. For example, if the TS has shifted substantially outside the high dose area of the treatment plan, it may be necessary to revise the treatment plan. In another example, an OAR may have shrunk to an extent that requires additional measures to stabilize the patient and/or reduce adverse side effects of the treatment.
[0061] The method also comprises a step of providing a monitoring report 450 comprising qualitative descriptions of the identified changes. In this embodiment quantitative information is also included in the report as well as any follow-up that have been identified at 444 in order to alert the physician to review.
[0062]
[0063] The pictographic report shows change states determined using RCC-8 calculus. The PTV is represented in each pictogram as circle with a dotted contour and each ROI is represented by a circle with a solid contour. Quantitative data has been added in the form of relative size and distance. The pictograms have been further enhanced by a risk indicator in the form of shading. An ROI with low risk has no shading, an ROI with a medium risk hatched shading, and a high risk ROI has solid shading. Alternatively, the colors green, orange and red could be used as a “traffic light” indication of risk. This color scheme is well-known and easily recognizable.
[0064] The pictographic report of
[0065] In the example of
[0066]
[0067] In the example of
[0068] The anatomical changes in this example GUI have been analyzed and reported with respect to both the initial image data used for therapy planning and the dose distribution in the treatment plan. The GUI has a view selector in the form of drop down menu 611 that allows the user to choose between the report of the comparison of the subsequent anatomical image data with the dose distribution data, shown as ROI-PTV in
[0069] In addition to the example of drop down menu 611, the GUI 600 of
[0070] Additional view 620 shows the natural language description 621 of the change state supplemented with additional quantitative information, which, for this example, is “GTV increased by 15% and shifted to the right by 5.” This provides an easy and consistent understanding of what is shown visually by the pictogram. The natural language description can be used by the physician or clinician in explaining the pictographic report to a patient or co-worker. Additional view 620 also provides further access to more detailed information. In this example access is provided through three controls in the form of three buttons 622, 623 and 624, but more or less buttons are also possible as well as alternative access options such as a drop-down menu.
[0071] Button 622 is a “show image” button, configured to open an additional view that shows the subsequent image of the subject. Preferably, the image also shows the anatomical image data in the form of the OAR and TS contours. A particularly advantageous option for this view is to show the subsequent image with its subsequent anatomical image data side by side with the first, planning image with the first anatomical image data. This will allow visual inspection and comparison by the user in case this is desired.
[0072] Button 623 is a “dose report” button, configured to open an additional view that shows a dose report. The dose report can be shown in the from of an image, a table, or dose volume histograms. The dose report can also be interactive to allow the user to explore and view multiple forms of dose information.
[0073] Button 624 is a “change report” button, configured to open an additional view 630 that shows a change report. The change report provides additional quatitative data on the changes in the subsequent anatomical image data. In the example shown in
[0074] Any of the method steps disclosed herein, may be recorded in the form of a computer program comprising instructions which when executed on a processor cause the processor to carry out such method steps. The instructions may be stored on a computer program product. The computer program product may be provided by dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared. Furthermore, embodiments of the present invention can take the form of a computer program product accessible from a computer-usable or computer-readable storage medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer readable storage medium can be any apparatus that may include, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or apparatus or device, or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory “RAM”, a read-only memory “ROM”, a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk—read only memory “CD-ROM”, compact disk—read/write “CD-R/W”, Blu-Ray™ and DVD. Examples of a propagation medium are the Internet or other wired or wireless telecommunication systems.
[0075] Variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. It is noted that the various embodiments may be combined to achieve further advantageous effects.
[0076] In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality.
[0077] A single unit or device may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
[0078] Any reference signs in the claims should not be construed as limiting the scope.