METHOD AND SYSTEM FOR VISUALIZING A PROPERTY OF CARTILAGE
20220133217 · 2022-05-05
Assignee
Inventors
Cpc classification
A61B2576/02
HUMAN NECESSITIES
A61B5/004
HUMAN NECESSITIES
G01R33/5608
PHYSICS
G01R33/50
PHYSICS
A61B5/055
HUMAN NECESSITIES
A61B5/1075
HUMAN NECESSITIES
International classification
A61B5/00
HUMAN NECESSITIES
A61B5/055
HUMAN NECESSITIES
Abstract
A method of visualizing a property of cartilage, comprising: generating, by a processing circuit, a plurality of slices, based on a magnetic resonance, MR, sequence of a portion comprising cartilage, wherein each slice represents a layer of the portion; for each slice, generating, by the processing circuit, a cartilage line representing cartilage of the slice; for the cartilage line of each slice, generating, by the processing circuit, an image column for visualizing a cartilage property of the cartilage of the slice; and generating, by the processing circuit, a two-dimensional, 2D, image for visualizing the cartilage property of the cartilage of the portion, based on the generated image columns.
Claims
1. A method of visualizing a property of cartilage, comprising: generating, by a processing circuit, a plurality of slices, based on a magnetic resonance, MR, sequence of a portion comprising cartilage, wherein each slice represents a layer of the portion; for each slice, generating, by the processing circuit, a cartilage line representing cartilage of the slice; for the cartilage line of each slice, generating, by the processing circuit, an image column for visualizing a cartilage property of the cartilage of the slice; and generating, by the processing circuit, a two-dimensional, 2D, image for visualizing the cartilage property of the cartilage of the portion, based on the generated image columns.
2. The method of claim 1, further comprising: prior to the step of generating a cartilage line, segmenting, by the processing circuit, the cartilage for generating a cartilage surface representing the cartilage of the portion; wherein for each slice, the cartilage line is an intersection line of the slice and the cartilage surface.
3. The method of claim 1, wherein the step of generating a cartilage line comprises: for each slice, segmenting, by the processing circuit, cartilage for generating the cartilage line.
4. The method of claim 1, wherein the step of generating an image column comprises: for each cartilage point of the cartilage line, determining, by the processing circuit, a cartilage property value; generating the image column comprising a column of pixels, each pixel corresponding to a cartilage point of the cartilage line in order; assigning a property value for each pixel according to a cartilage property value of its corresponding cartilage point.
5. The method of claim 4, wherein the pixels having different property values are displayed differently, e.g., in different colors or different intensities.
6. The method of claim 1, wherein the step of generating the 2D image comprises: arranging the image columns side by side in order, such that center pixels of all the image columns are aligned; wherein a center pixel corresponds to a center of any of: the portion, a slice, a cartilage line, and a cartilage surface representing the cartilage of the portion.
7. The method of claim 1, wherein the cartilage property is a thickness of a cartilage.
8. The method of claim 1, wherein the cartilage property is a signal intensity of a cartilage.
9. The method of claim 1, further comprising: acquiring, by an MR scanning device, the MR sequence of the portion.
10. The method of claim 1, wherein the MR sequence of the portion comprises quantification information of the portion; wherein the quantification information of the portion comprises at least one of: a longitudinal relaxation rate R1, a transverse relaxation rate R2, a longitudinal relaxation time T1, a transverse relaxation time T2, and a Proton Density, PD.
11. The method of claim 10, wherein the cartilage property comprises at least one of: a longitudinal relaxation rate R1, a transverse relaxation rate R2, a longitudinal relaxation time T1, a transverse relaxation time T2, and a Proton Density, PD.
12. The method of claim 1, further comprising: displaying, by a user interface, the 2D image for visualizing the cartilage property of the cartilage of the portion.
13. The method of claim 12, further comprising: generating, by the processing circuit, an anatomical image comprising a plurality of anatomical slice images, based on the MR sequence of the portion, or based on a different MR sequence of the portion, wherein each anatomical slice image represents a layer of the portion corresponding to one of the plurality of slices; and displaying, by the user interface, at least one of the plurality of anatomical slice images.
14. The method of claim 13, wherein the at least one of the plurality of anatomical slice images is displayed as seen from at least two different viewpoints.
15. The method of claim 13, further comprising: when an image column of the 2D image is selected, marking, by the processing circuit, a corresponding anatomy slice image; and/or when an anatomy slice image is selected, marking, by the processing circuit, a corresponding image column of the 2D image.
16. The method of claim 13, wherein at least a part of the 2D image and at least a part of the anatomical image are displayed simultaneously.
17. The method of claim 1, further comprising: generating, by the processing circuit, an indicator for indicating a size and/or a position of a part of the 2D image related to an anatomical image representing at least a part of the portion.
18. The method of claim 17, wherein the indicator has a length for indicating the size of the part of the 2D image, and/or for indicating a distance of the part of the 2D image from a center of the portion; and/or wherein the indicator indicates a center of the portion for indicating the position of the part of the 2D image.
19. The method of claim 1, further comprising: dividing the 2D image into a plurality of regions, and calculating a value representing the cartilage property of at least one of the plurality of regions.
20. The method of claim 1, wherein the portion comprises a joint.
21. A system for visualizing a property of cartilage, comprising a processing circuit configured to: generate a plurality of slices, based on a magnetic resonance, MR, sequence of a portion comprising a cartilage, wherein each slice represents a layer of the portion; for each slice, generate a cartilage line representing cartilage of the slice; for the cartilage line of each slice, generate an image column for visualizing a cartilage property of the cartilage of the slice; and generate a two-dimensional, 2D, image for visualizing the cartilage property of the cartilage of the portion, based on the generated image columns.
22. The system of claim 21, further comprising: a user interface configured to display images.
23. A non-transitory computer readable recording medium having computer readable program code recorded thereon which when executed on a device having processing capability is configured to perform the method of claim 1.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0087]
[0088]
[0089]
[0090]
[0091]
[0092]
[0093]
DESCRIPTION OF EMBODIMENTS
[0094] The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which currently preferred embodiments of the invention are shown.
[0095] In connection with
[0096] The processing circuit 3 is configured to carry out overall control of functions and operations of the system 1. The processing circuit 3 may include a processor, such as a central processing unit (CPU), microcontroller, or microprocessor. The dynamic MRA system 1 may comprise a memory. The processing circuit 3 may be configured to execute program codes stored in the memory, in order to carry out functions and operations of the system 1.
[0097] The memory may be one or more of a buffer, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory, a random access memory (RAM), or another suitable device. In a typical arrangement, the memory may include a non-volatile memory for long term data storage and a volatile memory that functions as system memory for the system 1. The memory may exchange data with the processing circuit over a data bus. Accompanying control lines and an address bus between the memory and the processing circuit also may be present.
[0098] Functions and operations of the system 1 may be embodied in the form of executable logic routines (e.g., lines of code, software programs, etc.) that are stored on a non-transitory computer readable medium (e.g., the memory) of the system 1 and are executed by the processing circuit 3. Furthermore, the functions and operations of the system 1 may be a stand-alone software application or form a part of a software application that carries out additional tasks related to the system 1. The described functions and operations may be considered a method that the corresponding device is configured to carry out. Also, while the described functions and operations may be implemented in software, such functionality may as well be carried out via dedicated hardware or firmware, or some combination of hardware, firmware and/or software.
[0099] The system 1 may comprise an MR scanning device 2. The MR scanning device 2 may be configured to acquire an MR sequence of a portion comprising a cartilage. A plurality of slices may be generated based on the MR sequence of the portion, wherein each slice represents a layer of the portion.
[0100] The system 1 may comprise a user interface 4. The user interface 4 may be configured to output data and information, e.g., the 2D image for visualizing the cartilage property of the cartilage of the portion, the anatomical image, and/or a value representing the cartilage property of one region of the 2D image. The user interface 4 may be configured to receive data and information, such as a command, from one or several input devices. The input device may be a computer mouse, a keyboard, a track ball, a touch screen, or any other input device. The user interface 4 may send the received data and information to the processing circuit 3 for further processing.
[0101] In connection with
[0102]
[0103] The cartilage line may represent a highest probability of cartilage of this layer of the portion. The cartilage line may be generated by segmenting cartilage for this slice, e.g., by an algorithm.
[0104] Alternatively, a cartilage surface representing a highest probability of cartilage of the portion may be firstly generated, e.g., by an algorithm. Then, the cartilage line of this slice may be an intersection line of the slice, as a plane, and the cartilage surface. That is, two cartilage surfaces respectively representing the cartilage around the femur and the tibia may be firstly generated. Then, two intersection lines of the slice, as a plane, cutting through these two cartilage surfaces may be considered as the two cartilage lines for this slice.
[0105] In
[0106] The length of the indicator may be determined to be a fixed value, e.g., 1 cm. The length of the indicator may be determined relatively to the imaged portion. For example, the length of the indicator in
[0107] A sagittal plane, also known as a longitudinal plane, is an anatomical plane which divides the body or a portion of the body into right and left parts. For example, the sagittal plane may be in the center of the body and split it into two equal halves, or away from the midline and split it into two unequal parts (para-sagittal).
[0108]
[0109] In connection with
[0110]
[0111] The cartilage thickness of the upper cartilage line around the femur in
[0112] Each of the cartilage lines of
[0113] For example, each cartilage point of the upper cartilage line of
[0114] In
[0115] In other words, one cartilage line may be sampled to a plurality of cartilage points. Then the cartilage property, e.g., a cartilage thickness, of the plurality of cartilage points may be visualized by the appearance of an image column of the 2D image.
[0116] The pixels of an image column of the 2D image may be arranged according to the order of the cartilage points of the cartilage line. That is, the first cartilage point of the cartilage line may be represented by the first pixel of the column, the second cartilage point of the cartilage line may be represented by the second pixel of the column, etc.
[0117] The same procedure can be repeated for all the slices (not shown), such that cartilages lines are also generated for other slices and the corresponding image columns for these cartilage lines can be generated in order to generate the 2D image.
[0118] The image columns may be arranged side by side in an order according to the slices such that the first slice may be represented by the first image column of the 2D image, the second slice may be represented by the second image column of the 2D image, etc.
[0119] A center pixel of each image column can be identified. The center pixels of all the image columns already arranged in order may be aligned to generate the 2D image comprising the image columns. That is, all the image columns are aligned in their center pixels such that the 2D image has a center row comprising the center pixels.
[0120] The center pixel may correspond to any of: a center of the portion, a center of a slice, a center of a cartilage line, and a center of a cartilage surface representing the cartilage of the portion. For example, the center pixel may correspond to a cartilage point coinciding with any of the centers, or the center pixel may correspond to a cartilage point being closest to any of the centers.
[0121] Thus, the 2D images of
[0122] Even though the geometrical distortion does exist, since the resulted 2D image is at least correctly positioned at the center row, it can still provide valuable information about the relative position and relative size of a region of interest identified in the resulted 2D image.
[0123] The indicator in
[0124] For example, in
[0125] Another example of cartilage property is a signal intensity. The term “intensity”, also known as “signal intensity”, in the field of MR refers to a shade of grey of a tissue or of a voxel representing the tissue in an MRI image. Generally, a high intensity means it would look “white” in the MRI image, an intermediate intensity means it would look “grey” in the MRI image, and a low intensity means it would look “black” in the MRI image.
[0126] It is known that the acquired MR sequence has already defined the characteristics of different tissues, including the cartilage, in terms of signal behaviors of the plurality of images, e.g., signal intensities in the images. Thus, the cartilage property can also be the signal intensity of the cartilage of a portion.
[0127] For visualizing the cartilage properties, such as cartilage thickness and signal intensity, the MR sequence does not need to comprise any quantification information of the portion.
[0128] In connection with
[0129]
[0130] The MR sequence may comprise quantification information of the portion. The quantification information of the portion may comprise at least one of: a longitudinal relaxation rate R1, a transverse relaxation rate R2, a longitudinal relaxation time T1, a transverse relaxation time T2, and a Proton Density, PD. The longitudinal relaxation rate R1 is an inversion of the longitudinal relaxation time T1. The transverse relaxation rate R2 is an inverse of the transverse relaxation time T2.
[0131] The cartilage property may be any of: a longitudinal relaxation rate R1, a transverse relaxation rate R2, a longitudinal relaxation time T1, a transverse relaxation time T2, and a Proton Density, PD.
[0132] The quantification value for each voxel, including the R1, R2, T1, T2 and PD, may be measured in different known ways, based on the MR sequence comprising quantification information. For example, the R1 and R2 values may be calculated by generating R1 and R2 maps, respectively. When the quantification values comprise additional parameters, e.g., a PD value, additional maps, e.g., a PD map, may be generated. The R1, R2 and PD maps describe the signal behavior of the slices resulted from the MR sequence.
[0133] These quantification values of the voxel may be used to determine the tissues of the tiny volume represented by the voxel. That is, it is possible to tell whether a voxel represents cartilage, muscles or bones, based on the quantification values of this voxel. A common way is to generate R1, R2 or PD weighted MRI images.
[0134]
[0135]
[0136]
[0137] In
[0138] In
[0139] The indicator in
[0140] In connection with
[0141]
[0142] One region of the 2D image of
[0143] An anatomical image of the portion may be generated based on the MR sequence of the portion, or based on a different MR sequence of the portion. The anatomical image of the portion may comprise a plurality of anatomical slice images, each representing a layer of the portion corresponding to one of the plurality of slices.
[0144] The 2D image for visualizing the cartilage property and the anatomical image may be visualized, e.g., side-by-side, on a same display or different displays. This may assist a user in correlating the 2D image visualizing a single cartilage property to the anatomy image.
[0145] When one area, e.g., a part of an image column, of the 2D image of
[0146] The corresponding slice may be a slice corresponding to a center column of the ROI. The anatomical slice image corresponding to this corresponding slice can be displayed, correspondingly to the ROI. If there are a few anatomical slice images being displayed simultaneously, this anatomical slice image may be marked such that it appears differently from other displayed anatomical slice images.
[0147] The MR sequence of the portion may comprise 3D information of the portion, e.g., the MR acquisition may be a 3D acquisition. Then, any anatomical image, and/or any anatomical slice images may be displayed as seen from different viewpoints/directions, in order to provide different views of the same imaged portion/slice as seen from various directions.
[0148]
[0149] Different ROIs may be selected, e.g., by the user, in the 2D image. The corresponding anatomical slice image may be displayed simultaneously with the 2D image for facilitating diagnosing.
[0150] Alternatively or in combination, when an anatomy slice image is selected, an image column of the 2D image corresponding to the selected anatomy slice image is known. The corresponding image column of the 2D image may be displayed. Since normally the displayed 2D image comprising more than one image column, this corresponding image column may be marked such that it appears differently from other image columns.
[0151] A selection marker, e.g., a dotted line, may be generated for marking the image column of the displayed 2D image corresponding to the selected anatomical slice image, which is currently displayed. When scrolling through the plurality of anatomical slice images, the selection marker may shift accordingly to indicate the current corresponding image column.
[0152] The selection of an anatomical slice image and of an image column of the 2D image, can be done by know way, e.g., by the user clicking on a desired position on a touch screen, or by the user dragging the selection marker to a desired position.
[0153] In connection with
[0154] The value representing the cartilage property of a region of the 2D image may be calculated based on the cartilage property values of the cartilage points corresponding to the pixels of the region. The value may be calculated by averaging the cartilage property values of the cartilage points corresponding to the pixels of the region.
[0155] The value may be determined to be a largest, a least or a median of the cartilage property values of the cartilage points corresponding to the pixels of the region.
[0156] Alternatively or in combination, the value may be calculated based on the cartilage property values of a selected group of the cartilage points represented by the pixels of the region.
[0157] For example, the 2D image visualizing the cartilage thickness around the femur of the portion may be divided into 6 regions around the indicator, e.g., left upper region, left middle region, left lower region, right upper region, right middle region, and right lower region. A mean value of the cartilage property, e.g., cartilage thickness, may be calculated for each region. The six numerical values respectively representing these six regions may visualize the cartilage thickness of cartilage of the portion. The number of regions used here is only an example. That is, the 2D image can be divided into any number of regions.
[0158]
[0159] The 2D image visualizing the cartilage thickness of
[0160] Thus, the cartilage property of a region of the 2D image can be represented by merely one value, instead of a region of the 2D image, which can further simplify the visualization of the cartilage property. Consequently, a set of values representing the cartilage property of different regions of the 2D image can be used to visualize the cartilage property of the whole imaged portion.
[0161] For example, the set of values can be used to compare a patient's left and right joint for a quick analysis. It can also be used to compare between a patient group and its healthy peers. The set of values may change over time and from scan to scan, which can be used to monitor disease development and/or recovery of a patient.
[0162] The values of the different regions may be displayed in a table, e.g., for recording and/or reporting.
[0163] The imaged portion used in the examples comprises a knee. However, the imaged portion may comprise different joints of a human or an animal, which is constructed to allow for different degrees and types of movement, e.g., an elbow and a shoulder. The imaged portion may also comprise cartilage not attached to closed to any joint.