METHOD FOR DETERMINING A DIAGNOSTICALLY RELEVANT SECTIONAL PLANE
20230086229 · 2023-03-23
Assignee
Inventors
Cpc classification
G01R33/543
PHYSICS
G01R33/5608
PHYSICS
A61B5/055
HUMAN NECESSITIES
International classification
Abstract
A computer-implemented method for determining an orientation of at least one diagnostically relevant sectional plane for heart imaging in a three-dimensional magnetic resonance imaging image dataset, comprises: providing the three-dimensional image dataset; applying a trained function to the three-dimensional image dataset to determine a position of at least one landmark; determining the orientation of the at least one diagnostically relevant sectional plane as a function of at least one landmark; and providing the orientation of the at least one diagnostically relevant sectional plane.
Claims
1. A computer-implemented method for determining an orientation of at least one diagnostically relevant sectional plane for heart imaging in a three-dimensional magnetic resonance imaging image dataset, the computer-implemented method comprising: providing the three-dimensional magnetic resonance imaging image dataset; applying a trained function to the three-dimensional magnetic resonance imaging image dataset to determine a position of at least one landmark; determining the orientation of the at least one diagnostically relevant sectional plane as a function of the at least one landmark; and providing the orientation of the at least one diagnostically relevant sectional plane.
2. The computer-implemented method as claimed in claim 1, wherein the three-dimensional magnetic resonance imaging image dataset maps at least one part of a heart, and wherein the three-dimensional magnetic resonance imaging image dataset is an overview scan of the at least one part of the heart.
3. The computer-implemented method as claimed in claim 2, wherein the at least one landmark is one of an apex, a mitral valve, an aortic valve, a pulmonary valve, or a tricuspid valve.
4. The computer-implemented method as claimed in claim 2, wherein the at least one diagnostically relevant sectional plane is one of a four chamber plane, a three chamber plane, a two chamber plane, a vertical long axis, a horizontal long axis, or a short axis.
5. The computer-implemented method as claimed in claim 1, wherein the applying of the trained function comprises: determining the position of the at least one landmark in the three-dimensional magnetic resonance imaging image dataset in the form of a probability distribution for the position of the at least one landmark.
6. The computer-implemented method as claimed in claim 1, wherein the providing of the orientation of the at least one diagnostically relevant sectional plane comprises: providing at least one first scanning parameter value for controlling a magnetic resonance imaging system for recording a two-dimensional sectional image of the at least one diagnostically relevant sectional plane.
7. The computer-implemented method as claimed in claim 6, wherein the at least one first scanning parameter value is derived from the orientation of the at least one diagnostically relevant sectional plane.
8. The computer-implemented method as claimed in claim 6, further comprising: recording the two-dimensional sectional image with the magnetic resonance imaging system as a function of the at least one first scanning parameter value; and providing the two-dimensional sectional image.
9. The computer-implemented method as claimed in claim 1, further comprising: determining an extent of a three-dimensional volume image perpendicular to the at least one diagnostically relevant sectional plane, wherein the three-dimensional volume image is spanned by the diagnostically relevant sectional plane and the extent; providing at least one scanning parameter value for controlling a magnetic resonance imaging system for recording the three-dimensional volume image, wherein the at least one scanning parameter value is derived from the orientation of the at least one diagnostically relevant sectional plane and the extent; recording the three-dimensional volume image with the magnetic resonance imaging system as a function of the at least one scanning parameter value; and providing the three-dimensional volume image.
10. The computer-implemented method as claimed in claim 1, wherein the trained function is based on at least one of a neural convolutional network or a U-Network.
11. A computer-implemented method for providing a trained function for determining a position of at least one landmark in a three-dimensional magnetic resonance imaging image dataset, the computer-implemented method comprising: receiving at least one three-dimensional training image dataset; receiving at least one annotated three-dimensional training image dataset, wherein the at least one annotated three-dimensional training image dataset is based on the at least one three-dimensional training image dataset, and wherein the position of the at least one landmark is annotated in the at least one annotated three-dimensional training image dataset; training a function as a function of the at least one three-dimensional training image dataset and the at least one annotated three-dimensional training image dataset; and providing the trained function.
12. The computer-implemented method as claimed in claim 11, further comprising: manually annotating the at least one three-dimensional training image dataset to create the at least one annotated three-dimensional training image dataset.
13. A determining system to determine an orientation of at least one diagnostically relevant sectional plane for heart imaging in a three-dimensional magnetic resonance imaging image dataset, the determining system comprising: an interface configured to provide the three-dimensional magnetic resonance imaging image dataset, and provide an orientation of the at least one diagnostically relevant sectional plane; and at least one processor configured to apply a trained function to the three-dimensional magnetic resonance imaging image dataset to determine a position of at least one landmark, and determine the orientation of the at least one diagnostically relevant sectional plane as a function of at least one landmark.
14. A magnetic resonance imaging system comprising: the determining system as claimed in claim 13, wherein the magnetic resonance imaging system is configured to acquire at least one of the three-dimensional magnetic resonance imaging image dataset or a two-dimensional sectional image.
15. A non-transitory computer program product including a computer program, which is loadable into a memory of a determining system, the computer program including program segments that, when executed by the determining system, cause the determining system to perform the computer-implemented method as claimed in claim 1.
16. A non-transitory computer-readable storage medium storing program segments that, when executed by a determining system, cause the determining system to perform the computer-implemented method of claim 1.
17. The computer-implemented method as claimed in claim 2, wherein the applying of the trained function comprises: determining the position of the at least one landmark in the three-dimensional magnetic resonance imaging image dataset in the form of a probability distribution for the position of the at least one landmark.
18. The computer-implemented method as claimed in claim 7, further comprising: recording the two-dimensional sectional image with the magnetic resonance imaging system as a function of the at least one first scanning parameter value; and providing the two-dimensional sectional image.
19. The computer-implemented method as claimed in claim 5, further comprising: determining an extent of a three-dimensional volume image perpendicular to the at least one diagnostically relevant sectional plane, wherein the three-dimensional volume image is spanned by the diagnostically relevant sectional plane and the extent; providing at least one scanning parameter value for controlling a magnetic resonance imaging system for recording the three-dimensional volume image, wherein the at least one scanning parameter value is derived from the orientation of the at least one diagnostically relevant sectional plane and the extent; recording the three-dimensional volume image with the magnetic resonance imaging system as a function of the at least one scanning parameter value; and providing the three-dimensional volume image.
20. The computer-implemented method as claimed in claim 9, wherein the trained function is based on at least one of a neural convolutional network or a U-Network.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0142] The above-described properties, features and advantages of the present invention will become clearer and more comprehensible in connection with the following figures and their descriptions. The figures and descriptions are not intended to limit the present invention and its embodiments in any way.
[0143] Identical components are provided with corresponding reference numerals in different figures. As a rule, the figures are not to scale.
[0144] In the drawings:
[0145]
[0146]
[0147]
[0148]
[0149]
[0150]
[0151]
[0152]
DETAILED DESCRIPTION
[0153]
[0154] The three-dimensional magnetic resonance imaging (acronym: MRI) image dataset or three-dimensional image dataset comprises a three-dimensional representation of at least one part of an examination object. The examination object is a person, in particular a patient, or an animal. In particular, the represented part of the examination object comprises the heart or at least one part of the heart of the examination object. In other words, the three-dimensional image dataset comprises a three-dimensional representation of at least one part of the heart of the examination object.
[0155] The three-dimensional image dataset comprises a plurality of voxels, which are arranged in a three-dimensional voxel matrix. Each Voxel comprises a voxel value.
[0156] In embodiments of the present invention, the three-dimensional image dataset can comprise an overview scan of at least the part of the heart. The overview scan can have been recorded with an MRI system described in
[0157] In embodiments of the present invention, the three-dimensional image dataset can comprise a two-dimensional multi-slice scan. The two-dimensional multi-slice scan comprises a plurality of two-dimensional sectional images or slice images of the heart or of the part of the heart. The plurality of slice images is oriented in particular parallel among themselves or to each other. These slice images can be arranged spatially behind each other or be “stacked”. A “pseudo” three-dimensional representation of the heart or of the part of the heart is generated in this way. The individual slice images sample the heart or the part of the heart perpendicular to the image plane of the sectional images.
[0158] A sectional plane is a two-dimensional section through the three-dimensional image dataset. The two-dimensional section can be mapped or represented in a sectional image of the sectional plane. The sectional image can be recorded with an MRI system described in
[0159] The orientation of the diagnostically relevant sectional plane describes the orientation relative to the examination object positioned in a scan region of the MRI system or relative to the MRI system.
[0160] In particular, the orientation describes a spatial situation or spatial orientation or angulation of the diagnostically relevant sectional plane in the space. The spatial situation can be described for example by a direction of a normal vector on the diagnostically relevant sectional plane. In embodiments, the orientation can also describe a position of the diagnostically relevant sectional plane relative to the examination object or the MRI system. The position can be specified for example by points, which should lie inside the diagnostically relevant sectional plane. In other words, the orientation can comprise information about the spatial situation and in embodiments of the present invention, about the position of the diagnostically relevant sectional plane.
[0161] In a method step of providing PROV-1, the three-dimensional image dataset is provided in particular by an interface SYS.IF. Providing PROV-1 can comprise retrieving or receiving or recording the three-dimensional image dataset.
[0162] In particular, the three-dimensional image dataset can be recorded with the MRI system. In embodiments, the three-dimensional image dataset can be provided by the MRI system.
[0163] Alternatively, the three-dimensional image dataset can be retrieved or received from a server, in particular from a database on the server. The server can in particular be a local server or a Cloud server. The database can in particular be a picture archiving and communication system (acronym: PACS).
[0164] In a method step of applying APP a trained function, the trained function is applied to the three-dimensional image dataset. In other words, the input data of the trained function comprises the three-dimensional image dataset. A position of at least one landmark is determined in the process.
[0165] The trained function can be based on a neural convolutional network (acronym: CNN) and/or a U-Network (U-net).
[0166] In embodiments of the present invention, in each case the position of more than one landmark can be determined in the three-dimensional image dataset.
[0167] The at least one landmark relates to an anatomy of the heart. The at least one landmark can be for example one of the following landmarks: apex, mitral valve, aortic valve, pulmonary valve, tricuspid valve.
[0168] In embodiments of the present invention, the at least one landmark can be one of the following landmarks:
left ventricular apex (acronym: LV apex)
right ventricular apex (acronym: RV apex)
right ventricle extent (acronym: RV extent)
mitral valve, midpoint (acronym: MV midpoint)
aortic valve, midpoint (acronym: AV midpoint)
tricuspid valve, midpoint (acronym: TV midpoint)
pulmonary valve, midpoint (acronym: PA center point)
aortic arch
descending aorta
four points on the vessel wall of the aortic bulb (anterior, posterior, left, right)
four points on the vessel wall of the pulmonary artery (left, right, superior, inferior) at a suitable point for a flow measurement of the pulmonary artery (pulmonary artery flow plane)
four points on the annulus of the pulmonary valve (left, right, superior, inferior) (pulmonary valve insertion)
four points on the annulus of the mitral valve (septal, lateral, superior, inferior) (mitral valve insertion)
four points on the annulus of the tricuspid valve (septal, lateral, superior, inferior) (tricuspid valve insertion)
right ventricle insertion points (anterior, posterior) on the left ventricle
descending aorta centerline
ascending aorta centerline.
[0169] The position of the at least one landmark can be described by its position in the voxel matrix of the three-dimensional image dataset. In other words, the position can indicate where in the voxel matrix the at least one landmark is mapped.
[0170] In embodiments of the present invention, the position of the at least one landmark can be indicated in the form of a probability distribution (heatmap). A probability can be assigned to each voxel of the voxel matrix of the three-dimensional image dataset, which indicates how probably the at least one landmark is mapped in the corresponding voxel.
[0171] In a method step of determining DET-1 the orientation of the at least one diagnostically relevant sectional plane, the orientation is determined as a function of at least one landmark.
[0172] In other words, the orientation is determined as a function of position of the at least one landmark. In particular, the orientation can be determined as a function of positions of more than one landmark. In particular, the orientation can be determined as a function of a selection of the particular positions of the landmarks. The selection can be predefined or specified for the diagnostically relevant sectional plane. Different selections of landmarks or their positions can be taken into account for different diagnostically relevant sectional planes. In other words, the orientation of different diagnostically relevant sectional planes can depend on different landmarks.
[0173] In particular, a spatial connection between the position of the at least one landmark and the diagnostically relevant sectional plane can be taken into account when determining DET-1 the orientation. In particular, the at least one landmark can lie in the diagnostically relevant sectional plane.
[0174] In particular, the probability distribution can be taken into account when determining DET-1 the orientation of the diagnostically relevant sectional plane. If, for example, three landmarks should lie in the diagnostically relevant sectional plane, the orientation of the diagnostically relevant sectional plane can be determined in such a way that the mean of the probabilities of the regions, through which the diagnostically relevant sectional plane runs, is maximal for all three landmarks.
[0175] In embodiments of the present invention, a prior knowledge in respect of the orientation can also be taken into account when determining DET-1 the orientation. The prior knowledge can take into account for example a known orientation relative to a standard orientation in the MRI system (coronal, sagittal, axial). Alternatively, or in addition, the prior knowledge can take into account a situation of the heart or the like.
[0176] The diagnostically relevant sectional plane can in particular be one of the following sectional planes: four chamber plane, three chamber plane, two chamber plane, vertical long axis, horizontal long axis, short axis.
[0177] A theoretical situation of said sectional planes is described for example in Maier et al., “Kardiale Magnetresonanztomographie—Anatomie and Planung”, Journal for Kardiologie—Austrian Journal of Cardiology 2003; 10: 3-7.
[0178] In embodiments of the present invention, the at least one diagnostically relevant sectional plane can be one of the following sectional planes:
vertical long axis (acronym: VLA)
horizontal long axis (acronym: HLA)
three chamber view (acronym: 3CH)
four chamber view (acronym: 4CH)
short axis (acronym: SAX)
right ventricle two chamber view (acronym: RV-2CH)
right ventricle three chamber view (acronym: RV-3CH)
Aortic Flow Plane
[0179] left ventricular outflow tract plane (acronym: LVOT)
mitral valve plane (acronym: MV Plane).
[0180] The orientation of the sectional planes can be derived from or depend on the landmarks or their positions indicated below in brackets after the sectional planes:
VLA (LV apex, MV midpoint+prior knowledge: parasagittal)
HLA (LV apex, MV midpoint+prior knowledge: orthogonal to VLA)
3CH (LV apex, MV midpoint, AV midpoint)
4CH (LV apex, MV midpoint, RV extent)
SAX (midpoint of LV apex and MV midpoint, RV extent+prior knowledge: orthogonal to VLA and HLA)
RV-2CH (RV apex, TV midpoint+prior knowledge: parasagittal)
RV-3CH (RV apex, TV midpoint, PA center point)
Aortic Flow Plane (Aortic bulb (anterior), Aortic bulb (posterior), Aortic bulb (left), Aortic bulb (right))
LVOT (Aortic bulb (anterior), Aortic bulb (posterior)+prior knowledge: slice in the midpoint of the two landmarks, orthogonal to the connecting vector of the landmarks)
MV Plane (MV insertion (septal), MV insertion (lateral), MV insertion (superior), MV insertion (inferior)).
[0181] In a method step of providing PROV-2 the orientation of the at least one diagnostically relevant sectional plane, the orientation is provided in particular by an interface SYS.IF. In particular, the orientation can be provided in the form of a vector in respect of a coordinate system of the MRI system. Alternatively, the orientation can be provided as the orientation of a magnetic field gradient, which is designed to orient the protons in the diagnostically relevant sectional plane in such a way that they can be excited with an excitation pulse.
[0182]
[0183] The first exemplary embodiment described in respect of
[0184] The at least one first scanning parameter value is designed for controlling a medical-technical MRI system 10 for recording a two-dimensional sectional image of the at least one diagnostically relevant sectional plane.
[0185] In particular, the first scanning parameter value is designed in such a way that a gradient control unit 19 of an MRI system 10 can actuate a gradient coil unit 18 of the MRI system 10 via the first scanning parameter value. The MRI system 10 is illustrated in the description relating to
[0186] In particular, the first scanning parameter value can be designed in such a way that the gradient coil unit 18 generates a magnetic field gradient, which is oriented perpendicular to the diagnostically relevant sectional plane. In other words, the first scanning parameter value can specify a direction of the magnetic field gradient. The magnetic field gradient, together with a homogeneous basic magnetic field, which is generated by a base magnet 16, forms a magnetic field in which the examination object is arranged.
[0187] In particular, the gradient coil unit 18 is actuated with the first scanning parameter value in such a way that the proton spins incorporated by the examination object precess or rotate in the diagnostically relevant sectional plane in a particular Larmor frequency. The Larmor frequency is proportional to a magnetic field strength of the magnetic field. In particular, the first scanning parameter value can thus specify a strength of the magnetic field gradient. In particular, the magnetic field gradient inside the diagnostically relevant sectional plane is constant. In particular, all spins in the diagnostically relevant sectional plane then precess at the same Larmor frequency. In particular, the spins in the diagnostically relevant sectional plane can then be excited with an excitation pulse of exactly this frequency. The signal, which the spins emit in the magnetic field on relaxation, can then be acquired. The two-dimensional sectional image of the diagnostically relevant sectional plane can be reconstructed from this signal. The excited spins are arranged perpendicular to the magnetic field gradient in a slice in the examination object. The slice is arranged in particular in the diagnostically relevant sectional plane.
[0188] In embodiments of the present invention, the first scanning parameter value can specify a “steepness” of the magnetic field gradient. The thickness of the slice of the excited spins perpendicular to the diagnostically relevant sectional plane can be specified by the “steepness” of the magnetic field gradient. The flatter the magnetic field gradient, the more spins precess at least approximately at the frequency of the excitation pulse and are thus excited, the thicker the slice is therefore. The steeper the magnetic field gradient, the fewer spins precess at the frequency of the excitation pulse and the thinner the excited slice is therefore.
[0189] The at least one first scanning parameter value is derived in the method step of providing PROV-3 in particular from the orientation of the diagnostically relevant sectional plane. In particular, the first scanning parameter value is designed in such a way that a magnetic field gradient can be generated by the first scanning parameter value, which excites spins inside the diagnostically relevant sectional plane. In other words, the generated magnetic field gradient is then oriented perpendicular to the diagnostically relevant sectional plane or parallel to a normal vector on the diagnostically relevant sectional plane.
[0190]
[0191] The second exemplary embodiment described in respect of
[0192] In the method step of the recording REC-1 the two-dimensional sectional image, the two-dimensional sectional image is recorded with the MRI system 10 as a function of the first scanning parameter value. The basic principle of the MRI system 10 is illustrated in the description relating to
[0193] The method step of recording REC-1 can comprise in particular a method step of receiving or reading out a signal and a method step of reconstructing the two-dimensional sectional image from the signal.
[0194] The signal can be received in particular on relaxation of the spins in the magnetic field. The signal can be received with an antenna, in particular a coil. The antenna can be a system coil 20 or a local coil 38.
[0195] In the method step of reconstructing, the two-dimensional sectional image is reconstructed on the basis of the received signal. In particular, the reconstruction can be based on a filtered backpropagation.
[0196] In the method step of providing PROV-4 the two-dimensional sectional image, the sectional image is provided in particular by an interface SYS.IF.
[0197] In embodiments of the present invention, a medical operator can be provided with the sectional image. For this the sectional image can be displayed on a display unit, in particular a monitor or a screen.
[0198] Alternatively, or in addition, the two-dimensional sectional image can be stored on a server, in particular in a database. The server can be a local server or a Cloud server. In particular, the database can be a PACS.
[0199]
[0200] The first exemplary embodiment described in respect of
[0201] The three-dimensional volume image is a three-dimensional representation or mapping of the heart or of the part of the heart. The heart in the diagnostically relevant sectional plane is also mapped in the three-dimensional volume image. The size of the three-dimensional volume image is specified or spanned by the diagnostically relevant sectional plane and an extent of the three-dimensional volume image perpendicular to the diagnostically relevant sectional plane. The diagnostically relevant sectional plane can lie at any position of the three-dimensional volume image. In particular, the diagnostically relevant sectional plane can form a side face of the three-dimensional volume image. Alternatively, the diagnostically relevant sectional plane can be arranged for example in the center of the three-dimensional volume image.
[0202] In the method step of determining DET-2 the extent of the three-dimensional volume image, the extent thereof perpendicular to the diagnostically relevant sectional plane is determined. In particular, the extent can be determined in such a way that an anatomy of the heart is mapped in the three-dimensional volume image. In other words, the extent can be determined as a function of an anatomical actuality of the heart. The anatomy or the anatomical actuality can be determined as a function of the three-dimensional image dataset. The anatomical actuality can depend for example on one or more landmark(s). For example, the extent can be designed in such a way that an aortic arch of the heart is mapped in the volume image. The extent can be indicated in particular in a metric unit. For example, the extent can comprise 0.1 cm or 0.5 cm or 1 cm or 2 cm.
[0203] In the method step of providing PROV-5, the at least one second scanning parameter value for controlling the MRI system when recording the three-dimensional volume image is provided. The at least one second scanning parameter value is derived from the orientation of the diagnostically relevant sectional plane and the extent. In particular, the at least one second scanning parameter value is designed in such a way that with it, the MRI system can be actuated in such a way that the third volume image can be recorded. The at least one second scanning parameter value can be designed at least partially as described in respect of the first scanning parameter value in the description relating to
[0204] In the method step of recording REC-2 the three-dimensional volume image, the three-dimensional volume image is recorded with the MRI system. The MRI system is actuated with the at least one second excitation pulse. Recording REC-2 of the three-dimensional volume image can take place analogously to the recording REC-1 of the two-dimensional sectional image described in the description relating to
[0205] In the method step of providing PROV-6 the three-dimensional volume image, the three-dimensional volume image is provided in particular via an interface SYS.IF. In particular, the three-dimensional volume image is displayed to a medical operator. Alternatively, or in addition, the three-dimensional volume image can be stored in a database or on a server. Providing PROV-6 the three-dimensional volume image can take place analogously to providing PROV-4 the two-dimensional sectional image in accordance with the description relating to
[0206]
[0207] The three-dimensional image dataset and the at least one landmark are designed in particular as described above in respect of
[0208] The trained function is designed for application in the method step of applying APP the trained function in accordance with the description relating to
[0209] In other words, the input data of the trained function comprises the three-dimensional image data and the output data the position of the at least one landmark.
[0210] The method for training the trained function will be described below.
[0211] In a method step of receiving TPROV-1 at least one three-dimensional training image dataset, the at least one three-dimensional training image dataset is received via a training interface TSYS.IF. The three-dimensional training image dataset can be designed analogously to the three-dimensional image dataset in accordance with the description relating to
[0212] In particular, a plurality of three-dimensional training image datasets can be received.
[0213] In a method step of receiving TPROV-2 at least one annotated three-dimensional training image dataset, the at least one annotated three-dimensional training image dataset is received by the training interface TSYS.IF. The annotated three-dimensional training image dataset can be received from the server, in particular from the database on the server.
[0214] If a plurality of three-dimensional training image datasets is received in the method step of receiving TPROV-1 at least one three-dimensional training image dataset, at least one annotated three-dimensional training image dataset is received for each of the three-dimensional training image datasets.
[0215] The annotated three-dimensional training image dataset is based on the three-dimensional training image dataset. In particular, the position of the at least one landmark is annotated or marked or drawn or identified in the annotated three-dimensional training image dataset. In other words, the annotated three-dimensional training image dataset comprises the position of the at least one landmark in the three-dimensional training image dataset.
[0216] In particular, the position of the at least one landmark can indicate the voxel in the three-dimensional training image dataset, which maps the at least one landmark. In particular, the annotated three-dimensional training image dataset can then comprise a coordinate of the voxel in the voxel matrix.
[0217] Alternatively, the position of the at least one landmark can indicate one or more region(s) in the three-dimensional training image dataset. A probability, with which the at least one landmark is mapped inside the corresponding region, can be assigned to each region. In particular, the annotated three-dimensional training image dataset can then match a voxel matrix in accordance with the voxel matrix of the three-dimensional training image dataset, which is divided into one or more region(s).
[0218] In particular, the position of more than one landmark can be annotated in the annotated three-dimensional training image dataset. Alternatively, an annotated three-dimensional training image dataset can be received for a three-dimensional training image dataset for each landmark. The position of another landmark can be annotated in each annotated training image dataset.
[0219] In particular, the annotated three-dimensional training image dataset can be manually annotated. In other words, the position of the at least one landmark can be manually drawn or annotated or marked by a medical operator. In particular, the medical operator can mark the voxel, which maps the at least one landmark. Alternatively, the medical operator can draw the region(s) described above as the position of the at least one landmark.
[0220] In a method step of training a function, the function is trained as a function of the three-dimensional training image dataset and as a function of the annotated three-dimensional training image dataset.
[0221] For this the function is applied to the at least one three-dimensional training image dataset. A position of the at least one landmark is determined in the three-dimensional training image dataset. The position determined in such a way is compared with the position in the annotated three-dimensional training image dataset. If the two positions differ from each other the function is adjusted or modified in such a way that on renewed application of the function to the three-dimensional training image dataset, the determined position better matches the position in accordance with the annotated three-dimensional training image dataset. This adjusting describes the training of the function.
[0222] In particular, this method can be repeated for the plurality of three-dimensional training image datasets and the corresponding plurality of annotated three-dimensional training image datasets.
[0223] In particular, the function can be iteratively adjusted further until a termination criterion is attained. The termination criterion can be for example a maximum number of iterations and/or a maximum number of three-dimensional training image datasets and/or an undershooting of a maximum deviation of the determined position and the position in accordance with the annotated three-dimensional training image dataset.
[0224] The function can be trained separately for the different landmarks. Alternatively, the function can be trained for all landmarks at once. In particular, the function can be trained for all landmarks at once if the landmarks are all annotated in an annotated three-dimensional training image dataset.
[0225] In a method step of providing TPROV-3 the trained function, the trained function is provided, in particular via the training interface TSYS-IF. In particular, the trained function is provided for application in the method in accordance with one of
[0226]
[0227] The represented determining system SYS for determining an orientation of at least one diagnostically relevant sectional plane for heart imaging in a three-dimensional MRI image dataset is designed to carry out an inventive method for determining an orientation of at least one diagnostically relevant sectional plane for heart imaging in a three-dimensional MRI image dataset. The represented training system TSYS is designed to carry out an inventive method for providing the trained function for determining a position of at least one landmark in a three-dimensional magnetic resonance imaging image dataset. The determining system SYS comprises an interface SYS.IF, a computing unit SYS.CU and a memory unit SYS.MU. The training system TSYS comprises a training interface TSYS.IF, a training computing unit TSYS.CU and a training memory unit TSYS.MU.
[0228] The determining system SYS and/or the training system TSYS can in particular be a computer, a microcontroller or an integrated circuit (IC). Alternatively, the determining system SYS and/or the training system TSYS can be a real or virtual computer network (a technical name for a real computer network is “Cluster”, a technical name for a virtual computer network is “Cloud”). The determining system SYS and/or the training system TSYS can be designed as a virtual system, which is implemented on a computer or a real computer network or a virtual computer network (a technical name is “virtualization”).
[0229] The interface SYS.IF and/or the training interface TSYS.IF can be a hardware or software interface (for example a PCI bus, USB or Firewire). The computing unit SYS.CU and/or the training computing unit TSYS.CU can comprise hardware and/or software component parts, for example a microprocessor or what is known as an FPGA (Field Programmable Gate Way). The memory unit SYS.MU and/or the training memory unit TSYS.MU can be designed as a Random Access Memory (RAM) or as a permanent mass storage (hard disk, USB stick, SD card, Solid State Disk (SSD)).
[0230] The interface SYS.IF and/or the training interface TSYS.IF can in particular comprise a plurality of sub-interfaces, which carry out different method steps of the respective inventive method. In other words, the interface SYS.IF and/or the training interface TSYS.IF can be designed as a plurality of interfaces SYS.IF and/or training interfaces TSYS.IF. The computing unit SYS.CU and/or the training computing unit TSYS.CU can in particular comprise a plurality of sub-computing units, which carry out different method steps of the respective inventive method. In other words, the computing unit SYS.CU and/or the training computing unit TSYS.CU can be designed as a plurality of computing units SYS.CU and/or training computing units TSYS.CU.
[0231]
[0232] The MRI system 10 is schematically represented. The MRI system 10 comprises a scanner unit 11 formed by a magnetic unit. In addition, the MRI system 10 has a scan region 12 for scanning an examination object 13, in particular a patient. In the present exemplary embodiment, the scan region 12 is cylindrical and cylindrically surrounded in a circumferential direction by the scanner unit 11, in particular by the magnetic unit. Basically, a design of the scan region 12 that differs herefrom is always conceivable, however. The examination object 13 can be pushed and/or moved via a positioning apparatus 14 of the MRI system 10 into the scan region 12. The positioning apparatus 14 has for this purpose a couch 15 configured to move inside the scan region 12. In particular, the couch 15 is mounted to be movable in the direction of a longitudinal extension of the scan region 12 and/or in the z-direction.
[0233] The scanner unit 11, in particular the magnetic unit, comprises a superconducting base magnet 16 for generating a strong and, in particular, constant basic magnetic field 17. Furthermore, the scanner unit 11, in particular the magnetic unit, has a gradient coil unit 18 for generating magnetic field gradients, which are used for spatial encoding during imaging. The gradient coil unit 18 is controlled via a gradient control unit 19 of the MRI system 10. In particular, an orientation of the magnetic field gradient can be controlled with the gradient control unit 19. In particular, the gradient control unit 19 can control the orientation of the magnetic field gradient with a first scanning parameter value. The scanner unit 11, in particular the magnetic unit, also comprises a radio-frequency antenna unit or a system coil 20 for exciting a polarization, which establishes itself in the basic magnetic field 17 generated by the base magnet 16. The system coil 20 is permanently arranged inside the scanner unit 11, in particular the magnetic unit. The system coil 20 is controlled by a system coil control unit 21 of the MRI system 10 and irradiates radio-frequency magnetic resonance sequences into the scan region 12 of the magnetic resonance apparatus 10.
[0234] For acquiring magnetic resonance signals or signals, the MRI system 10 has at least one local radio-frequency coil or local coil 38, which can be positioned around a region to be examined of the examination object 13. A local coil 38 is selected for the pending magnetic resonance examination as a function of the region to be examined of the examination object 13. For example, a local head radio-frequency coil for a head examination or a local knee radio-frequency coil for a knee examination, etc. The local coil 38 comprises at least one above-described coil element. In particular, if the local coil 38 comprises more than one coil element, the coil elements of the local coil 38 can be individually read out or actuated.
[0235] The MRI system 10 has a system control unit 22 for controlling the base magnet 16, the gradient control unit 19 and for controlling the system coil control unit 21. The system control unit 22 centrally controls the MRI system 10, such as carrying out a predetermined imaging gradient echo sequence. In addition, the system control unit 22 comprises an evaluation unit (not represented in more detail) for evaluation of MRI scans or medical image data, which are/is recorded during the magnetic resonance examination.
[0236] Furthermore, the MRI system 10 comprises a user interface 23, which is connected to the system control unit 22. Control information, such as imaging parameters, and reconstructed MRI scans can be displayed for a user or a medical operator on a display unit 24, for example on at least one monitor, of the user interface 23. Furthermore, the user interface 23 has an input unit 25 via which information and/or parameters can be input by the user during a measuring process.
[0237] The scanner unit 11 of the MRI system 10, together with the positioning apparatus 14, is arranged inside an examination room 26. By contrast, the system control unit 22, together with the user interface 23, is arranged inside a control room 27. The control room 27 is separate from the examination room 26. In particular, the examination room 26 is shielded in respect of radio-frequency radiation from the control room 27. During a magnetic resonance examination or recording of an MRI scan, the examination object 13 is located inside the examination room 26, whereas the user is located inside the control room 27.
[0238] The represented MRI system 10 can of course comprise further components, which MRI systems 10 conventionally have. A general mode of operation of the MRI system 10 is known to a person skilled in the art, moreover, so a detailed description of the further components will be omitted.
[0239] It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, components, regions, layers, and/or sections, these elements, components, regions, layers, and/or sections, should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of example embodiments. As used herein, the term “and/or,” includes any and all combinations of one or more of the associated listed items. The phrase “at least one of” has the same meaning as “and/or”.
[0240] Spatially relative terms, such as “beneath,” “below,” “lower,” “under,” “above,” “upper,” and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as “below,” “beneath,” or “under,” other elements or features would then be oriented “above” the other elements or features. Thus, the example terms “below” and “under” may encompass both an orientation of above and below. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly. In addition, when an element is referred to as being “between” two elements, the element may be the only element between the two elements, or one or more other intervening elements may be present.
[0241] Spatial and functional relationships between elements (for example, between modules) are described using various terms, including “on,” “connected,” “engaged,” “interfaced,” and “coupled.” Unless explicitly described as being “direct,” when a relationship between first and second elements is described in the disclosure, that relationship encompasses a direct relationship where no other intervening elements are present between the first and second elements, and also an indirect relationship where one or more intervening elements are present (either spatially or functionally) between the first and second elements. In contrast, when an element is referred to as being “directly” on, connected, engaged, interfaced, or coupled to another element, there are no intervening elements present. Other words used to describe the relationship between elements should be interpreted in a like fashion (e.g., “between,” versus “directly between,” “adjacent,” versus “directly adjacent,” etc.).
[0242] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments. As used herein, the singular forms “a,” “an,” and “the,” are intended to include the plural forms as well, unless the context clearly indicates otherwise. As used herein, the terms “and/or” and “at least one of” include any and all combinations of one or more of the associated listed items. It will be further understood that the terms “comprises,” “comprising,” “includes,” and/or “including,” when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. Expressions such as “at least one of,” when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list. Also, the term “example” is intended to refer to an example or illustration.
[0243] It should also be noted that in some alternative implementations, the functions/acts noted may occur out of the order noted in the figures. For example, two figures shown in succession may in fact be executed substantially concurrently or may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
[0244] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which example embodiments belong. It will be further understood that terms, e.g., those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
[0245] It is noted that some example embodiments may be described with reference to acts and symbolic representations of operations (e.g., in the form of flow charts, flow diagrams, data flow diagrams, structure diagrams, block diagrams, etc.) that may be implemented in conjunction with units and/or devices discussed above. Although discussed in a particularly manner, a function or operation specified in a specific block may be performed differently from the flow specified in a flowchart, flow diagram, etc. For example, functions or operations illustrated as being performed serially in two consecutive blocks may actually be performed simultaneously, or in some cases be performed in reverse order. Although the flowcharts describe the operations as sequential processes, many of the operations may be performed in parallel, concurrently or simultaneously. In addition, the order of operations may be re-arranged. The processes may be terminated when their operations are completed, but may also have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, subprograms, etc.
[0246] Specific structural and functional details disclosed herein are merely representative for purposes of describing example embodiments. The present invention may, however, be embodied in many alternate forms and should not be construed as limited to only the embodiments set forth herein.
[0247] In addition, or alternative, to that discussed above, units and/or devices according to one or more example embodiments may be implemented using hardware, software, and/or a combination thereof. For example, hardware devices may be implemented using processing circuitry such as, but not limited to, a processor, Central Processing Unit (CPU), a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a System-on-Chip (SoC), a programmable logic unit, a microprocessor, or any other device capable of responding to and executing instructions in a defined manner. Portions of the example embodiments and corresponding detailed description may be presented in terms of software, or algorithms and symbolic representations of operation on data bits within a computer memory. These descriptions and representations are the ones by which those of ordinary skill in the art effectively convey the substance of their work to others of ordinary skill in the art. An algorithm, as the term is used here, and as it is used generally, is conceived to be a self-consistent sequence of steps leading to a desired result. The steps are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of optical, electrical, or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
[0248] It should be borne in mind that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise, or as is apparent from the discussion, terms such as “processing” or “computing” or “calculating” or “determining” of “displaying” or the like, refer to the action and processes of a computer system, or similar electronic computing device/hardware, that manipulates and transforms data represented as physical, electronic quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
[0249] In this application, including the definitions below, the term ‘module’ or the term ‘controller’ may be replaced with the term ‘circuit.’ The term ‘module’ may refer to, be part of, or include processor hardware (shared, dedicated, or group) that executes code and memory hardware (shared, dedicated, or group) that stores code executed by the processor hardware.
[0250] The module may include one or more interface circuits. In some examples, the interface circuits may include wired or wireless interfaces that are connected to a local area network (LAN), the Internet, a wide area network (WAN), or combinations thereof. The functionality of any given module of the present disclosure may be distributed among multiple modules that are connected via interface circuits. For example, multiple modules may allow load balancing. In a further example, a server (also known as remote, or cloud) module may accomplish some functionality on behalf of a client module.
[0251] Software may include a computer program, program code, instructions, or some combination thereof, for independently or collectively instructing or configuring a hardware device to operate as desired. The computer program and/or program code may include program or computer-readable instructions, software components, software modules, data files, data structures, and/or the like, capable of being implemented by one or more hardware devices, such as one or more of the hardware devices mentioned above. Examples of program code include both machine code produced by a compiler and higher level program code that is executed using an interpreter.
[0252] For example, when a hardware device is a computer processing device (e.g., a processor, Central Processing Unit (CPU), a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a microprocessor, etc.), the computer processing device may be configured to carry out program code by performing arithmetical, logical, and input/output operations, according to the program code. Once the program code is loaded into a computer processing device, the computer processing device may be programmed to perform the program code, thereby transforming the computer processing device into a special purpose computer processing device. In a more specific example, when the program code is loaded into a processor, the processor becomes programmed to perform the program code and operations corresponding thereto, thereby transforming the processor into a special purpose processor.
[0253] Software and/or data may be embodied permanently or temporarily in any type of machine, component, physical or virtual equipment, or computer storage medium or device, capable of providing instructions or data to, or being interpreted by, a hardware device. The software also may be distributed over network coupled computer systems so that the software is stored and executed in a distributed fashion. In particular, for example, software and data may be stored by one or more computer readable recording mediums, including the tangible or non-transitory computer-readable storage media discussed herein.
[0254] Even further, any of the disclosed methods may be embodied in the form of a program or software. The program or software may be stored on a non-transitory computer readable medium and is adapted to perform any one of the aforementioned methods when run on a computer device (a device including a processor). Thus, the non-transitory, tangible computer readable medium, is adapted to store information and is adapted to interact with a data processing facility or computer device to execute the program of any of the above mentioned embodiments and/or to perform the method of any of the above mentioned embodiments.
[0255] Example embodiments may be described with reference to acts and symbolic representations of operations (e.g., in the form of flow charts, flow diagrams, data flow diagrams, structure diagrams, block diagrams, etc.) that may be implemented in conjunction with units and/or devices discussed in more detail below. Although discussed in a particularly manner, a function or operation specified in a specific block may be performed differently from the flow specified in a flowchart, flow diagram, etc. For example, functions or operations illustrated as being performed serially in two consecutive blocks may actually be performed simultaneously, or in some cases be performed in reverse order.
[0256] According to one or more example embodiments, computer processing devices may be described as including various functional units that perform various operations and/or functions to increase the clarity of the description. However, computer processing devices are not intended to be limited to these functional units. For example, in one or more example embodiments, the various operations and/or functions of the functional units may be performed by other ones of the functional units. Further, the computer processing devices may perform the operations and/or functions of the various functional units without sub-dividing the operations and/or functions of the computer processing units into these various functional units.
[0257] Units and/or devices according to one or more example embodiments may also include one or more storage devices. The one or more storage devices may be tangible or non-transitory computer-readable storage media, such as random access memory (RAM), read only memory (ROM), a permanent mass storage device (such as a disk drive), solid state (e.g., NAND flash) device, and/or any other like data storage mechanism capable of storing and recording data. The one or more storage devices may be configured to store computer programs, program code, instructions, or some combination thereof, for one or more operating systems and/or for implementing the example embodiments described herein. The computer programs, program code, instructions, or some combination thereof, may also be loaded from a separate computer readable storage medium into the one or more storage devices and/or one or more computer processing devices using a drive mechanism. Such separate computer readable storage medium may include a Universal Serial Bus (USB) flash drive, a memory stick, a Blu-ray/DVD/CD-ROM drive, a memory card, and/or other like computer readable storage media. The computer programs, program code, instructions, or some combination thereof, may be loaded into the one or more storage devices and/or the one or more computer processing devices from a remote data storage device via a network interface, rather than via a local computer readable storage medium. Additionally, the computer programs, program code, instructions, or some combination thereof, may be loaded into the one or more storage devices and/or the one or more processors from a remote computing system that is configured to transfer and/or distribute the computer programs, program code, instructions, or some combination thereof, over a network. The remote computing system may transfer and/or distribute the computer programs, program code, instructions, or some combination thereof, via a wired interface, an air interface, and/or any other like medium.
[0258] The one or more hardware devices, the one or more storage devices, and/or the computer programs, program code, instructions, or some combination thereof, may be specially designed and constructed for the purposes of the example embodiments, or they may be known devices that are altered and/or modified for the purposes of example embodiments.
[0259] A hardware device, such as a computer processing device, may run an operating system (OS) and one or more software applications that run on the OS. The computer processing device also may access, store, manipulate, process, and create data in response to execution of the software. For simplicity, one or more example embodiments may be exemplified as a computer processing device or processor; however, one skilled in the art will appreciate that a hardware device may include multiple processing elements or processors and multiple types of processing elements or processors. For example, a hardware device may include multiple processors or a processor and a controller. In addition, other processing configurations are possible, such as parallel processors.
[0260] The computer programs include processor-executable instructions that are stored on at least one non-transitory computer-readable medium (memory). The computer programs may also include or rely on stored data. The computer programs may encompass a basic input/output system (BIOS) that interacts with hardware of the special purpose computer, device drivers that interact with particular devices of the special purpose computer, one or more operating systems, user applications, background services, background applications, etc. As such, the one or more processors may be configured to execute the processor executable instructions.
[0261] The computer programs may include: (i) descriptive text to be parsed, such as HTML (hypertext markup language) or XML (extensible markup language), (ii) assembly code, (iii) object code generated from source code by a compiler, (iv) source code for execution by an interpreter, (v) source code for compilation and execution by a just-in-time compiler, etc. As examples only, source code may be written using syntax from languages including C, C++, C#, Objective-C, Haskell, Go, SQL, R, Lisp, Java®, Fortran, Perl, Pascal, Curl, OCaml, Javascript®, HTML5, Ada, ASP (active server pages), PHP, Scala, Eiffel, Smalltalk, Erlang, Ruby, Flash®, Visual Basic®, Lua, and Python®.
[0262] Further, at least one example embodiment relates to the non-transitory computer-readable storage medium including electronically readable control information (processor executable instructions) stored thereon, configured in such that when the storage medium is used in a controller of a device, at least one embodiment of the method may be carried out.
[0263] The computer readable medium or storage medium may be a built-in medium installed inside a computer device main body or a removable medium arranged so that it can be separated from the computer device main body. The term computer-readable medium, as used herein, does not encompass transitory electrical or electromagnetic signals propagating through a medium (such as on a carrier wave); the term computer-readable medium is therefore considered tangible and non-transitory. Non-limiting examples of the non-transitory computer-readable medium include, but are not limited to, rewriteable non-volatile memory devices (including, for example flash memory devices, erasable programmable read-only memory devices, or a mask read-only memory devices); volatile memory devices (including, for example static random access memory devices or a dynamic random access memory devices); magnetic storage media (including, for example an analog or digital magnetic tape or a hard disk drive); and optical storage media (including, for example a CD, a DVD, or a Blu-ray Disc). Examples of the media with a built-in rewriteable non-volatile memory, include but are not limited to memory cards; and media with a built-in ROM, including but not limited to ROM cassettes; etc. Furthermore, various information regarding stored images, for example, property information, may be stored in any other form, or it may be provided in other ways.
[0264] The term code, as used above, may include software, firmware, and/or microcode, and may refer to programs, routines, functions, classes, data structures, and/or objects. Shared processor hardware encompasses a single microprocessor that executes some or all code from multiple modules. Group processor hardware encompasses a microprocessor that, in combination with additional microprocessors, executes some or all code from one or more modules. References to multiple microprocessors encompass multiple microprocessors on discrete dies, multiple microprocessors on a single die, multiple cores of a single microprocessor, multiple threads of a single microprocessor, or a combination of the above.
[0265] Shared memory hardware encompasses a single memory device that stores some or all code from multiple modules. Group memory hardware encompasses a memory device that, in combination with other memory devices, stores some or all code from one or more modules.
[0266] The term memory hardware is a subset of the term computer-readable medium. The term computer-readable medium, as used herein, does not encompass transitory electrical or electromagnetic signals propagating through a medium (such as on a carrier wave); the term computer-readable medium is therefore considered tangible and non-transitory. Non-limiting examples of the non-transitory computer-readable medium include, but are not limited to, rewriteable non-volatile memory devices (including, for example flash memory devices, erasable programmable read-only memory devices, or a mask read-only memory devices); volatile memory devices (including, for example static random access memory devices or a dynamic random access memory devices); magnetic storage media (including, for example an analog or digital magnetic tape or a hard disk drive); and optical storage media (including, for example a CD, a DVD, or a Blu-ray Disc). Examples of the media with a built-in rewriteable non-volatile memory, include but are not limited to memory cards; and media with a built-in ROM, including but not limited to ROM cassettes; etc. Furthermore, various information regarding stored images, for example, property information, may be stored in any other form, or it may be provided in other ways.
[0267] The apparatuses and methods described in this application may be partially or fully implemented by a special purpose computer created by configuring a general purpose computer to execute one or more particular functions embodied in computer programs. The functional blocks and flowchart elements described above serve as software specifications, which can be translated into the computer programs by the routine work of a skilled technician or programmer.
[0268] Although described with reference to specific examples and drawings, modifications, additions and substitutions of example embodiments may be variously made according to the description by those of ordinary skill in the art. For example, the described techniques may be performed in an order different with that of the methods described, and/or components such as the described system, architecture, devices, circuit, and the like, may be connected or combined to be different from the above-described methods, or results may be appropriately achieved by other components or equivalents.
[0269] Although the present invention has been shown and described with respect to certain example embodiments, equivalents and modifications will occur to others skilled in the art upon the reading and understanding of the specification. The present invention includes all such equivalents and modifications and is limited only by the scope of the appended claims.
[0270] Where it has not yet expressly occurred, but expedient and within the meaning of the present invention, individual exemplary embodiments, individual partial aspects or features thereof can be combined with each other or interchanged without departing from the scope of the present invention. Advantages of the present invention described with reference to one exemplary embodiment also relate without being expressly mentioned, where transferrable, to other exemplary embodiments.