Recovery of missing information in diffusion magnetic resonance imaging data
10109081 ยท 2018-10-23
Assignee
Inventors
Cpc classification
G06T11/008
PHYSICS
G01R33/5608
PHYSICS
International classification
Abstract
There is described herein a method for recovering missing information in diffusion magnetic resonance imaging (dMRI) data. The data are modeled according to the theory of moving frames and regions where frame information is missing are reconstructed by performing diffusions into the regions. Local orthogonal frames computed along the boundary of the regions are rotated into the regions. Connection parameters are estimated at each new data point obtained by a preceding rotation, for application to a subsequent rotation.
Claims
1. A method for recovering missing information in diffusion magnetic resonance imaging (dMRI) data, the method comprising: fitting, at each data point of the dMRI data, a local orthogonal frame expressed as (i, j, k) to represent three directions; determining connection parameters c.sub.ijk at each data point to represent a rotation of the local orthogonal frame in a spatial neighborhood of the data point in accordance with the dMRI data; and performing inward diffusions into a region where frame information is missing by: rotating the local orthogonal frame in a heading direction at data points starting along a boundary of the region and moving into the region; and estimating connection parameters c.sub.ijk at each new data point obtained by a preceding rotation of the local orthogonal frame, for application to a subsequent rotation of the local orthogonal frame at the new data point.
2. The method of claim 1, wherein rotating the local orthogonal frame comprises computing new values for the three directions (i, j, k) independently.
3. The method of claim 2, further comprising adjusting the computed new values to enforce orthogonality of the three directions (i, j, k).
4. The method of claim 1, wherein determining connection parameters c.sub.ijk at each data point of the dMRI data comprises computing closed-form connections in linear space.
5. The method of claim 1, wherein estimating connection parameters c.sub.ijk at each new data point comprises selecting a computation scheme from a group comprising finite differentiation, energy minimization, and closed-form connections in linear space.
6. The method of claim 5, wherein selecting the computation scheme comprises selecting as a function of local parameters of each one of the new data points.
7. The method of claim 1, wherein performing inward diffusions into a region of missing information comprises rotating the local orthogonal frame and estimating the connection parameters c.sub.ijk for a plurality of layers of the region in an iterative fashion.
8. The method of claim 7, wherein each one of the plurality of layers has a thickness corresponding to one voxel.
9. The method of claim 1, wherein fitting, at each data point of the dMRI data, a local orthogonal frame expressed as (i, j, k) to represent three directions comprises using the dMRI data to obtain a first one of the three directions and basing a second one and a third one of the three directions on a local geometry of a heart wall.
10. The method of claim 9, wherein the region is a volumetric region or a distributed region, and wherein missing information is recovered for a plurality of regions in the heart wall in order to reconstruct a three-dimensional image of fiber orientations.
11. A system for recovering missing information in diffusion magnetic resonance imaging (dMRI) data, the system comprising: a processing unit; and a non-transitory memory communicatively coupled to the processing unit and comprising computer-readable program instructions executable by the processing unit for: fitting, at each data point of the dMRI data, a local orthogonal frame expressed as (i, j, k) to represent three directions; determining connection parameters c.sub.ijk at each data point to represent a rotation of the local orthogonal frame in a spatial neighborhood of the data point in accordance with the dMRI data; and performing inward diffusions into a region where frame information is missing by: rotating the local orthogonal frame in a heading direction at data points starting along a boundary of the region and moving into the region; and estimating connection parameters c.sub.ijk at each new data point obtained by a preceding rotation of the local orthogonal frame, for application to a subsequent rotation of the local orthogonal frame at the new data point.
12. The system of claim 11, wherein rotating the local orthogonal frame comprises computing new values for the three directions (i, j, k) independently.
13. The system of claim 12, wherein the program instructions are further executable for adjusting the computed new values to enforce orthogonality of the three directions (i, j, k).
14. The system of claim 11, wherein determining connection parameters c.sub.ijk at each data point of the dMRI data comprises computing closed-form connections in linear space.
15. The system of claim 11, wherein estimating connection parameters c.sub.ijk at each new data point comprises selecting a computation scheme from a group comprising finite differentiation, energy minimization, and closed-form connections in linear space.
16. The system of claim 15, wherein selecting the computation scheme comprises selecting as a function of local parameters of each one of the new data points.
17. The system of claim 11, wherein performing inward diffusions into a region of missing information comprises rotating the local orthogonal frame and estimating the connection parameters c.sub.ijk for a plurality of layers of the region in an iterative fashion.
18. The system of claim 17, wherein each one of the plurality of layers has a thickness corresponding to one voxel.
19. The system of claim 11, wherein fitting, at each data point of the dMRI data, a local orthogonal frame expressed as (i, j, k) to represent three directions comprises using the dMRI data to obtain a first one of the three directions and basing a second one and a third one of the three directions on a local geometry of a heart wall.
20. The system of claim 19, wherein the region is a volumetric region or a distributed region, and wherein missing information is recovered for a plurality of regions in the heart wall in order to reconstruct a three-dimensional image of fiber orientations.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Further features and advantages of the present invention will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15) It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
DETAILED DESCRIPTION
(16) There is illustrated in
(17) Let a point x=.sub.ix.sub.ie.sub.i.sup.3 be expressed in terms of e.sub.1, e.sub.2, e.sub.3, the natural basis for
.sup.3. Next, we define a right-handed orthonormal frame field f.sub.1,f.sub.2,f.sub.3:
.sup.3.fwdarw.
.sup.3. Each frame axis can be expressed by the rigid rotation f.sub.i=.sub.ja.sub.ije.sub.j where A={a.sub.ij}
.sup.33 is a differentiable attitude matrix such that A.sup.1=A.sup.T. Treating f.sub.i and e.sub.i as symbols, we can write Equation (1) below. Further, since each e.sub.i is constant, the differential geometry of the frame field is completely characterized by A. Taking the exterior derivative on both sides yields Equation (2) where d denotes the exterior derivative, and C=(dA)A.sup.1={c.sub.ij}
.sup.33 is the Maurer-Cartan matrix of connection forms c.sub.ij. Writing f.sub.i as symbols, then Equation (2) can be understood as df.sub.1=.sub.jc.sub.ijf.sub.j.
(18)
(19) The Maurer-Cartan matrix is a skew symmetric and hence referring to Equation (3) there are at most 3 independent, non-zero one-forms: c.sub.12, c.sub.13, and c.sub.23. One-forms operate on tangent vectors through a process denoted contraction, written as dwv
for a general one-form dw
v
=.sub.iw.sub.ide.sub.i and tangent vector v on
.sup.3, which yields dw
v
=.sub.iw.sub.ide.sub.i
.sub.jv.sub.je.sub.j=.sub.iw.sub.iv.sub.i since de.sub.i
e
=.sub.ij, where .sub.ij is the Kronecker delta.
(20) The space of linear models for smooth frame fields is fully parametrized by the one-forms c.sub.ij. This space can be explored by considering the motion of f.sub.i in a direction v=.sub.kv.sub.kf.sub.k using the first order terms of a Taylor series centered at x.sub.0 as given by Equation (4) where f.sub.i and df.sub.i are evaluated at x.sub.0, and c.sub.ijkc.sub.ijf.sub.k
are the connection forms of the local frame. Since only 3 unique non-zero combinations of c.sub.ij are possible, there are in total 9 connections c.sub.ijk. These coefficients express the rate of turn of the frame vector f.sub.i towards f.sub.j when x moves in the direction f.sub.k. Referring to
(21) A first order generator for frame fields using Equation (4) requires knowledge of the underlying connection forms c.sub.ijk. Three different ways of computing the connection forms c.sub.ijk may be used. The computation schemes are referred to herein as finite differentiation, energy minimization, and closed-form connections in linear space.
(22) The finite differentiation computation scheme is a direct estimate based on finite differences. In smooth frame fields, the connection one-forms c.sub.ij can be directly obtained using Equation (2), i.e., df.sub.i.Math.f.sub.k=(.sub.j.sup.3c.sub.ijf.sub.i).Math.f.sub.k=.sub.j.sup.3c.sub.ij.sub.jk=c.sub.ik. The differentials df.sub.i can be computed by applying the exterior derivative for a function, i.e., for the k'th component f.sub.i, f.sub.ik:.sup.3.fwdarw.
,
(23)
as given by Equation (5) where
(24)
is the Jacobian matrix of partial derivatives of f.sub.i. Now setting v=f.sub.k we obtain Equation (6). The Jacobian matrix J, can be approximated to first order using, e.g., finite differences on f.sub.i with a spacing of size x:
(25)
(26)
(27) The energy minimization computation scheme is a regularized optimization scheme. The connection forms c.sub.ijk at x.sub.0 can be obtained as the minimizer of an extrapolation energy contained within a neighborhood as given by Equation (7) where is a regularization weight used to penalize high curvature. Denoting {tilde over (f)}.sub.i as the normalized approximation to f.sub.i at x.sub.0+v using Equation (4) then we can choose to minimize the angular error between {tilde over (f)}.sub.i and f.sub.i:
(28)
with .sub.i(x.sub.0+v)=ar cos(f.sub.i(x.sub.0+v).Math.{tilde over (f)}.sub.i(x.sub.0+v)).
(29)
(30) The closed form connections in linear space computation scheme is based on trigonometrical considerations in the first-order structure of 3D frame fields and enforces the requirement that c.sub.ijv
=.sub.kc.sub.ijkv.sub.k. This requirement is not explicitly enforced in the finite differentiation and energy minimization computation schemes. The closed form connections in linear space computation scheme also provides exact c.sub.ijk measurements in manifolds that have low second-order curvatures (d.sup.2f.sub.i.fwdarw.0). Given a local basis f.sub.i and data-driven neighboring bases f.sub.i(v), the one-forms c.sub.ij
v
can be solved for using linear least-squares. We begin by expanding Equation (4) to yield Equation (8) and analyze this expression geometrically using
f.sub.i(v)=f.sub.i+c.sub.ijv
f.sub.j+c.sub.ik
v
f.sub.k(8)
(31) Let f{(v)} denote the projection of f.sub.i(v) in the f.sub.if.sub.j plane, i.e. f.sub.i.sup.j(v)=f.sub.i(v)(f.sub.i(v).Math.f.sub.k)f.sub.k, k(1,2,3)ij and let .sub.ij(v) denote the signed angle between f.sub.1 and f.sub.i.sup.j(v) with positive values assigned to .sub.ij(v) rotating f.sub.i towards f.sub.j, obtained as Equation (9). Using trigonometry, we obtain Equation (10). Then by expanding the contraction c.sub.ijv
we obtain Equations (11) to (13) which when substituted into Equation (10) yield Equation (14) wherein we have a linear system in the nine unknowns c.sub.ijk. Now, aggregating n measurements v.sub.i(x) yields Equation (15).
(32)
(33) Accordingly, we require n3 otherwise the system will be undetermined. In general, v.sub.i.Math.v.sub.j0 such that V is not a full row rank. A QR factorization or singular value decomposition (SVD) pseudoinverse process can be used to solve for C C=(V.sup.TV).sup.1V.sup.T{tilde over (C)}.
(34) Referring back to
(35) The region of missing information may be a volumetric region or a distributed region. In some data sets, there may be a combination of volumetric regions and distributed regions for which frame information is missing. The regions may be reconstructed sequentially or in parallel.
(36) Each region is defined by a boundary and inward diffusions are performed starting from the boundary and into the region. As per step 402, each local orthogonal frame is rotated in a heading direction for the data points at the boundary of the region. New values for the three directions (i, j, k) are computed at the new data points. At step 404, connection parameters c.sub.ijk are estimated at each new data point obtained by the rotation of step 402. The estimated parameters c.sub.ijk are then used to further rotate the local orthogonal frames into the region, as per step 406.
(37) In some embodiments, the method 106 is performed iteratively, in a layer-by-layer fashion. For example, if the region to be reconstructed were to be spherical, then the layers would be concentric spherical shells of decreasing diameters. For a non-spherical region, the layers may have a shape that corresponds to the shape of the boundary of the region. The layers may be set out evenly, such that each layer has a same thickness, or they may be set out unevenly, such that the thickness varies from one layer to another. Similarly, a given layer may have a constant thickness or a thickness that varies throughout the layer. The thickness of each layer may be set as desired, for example at one voxel, two voxels, three voxels, and the like.
(38) Alternatively, the region is divided into a plurality of sub-regions, and the inward diffusions are performed separately in each sub-region. The order of diffusion for the sub-regions may be set in accordance with available data points from the dMRI data, such that a first rotation of the local frames as per step 402 is performed from known data points. This embodiment may be more suitable for distributed regions, whereas the layer-by-layer approach may be favored for volumetric regions. Other approaches for performing the inward diffusion of regions where frame information is missing may also be used.
(39) In some embodiments, rotating the local orthogonal frame comprises computing new values for the three directions (i, j, k) independently. There may be a need to adjust the newly computed values of the three directions (i, j, k) so as to enforce orthogonality, as per step 408. As illustrated in
(40) Step 106 of inward diffusions into regions where frame information is missing will now be described mathematically. We define as a region where frame field data are available, and A as a reconstruction domain. Starting with A.sup.0=A each iteration propagates information on the boundary A such that A.sup.n+1=AB.sub.r is eroded with a ball element B.sub.r of radius r=1 and c.sub.ijk is updated in and
A.sup.n+1 until A.sup.n+1=
. Frames f.sub.i are transported from xA in a direction v across A using a neighbor accumulation of Equation (4) as given by Equation (16) which is then normalized.
(41)
(42) In some embodiments, connection forms c.sub.ijk at xA are obtained by combining the three computation schemes described above, namely finite differentiation, energy minimization, and closed-form connections in linear space. For each data point, the computation scheme may be selected based on the following heuristics in Equation (17), where k=V.sup.1.sub.FV.sub.F is the condition number of V in Equation (15) and F is the Frobenius norm where N=(2r+1).sup.3 and .sub.0=3 were determined empirically and generally offer a good tradeoff between neighborhood connectivity and well-conditioning of V.
(43)
(44) Note that unrealistically large c.sub.ijk values can still arise in spite of the regularization. To see this, take f.sub.1(x) and make it parallel to f.sub.2(x) in a neighboring voxel. Using Equation (4) we have f.sub.1(v)f.sub.1+c.sub.12(v)f.sub.2+c.sub.13(v)f.sub.3m such that f.sub.1(v)\\f.sub.2(v)c.sub.12
v
.fwdarw..
(45) In some embodiments, a hard threshold may be applied on and c.sub.ijk in Equation (17). To do this we set
(46)
or if c.sub.ijk exceeds bounds obtained as follows. In the discrete case using forward differences, the frame axis differential d(f.sub.i1e.sub.1+f.sub.i2e.sub.2+f.sub.i3e.sub.3) is bounded by
(47)
and f.sub.i=1. We thus have |c.sub.ijv
=|f.sub.j.sup.T.sub.f.sub.
(48) The diffusion process guided by Equations (16) and (17) does not enforce orthogonality of the resulting frame field. Since this is a first-order method, there may be some orthogonality drift as the process gets deeper into the region A. To see this, using Equation (8), we get
f.sub.1(v).Math.f.sub.2(v)=(f.sub.1+c.sub.12(v)f.sub.2+c.sub.13(v)f.sub.3).Math.(f.sub.3+c.sub.21(v)f.sub.1c.sub.23(v)f.sub.3)
(49) and similarly for the other axis products. Since f.sub.i is by definition orthogonal at 0, we have f.sub.i.Math.f.sub.j=.sub.ij such that
(50)
(51) The extrapolated frame f.sub.i(v) will therefore never be exactly orthonormal. To enforce orthonormality we therefore fix f.sub.1(v) and find its orthogonal complement f(v) using Equations (18) and (19) where c.sub.ij is taken as c.sub.ij(v). We similarly proceed with f(v).
(52)
(53) The method 100 may be applied to reconstruction of various internal organs, such as, but not limited to the brain, the kidney and the pancreas. In some embodiments, the method 100 is applied to cardiac fiber reconstruction, i.e. the heart. For example, the dMRI data may be used to obtain a first direction for the local orthogonal frames whereas the other two directions are based on the local geometry of a heart wall. Therefore, the method 100 may be used to reconstruct a three-dimensional image of fiber orientations.
(54) Given a partial volume of fiber orientations f.sub.1 in a mask H of the heart, f.sub.1 may be reconstructed everywhere in A=H. For cardiac fiber reconstruction, step 106 of method 100 may be guided by rule-based priors for fiber orientations based on H and estimated heart wall normal directions of which one relates to the circumferential arrangement of myofibers and the other to their helix angle turning.
(55) The circumferential component may be estimated as follows. Using a smoothing kernel G.sub., the Euclidean distance transforms G.sub.*D.sub.+ and G.sub.*D.sub. to the outer and inner walls are first computed. From the average D=(D.sub.+D.sub.) local wall normal directions are computed using {tilde over (f)}.sub.3=D. The apex .sub.0 and an upward are identified, and used to obtain heart centerline measurements .sub.t parametrized over t steps along , such that:
(56)
(57) In other words, (x) is 1 in the current short axis plane and 0 elsewhere, and:
(58)
(59) Then, a smooth heart centerline is obtained as L(t)=G.sub.*.sub.t. We can now obtain a local long-axis direction f.sub.L using
(60)
and finally estimate the circumferential direction f.sub.C from the cross product of f.sub.L and the local wall normal {circumflex over (f)}.sub.3 as f.sub.C=f.sub.Lf.sub.3.
(61) The helical component may be estimated as follows. A rule-based helix angle variation prior is used, from .sup.+ to .sup. from outer to inner wall. A voxel x is first parametrized over the local depth of the heart wall in the range [0, 1], where 0 indicates that the voxel is lying on the outer wall and f.sub.L on the inner wall, using:
(62)
(63) Then, the local helix angle at x is linearly interpolated using:
a(x)=(.sub.+y.sub.++y.sub.)(x).
(64) Finally, the helix fiber direction {circumflex over (f)}.sub.1 is obtained using a helical rotation of f.sub.c about the local transmural axis {circumflex over (f)}.sub.3 from the axis angle {circumflex over (f)}.sub.3,
using Rodrigues' formula:
{circumflex over (f)}.sub.1=cos f.sub.C+sin ({circumflex over (f)}.sub.3f.sub.C)+(1cos )({circumflex over (f)}.sub.3.Math.f.sub.C){circumflex over (f)}.sub.3
(65) Each diffusion pass n+1 combines current frame field estimates f.sub.i, differentials df.sub.i and rule-based priors {circumflex over (f)}.sub.i using
(66)
(67) Here, v=xy, (x) denotes the current (diffused) boundary around x from which data are recovered, and .sub.1=0.1, .sub.3=0.7 are prior weights determined empirically. The higher the confidence in the rule-based model, the larger these coefficients should be. Each {acute over (f)}.sub.i.sup.n+1 is normalized after each diffusion pass.
(68) Damaged diffusion volumes were simulated using Poisson disk stochastic sampling, where each sample point p satisfies a minimum distance constraint to others. At p, an ellipsoid with random semi-axis lengths (range=: 1 to 10 voxels) is carved out. A prototypical synthetic in vivo mask was also obtained by regularly slicing H along its long-axis. The corruptions were applied to dMRI volumes of a healthy rat heart. Subsequently, the method 100 was compared against a standard vector interpolation scheme based on distance weighting, against a pure vector diffusion scheme using Equation (16) with c.sub.ijk=0, and against a ruled-based model. The robustness to noise was also tested by combining Poisson sampling and random angular perturbations to f.sub.1, prior to reconstruction.
(69)
(70)
(71) Referring to
(72) Turning to
(73) The connections 804 may comprise wire-based technology, such as electrical wires or cables, and/or optical fibers. The connections 804 may also be wireless, such as RF, infrared, Wi-Fi, Bluetooth, and others. Connections 804 may therefore comprise a network, such as the Internet, the Public Switch Telephone Network (PSTN), a cellular network, or others known to those skilled in the art. Communication over the network may occur using any known communication protocols that enable devices within a computer network to exchange information. Examples of protocols are as follows: IP (Internet Protocol), UDP (User Datagram Protocol), TCP (Transmission Control Protocol), DHCP (Dynamic Host Configuration Protocol), HTTP (Hypertext Transfer Protocol), FTP (File Transfer Protocol), Telnet (Telnet Remote Protocol), SSH (Secure Shell Remote Protocol).
(74) One or more databases 808 may be integrated directly into the system 802 or any one of the devices 806, or may be provided separately therefrom (as illustrated). In the case of a remote access to the databases 808, access may occur via connections 804 taking the form of any type of network, as indicated above. The various databases 808 described herein may be provided as collections of data or information organized for rapid search and retrieval by a computer. The databases 808 may be structured to facilitate storage, retrieval, modification, and deletion of data in conjunction with various data-processing operations. The databases 808 may be any organization of data on a data storage medium, such as one or more servers. The databases 808 illustratively have stored therein any one of datasets of dMRI data, computed local orthogonal frame directions (i, j, k), c.sub.ijk parameters, data defining boundaries of regions to reconstruct, reconstructed images, partially reconstructed images, and any other information used for the methods described herein.
(75)
(76)
(77)
(78) Note that while illustrated separately, the connection parameters computation unit 1004 and the connection parameters estimation unit 1104 may be provided as a single unit that can perform both computation based on obtained dMRI data and estimation based on rotated local orthogonal frames. Similarly, the two units 1004 and 1104 may share certain resources. Other units may also be combined or separated as desired to suit the targeted functions.
(79)
(80) The processing unit 1202 may comprise any suitable devices configured to cause a series of steps to be performed so as to implement the computer-implemented method 100 such that instructions 1206, when executed by a computing device 1200 or other programmable apparatus, may cause the functions/acts/steps specified in the methods described herein to be executed. The processing unit 1202 may comprise, for example, any type of general-purpose microprocessor or microcontroller, a digital signal processing (DSP) processor, a central processing unit (CPU), an integrated circuit, a field programmable gate array (FPGA), a reconfigurable processor, other suitably programmed or programmable logic circuits, or any combination thereof.
(81) The memory 1204 may comprise any suitable known or other machine-readable storage medium. The memory 1204 may comprise non-transitory computer readable storage medium such as, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. The memory 1204 may include a suitable combination of any type of computer memory that is located either internally or externally to device such as, for example, random-access memory (RAM), read-only memory (ROM), compact disc read-only memory (CDROM), electro-optical memory, magneto-optical memory, erasable programmable read-only memory (EPROM), and electrically-erasable programmable read-only memory (EEPROM), Ferroelectric RAM (FRAM) or the like. Memory may comprise any storage means (e.g., devices) suitable for retrievably storing machine-readable instructions executable by processing unit.
(82) Each computer program described herein may be implemented in a high level procedural or object-oriented programming or scripting language, or a combination thereof, to communicate with a computer system. Alternatively, the programs may be implemented in assembly or machine language. The language may be a compiled or interpreted language. Computer-executable instructions may be in many forms, including program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types. Typically the functionality of the program modules may be combined or distributed as desired in various embodiments.
(83) While illustrated in block diagrams as groups of discrete components communicating with each other via distinct data signal connections, it will be understood by those skilled in the art that the present embodiments are provided by a combination of hardware and software components, with some components being implemented by a given function or operation of a hardware or software system, and many of the data paths illustrated being implemented by data communication within a computer application or operating system. The structure illustrated is thus provided for efficiency of teaching the present embodiment.
(84) The above description is meant to be exemplary only, and one skilled in the relevant arts will recognize that changes may be made to the embodiments described without departing from the scope of the invention disclosed. For example, the blocks and/or operations in the flowcharts and drawings described herein are for purposes of example only. There may be many variations to these blocks and/or operations without departing from the teachings of the present disclosure. For instance, the blocks may be performed in a differing order, or blocks may be added, deleted, or modified.
(85) The present disclosure may be embodied in other specific forms without departing from the subject matter of the claims. Also, one skilled in the relevant arts will appreciate that while the systems, methods and computer readable mediums disclosed and shown herein may comprise a specific number of elements/components, the systems, methods and computer readable mediums may be modified to include additional or fewer of such elements/components. The present disclosure is also intended to cover and embrace all suitable changes in technology. Modifications which fall within the scope of the present disclosure will be apparent to those skilled in the art, in light of a review of this disclosure, and such modifications are intended to fall within the appended claims.