Optical polarization tractography systems, methods and devices
11287623 · 2022-03-29
Assignee
Inventors
Cpc classification
A61B5/0059
HUMAN NECESSITIES
G02B21/0028
PHYSICS
A61B5/0084
HUMAN NECESSITIES
G02B21/008
PHYSICS
International classification
A61B5/00
HUMAN NECESSITIES
A61B1/00
HUMAN NECESSITIES
Abstract
High-resolution 3D optical polarization tractography (OPT) images of the internal fiber structure of a target tissue. Manipulation of dual-angle imaging data of the fiber orientation inside a target tissue leads to the determination of 3D imaging properties of the target tissue, allowing transmission of the 3D image properties of the target tissue to an OPT processor to produce high-resolution 3D images.
Claims
1. A system for in situ imaging of a target tissue, the system comprising: an optical polarization tractography (OPT) imaging system; a scanning device coupled to the OPT imaging system structured and operable to scan the target tissue in situ and obtain local optic axis data for the target tissue, to obtain the local optic axis data the scanning device is structured and operable to: focus a polarized incident light with one or more optical polarizations, produced by the OPT imaging system, in a first direction on one or more surface locations of a fibrous target tissue sample, whereby at each surface location of the incident light in the first direction the incident light propagates inside the fibrous target tissue sample and comes out from different depths within the fibrous target tissue sample to provide a first signal resulting from the incident light in the first direction; and focus the polarized incident light with one or more optical polarizations, produced by the OPT imaging system, in at least one additional direction that is different than the first direction on one or more additional surface locations of the fibrous target tissue sample, whereby at each surface location of the incident light in the at least one additional direction the incident light propagates inside the fibrous target tissue sample and comes out from different depths within the fibrous target tissue sample to provide an additional signal resulting from the incident light in the at least one additional direction; and an image processor structured and operable to receive the local optic axis data obtained from the scanning of the target tissue and construct an OPT image utilizing the local optic axis data obtained from the scanning of the target tissue.
2. The system of claim 1 wherein the OPT imaging system is a 3D OPT imaging system and the OPT image is an OPT 3D image.
3. The system of claim 1 wherein the scanning device for scanning the target tissue in situ is one of an OPT surgical or dissecting microscope, or an endoscopic device.
4. The system of claim 1 wherein the system further comprises a fiber disarray index marker system structured and operable to project a location of tissue predicted to be candidates of tissue distress.
Description
DRAWINGS
(1) The presently disclosed subject matter will be better understood from reading the following description of non-limiting embodiments, with reference to the attached drawings, wherein below:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
DETAILED DESCRIPTION
(14) The foregoing summary, as well as the following detailed description of certain embodiments will be better understood when read in conjunction with the appended figures. As used herein, an element or step recited in the singular and proceeded with the word “a” or “an” should be understood as not excluding the plural of said elements or steps, unless such exclusion is explicitly stated. Furthermore, references to “one embodiment” or “an embodiment” are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features. Moreover, unless explicitly stated to the contrary, embodiments “comprising” or “having” an element or a plurality of elements having a particular property may include additional elements not having that property.
(15) Various embodiments as described and shown herein provide an enhanced system for optical polarization tractography (OPT) imaging as developed by applicants. Applicants' enhanced OPT system using dual-angle imaging enables true three-dimensional (3D) images of the fiber structure inside the tissue with cellular level resolution. Moreover, applicants have devised such a system and method which allows for optimum registration of the 3D imaging and to remove surface refraction effects which distort the orientation of the OPT measurement plane. Further, applicants' OPT system and method includes means for providing the “fiber disarray index” readouts and fiber tissue image mapping that are useful both for clinical diagnosis and for therapeutic treatment protocols. Additionally, the OPT regimen and system are devised to be capable of providing ex vivo and in vivo images of fresh or living tissue, without labeling, including OPT surgical and dissection microscopes.
(16) Applicants' OPT system utilizes “polarization” information, i.e., information provided by such properties as birefringence, diattenuation, and optic axis properties, created by reflected light in order to ascertain additional imaging information for fibrous tissue. Using this stream of information, applicants construct true 3D ex vivo and in vivo tissue images, preferably non-destructively, having a resolution at the cellular level and providing the other benefits described herein.
(17) According to the invention, a local optic axis and other polarization-related data for a target tissue is obtained using a Jones-matrix polarization-sensitive optical coherence tomography (PSOCT) system and method. The core of the hardware for the OPT regimen of the invention is the Jones matrix PSOCT system (JMOCT), an advanced version of PSOCT.
(18) A schematic depiction showing an embodiment of the OPT apparatus components of a system of the invention is set forth in
(19) In an exemplary application of applicants' OPT system employing this embodiment, the pixel-wise Jones matrices of an 8×8×1.1 mm3 sample volume (2000×1000×280 pixels in B×C×A scans) may be imaged in, e.g., 80 seconds.
(20) The polarization image data is fed to a computer with software employing an iteration algorithm according to applicants' OPT system to drive data-gathering of and from the local polarization properties of the target tissue, including, e.g., its optical axis, birefringence, and diattenuation properties. See Fan and Yao. Biomed. Opt. Express 4:460(2013). The final 3D dataset may be interpolated in the lateral directions to obtain the same pixel size of, e.g., 3.9 μm in all A-, B-, and C-scans.
(21) In a preferred embodiment according to the OPT method of the invention, as depicted in
(22) In this embodiment, the light (the z′ axis in
L=[L.sub.x,L.sub.y,L.sub.z].sup.T=I/n+(cos θ.sub.i−√{square root over (n.sup.2−sin.sup.2θ.sub.i)})N/n, (1)
(23) where n is the tissue refractive index. The θ.sub.i is the incident angle:
cos θ.sub.i=−N.Math.I. (2)
(24) In certain embodiments, the light vector L may also be presented using the following vector based on a polar angle θ and an azimuthal angle φ: L=[sin θ cos ϕ, sin θ sin ϕ, cos θ], where the (θ, φ) is calculated using the vector L=[Lx, Ly, Lz] constructed in Eq. 1:
(25)
(26) In general, the orientation β measured in certain embodiments of applicants' OPT system and method represents the projected fiber within the evaluation plane (x′-y′ in
(27)
(28) where γ=β−φ.
(29) Dual-Angle 3D Opt Images
(30) Applicants' OPT enhanced system and method additionally provide for true 3D images by the use of a dual-angle imaging process. In the dual-angle imaging approach, to achieve true 3D images of the 3D fiber orientation, an initial OPT imaging of the fiber orientation inside a target tissue is carried out, e.g., as described above. The actual 3D fiber is not determined, however, by a single OPT measurement. According to this aspect of the invention, the fiber is located within the projection plane (See
(31) Upon making such a “dual-angle” measurement, the 3D fiber may be fully determined as the intersection line of the two projection planes. In accordance with an embodiment of the invention, this second measurement may be performed by rotating the sample, or, alternatively, by rotating the incident light in a predefined way. This projection plane corresponding to the light direction (θ, φ) and projected fiber orientation γ=β−φ is thereby identified using its normal vector M calculated as the cross-product of P and L:
(32)
(33) If the second measurement produces a different light direction (θ′, φ′) and results in a projected fiber orientation γ′=β′-φ′, the 3D fiber orientation may then be determined as:
(34)
(35) In an embodiment of the dual-angle construction of the invention, a registration of the two image volumes measured at γ and γ′ (or in some cases multiple image volumes) is carried out. This can be achieved by transforming (rotating and translating) one (or more) 3D image volume to substantially match the target image volume, thereby minimizing the location differences of the image features between the 3D image volumes. Multiple image features can be used to determine the best transformation. For example, any particular structures inside the tissue that appear to be distinct from its surroundings can be used as markers to register the images. In addition, the surface of the tissue image volume can be used for image registration. The sample surface profiles can be quantified using the distance between each pixel on the surface and a standard imaging plane (e.g., the plane of the en face plane at z=0). When the two image volumes are registered, i.e., the locations of the identified image feature(s) should coincide, and their surface profiles will overlap with each other. An optimization procedure in computer program can be applied to automatically rotate and translate one image volume and calculate the differences of the locations of all identified features between two or more image volumes. The computerized optimization procedure iterates this process to find the best transformation to register the two or more image volumes. Since the precision of image registration determines the eventual accuracy in 3D fiber calculation, it is quite useful to achieve pixel-level accuracy in image registration.
(36) Surface Refraction Correction
(37) In another aspect of the OPT system and method of the invention, a correction is made for a significant image distortion which applicants discovered is created by surface refraction of imaged depth-resolved target tissue. This corrective procedure provides cellular-level microstructural details essentially equal to those provided by histological analysis.
(38) As discussed, the refraction at the tissue surface changes the light direction inside the tissue. Therefore the evaluation plane (
(39) According to this embodiment, the actual pixel coordinate [i′, j′, k′] for the original pixel [i, j, k] may be calculated as:
(40)
(41) A new rectangular 3D image matrix may then be computed using a 3D bi-cubic interpolation based on the above actual pixel coordinates. In this exemplary embodiment, the M vector (Eq. 5) is obtained for each pixel in the 3D dataset.
(42) Fiber Tissue Distress Imaging and Applications
(43) Applicants' OPT regimen includes application of a “fiber disarray index” (FDI), optionally supplemented by a local retardance calculation, to produce the fiber stress pattern readout and/or image map of stressed, damaged and/or diseased fibrous tissue. The regimen may be configured to provide assistance to clinicians and researchers addressing particular pathologies.
(44) Various pathologies, e.g., inflammation, can lead to damaged fibers. The damaged fibers may be identified by fragmentation or by showing “disarrayed” patterns which may be established quantitatively as being different from, and distinguishable to, their comparable normal tissue patterns. Such a quantitative “disarrayed” pattern may be located by performing mathematical image processing algorithms over a targeted portion, or the entire, imaged volume of the tissue, thus identifying areas which show higher variation in fiber orientation distribution, i.e., they mark areas where the fiber is damaged or diseased. Thus, according to this aspect of the invention, an FDI is established by which healthy and “distressed” tissues are distinguished. The results of these FDI calculations can be used to generate data, and data readouts regarding, and FDI image mapping of, distressed or damaged tissue. In turn, these tools may be used by clinicians to assist them in diagnosing damaged or diseased tissue for further investigation, or for targeted treatments. They may also be utilized by researchers and industry to investigate new drug and therapeutic regimens and treatment protocols.
(45) According to this aspect of the invention, a “threshold” of FDI may be established, e.g., using clinical (or other sources of) data contrasting a known damaged/diseased tissue with a normal tissue of a specific type to establish the FDI algorithm (See Exs. 6 and 7, below) which may be used to automatically identify the distressed tissue. This FDI algorithm, based on determination of a calculated threshold, is then applied to the data acquired by the OPT system and method of the invention to prepare the data readouts and/or FDI image maps. See Exs. 6 and 7. Thus, locations where the FDI is higher than the FDI threshold may be labeled such as by using a colored light, or other distinctive illumination of the distressed tissue area, to indicate potential sites of candidates for further pathological assessment. Such assessment may be conducted using a 3D OPT system or in situ imaging, especially using an OPT microscope, as described elsewhere in this application.
(46) In Vivo and Ex Vivo Imaging
(47) Applicants also provide an OPT regimen for in vivo or ex vivo imaging, including use of an OPT microscope for viewing and dissecting fibrous tissue.
(48) According to this aspect of the invention, the OPT system of the invention is adapted for use or retrofitted to be used with and/or coupled to a surgical or dissection microscope to provide for in situ, in vivo or ex vivo visualization of tissue structures during surgery or tissue dissection. See U.S. Pat. Nos. 7,889,423; 8,049,873; and 8,777,412, which are incorporated by reference as though fully set forth herein for additional details on applying applicants' OPT system and method to surgical and dissection microscopes.
(49) A schematic diagram showing the OPT microscope for in vivo visualization is shown in
(50) In the aforementioned exemplary embodiment, the “incident light” from the OPT system (
(51) In general, once tissue damage is detected using markers such as the FDI, the FDI image may be projected back to the tissue sample. In an exemplary embodiment, the projection system is designed to share the same scanning system already used in the OPT system of the invention. In one embodiment, an “incident light for projection” at another wavelength (e.g. green light) is used for the projection component to achieve better visual contrast. Such a projecting light can be integrated with the OPT microscope system using a dichroic mirror (
(52) In the aforementioned exemplary embodiment, the measured fiber orientation can also be projected back to the tissue surface so that the surgeon and other operators can clearly see it during, e.g., transplantation surgery. This provides a way for the surgeons to rotate the transplant grafts or materials to match their fiber structure with that of the host. Such a capability can improve the transplant outcome in cartilage repair, blood vessel repair, and many other grafting procedures.
EXAMPLES
(53) Dual-Angle 3D Imaging
(54) In Examples 1 and 2, dual-angle measurements were obtained by imaging the tissue sample at two different rotational angles (γ.sub.1 and γ.sub.2) around the C-scan direction to obtain two datasets for M at (θ, φ, β) and M′ at (θ′, φ′,β′), respectively. To register these two new 3D datasets, the 3D image for M′ measured at γ.sub.2 around the C-scan direction was rotated back around the C-scan. All image processing was implemented using Matlab.
Example 1: Demonstration of the 3D OPT System in a Small Piece of the Mouse EDL Muscle
(55) The dual-angle 3D OPT system and method according to an embodiment of the invention was demonstrated by imaging a small piece of the mouse EDL muscle which was placed at known orientations in the space. The middle of the EDL muscle had relatively homogeneous myofiber orientation. The muscle sample was fixed in 10% paraformaldehyde after excising it from the animal.
(56)
(57) Before the dual-angle construction, the two image volumes measured at γ.sub.1 and γ.sub.2 were registered. Their surface profiles were used as the image features for registration. As expected, the “contour” profiles of the sample surface obtained at γ.sub.1=−20° (
(58) The muscle sample was imaged multiple times when placed at different rotational angles around the y-axis (B-scan) from α=−30° to +20° in a step of 10° around an axis V in the y-z plane (
(59) At each sample position α, the 3D fiber orientation was calculated using the dual-angle OPT obtained at γ.sub.1=−20° and γ.sub.2=+20°.
(60)
(61) For the purpose of validation, the directly measured 3D fiber angle at a sample position α was compared with the “expected” angles calculated using 3D fiber angle measured at α=0°. The “expected” 3D fiber direction F.sup.e(α)=[f.sub.x(α), f.sub.y(α), f.sub.z(α)].sup.T at sample position α can be calculated from the 3D fiber direction F(0) measured at sample position α=0:
F.sup.e(α)=R.sub.v(α)F(0)=[R.sub.x(−γ)R.sub.y(α)R.sub.x(γ)]F(0), (8)
(62) where R.sub.x and R.sub.y are standard rotational matrices around the x- and y-axis, respectively. To facilitate the comparison among 3D angles, we compared the 2D projected angles of the 3D direction in the three orthogonal projection planes:
(63)
(64)
(65) Similar results were obtained when different sets of ROIs were used in the validation. We repeated ten times the aforementioned procedure of selecting 50 ROIs randomly in the EDL muscle. The mean and standard deviation of the coefficients of determination (R.sup.2) were 0.88±0.01, 0.95±0.01, and 0.94±0.01 in the AC, AB, and BC planes (
(66) The above consistent results indicated a high correlation between the dual-angle OPT measurement and the expected values and thus validated the dual-angle OPT in imaging 3D fiber orientation.
Example 2: Imaging 3D Fiber Orientation in the Mouse TA Muscle
(67) In order to further evaluate the accuracy of the 3D measurements according to an embodiment of the OPT system of the invention, a piece of fixed mouse TA muscle was imaged.
(68)
Example 3: Imaging 3D Fiber Orientation in Cartilage
(69) In this example, dual-angle OPT was applied to image the collagen fiber organization in a piece of bovine articular cartilage. The cartilage sample was excised from the middle phalanx and fixed in 4% paraformaldehyde. This sample was imaged from the cartilage surface (referred to as the “top-scan”) using the dual-angle procedures at γ.sub.1=−25° first and then at γ.sub.2=+25°.
(70) No fibers can be observed from the 3D intensity image of the cartilage sample (
(71) The 3D OPT data set can be explored programmatically to provide a detailed view of the fiber architecture. Due to the unique “arcade” 3D fiber structure in cartilage, the fiber orientation would appear differently when viewed from different angles or in cutting planes made at different orientations.
Example 4: Distortion Correction and Comparison to Histology
(72) This example provides an illustration of the removal of surface refraction distortion in an aspect of the OPT system and method of the invention and provides a comparison to histologic processing.
(73) A small piece of the heart tissue of roughly 2-4 mm in size was cut from either the left or right ventricles from a mouse heart. This piece of heart tissue was imaged first using an embodiment of the OPT system of the invention of the type depicted in
(74) Our OPT method was implemented in a spectral domain full-range JMOCT system as described in Fan and Yao. Opt. Express 20:22360(2012). Fiber orientation and tractography were obtained using OPT as described in Wang et al. Biomed. Opt. Express 5:2843 (2014). Due to the labor intensive nature of histology analysis, an intensity-gradient based method was applied to calculate cardiac myofiber orientation in histology images to facilitate the comparison between OPT and histology images (see description in Wang et al. 2014). The OPT and histology images were registered and compared as described in Wang et al. 2014.
(75) To correct surface refraction, the sample surface in the OCT intensity image was first determined using an intensity threshold-based segmentation algorithm (as set out in Wang et al. 2014, incorporated herein by reference as though fully set forth herein). The resulting surface data were represented as a 2D array containing the axial depth position for each pixel on the sample surface. A 5×5 median filter was applied to remove noisy pixels from the data set. The surface normal vector N=[Nx,Ny,Nz] was then calculated by using the “surfnorm” function in MATLAB, a commercially available computer software application.
(76)
(77)
(78) X-Y-Z represents the laboratory coordinates. The original incident light is perpendicular to the en face plane formed by the B-C scanning. The en face plane is equivalent to the histology sectioning plane. Due to surface refraction, the incident beam is deviated by an angle of Δθ within the incident plane which is formed by the incident light and the surface normal vector (N) of the tissue surface. Applying geometrical transformation, the actual pixel position (x′, y′, z′) corresponding to the raw pixel (x, y, z) can be calculated as:
x′=x+z sin Δθ cos ϕ
y′=y+z sin Δθ sin ϕ,
z′=z cos Δθ (12)
(79) where the surface refraction induced direction change Δθ can be determined according to Snell's law at the tissue surface:
(80)
(81) The image distortion due to surface refraction can significantly impact the OPT accuracy. To illustrate this effect,
(82) Without correcting the surface refraction, the OPT results (
(83) To further quantify the differences between histology and OPT, the pixel-by-pixel differences between the two images were calculated. The histology images were resized using cubic spline to match the pixel size of 3.9 μm in OPT. As shown in
Examples 5 and 6: Imaging Fiber Organization/Disorganization; Muscle Damage
(84) Examples 5 and 6 are illustrative of aspects of the system and method of the invention wherein normal and distressed fibrous tissue are imaged and mapped, using, e.g., a Fiber Disarray Index (FDI) or similar calculations applying the same differentiating principles which may be applied in a targeted and/or automated manner to identify tissue distress candidates.
Example 5: Imaging Cardiac Myofiber Organization
(85) The heart is a highly organized helical structure composed of well-oriented myofibers. Such organization enables normal electric signal propagation and coordinated mechanical force production for efficient blood pumping. In other words, the axial orientation of myofibers plays an important role in normal heart function. For example, action potential propagates 2 to 10 times faster along the heart muscle fibers than along the transverse direction. Disruption of normal myofiber architecture in the heart contributes to numerous cardiac diseases such as arrhythmia, dilated cardiomyopathy, hypertrophic cardiomyopathy, and infarction.
(86) Duchenne muscular dystrophy (DMD) is the most common and severe muscle disease caused by mutations in the dystrophin gene. It affects approximately one of every 5,000 male infants. The absence of the dystrophin gene leads to body-wide muscle degeneration and necrosis. Most patients eventually die from respiratory and/or cardiac failure. Animal models have been indispensable in our understanding of DMD and developing therapeutic approaches. The mdx4cv mouse is a commonly used DMD animal model where the dystrophin expression is abolished by a nonsense point mutation in exon.
(87) The OPT regimen outlined in the schematic in
(88) In addition, application of OPT revealed significant cellular-level myofiber disorganization in the RVs of mdx mice (
Example 6: Imaging Muscle Damage
(89)
(90) Due to its destructive nature, conventional histology image can only be obtained in a specific cutting plane (
(91) The power of OPT is better illustrated in its ability to visualize the 3D tractography and to identify 3D lesions in the entire TA muscle (the bottom panel in
(92) While the invention has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the related art that various changes in form and details may be made therein without departing from the scope of the invention as described otherwise herein and by the appended claims.
(93) It is to be understood that the above description is intended to be illustrative, and not restrictive. For example, the above-described embodiments (and/or aspects thereof) may be used in combination with each other. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the various embodiments of the invention without departing from their scope. While the dimensions and types of materials described herein are intended to define the parameters of the various embodiments of the invention, the embodiments are by no means limiting and are exemplary embodiments. Many other embodiments will be apparent to those skilled in the related art upon reviewing the above description. The scope of the various embodiments of the invention should, therefore, be determined with reference to the invention principles and appended claims, along with the full scope of equivalents to which such invention principles and claims are entitled.
(94) This written description uses examples to disclose the various embodiments of the invention, including the best mode, and also to enable any person skilled in the art to practice the various embodiments of the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the various embodiments of the invention may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the invention and claims if the examples have structural elements that do not differ from the literal language of the claims, or if the examples include equivalent structural elements with insubstantial differences from the literal languages of the claims.