A METHOD OF DETECTING A FLOW IN A SEQUENCE OF IMAGES
20220022759 · 2022-01-27
Inventors
- Peijun Gong (Leeming, Western Australia, AU)
- Qiang Wang (Nedlands, Western Australia, AU)
- David D. Sampson (Millbrook, Guildford Surrey, AU)
Cpc classification
A61B5/441
HUMAN NECESSITIES
G06T7/262
PHYSICS
A61B5/0075
HUMAN NECESSITIES
G02B30/52
PHYSICS
G06T2207/10101
PHYSICS
International classification
Abstract
A method of detecting a flow in sequence of images of a material. Providing a sequence of at least three images of an area of the material. Each image includes a plurality of voxels or regions of interest such that the at least three images of the area of the material provide for each voxel or region of interest an intensity for at least three points in time, Fourier transforming for each voxel or region of interest to obtain a frequency distribution including the intensities for the at least three points in time, analysing for each voxel or region of interest and generating a processed image of area of the material including the voxels or regions of interest, associating voxels or regions of interest that have a larger amplitude at a higher frequency range with a first visual property and voxels or regions of interest that have smaller amplitude in the higher frequency range with a second visual property.
Claims
1-14. (canceled)
15. A method of detecting a flow in a sequence of images of a material, the method comprising the steps of: providing a sequence of at least three images of an area of the material, each image including a plurality of voxels or regions of interest such that the at least three images of the area of the material provide for each voxel or region of interest an intensity I(t) as a function of time t for at least three points in time; Fourier transforming I(t) for each voxel or region of interest to obtain a distribution I(ω) of frequency co, I(t) including the intensities for the at least three points in time; and analysing I(ω) for each voxel or region of interest and generating a processed image of the area of the material including the voxels or regions of interest, comprising associating voxels or regions of interest that have a larger amplitude I.sub.L(ω.sub.H) at a frequency ω.sub.H in a higher frequency range than other voxels or regions of interest with a first visual property and voxels or regions of interest that have smaller amplitude I.sub.S(ω.sub.H) in the higher frequency range than other voxels or regions of interest with a second visual property; wherein the larger amplitude I(ω.sub.H) is associated with a flow and the smaller amplitude I.sub.S(ω.sub.H) is associated with a stationary region.
16. The method of claim 15 wherein the flow is a flow of blood in a blood vessel.
17. The method of claim 15 wherein the first and second visual properties are different shades of grey, colours or intensities.
18. The method of claim 16 wherein the first and second visual properties are different shades of grey, colours or intensities.
19. The method of claim 15 wherein the step of analysing I(ω) is performed such that a contrast in the processed image is increased between voxels associated with I.sub.L(ω.sub.H) and voxels or regions of interest associated with I.sub.S(ω.sub.H).
20. The method of claim 16 wherein the step of analysing I(ω) is performed such that a contrast in the processed image is increased between voxels associated with I.sub.L(ω.sub.H) and voxels or regions of interest associated with I.sub.S(ω.sub.H).
21. The method of claim 17 wherein the step of analysing I(ω) is performed such that a contrast in the processed image is increased between voxels associated with I.sub.L(ω.sub.H) and voxels or regions of interest associated with I.sub.S(ω.sub.H).
22. The method of claim 18 wherein the step of analysing I(ω) is performed such that a contrast in the processed image is increased between voxels associated with I.sub.L(ω.sub.H) and voxels or regions of interest associated with I.sub.S(ω.sub.H).
23. The method of claim 20 wherein the method comprises generating the processed image with improved blood vessel contrast.
24. The method of claim 15 wherein the step of analysing I(ω) comprises dividing I.sub.L(ω.sub.H) and I.sub.S(ω.sub.H) by an amplitude I(ωL) at a frequency ω.sub.L in a lower frequency range.
25. The method of claim 15 wherein I.sub.L(ω.sub.H) and I.sub.S(ω.sub.H) are respective averages of amplitudes within a predetermined frequency range, such as a range of frequencies greater than 0.5, 1, 2 or 3 Hz.
26. The method of claim 15 wherein I.sub.L(ω.sub.L) is an amplitude for a frequency of substantially zero (DC).
27. The method of claim 15 wherein providing a sequence of at least three images comprises providing a sequence of at least three depth images.
28. The method of claim 27 wherein the depth images are OCT images, such as OCT B-scans comprising a sequence of OCT A-scans.
29. The method of claim 28 wherein the OCT image may comprise a sequence of OCT B-scans from different locations within the material in order to obtain a volume image.
30. The method of claim 15 wherein providing a sequence of at least three images comprises obtaining OCT light spectra and then applying an inverse Fourier transformation to each obtained OCT light spectrum to transform the spectral intensity distribution associated with the OCT A-scan to a spatial intensity distribution for forming an image.
31. The method of claim 15 wherein the material is biological tissue, such as tissue within an eye and skin, such as a human eye and skin.
32. The method of claim 16 wherein the material is biological tissue, such as tissue within an eye and skin, such as a human eye and skin.
33. The method of claim 15 wherein the method is performed in-vivo.
34. The method of claim 16 wherein the method is performed in-vivo.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0019] Notwithstanding any other forms which may fall within the scope of the disclosure as set forth in the Summary, specific embodiments will now be described, by way of example only, with reference to the accompanying drawings in which:
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS
[0036] The present invention provides in a first aspect a method of detecting a flow in a sequence of images of a material. Referring to
[0037] The material in a specific embodiment is a biological tissue and more specifically human skin tissue, is performed in vivo and the method is a method of detecting a flow of blood within a blood vessel in the human skin. In a further embodiment, the material is a fabricated flow phantom comprising capillary regions and a static matrix region, which respectively model blood vessels and static tissue in a human tissue. The method more specifically comprises providing a sequence of at least three depth OCT images.
[0038] It will be understood that other biological tissues are however envisaged, such as tissue within a human eye. Materials other than a biological tissue are also envisaged and within the scope of the present invention. Further, the method may be performed ex-vivo.
[0039] As mentioned above, the inventors have observed that the amplitude I(ω.sub.H) in the higher frequency region is often larger for regions of interest which are associated with a blood flow in a blood vessel than for surrounding static tissue. This finding can be used to image for example blood vessels with a higher contrast.
[0040] Improving a blood vessel contrast for each of the flow phantom and for the human skin tissue in vivo will now be discussed. However, a person skilled in the art will appreciate that the present invention has broader applications. Further, it will be understood by a person skilled in the art that the present invention is not limited to OCT, but may be used for magnetic resonant imaging (MRI) and ultrasound imaging (for example).
[0041] An embodiment of the present invention comprises taking the frequency spectrum of a detected OCT signal from multiple acquisitions at a given voxel is analysed for each of the flow phantom and the human skin tissue and the method of detecting the flow of blood within a capillary and blood vessel, respectively, is herein referred as a short-time series OCT angiography (OCTA) method. The short-time series OCTA method is also compared to commonly used intensity-based OCTA methods, including speckle decorrelation (correlation mapping) and speckle variance. Results generally demonstrate, for a modest increase in acquisition times for a given OCT A-scan rate in the human tissue, improved vessel contrast and visibility, in particular, for small vessels. Further, the relative simplicity of the method lends itself to fast implementation. These advantages suggest its potential for future applications.
Methods
Short-Time Series OCTA Algorithm
[0042] The basic assumption underlying the method in accordance with an embodiment of the present invention is that blood flow induces stronger non-zero frequency components in the OCT signal than those induced by the surrounding static tissue. As with other OCTA methods, the method first requires the acquisition of co-located OCT B-scans (i.e., B-scans from the same lateral location) at multiple time points, throughout an acquisition volume. The OCT intensity signal (i.e., the modulus of the complex amplitude of the OCT signal) at the same voxel locations comprises a discrete time series with the nth sample at location (x, y, z) denoted by:
I(x,y,z;t.sub.n)=I(x,y,z;t.sub.1+(n−1)T), (1)
where (x, y, z) is the voxel coordinate in the fast scanning, slow scanning and depth axes, respectively; I represents the OCT intensity signal as a function of the voxel coordinate with time point t.sub.n for n, an integer ranging from 1 to 2N+1, where 2N+1 is the total number of co-located B-scans (i.e., total number of time samples) acquired from the same lateral location; and T is the time interval between co-located B-scans.
[0043] The time series at each voxel in Equation (1) is discrete Fourier transformed to obtain the complex frequency signal with the frequency components F denoted by:
F(x,y,z;f.sub.m)=F(x,y,z;mf.sub.o), (2)
where f.sub.0 is the interval between neighbouring discrete frequencies, determined by 1/[(2N+1)T]; and m is the index of the (two-sided) frequency components ranging from −N to N. The average magnitude of the complex frequency signal at non-zero frequencies is then calculated as
[0044] Alternatively, if many B-scans are acquired for analysis (i.e., 2N+1≥29 for the scanning parameters used in this study), instead of a single frequency component, a narrow band centered on the zero-frequency component is excluded (i.e., high-pass filtered). This narrow band should be optimized for a particular tissue and setup, and will depend on the frequency spectrum recorded from static tissue. The optimization for human skin tissue, recorded using our system parameters, is shown in the Results section. However, there, we demonstrate that only a small number of co-located B-scans (˜5) is required for practical imaging of the vessel network with our method. Thus, the elimination of only the zero-frequency component, as shown in Equation (3), applies.
[0045] After Fourier transformation, voxels with low OCT signal intensity lead to a correspondingly low magnitude of the complex non-zero frequency components, even if there is flow. To enhance the flow detectability at low OCT signal levels, we incorporate weighting by the inverse of the OCT signal intensity (i.e., zero-frequency component scaled by the number of co-located B-scans), given by:
where
OCT Scanning of Flow Phantom and Human Skin
[0046] OCT scans were acquired using a commercial spectral-domain scanner (an upgraded TELESTO II, Thorlabs Inc., USA) to demonstrate the short-time series OCTA method on both a flow phantom and in vivo on normal human skin. The system has a center wavelength of 1300 nm and provides an imaging resolution of 5.5 μm (in air) and 13 μm, respectively, axially and laterally (as defined by the vendor). The scanner was operated at 76 kHz (A-scan/s), below its maximum of 146 kHz. Scans were acquired in one of two modes: 2D scanning by acquiring 200 co-located B-scans from a single lateral location with a FOV of 6×3.6 mm (1024×1024 pixels) in x and z directions, respectively; and 3D scanning with a FOV of 6×1.8×3.6 mm in x, y and z directions. In 3D scanning mode, 240 lateral (y) locations were scanned with a set of 5 co-located B-scans acquired from each location, using the same pixel sizes in x and z directions as in the 2D mode. It took approximately 4 and 21 s to acquire a scan, respectively, in the 2D and 3D scanning modes. In addition, the time interval between B-scans was 17.8 ms (˜56 B-scans/s) for both 2D and 3D modes, leading to a discrete frequency spectrum with components up to 28 Hz.
[0047] For comparison to short-time series OCTA, speckle variance in the same 3D scans was calculated over the 5 co-located B-scans using the method presented by Mariampillai et al. in “Speckle variance detection of microvasculature using swept-source optical coherence tomography,” Opt. Lett. 33(13), 1530-1532 (2008). Speckle decorrelation was determined for each adjacent pair of co-located B-scans using the formula described in P. Gong, S. Es'haghian, K. A. Harms, A. Murray, S. Rea, B. F. Kennedy, F. M. Wood, D. D. Sampson, and R. A. McLaughlin, “Optical coherence tomography for longitudinal monitoring of vasculature in scars treated with laser fractionation,” J. Biophotonics 9(6), 626-636 (2016), with a window of 3×3 pixels in the fast scanning and depth axes. This led to four decorrelation B-scans from each lateral location, which were then averaged to generate a single enhanced decorrelation B-scan. In addition, the speckle decorrelation and speckle variance was weighted by the averaged and thresholded OCT signal at the corresponding pixels to reduce the noise (J. Enfield, E. Jonathan, and M. Leahy, “In vivo imaging of the microcirculation of the volar forearm using correlation mapping optical coherence tomography (cmOCT),” Biomed. Opt. Express 2(5), 1184-1193 (2011)). The threshold used in short-time series OCTA was used here. The same lateral averaging window (3×3 pixels) was applied to the short-time series and speckle variance images to ensure a fair comparison.
[0048] Blood vessels were mainly compared over a depth range of 300 μm from the skin tissue surface (determined from the OCT depth scan by assuming an average refractive index of 1.4) to ensure sufficiently strong signals from all three methods. For each method, the maximum OCTA signal of each A-scan in this depth range was used to generate a projection image of vessels. For visualization, the same colormap was used in the projection and cross-sectional OCTA images. The lower and upper thresholds were set at, respectively, the 50% and 99.5% points of the cumulative distribution function of the OCTA signal in the image. These thresholds were empirically chosen to maximize the vessel contrast without loss of vessels with low signal. For quantification, each projection image was processed to measure the vessel area density, defined as the ratio of the total vessel area to the total tissue area in the thresholded vessel image. The threshold was set using the Otsu's method for each image (N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Trans. Syst. Man Cybern. 9(1), 62-66 (1979)).
[0049] The silicone flow phantom was fabricated in house by mixing Elastosil® P7676A and P7676B fluid (Wacker Chemie AG, Germany) with titanium dioxide in a 3D-printed plastic container (see, S. Es'haghian, K. M. Kennedy, P. Gong, D. D. Sampson, R. A. McLaughlin, and B. F. Kennedy, “Optical palpation in vivo: imaging human skin lesions using mechanical contrast,” J. Biomed. Opt. 20(1), 016013 (2015)). The container was customized with two holes in the sidewall to hold a small glass capillary (outer diameter: 80 μm; inner diameter: 50 μm) that mimicked a blood vessel. After curing, the capillary was embedded in the silicone that mimicked the static tissue. The capillary was then connected to a syringe filled with a polystyrene microsphere suspension (nominally 0.5-μm diameter) to mimic the blood flow. The syringe was connected to a pump (Fusion 200, Chemyx Inc., USA) to introduce and control the flow speed. The scattering properties of the phantom were adjusted by tuning the ratio of titanium dioxide to Elastosil® P7676A and P7676B so that the phantom had a signal attenuation that approximately matched the attenuation of normal human skin.
[0050] Human subjects (n=4) were recruited for in vivo OCT scanning with ethics approval from the Human Research Ethics Committee of The University of Western Australia. Written consent was acquired from all subjects prior to OCT scanning of skin on the volar forearm, including one subject who had received laser treatment for wart removal. For this subject, one region from the treated area and one from the adjacent normal skin were selected for OCT imaging. To reduce bulk tissue motion during data acquisition, a spacer was attached to the skin surface to tightly couple the OCT probe and the skin tissue. A piece of thin metal with a center hole (5 mm in diameter) to image through was also attached to the skin as a fiducial marker to check for motion artefact. We observed a generally good vessel contrast and negligible vessel distortions, so no motion correction was performed. Further details on the imaging probe spacer and scanning setup can be found in P. Gong et al., “Optical coherence tomography for longitudinal monitoring of vasculature in scars treated with laser fractionation,” J. Biophotonics 9(6), 626-636 (2016). The acquired scans from the phantom and skin tissue were then processed using the three OCTA methods and compared.
Results
[0051] This section firstly considers the contrast present in the short-time series OCTA method and its optimization by selecting the number of samples and incorporating signal weighting. The difference between short-time series implemented on the OCT intensity and on the complex signal is also shown. Results from the optimized short-time series OCTA method are then compared to those acquired from speckle decorrelation and speckle variance.
Vessel Contrast
[0052] The blood vessel contrast in short-time series OCTA originates from the elevated non-zero frequency components induced by the moving scatterers in blood. An example of such vessel contrast, obtained from an extended time series of 200 B-scans,is shown in
[0053] Two-sided spectral density of the signal from 200 B-scans in the flow and static regions is shown in
[0054] The frequency spectrum of the OCT signal from the static matrix region in
[0055] Similar plots were obtained from in vivo skin, determined from 200 co-located B-scans, with the spectral density shown in
Choice of Time Series Length
[0056] The frequency spectra shown in
[0057] The average magnitude increases, for both the flow regions in the capillary/blood vessels and for the static matrix/static tissue, versus the number of acquired co-located B-scans, as does the difference in the average magnitude between the flow and static regions. Notably, the ratio between the two (dotted plots) peaks at around 5-10 co-located B-scans before it reaches a plateau (with local fluctuations). In
Signal Enhancement by Weighting
[0058] To enhance the vessel signal in the flow regions with low OCT signal, we further weight the average magnitude of non-zero frequencies by the inverse of the linear OCT signal intensity, as described in Equation (4). The weighted image in
[0059]
[0060]
Intensity Vs. Complex Signal-Based Processing
[0061] As with other OCTA methods, it is possible to analyze either the intensity or the full complex OCT signal (i.e., intensity and phase). The short-time series method was applied to both cases in the same skin scans. A representative example is shown by the vessel projection images in
[0062] A customized imaging spacer and setup was used to minimize motion during data acquisition, which has previously been shown to be effective when used in combination with the speckle decorrelation method (P. Gong et al., “Optical coherence tomography for longitudinal monitoring of vasculature in scars treated with laser fractionation,” J. Biophotonics 9(6), 626-636 (2016)).
[0063] Whilst residual tissue motion is almost absent in
Comparison with Speckle Decorrelation and Speckle Variance
[0064] To further assess the performance of the OCTA method in accordance with embodiments of the present invention, the short-time series OCTA method was compared to two commonly used intensity-based OCTA methods, speckle decorrelation (correlation mapping) and speckle variance, applied to sets of 5 co-located B-scans in 3D scans.
[0065] Referring to
[0066] Vessels from the forearm skin are projected from the surface to 300 μm in depth. The arrows in the
[0067] Thus,
[0068] Such improvement is further quantified by measuring the vessel area density, with an estimated accuracy of approximately 1%. This results in a superior area density of 28% for the short time-series image shown in
[0069] The consistent superiority of vessel contrast afforded by short time series OCTA is observed in all human subjects (n=4) in this study, with a further example shown in
[0070] To further elucidate the contrast differences among the three methods, an experiment was performed to examine the OCTA signal in the phantom versus flow speed (9 values ranging from 0 to 2 mm/s).
[0071] In addition to visualization of normal vessel networks, short-time series OCTA also shows good vessel contrast for the subject with a treated wart. The resulting vessel image is shown in
[0072] The wart was removed with a laser ˜16 years prior to OCT scanning. Comparison of the images generated by the three OCTA methods consistently shows the improved visualization by the short-time series method, for both the normal and treated skin regions (not shown). Though the treated region shows a very comparable skin color to the normal skin, the underlying microvasculature visualized by the short-times series method clearly reveals the morphological differences. For example, the treated region presents a network with more branches and a distinct honeycomb-like pattern (i.e., local loops), absent from the normal skin. The quantified vessel area density in the treated region (34%) is significantly higher than that in the normal skin (29%). Such visualization and the associated contrast demonstrate the potential of short-time series OCTA for future studies of various cutaneous conditions.
[0073] Another important factor is the computation time, which can be limiting for applications requiring near-real-time or real-time imaging. Overall, speckle decorrelation is more time consuming than short-time series or speckle variance due to the requirement for window processing (not simply averaging) to generate the vessel signal. It took ˜420 ms to calculate the decorrelation of a pair of B-scans (1024×1024 pixels per B-scan) using a 3×3 pixel window on an Intel® Core™ i7-3820 processor with MATLAB R2016a (The MathWorks, Inc.). When a larger window is used for processing, the computation time increases significantly (e.g., 990 ms for a 5×5 pixel window). In contrast, data processing for the short-time series method and speckle variance is much faster, taking ˜64 ms and ˜27 ms, respectively, to process each set of 5 co-located B-scans. This feature indicates the promise for future implementation of the short-time series method on fast scanning OCT systems to enable in-procedure or even real-time visualization of microvasculature.
DISCUSSION
[0074] The method proposed in accordance with the described embodiment takes a short time series of OCT B-scans, i.e. a sequence of at least three images acquired at the same location as an input, and performs a discrete Fourier transform to determine the frequency content in order to image blood vessels. The observed higher magnitudes at non-zero (high-pass) frequencies in the blood vessels (up to 28 Hz demonstrated here) create a clear contrast to distinguish blood vessels from surrounding static tissue. This method is easily applicable to OCT scans acquired using normal scanning parameters for imaging of the microvascular network. In case studies on human skin, short-time series OCTA shows moderately but consistently improved vessel contrast in comparison to speckle decorrelation and speckle variance, especially for the smaller vessels. Whilst the in vivo comparison was demonstrated on skin tissue, application of short-time series OCTA method to other biological tissues, such as the retina, is also envisaged.
[0075] The number of co-located B-scans acquired from the same location is an important parameter for the practical implementation of the short-time series method in accordance with embodiments of the present invention. We chose five in this study so as to minimize the amount of collected data and corresponding total acquisition time, whilst still attaining a high vessel/static tissue contrast in skin.
[0076] Thus, the short-time series OCTA method in accordance with the specific embodiment of the present invention demonstrates the performance of imaging of tissue microvasculature in vivo, wherein the flow-induced signature in the frequency domain via Fourier transform of the time series of the OCT signal in five B-scans from the same lateral location was analysed. The angiography signal is computed as the average magnitude of the non-zero (high-pass) frequency components, clearly differentiating blood vessels and static tissue, as demonstrated in a flow phantom and in human skin in vivo. Weighting of the angiography signal by the inverse of the mean OCT signal demonstrated improved detection of blood vessels. The imaging performance of short-time series OCTA was assessed by comparison to the commonly used speckle decorrelation and speckle variance methods, showing consistently substantially improved results, evidenced by improved visualization, especially for small vessels, and increased vasculature density of the human cutaneous microvascular network.
[0077] It is also to be understood that, if any prior art publication is referred to herein, such reference does not constitute an admission that the publication forms a part of the common general knowledge in the art, in Australia or any other country.