APPARATUS, METHODS AND SYSTEMS FOR FLUORESCENCE IMAGING

Abstract

The present patent application aims to teach apparatus, methods, and systems for providing accurate imaging in an OCT-Fluorescence imaging system, all the while decreasing lengthy processing times for the imaging, thus leading to a more accurate and timely delivery of data and images to the end user.

Claims

1. A method for correcting raw data collected from an OCT-fluorescence device, comprising: collecting raw data from an OCT-fluorescence device; determining a threshold value for the raw data collected based on the fluorescence raw data; identifying raw data that is outside the threshold value; setting raw data that is outside the threshold value at zero; and applying a first algorithm to the raw data within the threshold value to produce a corrected data.

2. The method according to claim 1, wherein the threshold value is calculated from a system background signal.

3. The method according to claim 1, wherein the raw data collected from the OCT-fluorescence device is pre-processed to remove outlier values.

4. The method according to claim 1, wherein the raw data collected from the OCT-fluorescence device is a single data element.

5. The method according to claim 1, wherein the raw data collected from the OCT-fluorescence device is a cluster of data elements.

6. The method according to claim 1, wherein the raw data collected from the OCT-fluorescence device, that is outside the threshold value is greater than the threshold value.

7. The method according to claim 1, wherein the raw data collected from the OCT-fluorescence device, that is outside the threshold value is less than the threshold value.

8. The method according to claim 1, wherein the method may be repeated for additional data.

9. The method according to claim 1, further comprising applying a second algorithm to the raw data collected from the OCT-fluorescence device, that is outside the threshold value.

10. The method according to claim 9, wherein the second algorithm is to set the data outside the threshold value to null.

11. method according to claim 1, wherein the first algorithm is a distance correction algorithm.

12. The method according to claim 11, wherein the distance correction algorithm comprises object surface segmentation in the raw data collected from the OCT-fluorescence device.

13. The method according to claim 11, wherein the distance correction algorithm further comprises calculating distance value between an object surface and an optical probe that corresponds to a fluorescence data position.

14. The method according to claim 11, wherein the distance correction algorithm further comprises calculating the correction factors by plugging in at least two distance values to a correction function and multiplying the correction factor to the raw data collected from the OCT-fluorescence device.

15. The method according to claim 11, wherein distance correction is selected from the group consisting of: OCT segmentation; distance calculation; distance correction of fluorescence; and combinations thereof.

16. The method according to claim 1, wherein the raw data collected from the OCT-fluorescence device, includes optical coherence tomography data and/or structural data.

17. The method according to claim 16, further comprising acquiring the fluorescence data and the structural data simultaneously.

18. The method according to claim 16, wherein the structural data and/or fluorescence data are acquired using a single catheter.

19. The method according to claim 16, wherein the structural data is delivered by a core of a double clad fiber and the fluorescence data is delivered by a cladding of the double clad fiber.

20. The method according to claim 1, further adjusting the raw data collected from the OCT-fluorescence device, by modifying the image contrast.

21. A method for correcting raw data collected from an OCT-fluorescence device, comprising: collecting raw data from an OCT-fluorescence device; calculating a distance from OCT-fluorescence device to a subject; determining a threshold value for the raw data collected based on the distance calculated; identifying raw data that is outside the threshold value; setting the raw data that is outside the threshold value at zero; and applying a first algorithm to the raw data within the threshold value to produce a corrected data.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Further objects, features and advantages of the present disclosure will become apparent from the following detailed description when taken in conjunction with the accompanying figures showing illustrative embodiments of the present invention.

[0028] FIG. 1 is a schematic illustration of an existing OCT-fluorescence imaging system according to the prior art.

[0029] FIG. 2 is a flowchart of signal processing for the OCT-fluorescence imaging system, according to the prior art.

[0030] FIG. 3 provides a schematic illustration of an exemplary OCT-fluorescence imaging system, according to one or more embodiment of the subject apparatus, method or system.

[0031] FIG. 4 is a flowchart depicting an exemplary workflow of distance correction algorithm, according to one or more embodiment of the subject apparatus, method or system.

[0032] FIG. 5 provides a schematic flowchart detailing an exemplary workflow of distance correction algorithm, according to one or more embodiment of the subject apparatus, method or system.

[0033] FIGS. 6A, 6B and 6C provide graphs depicting exemplary fluorescence data indicating: 6(A) the detection threshold; 6(B) longitudinal OCT image; and 6(C) two-dimensional distance corrected fluorescence image, according to one or more embodiment of the subject apparatus, method or system.

[0034] FIG. 7 provides a flowchart of the normalization of fluorescence dataset, according to one or more embodiment of the subject apparatus, method or system.

[0035] Throughout the Figures, the same reference numerals and characters, unless otherwise stated, are used to denote like features, elements, components or portions of the illustrated embodiments. In addition, reference numeral(s) including by the designation “'” (e.g. 12′ or 24′) signify secondary elements and/or references of the same nature and/or kind. Moreover, while the subject disclosure will now be described in detail with reference to the Figures, it is done so in connection with the illustrative embodiments. It is intended that changes and modifications can be made to the described embodiments without departing from the true scope and spirit of the subject disclosure as defined by the appended paragraphs.

DETAILED DESCRIPTION OF THE DISCLOSURE

[0036] As the optical fiber-based system has a fluorescence background signal (optical fiber autofluorescence or Raman) there is a detection threshold for distinguishing the background signal and the signal from the sample. Hence, any sample signal that is below the limit of detection (herein referred to as “LOD”) can be disregarded when contrasting a fluorescence image. LOD can be determined as a metric of the background signal average and the signal fluctuation value such as standard deviation of the background signal. For example, the following equation can be used.

LOD=x.sub.Bg+k.Math.S.sub.Bg

[0037] where x.sub.Bg and S.sub.Bg are an average and a standard deviation of background signal, respectively. k is a multiplication factor for standard deviation.

[0038] FIG. 3 shows an exemplary schematic of an OCT-fluorescence imaging system 10, according to one or more embodiment of the subject apparatus, method or system. An OCT light source 12 with a 1.3 μm is delivered and split into a reference arm 14 and a sample arm 16 with a splitter 18, creating a reference beam 20 and sample beam 24, respectively. The reference beam 20 from the OCT light source 12 is reflected by a reference mirror 22 while a sample beam 24 is reflected or scattered from a sample 26 through a circulator 28, rotary junction 30 (“RJ”) and a catheter 32. Optical fibers in the sample arm i6 are made of double clad fiber 36 (“DCF”) (DCF is used in the Patent Interface Unit, RJ and Catheter). Excitation light 34 for the fluorescence is also directed to the RJ 30 and the catheter 32, and illuminate the sample 26. The OCT light source 12 is delivered through the core of DCF 36 while the fluorescence light emitted from the sample 26 is collected through the cladding of the DCF 36. For pullback imaging, the RJ 3o is moved with a linear stage 38 to achieve helical scanning of the sample 26.

[0039] The optical fiber in the catheter 32 rotates inside the catheter sheath 40 and the OCT light 12 and excitation light 34 are emitted from the side angle of the tip of the catheter 32. The OCT light 12 is delivered back to the OCT interferometer circulator 42 and combined with reference beam 20 to generate interference patterns. The output of the interferometer 42 is detected with a first detector 44, wherein the first detector 44 may be photodiodes or multi-array cameras, then recorded to a computer46 through a first data-acquisition board 48 (“DAQ.sub.1”).

[0040] Simultaneously, the fluorescence intensity is recorded through a second detector 52 (e.g. photomultiplier) through a second data-acquisition board 50 (“DAQ.sub.2”). The OCT signal and fluorescence signal are then processed by the computer 46 to generate an OCT-fluorescence dataset 54, which consists of multiple frames 56 of helically scanned data. Each set of frames 56 consist of multiple data elements of co-registered OCT and fluorescence data, which correspond to the rotational angle and pullback position.

[0041] FIG. 4 provides an exemplary workflow chart of a distance correction algorithm, according to one or more embodiment of the subject apparatus, method or system. From the OCT-Fluorescence dataset 54, a first data section 58 of the OCT-fluorescence frame is selected. The first data section 58 can be a single data element or a cluster of data elements. If preferable, outlier data points in fluorescence data can be removed prior to the following steps. In order to remove outlier data, a smoothing filter can be applied to the OCT-Fluorescence dataset 54. The cluster of data elements can be a single frame or a set of frames of the helically scanned data. The maximum fluorescence value of the selected fluorescence data section is calculated and compared with the fluorescence detection threshold value. If preferable, a system limit of detection (“LOD”) value can be used as the fluorescence detection threshold value.

[0042] LOD can be specified according to the system specification, determined by the user, or determined with the system calibration data, such as background signal measurements. Based on the result of the comparison of maximum fluorescence value and the LOD, different algorithms can be applied to that data section 58.

[0043] In one embodiment, if the maximum fluorescence value is greater than LOD, a distance correction algorithm can be performed. Distance correction can include: OCT segmentation 68; distance calculation and calculating distance correction factor 70; and calculating distance-corrected fluorescence data 72. The distance-corrected fluorescence data 72 is stored as a new fluorescence value 78. If the maximum fluorescence value is lower than LOD, fluorescence value in the section can be set as null, and stored as new fluorescence value 78. In this case, no OCT segmentation 68 and distance correction calculation 7o is performed. The algorithm then selects the next data section 58′ and repeats the same steps until all data sections 58 of the OCT-fluorescence dataset 54 have been analyzed.

[0044] FIG. 5 provides a schematic flowchart detailing an exemplary workflow of a distance correction algorithm flowchart 62, according to one or more embodiment of the subject apparatus, method or system. Specifically, the flowchart 62 details when maximum fluorescence in the data section 58 is greater than LOD, the OCT-fluorescence dataset 54 is OCT segmented 68 and the distance between the catheter sheath and the sample lumen at the pullback position i and the angle j is calculated 70 and stored as d(i, j). By plugging d(i, j) into the predetermined distance correction factor F(d), a fluorescence correction factor K(i, j) 74 is obtained. The fluorescence dataset 48 is processed for fluorescence intensity correction 76 by multiplying the fluorescence correction factor 74 with the fluorescence value at the corresponding pullback position and angle. Pullback fluorescence dataset 48 has fluorescence value with a time stamp. The time stamp can convert to each position/angle since the spin and linear motor speeds are known. So fluorescence value is F(i,j), and d(I,j) is derived by OCT(I,j) with the lumen segmentation and distance calculation.

[0045] In another embodiment, the method to equalize the noise with distance correction is described. The NIRAF signal is normalized by the correction function to obtain distance independent value:

K(i, j)=F(d(i, j))

P.sub.Normal(i,j)=P.sub.raw(i, j)×K(i, j)

[0046] Where K is the correction factor, d is the distance from the probe to the target. F(d) is the correction function obtained from the experiment. P.sub.raw(i,j) and P.sub.Normal(i,j) are the pixel values before and after distance correction.

[0047] In one embodiment, a predetermined correction factor table for variable distance can be used instead of predetermined correction function. With the calculated distance d(i, j), the correction factor that is closest to d(i, j) is looked up from the correction factor table. By multiplying the selected correction factor to the fluorescence signal, distance corrected fluorescence value is obtained.

[0048] FIGS. 6A-6C provide graphs or images depicting the exemplary fluorescence data indicating: 6(A) the detection threshold 80; 6(B) longitudinal OCT image 82; and 6(C) two-dimensional distance corrected fluorescence image 84, according to one or more embodiment of the subject apparatus, method or system. In this instance, the graph illustrates OCT and fluorescence data 54 from a coronary artery employing the subject OCT-fluorescence imaging system. Fluorescence data elements 60 and the system detection threshold 80 is shown in FIG. 6A. Each pullback frame contains 500 fluorescence data elements 60. The frame number that contains the fluorescence value higher than the detection threshold 80 is identified by comparing the maximum fluorescence value 66 from the frame with the system detection threshold 80. For the identified frame, lumen segmentation was performed with the OCT data 54 and the distance between catheter sheath 4o and the lumen is calculated. The distance correction factor 70 is calculated by plugging in the distance value to the pre-determined fluorescence correction function 86. By multiplying the distance correction factor 70 to the fluorescence data 54, distance corrected fluorescence data 72 is obtained.

[0049] The fluorescence data elements 6o from the frames that do not contain the fluorescence data element higher than the system detection threshold 80 are set as null. New values are stored as distance corrected fluorescence data 72. Based on distance corrected fluorescence data 72, the fluorescence images may be rendered. FIG. 6C shows the exemplary distance corrected fluorescence in a two-dimensional image 84. With the above-detailed method of the current innovation, thresholding with LOD 64 or system detection threshold 8o is utilized, thus processing time is drastically reduced for distance correction and rendering, resulting in the amount of signal processing being significantly reduced without affecting the output image.

[0050] In another embodiment, depicted in FIG. 7, a method to normalize fluorescence value of OCT-fluorescence dataset obtained with OCT-fluorescence imaging system is described. This OCT-fluorescence imaging system is equivalent to the system in the above-detailed embodiment. However, in the present embodiment, the profile of fluorescence intensity within one pullback dataset can be better visualized. This is beneficial especially when the overall fluorescence signal level in one pullback is relatively small, and regions with lower fluorescence signal level, are almost invisible in the conventionally processed fluorescence image.

[0051] In FIG. 7, an exemplary flowchart of an internal normalization method is provided. The Fluorescence dataset 54 can be raw data or distance corrected data. If preferable, outlier data points can be removed prior to the following process. To remove outlier data, a smoothing filter 100 can be applied to the fluorescence dataset 54. The maximum value of a particular fluorescence data 54 is calculated and set as the upper range for fluorescence normalization. The lower range for fluorescence normalization can be LOD 64 value or pre-determined. The LOD 64 can be calculated, as previously described, using background signal average and fluctuation value such as standard deviation. Using upper and lower range for fluorescence normalization, 88 and 90, respectively, the OCT-fluorescence dataset 54 is normalized. The normalized OCT-fluorescence dataset 92 can be rendered to provide fluorescence images 94. With this normalization method, the normalization range varies for each pullback so it is not suitable for comparing different pullback images, but enables one to enhance the fluorescence profile within a single pullback dataset.

[0052] In another embodiment, the normalized OCT-fluorescence dataset 92 can be further modified by applying the gradation processing (e.g. gamma adjustment) to enhance the contrast of the fluorescence images. A non-linear gamma curve can be applied to the normalized data.

[0053] Rendered fluorescence image can be shown on the display attached to the computer. Different way of fluorescence data presentation can be used based on the user input. For example, distance corrected images can be shown first then a user can choose the internally normalized fluorescence images. In another embodiment, the user can also toggle with both raw image and corrected images. In another embodiment, different fluorescence images can be shown by overlaying multiple images based on user input.

[0054] During the distance correction process, while the signal amplitude is normalized to the distance, the noise in the NIRAF signal is also scaled accordingly. The correction process results in a NIRAF image with non-uniform noise distribution which makes the image quality in some area appear noisier than the other area and the signal to noise ratio of the image become non-uniform.

[0055] To correct the non-stationary noise issue produced by the distance correction process, a non-uniform image filtering approach is applied during the correction process.

[0056] It is reasonable and common practice to assume the NIRAF signal sensor produces the NIRAF signal with a stationary noise. Assume the stationary noise from the NIRAF signal sensor is N(0, σ.sup.2), which means that the standard deviation for each pixel P.sub.raw(i, j) is:

σ=√{square root over (Var(P.sub.raw(i,j)))}=√{square root over (E.sup.2(P.sub.raw(i,j)))}

[0057] After applying a distance correction, the corrected pixel P.sub.Normal(i, j) has a standard deviation of:

σ(P.sub.Normal(i, j))=√{square root over (E.sup.2(P.sub.raw(i, j)×K(i,j)))}=K(i, j) √{square root over (E.sup.2 (P.sub.raw(i, j)))}

[0058] To compensate for the factor of the standard deviation change, we apply a simple average filter mask centered at (i, j), with the mask size of K.sup.2(i, j), assuming the neighboring pixels all have the same distance correction factor. The resulted pixel has the standard deviation of:

[00001]$\sqrt{E^2\left(\frac{1}{K^2\left(i,j\right)}\Sigma P_{\mathrm{Normal}}\left(i,j\right)\right)}=\sqrt{\frac{1}{K^4\left(i,j\right)}{K}^2\left(i,j\right)E^2\left(P_{\mathrm{Normal}}\left(i,j\right)\right)}\sqrt{E^2\left(P_{\mathrm{raw}}\left(i,j\right)\right)}$

[0059] By applying the variable sized mask to the pixel value during the distance correction operation, the resulted NIRAF image maintains the uniform signal to noise ratio. In implementation, K can be selected based on the normalized farthest range of effective NIRAF range such that the correction factor K is always greater than 1.