Optical coherence tomography (OCT) apparatus and OCT method for axial tracking and flattening
11690516 · 2023-07-04
Assignee
Inventors
- Adrian Podoleanu (Canterbury, GB)
- Manuel Marques (Herne Bay, GB)
- Adrian Bradu (Faversham, GB)
- Adrian Fernandez Uceda (Canterbury, GB)
Cpc classification
G01B9/02091
PHYSICS
International classification
A61B5/00
HUMAN NECESSITIES
A61B5/16
HUMAN NECESSITIES
Abstract
The present specification relates to Master-Slave (MS) interferometry for sensing the axial position of an object subject to optical coherence tomography (OCT) imaging, and to MS-OCT applied to curved and axially moving objects. The methods and apparatuses allow producing OCT signals from selected depths within the object irrespective of its axial position in respect to the imaging system. Images are obtained for curved objects that are flattened along a layer of interest in the object, images that are used to provide OCT angiography images less disturbed by axial movement or lateral scanning.
Claims
1. An optical coherence tomography (OCT) apparatus, comprising: an optical imaging source launching a beam of light into a two arm imaging interferometer, and wherein due to interference of light returning from the two arms, an optical spectrum at an output of the two arm imaging interferometer is modulated to produce an optical channeled spectrum, wherein the optical imaging source is a swept source, an arm of the two arm imaging interferometer comprises a lateral scanner and an object to be imaged, and the lateral scanner scans the beam of light from the source towards the object in two lateral directions over r=1, 2 . . . R lateral pixels, where R is an integer, where the OCT apparatus further comprises: an imaging detector, a corrector, a sensor, an imaging Master Slave (MS) processor comprising a mask selector and a dynamic MS comparator with at least two inputs and, where the mask selector delivers at least one mask signal at its output, to the dynamic MS comparator, wherein for each lateral pixel, r, addressed by the lateral scanner, the OCT apparatus performs a spectral scan, comprising scanning the optical channeled spectrum at the two arm imaging interferometer output and where due to the spectral scan, the imaging detector delivers an electrical signal due to the optical channeled spectrum at the output of the two arm imaging interferometer, wherein the dynamic MS comparator comprises at least one MS-calculator, the at least one MS-calculator comprising two inputs, wherein one of the two inputs is for receiving the at least one mask signal delivered by the mask selector and the other input is for receiving the signal delivered by the imaging detector, wherein the mask selector comprises a store for two system functions g and h, the function g incorporating a chirp of the optical channeled spectrum due to nonlinear sweeping of the swept source and the function h incorporating the chirp of the optical channeled spectrum due to dispersion in the interferometer, and a mask-calculator, and where the mask selector is under a control input, where the mask signal represents an electrical replica of the optical channeled spectrum at the imaging interferometer output for a specific depth in the object z=mδ where δ is an axial resolution interval of the OCT and m is a mask index, where the mask-calculator in the mask selector operates a Master Slave algorithm that, based on the functions g and h, calculates any mask signal for any specific mask index determining any specific depth in the object, where a choice of mask indices of the mask signals to be calculated is controlled by signal received from the control input, where the sensor further comprises a sensor storage of mask indices, where the sensor measures an axial distance up to a part of the object, where that part coincides with the part being imaged by an optical beam from the imaging interferometer or is different than the part being imaged by the optical beam from the imaging interferometer, and where the axial distance measured is converted into the mask index, that is deposited in the sensor storage of mask indices, wherein mask indices for each r are converted by the corrector into a difference of mask indices in respect to a reference mask index that the corrector sends to the control input of the mask selector, wherein, based upon the difference of mask indices received at its control input, the mask selector calculates the at least one mask signal, and where the MS-calculator operates based on a Master Slave algorithm to deliver a reflectivity value from a depth z inside the object, that is the specific depth of the mask signal delivered by the mask selector to the dynamic MS comparator.
2. The OCT apparatus according to claim 1, where the mask selector further comprises a storage of masks calculated by a mask calculator and a distributor comprising a plurality of outputs, that under the control input distributes at the plurality of outputs of the distributor, the at least one mask signal from the storage of masks, towards the dynamic MS comparator.
3. The OCT apparatus according to claim 1, where the optical imaging source is a swept narrowband source and the imaging detector is a photodetector or a balanced photodetector and where the spectral scan means sweeping the optical spectrum emitted by the swept source at each r pixel, or where the optical imaging source is a broadband source and the imaging detector is a spectrometer and where the spectral scan means reading content of the spectrometer at each r pixel.
4. The OCT apparatus according to claim 1, where the sensor further comprises: a thresholder, and a sensor Master Slave processor whose input is connected to the output of the imaging detector, comprising Q two input MS-calculators, where the sensor storage of masks indices is organized as a matrix of Q rows and R columns, where Q is an integer, and where the thresholder delivers an array of mask indices to the sensor storage of masks indices for each r, populating its columns for each r at a time, where all indices in the column are set to nil, apart from a single index q of that mask that determined a variation of: the Master Slave signal strength along the depth in the object from mask index q to mask index q−1 larger than a threshold value in an array of set threshold values, with a value for each lateral pixel r.
5. The OCT apparatus according to claim 1, further comprising: R storages of signals representing optical channeled spectra, a storage for each r, acquired from the imaging detector, where the sensor further comprises: a storage of masks containing Q mask signals, a thresholder, a sensor Master Slave processor comprising R two input MS-calculators, whose first inputs are connected each to the storage of each signal representing an optical channeled spectrum r and where all second inputs are tied up to a common entry receiving a mask signal at a time from the storage of masks signals, where the sensor storage of masks indices is organized as a matrix of Q rows and R columns, where Q is an integer, and where for each mask delivered by the storage of masks signals to the common entry connected to the second input of the R two input MS-calculators, the R two input MS-calculators deliver R Master Slave reflectivity strengths to the thresholder, where the thresholder contains a level comparator, and where the thresholder delivers an array of mask indices to the sensor storage of masks indices for each index q, where q=1, 2 . . . Q, populating its rows for each q at a time, where all indices in the rows are set to nil, and apart from those lateral pixel indices, where a variation of: the Master Slave signal strength along the lateral pixel r, from pixel r to pixel r-1 is larger than a threshold value in an array of set threshold values, with a value for each lateral pixel r.
6. The OCT apparatus according to claim 1, where the sensor comprises: a thresholder, a Fourier Transform (FT) processor whose input is connected to the output of the imaging detector, that produces an A-scan for each r spectral scan, where the sensor storage of masks indices is organized as a matrix of Q rows and R columns, where Q is an integer, where the thresholder delivers an array of mask indices to the sensor storage of mask indices for each r, populating its columns for each r at a time, where all indices in the column are set to nil, apart from a single index m that determined a variation of: the A-scan signal strength along the depth in the object from distance (m−1)δ to mδ larger than a threshold value in an array of set threshold values, with a value for each lateral pixel r, and where δ is the axial resolution interval of the OCT and m an integer number.
7. The OCT apparatus according to claim 1, where the sensor targets a layer at a certain depth in the object, and where the OCT apparatus further comprises: a mode switch synchronized with the lateral scanner, to switch the operation of the OCT apparatus between two operational modes, sensing and flattening, where the OCT apparatus additionally comprises a store of R storages, a storage for each signal representing an optical channeled spectrum r, where the mode switch, during a first lateral scan, switches the OCT apparatus into the sensing operational mode, when signal is acquired from the imaging detector and each signal representing the optical channeled spectrum r is deposited for each r into the store r of the R storages, the sensor determines for each lateral pixel, r, an axial position of that pixel object in respect to the axial distance of a reference pixel, and converts that distance information into a mask index that is deposited into the Sensor storage of mask indices, and where the mode switch, during a next lateral scan, switches the OCT apparatus into flattening operational mode, where depending on information of axial distance received from the sensor storage of mask indices, for each r, the corrector actuates on the mask selector to generate or select a single mask to be provided as input to the sensor Master Slave processor to perform a Master Slave protocol with the r-th electrical signal representing the optical channeled spectrum stored during the sensing mode, to produce the reflectivity of the pixel r in a flattened en-face OCT image at a depth of the mask used, selected in respect to the layer targeted by the sensor.
8. The OCT apparatus according to claim 1, where the sensor targets a layer at a certain depth in the object, and wherein the OCT apparatus further comprises a mode switch synchronized with the lateral scanner, to switch the operation of the OCT apparatus between two operational modes, sensing and flattening, wherein the OCT apparatus additionally comprises a store of R storages, a storage for the electrical signal representing each channeled spectrum r, where the mode switch, during a first lateral scan, switches the OCT apparatus into the operational sensing mode, when signal is acquired from the imaging detector and each signal representing the optical channeled spectrum r, is deposited for each r into the storage r of the R storages, the sensor determines for each lateral pixel, r, an axial position of that pixel object in respect to the axial distance of a reference pixel, and converts that distance information into a mask index that is deposited into the sensor storage of mask indices, and where the mode switch, during a next lateral scan, switches the OCT apparatus into flattening operational mode, where depending on information of axial distance received, the corrector actuates on the mask selector to generate or select Q masks, where Q is an integer, to be provided as inputs to the Imaging Master Slave processor to perform a Master Slave protocol with the stored electrical signal representing the r-th optical channeled spectrum during the sensing mode, to produce an axial reflectivity profile of Q depths at each pixel r in a cross section OCT image, flattened along the depth of the layer targeted by the sensor.
9. The OCT apparatus according to claim 1, where the sensor collects signal from a second two arm interferometer and further comprises a second optical source, where one arm of the second interferometer shares its path with the imaging interferometer to send a second beam of light from the second optical source towards the object and to collect signal from the object, where due to interference, the optical spectrum at an output of the second interferometer is modulated producing a second optical channeled spectrum, where the sensor further comprises: a second detector producing an electrical signal representing the second optical channeled spectrum at the output of the second interferometer, a sensor thresholder, a sensor Master Slave processor for the signal at the output of the second detector, containing a sensor mask storage, a sensor compound level comparator of N MS-calculators, where N is an integer, wherein in a sensor storage of mask indices for each time event, e=1, 2, . . . E, where E is an integer, during an observation time length, where E is larger than R, and where the sensor thresholder contains a sensor level comparator of the Master Slave signal strength delivered by each MS-calculator in the compound comparator with a threshold value in an array of set threshold values, with a value set for each time event e, and where the sensor level comparator of signal strength delivers an array of mask indices that are placed in the sensor storage of mask indices for each e.
10. The OCT apparatus according to claim 9, where the second optical source is a second swept narrowband source and the second sensor detector is a second photodetector or a balanced photodetector and where the spectral scan means sweeping the optical spectrum emitted by the second swept source at each e event, where e=1, 2, . . . E with E>R or where the second optical source is a second broadband source and the second sensor detector is a second spectrometer and where the spectral scan means reading content of the second spectrometer at each e event, where e=1, 2, . . . E with E>R.
11. The OCT apparatus according to claim 1, where the sensor collects signal from a second two arm interferometer and further comprises a thresholder and a second optical source, where one arm of the second interferometer shares its path with the imaging interferometer to send a second beam of light from the second optical source towards the object and to collect signal from the object, where due to interference, the optical spectrum at the output of the second interferometer is modulated producing a second optical channeled spectrum, where the sensor further comprises: a second detector producing an electrical signal representing the second optical channeled spectrum at the output of the second interferometer, a sensor thresholder, in a Fourier Transform (FT) processor for the signal at the output of the second detector, and in a sensor storage of mask indices for each lateral pixel r, where the thresholder contains a level comparator of an FFT signal strength with a threshold value in an array of set threshold values, with a value for each time event e=1, 2, . . . E, where E>R, and where the level comparator of the FFT signal strength delivers an array of distance positions in depth, that after division of such distance by δ, where δ is the axial resolution interval of the OCT, the results are placed in the sensor storage of mask indices for each e.
12. The OCT apparatus according to claim 1, where the sensor is connected to the output of the imaging detector and where the OCT apparatus further comprises a second sensor, where the corrector admits signal from a second input and where the second sensor senses an axial position of the object and the output of the second sensor drives the second input of the corrector.
13. A method for imaging a curved, axially moving object, the method comprising: using a Master Slave-OCT protocol applied to two electrical signals, one electrical signal represented by a mask signal and the second electrical signal represented by a signal delivered by an imaging detector, at the output of a two beam imaging interferometer producing interference of light, from light collected from an object arm and from a reference path, wherein the object arm comprises a lateral scanner; associating the mask signal to a mask index that represents a depth in the object; performing a spectral scan on each lateral pixel of the object to deliver the second electrical signal; for each lateral pixel addressed by the lateral scanner, using a sensing method to sense a variation of depth of the lateral pixel of a targeted layer, that is translated into a variation of the mask index, where the variation of depth is due to a cumulated effect of object curvature and object axial movement, wherein the sensing method operates in synchronism with the lateral scanner; and using a correcting method to prepare the mask index of the mask signal selected to be used by the Master Slave-OCT protocol to generate a signal reflectivity from the depth in the object as represented by the mask index of the mask signal selected, wherein the correcting method comprises dynamically varying the mask signal used by the Master Slave-OCT protocol according to the sensing method.
14. The method according to claim 13, wherein the sensing method uses the same signal collected by the imaging interferometer to sense an axial position of each pixel laterally scanned using the Master Slave-OCT protocol, and based on axial distances measured, establishes an array of correcting indices placed in a corrector, where the method further comprises dynamically changing the mask indices used by the Master Slave-OCT protocol for creating the OCT images using the array of correcting indices.
15. The method according to claim 13, where the sensing method uses the same signal collected by the imaging interferometer to sense an axial position of each pixel laterally scanned using Fourier Transform processing, and based on axial distances measured, establishes an array of correcting indices placed in a corrector, where the method further comprises dynamically changing the mask indices used by the Master Slave-OCT protocol for creating images using the correcting indices.
16. The method according to claim 13, where the sensing method comprises: using a second interferometer to collect scattered light from the same or a different part of the object than a part used by the imaging interferometer; using the scattered light to sense an axial position of the object; based on axial distances measured, establishing an array of correcting indices and placing the array of correcting indices in a corrector; and dynamically changing the mask indices used by the Master Slave-OCT protocol for creating images using the correcting indices.
17. The method according to claim 16, where the correcting method employs results of the sensing method using both signals from the imaging interferometer and from the second interferometer, each targeting a different part of the object, to reduce effects of object bulk axial movement while conserving a measurement of relative axial movements between the two different object parts.
18. The method according to claim 13, where for each spectral scan, a single mask is chosen by the sensing method to be used by the Master Slave-OCT protocol to generate a flattened en-face OCT image of a layer targeted by the sensing method.
19. The method according to claim 18, further comprising: producing at least two en-face OCT images of the layer targeted by the sensing method at different times; performing a variational method on the two en-face OCT images to obtain an OCTA image that substantiates temporal variations in the layer targeted by the sensing method; repeating the producing and the performing for different targeted layers in the object, followed by superposition of all OCTA images for each targeted layer to obtain a global OCTA volume of flattened and axially corrected OCTA images.
20. The method according to claim 13, further comprising: using a set of Q masks as chosen by the sensing method to be used by the MS-OCT protocol to generate for each spectral scan a corrected A-scan, where Q is an integer; and obtaining, by assembling the A-scans together, a B-scan OCT image flattened along a contour of a layer in the object targeted by the sensing method.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
(24)
(25)
(26)
(27)
(28)
(29)
(30)
(31)
(32)
(33)
(34)
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
(35) Various features of the embodiments described herein, as well as other objects and advantages attendant thereto, are set forth in the following description and the accompanying drawings in which like reference numerals depict like elements.
(36) The embodiments described herein can be implemented in different versions, using a single or two interferometers.
(37)
(38) The decoder 2 provides a synchro signal, 23, for each spectral scan enabled by the swept source 211 or the spectrometer 220, depending on the technology used, in synchronism with moving the scanned beam from pixel r ro pixel r+1, in a time t.sub.r, where r=1, 2, . . . R. For instance, when using a swept source 211 or spectrometer 220 at 100 kHz, t.sub.r=0.01 ms. This means that for a triangular signal applied to the fast scanner 110 of period T.sub.x=4 ms, on each ramp, in 2 ms, a total of R=200 pixels are scanned along the horizontal axis X. Matching the number of scanned pixels with pixels in the C-scan image H=200 and making the image square, i.e. for V=200 lines, a frame raster of H=V=200 pixels on each ramp takes t.sub.F=0.8 s. For a saw-tooth signal driving the slow scanner 111, along coordinate Y (vertical), the two frames can be combined to assemble a frame of H=200 and V=400 (by flipping one of them horizontally, according to means known in the art of scanned imaging systems). The frame scanner 111 can also be driven by a stair type of signal, stepping the voltage applied to the frame scanner, to allow on each step to acquire two or more T-scans. Such an operation is presented by the end of the disclosure, to obtain angiography information, i.e. OCTA information.
(39) These calculations give an idea of time available for the different processes, where real time correction would mean correction on the fly, during the spectral scan, i.e. in a time t.sub.r, where the information from the sensor 8, utilized by the corrector 9 actuates the Mask selector 5 in real time, Quasi real time would mean correction done with some delay, either within the time of a ramp T.sub.x/2 or during the period of the triangle T.sub.x, or during the time of a raster t.sub.F. The embodiments further presented can be adapted to operate between real time and quasi real time depending on the digital resources allocated for parallel processing. They also allow for post-acquisition, where correction is done long after the acquisition ended, i.e. after the time of a frame t.sub.F, employing R memories of mask indices correction data, i, and of R channeled spectra.
(40) Such control of operational modes is performed by a mode switch, 113, synchronized with the lateral scanner 11, that distributes enabling control signals to different blocks, sensor 8, MS-processor 6, corrector 9 and as disclosed below to different memories of signals. Different processes of acquisition, sensing, storage and correction are interleaved in the time between trigger pulses 112 in synchronism with the deflection of the scanners in 11. Processes of acquisition, sensing, storage may be inserted within a T.sub.x/2 interval or spread over the whole T.sub.x or over a few T.sub.x intervals, in which case, the trigger 112 is acquired from the driving signal applied to (or from the position sensing of) the fast lateral scanner 110. Processes of sensing and correction may require longer, over the period of a frame, t.sub.F, in which case, the trigger 112 is acquired from the driving signal applied to (or from the position sensing of) the slow lateral scanner 111.
(41) The sensor can use signal 20 from the imaging interferometer 1, as in the embodiments shown in
(42) As disclosed further below, different embodiments of the MS-processor are possible adapted to optimize the time of response to different tasks, depending on the need to generate C-scans or B-scans.
(43)
(44) Because a single mask is necessary or a few only, it is more advantageous to avoid transfer of data between a storage and MS-calculator 41(q) and faster operation is achieved by calculating the mask needed on the fly, as disclosed in this embodiment. For each pixel r, input 95 provides a correction of the mask index p, from p to p+i to produce via the MS protocol the complex reflectivity 40 for the depth of the mask p+i, 40(p+i).
(45)
(46) Dynamic changes of many masks used in a single spectral scan may be slow in case a large number Q of masks are used or their number of sampling points, M is high. In a FPGA environment this may not be a problem, but for a graphic cards environment often transfers from memories take time. This issue is addressed in the embodiment of the MS processor in
(47)
(48) When a single en-face image is needed only, such as in rapid investigations in ophthalmology and surgery, flattened, irrespective of the tissue curvature and axial movement, the MS-processor 6 in
(49)
(50) The range of masks, N, calculated in
(51) To cover an axial range of N depth points, the FFT utilizes 2N samples and performs ˜2N log.sub.2(2N) operations, according to Cooley-Tukey radix-2 implementation.
(52) The MS protocol requires ˜2N.sup.2 operations to generate reflectivity values in N axial slots.
(53) To cover an axial range of Q<<N depth points, MS requires 2NQ operations. In the example above, where Q=10 and N>512=2.sup.9, 2NQ is smaller than 2N log.sub.2 N, i.e. processing is faster than performing Fourier transformations. The comparison above does not include the time required for data resampling required before calculating the FFT, in which case MS becomes comparatively faster than a FFT for a larger Q value. Calculations above are only illustrative, if complex master slave process is compared with complex FFT, then other coefficients should be used in terms of the number of operations required by MS and FFT.
(54) In comparison to the prior art in
(55) Therefore, in
(56) In different implementations as disclosed below, the MS-processor 6 may be used in different scenarios in terms of selection of masks from the Mask selector 5. A set of Q masks from within the set of N masks is used to generate cross section OCT (B-scans), where the indices in the set used are from p, to p+Q in
(57) For instance, let us consider simple examples, such as the storage of masks 52 equipped with N=10 masks, indices 1, 2, 3, . . . 10. For continuous depth ranges, such as needed in B-scans, a set of Q=5 masks are used, such as 4, 5, 6, 7, 8, or 3, 4, 5, 6, 7, i.e. mask indices are in continuous succession in the set selected and slid around under control 95.
(58) For two C-scans, embodiments may use only mask index q=3 and q′=7, for two distanced targeted layers in the object, i.e. not necessarily next to each other within the set of N mask indices.
(59) When performing a C-scan, a single MS-calculator 41(q) is used. When performing a B-scan, Q MS-calculators 41(p), 41(p+1), . . . 41(p+Q) are used, where mask index p determines a reference depth wherefrom the tracking axial range starts.
(60) The four embodiments in
(61) Flattening
(62) To perform flattening, the embodiment in
(63) Schematic diagrams of the sensor 8 (left) and MS-processor 6 (right) are presented in
(64) The sensor in
(65) Variations of signals 40 over depth in
(66) Performing segmentation via the MS protocol is possible via two possible scenarios.
(67) (i) As shown in
Modulus difference of {[modulus of complex signal 40(q.sub.r)]−[modulus of complex signal 40(q.sub.r−1)]}>Threshold (1)
(68) Each spectral scan controlled by 23 ends for each r with the index q.sub.r of the mask where the change in amplitude from mask q−1 to mask q exceeded the threshold established for that r, 81.sub.r. Retention of mask index is shown in
(69) Let us suppose that the object is a metal sphere, i.e. a single surface object, as shown by the contour 3 (3′) in
(70) (ii) As shown in
Modulus difference of {[modulus of complex signal 40.sub.r(q)]−[modulus of complex signal 40.sub.r-1(q)]}>Threshold (2)
(71) The process is repeated for all Q masks under control repetition trigger 23″. As each time the mask index delivered by 5″ is known, in this scenario is not the depth (mask index thought after) but the pixel index r. This is equivalent on placing a T-scan along the contour of a curved single layer object 3 as shown in
(72) As shown in
(73)
Modulus difference of [Modulus of A-scan at depth (z.sub.r+δ)−Modulus of A-scan at depth z.sub.r]>Threshold (3)
(74) the depth z.sub.r of the A-scan peak is retained. In this case, what is retained after thresholding is the distance z.sub.r, of the A-scan peak position, considering that by adjusting the threshold value, each A-scan reduces to a single peak. What is now input to the array 83′ are not the mask indices such as in 83, but the depth position, z.sub.r, where the strength of A-scan variation from a depth slot to the next exhibited the peak. As shown in
(75) For better clarity in the different modes of operation of sensors in
(76)
(77) Am equivalent matrix can be written for 83′, by multiplying the matrix in (4) by δ. Similar to the embodiment in
(78) In
(79) For flattening of a T-scan, the embodiments in
(80) The arrays 83 are sent via 84 to the corrector 9, that in its storage 94 will contain the mask indices, values from p+1 to p+Q as well as difference of indices, starting from a reference value, such as 83.sub.r−83.sub.REF=q.sub.r−q.sub.REF. For reference taken from the first pixel, r=1, q.sub.REF=q.sub.1, in which case q.sub.r−q.sub.1 are stored. Reference can also be taken not from the first pixel but from the pixel in the middle of the T-scan line, or in the middle of the C-scan, at R/2 (in which case the storage 94 stores q.sub.r−q.sub.R/2 values) as well or from the pixel where maximum or minimum mask index was retained.
(81) To generate a single C-scan, the MS-processor 6 in the right-hand side of
(82) The differences i, from a reference index, either first index or that in the middle of T-scan or in the middle of the C-scan, depending the case, are used for the correction function, delivered by 9, to dynamically change the mask used for MS operation for each lateral pixel r, by the Mask selector 5.
(83) To allow for timely correction of the acquired set of electrical signals corresponding to the channeled spectra, they are stored in the storage 99 and are transferred to be used with the required delay in memory 99″, synchronized by trigger 112.
(84) In the corrector 9, irrespective of the segmentation (edge detection) method used for sensing, using MS of FFT, the output, i, shown in
(85) At the bottom of each
(86) Let us consider H=V=200 pixels along horizontal and vertical directions. Using a swept source at 100 kHz, for H=200, a lateral scan of R=200 pixels lasts 2 ms, this represents the duration of one ramp signal applied to the fast lateral scanner 110. Two ramps would mean a triangular shape of the signal applied to 110 of period T.sub.X=4 ms. (For resonant scanners, due to their sinusoidal displacement, elimination of fly-backs requires T.sub.X slightly longer).
(87) In some cases, as shown in
(88) The intervals shown at the bottom of
(89) In case of acquisitions of stationary curved objects, the data does not vary in time, so in this case there is no need for memory 99″ to store the channeled spectra. In such cases, correction can be applied to a new set of channeled spectra acquired. Otherwise, if object is subject to movement, the R channeled spectra 20 are stored for one or more sub-periods or periods of the fast lateral scanner 110. In this way, corrected, flattened T-scans are delivered with delays of a few milliseconds only. Considering the embodiment in
(90) Overall operation can be made faster using parallel processing, by engaging parallel processing, using multiple CPUS, GPUs or FPGAS. By storing R channeled spectra, Q MS-calculators 41 can be engaged in R batches to operate in parallel in the sensor 8 in
(91) For simplicity, the sketches in
(92) In case of tissue, such as cornea, retina, there is more than a single peak in the A-scan. Targeting to edge detect the interface between the retina and vitreous, the inner limiting membrane exhibits a small reflectivity and therefore the threshold in 82 is set low. Targeting to edge detect the RPE that is more reflective, the threshold is set higher. If the object imaged 3 is cornea, that is curved and returns a lot in its center and less from edges, some knowledge of the lateral variation of the signal amplitude is needed to set the values of thresholds along the lateral coordinate, X and r, via line 86.
(93) Results obtained with a proof of concept system are presented in
(94)
(95)
(96)
(97) For the computer used to produce the images in
(98) For the segmentation (edge detection) operation based on A-scans obtained by FFT (i.e. using
(99) These examples of times are important in establishing engagement of parallel resources. The disclosure refers to such option for the developer to engage MS or FFT in the sensor depending on the object imaged and digital resources available, while at the correcting stage, MS in the final imaging procedure employs dynamic allocation of masks.
(100) If the layer in question has weak contrast and an automated segmentation fails, embodiments described herein protect the solution where it is possible to also accept manual segmentation. An user can manually introduce a manual contour approximating a layer selected on the image via input 87. No thresholder 82 is used in this case in
(101) Preliminary results using manual input 86 are presented for a metallic sphere as object 3. In
(102) In
(103) In
(104) In comparison with
(105) Axial Tracking Using a Second Interferometer
(106)
(107) The second interferometer consists in a splitter 12S, reference mirror 13S shared beamsplitter 12c and part of the object 3′. Supplementarily, the apparatus also consists in a decoder 2S that incorporates a source 21S and a reader 22S. The second interferometer collects signal from the top of the organ in surgery, or when imaging the anterior chamber in an eye, from cornea, where in both examples 3 and 3′ coincide. When imaging the retina 3 of an eye, light in the second interferometer is collected from the cornea 3′, as shown in
(108) When imaging the retina 3 and using cornea as 3′ for sensing, the interface optics to collect optical signal from either cornea or retina is not shown, but utilization of focusing elements to either cornea or retina is obvious for the person skilled in the art as disclosed in U.S. Pat. No. 8,678,594 “Apparatus and method of monitoring and measurement using spectral low coherence interferometry”, by A. Gh. Podoleanu and M. Leitner. The two decoders 2I and 2S preferentially should employ optical sources 21I and 21S of different wavelengths in order to enable a dichroic filter as the shared beamsplitter 12c, in this way reducing the losses at both wavelengths.
(109) The sensor 8S outputs data on the axial position of the part of the object 3′, along line 84S to a corrector 9. This information can be obtained based on the MS principle as disclosed in
(110) This axial information can be used post acquisition, as well as in real time, or quasi real-time, as explained more below.
(111) Sensing the Axial Position of the Object Along a Stationary Beam and Correcting for Axial Distance the Images Generated
(112) Schematic diagrams of the sensor 8S (left) and MS-processor 6I (right) used in the embodiment in
(113) The main differences in the
(114) It is now possible to have several sensing events e, along line 23S from decoder 2S, per each spectral scan, r, event synchronized along line 23I by decoder 2I. For example, the imaging can use a swept source 211I at 1060 nm for retina at 100 kHz sweeping rate, t.sub.r=10 microseconds and the sensor 8S to employ a swept source 211S at 1300 nm at 1 MHz, t.sub.e=1 microsecond, in which case sensing is updated 10 times for each lateral pixel, r. In this way, 10 axial distance values are measured per each imaging spectral scan, r, that can allow obtaining an average distance position to be used for the i-correction delivered via 84 to corrector 9. In case there are variations in the axial distance during the imaging spectral scan, i.e. if the 10 measurements differ considerably, that scan r is discarded and another set of sensing scans (in this example 10), for the same r can be repeated. Sensing acquisition events, e, are synchronized by trigger 23S, but sensing information can only be accepted by 5I at the rate imprinted by trigger 23I.
(115) Sensing the axial position of the object 3(3′) using
Modulus difference of {[modulus of complex signal 40(q.sub.e)]−[modulus of complex signal 40(q.sub.e−1)]}>Threshold (5)
(116) For each sensor spectral scan event e, a single index, q.sub.e, in the array 83.sub.e of Q elements is different from zero, that is retained.
(117) As shown in
(118) For each spectral scan event, e, trigger 23S, an array 83 of mask indices is produced. For each e, the array 83 of Q elements contains a single index q.sub.e different from zero with all others set to zero. If the threshold is set right, a single element of the array 83e is different from zero and all others are set to zero. This is shown in
(119) Sensing the axial position of the object 3(3′) using
Modulus difference of {[modulus of complex signal 40.sub.e(q)]−[modulus of complex signal 40.sub.e-1(q)]}>Threshold (6)
(120) What is now retained when equation (6) is accomplished is the index of the event e, for each mask 50(q), as the mask index q now is known, as a difference to the procedure in
(121) The process is repeated for all Q masks under control repetition trigger 23″. As each time the mask index of the mask delivered by 5″ is known, in this scenario is not the depth (mask index thought after) but the index of the event, e. This is equivalent on placing a T-scan above the contour of the axial variation in time of the object, in
(122) Sensing the axial position of the object 3(3′) using
Modulus difference of [Modulus of A-scan at depth d+δ)−Modulus of A-scan at depth d]>Threshold (7).
(123) In this case, what is retained after thresholding is the distance from a start depth of the A-scan peak position, considering that by adjusting the threshold value, each A-scan reduces to a single peak. What is now placed in 83′ are not the mask indices such as in 83, but the depth position, z.sub.e, where the strength of A-scan variation from a depth slot to the next exhibited the peak. A FFT processor 6″ processes the channeled spectrum 20S and produces A-scans that are sent to the thresholder 82. As in
(124) For all embodiments in
(125) The sensor 8S sends data on the axial position of the object 3(3′), along line command 84 that controls the operation of the MS processor 6I. The Mask selector 5 in the MS-processor 6I, receives such information, i, from the corrector 9.
(126) The sensors in
(127) Another possibility to track a continuous drift, is to use a reduced number of masks around the new axial position if it is known that sudden big jumps are excluded from one correction to the next. Dynamic search in depth can be performed initially with a large number of masks, which after the contour is detected, the number of masks is reduced to maintain tracking.
(128) Obviously, for ultra-fast sensing and parallel processing, it is possible to reduce delay between sensing and tracking to the time taken by a spectral scan, i.e. to perform the sequence of the two modes of operation for each r, sensing and axially tracking in a time interval matching the spectral scan duration. For instance, sweeping at 10 kHz would mean 0.1 ms per each imaging scan, event line 23I, and in this time, it would allow ultra-fast sensing at larger frequency rates to provide the mask indices in the array 83 within sensor 8S (
(129)
(130) As detailed in
(131) As further detailed in
(132)
(133) To avoid the flyback due to switching back a scanner in a short time, when using a sawtooth signal, a triangular signal can be used, in which case each T-scan is bidirectional. In this case, 4 unidirectional T-scans are acquired for each y, two on the ascending ramps and two on the descending ramps, to perform variance calculation between the information collected during deflection events in the same direction (variance applied to the acquired data on the 1.sup.st and 3.sup.rd ramps, both ascending, and variance applied to the acquired data on the 2.sup.nd and the 4th ramps, both descending). In this case, 1.sup.st Tscan and 2.sup.nd T-scan in
(134) The resulting TscanA is made from an OCTA scan for left-right deflection and continuing with an OCTA scan for right-left deflection. An overall TscanA at the coordinate y is obtained by superposing one with the other one flipped horizontally.
(135) Different other scenarios are possible, where more than two T-scans are used in calculation of the variance. It is also possible to apply variance between the two signals acquired during opposing deflections, obtained from the two ramps of a triangular signal. In this case, the time intervals between the pulses 112 in
(136) By repeating the process in
(137) The method can be repeated for many other depths, Q, to produce Q C-scans. By parallel processing, these can be obtained in the same time of a frame, t.sub.F. It should be noticed, that for repeating calculations for other depths, the same information of axial correction is used in all, i.e. the same difference of indices i delivered by the corrector 9. These indices are being advanced by one for each new C-scan, to obtain a flattened C-scan image below the previous C-scan, all flattened. This means that sensing, as a process is required only once and not repeated Q times, in order to obtain volumetric data of OCTA information in Q C-scans.
(138) As the masks are complex, variance calculation for the two images can involve modulus and phase of the complex signal, according to means known in the art for evaluating amplitudes and phase variance from one image to next. Calculation of differences is similar to that used in the paper by S. Caujolle, R. Cernat, G. Silvestri, M. J. Marques, A. Bradu, T. Feuchter, G. Robinson, D. K. Griffin and A. Podoleanu, “Speckle variance OCT for depth resolved assessment of the viability of bovine embryos”, Biomed. Opt. Express 8, 5139-5150 (2017). This refers to squared differences of amplitudes for each r pixel across two T-scans acquired, delivering the variance signal:
(139)
(140) for each r, where P is the number of images in the calculation of variance, with P=2 in
(141) In prior art OCTA, co-registration of images is used to eliminate the movements between OCT slices prior to flattening and then slicing the volume of OCT data to obtain en-face OCTA images. Performing flattening and axial tracking as disclosed here, the en-face OCT images so generated are easier to be subsequently co-registered, as major components marring the presentation of 3D OCTA signal, curvature and axial movement, are reduced or eliminated. Such a method, made possible by the present embodiments, is disclosed in
(142) For the procedures described in
(143) Alternatively, embodiments allow similar processes engaging the MS-processors 6 in
(144) Not shown, pairs of B-scans could be generated for the whole set of V coordinates, i.e. repeating generation of B-scans for V times, for the number of lines in the frame. They could be on pairs, subject to co-registration as in
(145) To produce a volume angiography information, the process in
(146) Another advantage of the embodiments described herein is adaptability to variation of the axial resolution, for instance by reducing the tuning bandwidth that leads to an increase in the axial depth interval, δ, with advantage in in the time demanded for the calculations. For an A-scan with M=1024 points, M/2=N=512 depth points are needed. Considering an axial resolution of δ=5 microns, this correspond to a thickness of tissue of ˜2.5 mm. This involves ˜M log.sub.2 M FFT calculations. For better stability and improved consistency of vessels produced in the OCTA image, averages over the axial range are performed to reduce the axial resolution, let us say by a factor of 4, to 20 microns. This reduces the number of depth resolved points for both MS and FFT, that reduces the FFT advantage in terms of speed in comparison with the MS technology. With MS, a single multiplication of a mask of M points is needed for each depth. A MS-calculator for each depth can be configured in a FPGA, where each has to do a single multiplication. MS is ideally suited using poorer resolution spectrometers or wider linewidth swept source, where for a retina tissue of 0.5 mm, with 20 micron resolution, 25 such MS processors as in
(147) Superposing the en-face OCTA images of the output of all such processors, for all depths, leads to an overall OCTA image.
(148) A proof of concept of axial tracking with a sensor based on the second embodiment in
(149) The resulting channeled spectra are detected by a balanced photo-detector, Santec BPD-200, 200 MHz cutoff frequency, as 221S, and the corresponding electrical signal is sent to a processor 6S, performing FFT, consisting in a National Instruments PCI5124 card with a 25 MS/s sampling rate, mounted in a PC (Intel Core i7-77700K 4.20 GHz, 16 Gb RAM, Windows 10 64 bit, GPU NVIDIA GeForce GT 710). For the imaging system, a swept source 211I was used, with a 2 kHz sweeping frequency, 850 nm central wavelength and a tuning range of 50 nm (IS source, Superlum BroadSweeper 840). The resulting channeled spectra are detected by a custom-made band pass photodetector, 221I (1 MHz cutoff frequency) and the corresponding electrical signal is sent to the MS processor 6I, consisting in an AlazarTech ATS9350 acquisition card sampling at 2 MS/s. By setting appropriate spectral tuning ranges, both systems have a similar axial resolution in air of ˜6.7 μm. The position of the peak of maximum amplitude, due to the top of the eye model 3′, within the A-scan, along the OPD coordinate, is used to select the starting index of the subset of masks employed in the MS imaging processor 6I. The compensation is applied to individual A-scans, allowing it to operate both inter- (
(150) In the sensor S system, light from the swept source 211S is sent to a coupler 12S 20/80, with 20% power sent to the object arm, via collimator 71S, and then to a splitter 12C (Dichroic Thorlabs DMSP950L) and lens 72. Light from the top of the object, the lens of the eye model, 3′, returns via the lens 72, splitter 12C, lens 71S and coupler 12S towards the balanced coupler 75S, 50/50, towards the balanced photodetector 221S. The other input of the balanced coupler is fed via the reference arm of the sensor S, via lenses 73S and 73′S. The OPD in the 2.sup.nd interferometer is adjusted via reference mirrors 13S and 13′S placed on a translation stage 77S. Mechanical correction in prior art in
(151) In the I system, light from the swept source 211I is sent to a splitter 12I via lens 71I, 20/80, with 20% power sent to the object arm, via dual head galvoscanner 11, via collimator 73I, and splitter 12C and lens 72. Light from the object 3 (mimicking the retina) returns via the lens 72, splitter 12C, collimator 73I, galvoscanner 11, towards splitter 12I, followed by the collimator 74I and then to the balanced coupler 75I, 50/50, towards the balanced photodetector 221I. The other input of the balanced coupler 75I is fed via the reference arm, via reference mirrors 13I and 13′I and lens 74′I placed on a translation stage 77I.
(152)
(153) A moving subset of Q=150 masks, equivalent to a 1 mm of axial interval measured in air was used, over a range of N=500 masks, equivalent to 3.35 mm, to process each A-scan. Therefore, axial movements up to ±1.175 mm could be compensated. The stage 78 was controlled with linear motion amplitudes of 0.2 mm, 0.5 mm and 1 mm, and speeds of 0.5 mm/s, 1 mm/s and 2 mm/s. The resulting images were corrected both in real-time and in post-acquisition. Using the set-up in
(154) The embodiments presented are not exhaustive, have been presented as a matter of example and modifications and other possibilities exist without departing from the spirit of the embodiments described herein.
(155) The use of one, two or three T.sub.x/2 intervals at the bottom of
(156) It should also be obvious for those skilled in the art, that where a compact 2D lateral scanner is mentioned, this can equally be implemented using separate lateral scanners incorporating interface optics between them.
(157) Adjustment of OPD was shown by using means in the reference path of the interferometers, however equally they can be applied into the object paths according to similar means, as known in the art.
(158) As a matter of preference, embodiments are using refractive elements, but this is not a limitation of the embodiments described herein and any such element can be equally replaced with reflective elements.
(159) Fiber splitters and plate beamsplitter have been shown as a 2 input by 2 output splitting elements, but equally, other splitting elements can be employed such as cube beam-splitters, and where a fibre or bulk optics splitter was employed, a bulk splitter and respectively a fibre element can be employed instead.