Fast two-photon imaging by diffracted swept-laser excitation

Abstract

An apparatus and methods for high-speed non-linear spectrally encoded multi-photon imaging that are particularly suited for use in two photon fluorescence and fluorescence lifetime imaging. The system is capable of optical image compression and scale invariant digital zoom. A wavelength agile laser with digitally synthesized electro-optic modulation in a master oscillator-power amplifier configuration is combined with spectral encoding to eliminate the speed limitations of inertial scanning. The technique for fast two photon fluorescent imaging with simultaneous lifetime imaging independently detects the location, amplitude and lifetime of fluorescent emission by synthesizing a sequential excitation beam via digital electro-optic modulation of a quasi-CW swept source followed by time encoded detection. For fluorescent imaging, spectral and temporal mappings are employed separately, with quasi-CW spectral encoding used for pumping and time encoding for constructing the image at fluorescence wavelength.

Claims

1. A laser scanning apparatus, comprising: (a) a wavelength agile laser multi-color light source; (b) a modulator configured for modulating said multi-color light source into a dynamic time pattern; and (c) a diffraction grating configured for diffracting said dynamic time pattern of wavelength agile light onto a sample; (d) wherein different wavelengths of light are preferentially diffracted at different angles.

2. The apparatus of claim 1, wherein the wavelength agile laser light source is a wavelength swept laser.

3. The apparatus of claim 1, said modulator further comprising: an optical amplifier for amplifying the modulator output to instantaneous powers higher than an average power.

4. The apparatus of claim 1, wherein said modulator comprises stimulated Raman scattering (SRS) providing both pulse modulation and amplification.

5. The apparatus of claim 1, wherein the dynamic time pattern of the modulator encodes a diffraction pattern imposed on the sample.

6. The apparatus of claim 1, wherein the diffraction grating comprises a spatially adjustable grating.

7. The apparatus of claim 1, further comprising: an objective lens for focusing diffracted beams on to the sample.

8. The apparatus of claim 1, further comprising: a detector configured to detect interactions of the dynamic time pattern with the sample; and an imager.

9. The apparatus of claim 1, further comprising: a controller configured to control laser, modulator, diffraction grating and detector functions.

10. The apparatus of claim 9, wherein an illumination pattern applied to the sample can be dynamically formed by control of one or more of the wavelength outputs of the agile laser, the modulation dynamic time pattern, and an adjustable diffraction grating.

11. The apparatus of claim 9, further comprising: an electro-optical modulator configured for time modulation; and a time-dependent bias voltage applied to the electro-optical modulator by the controller to match a wavelength dependent bias voltage to the instantaneous color output of the wavelength agile laser.

12. The apparatus of claim 1, wherein the detector is selected from the group of detectors consisting of an avalanche photodetector, a photomultiplier tube, a hybrid photodetector, a multichannel plate, charged coupled detector, a CMOS detector, an arrayed detector, a gated detector, and an image intensifier.

13. A laser scanning apparatus, comprising: (a) a wavelength swept laser configured for generating a broadband light source; (b) a pulse modulator configured for modulating said broadband light source into short pulses; and (c) a diffraction grating configured for diffracting said wavelength swept short pulses into a spectral brush directed onto a line or a two-dimensional array on a sample; and (d) a detector configured to detect interactions of the spectral brush with the sample; (e) wherein each of said short pulses are diffracted at a different angle in response to their differing wavelength inducing a pixel wise interaction with the sample.

14. The apparatus of claim 13, further comprising: an optical amplifier for amplifying the short pulses.

15. The apparatus of claim 13, further comprising: an adjustable beam scanner configured to direct beams from the diffraction grating to the sample.

16. The apparatus of claim 15, further comprising: an objective lens for focusing diffracted beams from the beam scanner on to the sample.

17. The apparatus of claim 16, wherein individual pulse length, repetition rate, pulse pattern, individual pulse height and individual pulse form of the broadband light source are controlled by the controller.

18. The apparatus of claim 15, further comprising: a controller configured to control laser, modulator, diffractive element, beam scanner and detector functions.

19. The apparatus of claim 18, wherein the wavelength swept laser is controlled with an electronic waveform from the controller to produce a linear wavelength sweep.

20. The apparatus of claim 18, wherein the wavelength swept laser is controlled with an electronic waveform from the controller to produce a k-space linear frequency sweep.

21. The apparatus of claim 18, wherein detection by the detector is synchronized with the pulse modulation by the controller to only detect signals generated synchronously with the applied pulses thereby suppressing any background signals.

22. The apparatus of claim 18, wherein the modulator is operated by the controller with both a pulse pattern and a sweep pattern to improve modulation depth of the pulses.

23. The apparatus of claim 18, wherein a digitally sculpted waveform is applied to the pulse modulation of the modulator by the controller to produce non-uniform sampling of the sample.

24. The apparatus of claim 13, wherein a non-linear interaction comprising the simultaneous absorption of two or more photons is induced at the sample.

25. The apparatus of claim 13, wherein said interaction detected by the detector is selected from the group consisting of absorption, non-linear absorption, reflection, scattering, ionization, plasma formation, polymerization, lithography, ablation, spectroscopy, and laser induced breakdown spectroscopy.

26. The apparatus of claim 13, further comprising: a plate with at least one fluidic channel with a fluidic flow where sample objects pass the optical beam in flow; wherein fluorescence lifetime imaging is performed of the objects in flow.

27. The apparatus of claim 13, further comprising an imager operably coupled to the detector.

Description

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

(1) The technology described herein will be more fully understood by reference to the following drawings which are for illustrative purposes only:

(2) FIG. 1 is a functional block diagram a system for fast two-photon imaging by diffracted swept laser excitation according to one embodiment of the technology.

(3) FIG. 2 is a functional block diagram of an alternative embodiment a system for fast two-photon imaging by diffracted swept laser excitation according to the technology.

DETAILED DESCRIPTION

(4) Referring more specifically to the drawings, for illustrative purposes, embodiments of the apparatus and methods for fast two-photon imaging by swept-laser excitation are generally shown. Referring more specifically to the drawings, for illustrative purposes, embodiments of methods for pathogen nucleic acid purification and identification are generally shown. Several embodiments of the technology are described generally in FIG. 1 and FIG. 2 to illustrate the apparatus and system characteristics and functionality. It will be appreciated that the methods may vary as to the specific steps and sequence and the systems and apparatus may vary as to structural details without departing from the basic concepts as disclosed herein. The method steps are merely exemplary of the order that these steps may occur. The steps may occur in any order that is desired, such that it still performs the goals of the claimed technology.

(5) The apparatus for laser scanning generally includes a wavelength agile laser capable of generating a multi-color light source; a modulator configured for modulating the broadband light source into a dynamic time pattern and optionally an optical amplifier for amplifying the output to instantaneous powers preferably higher than the average power; and a diffractive element configured for diffracting said wavelength agile light onto a sample, wherein different wavelengths are preferentially diffracted at different angles.

(6) The apparatus may also have a high numerical aperture for focusing, a detector and a computer controller with an imager and recorder. The interaction of the laser that is recorded can be one or more of the following interactions: absorption, non-linear absorption, reflection, scattering, ionization, plasma formation, polymerization, lithography, ablation, spectroscopy, and laser induced breakdown spectroscopy etc. In one embodiment of the apparatus, a fast detection system is employed to record the laser interactions with the sample. The interactions may be used to generate an image of the sample. The size of the obtained image can also be traded off for faster imaging speed by intelligently covering only an area of interest. In addition, the temperature of at least some of the elements of the apparatus may be controlled to achieve optimal performance.

(7) The broadband light source is preferably a wavelength agile laser that contains an optical fiber, preferably single-mode optical fiber. A wavelength agile laser is one that can be rapidly scanned through a broad range of wavelengths. In one embodiment, an electronic differentiator can be used to achieve short impulses of an electronic step function. These short impulses can be used to modulate short impulses out of the light source.

(8) The illumination pattern can be dynamically adapted by the wavelength output of the agile laser and/or the modulation pattern and/or an adjustable diffractive element. For example, the wavelength agile laser source can induce a pixel wise interaction with the sample and may produce multiple beam spots that are employed in parallel.

(9) The dynamic time pattern produced by the modulator is preferably digitally programmable. In one embodiment, the dynamic time pattern encodes the diffraction pattern. In another, the dynamic time pattern employs short impulses. The individual pulse length and/or the repetition rate and/or the pulse pattern and/or individual pulse height and/or individual pulse form can be adjusted by a controller. In another embodiment, the pulse modulator comprises stimulated Raman scattering (SRS) which provides both pulse modulation and amplification.

(10) Preferably, the spectrum of the wavelength agile laser is diffracted to achieve a spectral brush on the sample. In one embodiment, one or more secondary scanning devices are employed in order to move the spectral brush across the sample to achieve a two-dimensional or three-dimensional excitation of the sample. In one embodiment, a chromatic aberration of the focusing lens can be harnessed to achieve a depth scanning spectral brush in the sample. In addition, the multi-color output can also be harnessed to achieve a color-dependent depth scan of the sample.

(11) In one embodiment, a nonlinear interaction is induced at the sample. For example, the non-linear interaction can be the simultaneous absorption of two or more photons in the sample. In another embodiment, the sweeping bandwidth of the excitation laser can be adjusted such that the effective bandwidth after non-linear interaction lies within the absorption band of the sample. For example, the time resolution can be high enough to observe a fluorescence lifetime decay and/or the temporal dynamic of a harmonic generation signal. The repetition rate can be adjusted to respect long fluorescence lifetimes of the sample and/or respect long-lived triplet states of the sample.

(12) In one embodiment, the wavelength swept laser is equipped with a buffering mechanism. The buffering mechanism can provide an almost linear sweep in wavelength. This aims at allowing a linear mapping of the diffracted wavelength onto the sample. The spectral width of the wavelength agile light source can also be used to modify the scanning angle after the diffractive element.

(13) In one embodiment of the system, the wavelength swept laser is operated with an electronic waveform, such that an almost linear sweep in wavelength is created. In an alternative embodiment, an almost linear sweep in frequency (k-space linear sweep) can be obtained. For example, the pulse modulation can be programmed to digitally set the mapping along the spectral scan on the sample. One preferential application is an unequal sampling in time in order to generate a linear spatial mapping on the sample. In one embodiment, a digitally sculpted waveform is employed to the pulse modulation to achieve non-uniform sampling on the sample. This can be used for image compression by allotting higher sampling density to a particular region of interest and less dense sampling in the periphery.

(14) In one embodiment, an electro-optical element is used for time modulation. For example, a time-dependent bias voltage can be applied to the electro-optical element to match the wavelength dependent bias voltage to the instantaneous color output of the wavelength agile laser.

(15) In another embodiment, the detection is driven synchronously to the pulse modulation, so as to detect only signals generated synchronous to the applied pulses and suppressing background signals. In another embodiment, the modulation system is operated with both a pulse pattern and an additional swept pattern, such as to improve the modulation depth of the pulses.

(16) Accordingly, the multitude of generated signals can be separated based on time and/or spectral characteristic in order to multiplex the different signals for multi-modal imaging.

(17) Generally, a new tool for high-speed non-linear imaging is provided with utility in two photon fluorescence and fluorescence lifetime imaging (FLIM) is used to illustrate the technology. To enable fast two photon fluorescent imaging with simultaneous lifetime imaging, a technique called Two-Photon Spectro-temporal Lifetime Imaging by Digitally sculpted Excitation (SLIDE) is provided. The technique independently detects the location, the amplitude and the lifetime of fluorescent emission by synthesizing a sequential excitation beam via digital electro-optic modulation of a quasi-CW swept source followed by time encoded detection. To enable fluorescent imaging, spectral and temporal mappings are employed separately, with quasi-CW spectral encoding used for pumping and time encoding for constructing the image at fluorescence wavelength.

(18) Although the methods are demonstrated with a wavelength-swept Fourier-Domain Mode-Locked (FDML) laser with digitally synthesized electro-optic modulation in a master oscillator-power amplifier configuration combined with spectral encoding, other laser sources and configurations can be adapted to the system to perform imaging.

(19) Turning now to FIG. 1, a system diagram of one embodiment of apparatus 10 for Two-Photon Spectro-temporal Lifetime Imaging by Digitally sculpted Excitation (SLIDE) imaging is shown schematically. Initially, an apparatus is provided with a swept-source Fourier Domain Mode-Locked (FDML) laser source 12 that is pulse-modulated with an electro-optic modulator (EOM) 14 and amplified with an optional amplifier 18. The mapping pattern 16 is digitally sculpted through the pulse modulation.

(20) The FDML laser 12 provides a high spectro-temporal bandwidth M.sub.ST. This is the product of the spectral span (Δλ) required for high-resolution imaging and the line-scan speed ΔT, which is governed by the fluorescence decay times and the pixel number.

(21) The amplified mapping pattern that has been digitally sculpted through the pulse modulation beam output 20 is diffracted by a diffractive element 22. The y-axis is scanned by a beam scanner 24 to produce rapid beam steering through spectrum-to-line mapping. In SLIDE, each pulse 20 has both a unique wavelength and time leading to a sequential and pixel wise illumination.

(22) After fluorescence excitation 28 from the scan 26, the fluorescence 28 is detected by a detector and digitizer 30. The mapping allows both straightforward image generation and recording of the fluorescent lifetimes using a high-speed digitizer 30. The photodetector 30 may have high quantum efficiency and/or high optical and/or electrical bandwidth. The detector 30 may be of the group including an avalanche photodetector, a photomultiplier tube, a hybrid photodetector, a multichannel plate, a charged coupled detector, a CMOS detector, an arrayed detector, a gated detector, and an image intensifier and the like.

(23) A typical excitation pulse length is 65 ps at 88 MHz repetition rate with peak power ranging from 1.8 W to 18 W and an average power in the range of 10 mW to 100 mW (pulse energies of 0.12 nJ to 1.2 nJ).

(24) Spectro-temporal Lifetime Imaging places rigorous requirements on the time-bandwidth of the optical source requiring tens of nanometers wavelength sweep in a few microseconds with a product that increases quadratically with the number of pixels. Fourier domain Mode locked (FDML) lasers can meet these requirements.

(25) The wavelength sweep time ΔT is equal to the number of pixels n times the time between pulses Δt.sub.i, governed by the fluorescent decay time τ.sub.i. Considering, for example, 256 horizontal (linescan) pixels and a typical total fluorescent decay time of 10 ns, this time calculates to ΔT=2.56 μs. Assuming a spectral resolution of Δλ.sub.i=100 pm for the diffractive mapping, this means that the light source needs to sweep over Δλ=25.6 nm in ΔT=2.56 μs. A unique feature in SLIDE is that the spectro-temporal bandwidth scales quadratically with the number of pixels (in linescan):
Spectro-temporal bandwidth M.sub.ST=ΔT×Δλ=n.sup.2×Δλ.sub.i×Δt.sub.i.

(26) A wavelength tuning speed of tens of nanometers over few microseconds is beyond the reach of conventional tuneable lasers. Although very fast tuning speeds can be achieved by chirping a supercontinuum pulse source in a dispersive medium as employed in time stretch techniques, achieving a time span of 2.56 μs is about three orders of magnitude beyond the reach of available dispersive elements (typically in the ns-regime). Furthermore, the spreading of energy due to the stretching would result in negligible peak powers and would prevent non-linear excitation.

(27) Spectro-temporal stretch via an FDML laser 12 is the preferred solution for this difficulty. The FDML laser provides a combination of large spectral span along with a time span in microseconds and a narrow instantaneous line width. Its low instantaneous line width allows for diffraction-limited spatial resolution, a feat that is not possible with chirped supercontinuum sources.

(28) In the SLIDE system, the laser 12 is pulse-modulated by an electro-optic modulator (EOM) 14 typically generating 65 ps pulses and amplified to high instantaneous powers sufficient for two photon excitation.

(29) Upon spatial diffraction with diffractive element 22, spectrally swept pulses 20 pump the sample with a unique spatial and temporal sequence 26. The EOM modulation leads to digitally sculpted waveforms 26 making the excitation pattern digitally programmable. Digitally temporal synthesis assigns a unique timing to each pixel. The image is constructed from the time of arrival of the fluorescence signal 28 which is recorded in epi-direction on a hybrid photodetector 30, digitized and processed on a computer controller.

(30) The spectro-temporal imaging with large spectro-temporal bandwidth permits simultaneous single shot Two-Photon excited fluorescence (TPEF) and fluorescence lifetime imaging (2P-FLIM). The current standard for fluorescent lifetime measurement is time-correlated single-photon counting (TCSPC). The inherent drawback with conventional systems is the speed limitation caused by less than one fluorescence photon emission per excitation pulse. The system of FIG. 1 is several orders of magnitude faster than conventional approaches.

(31) The technology described herein may be better understood with reference to the accompanying examples, which are intended for purposes of illustration only and should not be construed as in any sense limiting the scope of the technology described herein as defined in the claims appended hereto.

Example 1

(32) In order to demonstrate the operational principles of the apparatus and the capture and identification methods, a testing apparatus embodiment was fabricated with a structure and processing steps shown generally in FIG. 2 and tested.

(33) The setup of the Spectro-temporal Lifetime Imaging by digitally sculpted excitation (SLIDE) system embodiment 40 shown if FIG. 2 has a light source 42 with a wavelength swept FDML laser at 1060 nm (±6 nm) and 342 kHz sweep repetition rate. The light source 42 in this embodiment has a PC: Polarization Controller 44, an ISO: Isolator 46, a SOA: semiconductor optical amplifier 48 a FFP: Fiber Fabry-Pérot Filter 50, and a delay 52. The light source output 62 also has a PC: Polarization Controller 54, a delay 56 and an OSA: optical spectrum analyzer 60. The wavelength sweep is accomplished by the fibre Fabry-Pérot-Filter (Lambdaquest) 50 driven at 171 kHz. The FDML output is two-times buffered to 342 kHz sweep rate. After the buffer stage, a booster semiconductor optical amplifier (SOA, Innolume SOA-1060-90-Hi-30 dB) 60 was installed.

(34) In one embodiment, the temperature of the Fiber Fabry-Pérot Filter 50 was controlled to control the phase of the oscillation. As the phase of an oscillator changes dramatically over the frequency at a resonant frequency, the precise control of the frequency was important for the phase control. Here, the frequency is dependent on the temperature so controlling the temperature can be important. The phase of the oscillation was also important, as this determines the instantaneous wavelength output of the wavelength agile light source. When the light source is diffracted on a diffractive element, this phase determines the timing of a specific diffraction angle.

(35) The boosted output was modulated to typically 256 impulses of short temporal width (65 ps) by an electro-optical modulator (EOM) 64. The impulses are digitally synthesized on an arbitrary waveform generator (AWG) 66, which also drives the FDML laser 42. The electronic waveforms for the filter and the 50% modulation of the cavity SOA 60 (same model as in booster stage, driven by a Highland Technologies T160 driver) were programmed on the arbitrary waveform generator 66 (AWG, Tektronix AWG7052).

(36) To enable non-linear excitation, these optical pulses 74 were amplified to high instantaneous powers by two core-pumped ytterbium-doped fibre-amplifiers (YDFAs) 68, 70 and a double-clad power amplifier (DC-YDFA) 72 with a 99/1 tap coupler that serves as monitor port. The 99/1 monitor tap coupler allowed beam monitoring and was also used in reflection mode for beam alignment using sample light reflections.

(37) The electronic pulses 76 can be obtained by differentiating the digital marker outputs of the AWG 66 using a 2.92 mm step-to-impulse converter (Entegra Corp.). The obtained optical pulse length was measured to be 65 ps. The amplitude electro-optical modulator (EOM) 64 was a 20 GHz bandwidth model (Photline NIR-MX-LN-20) that was employed in combination with an electronic pulse amplifier (Multilink MTC5515).

(38) Spectral line-scanning of the pulsed and amplified output 76 was achieved by a diffraction grating 78. The y-axis was scanned by a synchronously driven galvo scanner 80 and controller. The driving signal was also generated on the AWG 66. A high numerical aperture (NA) objective 84 focuses the excitation light on the sample 86 and collects the epi-generated fluorescence signal. A dichroic filter 82 directed only non-linear signals on a fast hybrid photodetector (HPD) 88, connected to a transimpedance amplifier 90 and a fast digitizer/computer 92. Either an oscilloscope (Tektronix DPO71604B) at 3.125 GSamples/s or a streaming ADC card (Innovative Integrations Andale X6GSPS) with synchronously driven sample clock at 3196 MHz were employed s digitizers 92. To ensure sample-accurate fitting, an external sample clock was employed such that the data acquisition runs synchronously to the FDML laser 42 and the pulse modulation. In order to acquire large data sets, a streaming ADC in combination with a RAID-SSD array was employed to store the data and process in post acquisition. The sample clock of the digitizer/computer 92 can also be synchronized to the excitation by a sample clock signal from the AWG 66.

(39) It can be seen that the whole system is driven by the arbitrary waveform generator 66 (AWG, Tektronix AWG7052) and controller. This AWG 66 provides all of the digitally synthesized driving waveforms, driving the FDML laser (Fabry-Perot Filter waveform and 50% modulation of SOA for buffering), the galvo-mirror 80 and also generating an external sample clock signal for the digitizer 92. The waveforms are digitally programmed and enable flexibility on the number of pulses per sweep, pulse pattern and enabling the possibility of warped sampling. For very short lifetimes, a higher repetition rate can be employed.

(40) In one embodiment, the light from the light source was collimated using an f=37 mm lens followed by a beam-expander (f=100 mm and f=150 mm) upon exiting the single-mode fiber 76. This resulted in a beam diameter of 11.5 mm filling the 60× microscope objective aperture 84. The grating 78 was positioned at a 30° angle, such that the first order was reflected at almost the incident direction in order to minimize ellipticity of the first-order diffraction beam. At 1200 lines/mm the grating 78 only produced a 0 and +1 diffraction order and the first order power was maximized by adjusting the polarization on a polarization control paddle. The grating resolution was calculated to be 67 pm. This fits well to the instantaneous line width of the FDML, which was measured for a single pulse to be 56 pm. Considering spectral mapping, the 12 nm FDML span leads to 12 nm/0.067 nm≈180 discernible pixels, which were oversampled using 256 pulses per sweep, i.e. pixels per line. It is important to note that the applied 12 nm sweep span lies well inside most absorption bandwidths.

(41) For TPEF imaging, the excitation can be considered monochromatic. A 12 nm bandwidth calculates to an approximately 140 fs time-bandwidth limited pulse, which is routinely applied for TPM. In fact, even shorter pulses are used, scaling quadratically in bandwidth. Consequently, even larger FDML spans can be applied in this setup, leading to larger scan fields and fields of view (FOVs) in the future. For simplicity, the excitation can thus be considered almost monochromatic. Any spectral considerations of the excitation serve solely for the purpose of fast, inertia-free beam steering, especially since fluorescence excitation characteristic is independent of the exact excitation wavelength.

(42) For microscopy adaptations, two lenses were used to relay image the beams onto a galvanometric mirror (EOPC) 80 for y-axis scanning. The galvo mirror 80 was driven synchronously, producing 170 lines at 2.012 kHz. A high NA, oil immersion microscope objectives 84 was used (Nikon Plan Apo 60× NA 1.4 oil). The field-of-view (FOV) was determined by inserting a resolution target and recording the reflected excitation light on a CCD camera installed in the microscope, which was sensitive to the 1064 nm excitation light. If linearly sampled, the FOV was scanned by a cosine mapping in both axes, so a non-linear mapping is produced. The FOV could be dynamically adjusted using warped sampling or adjusting the swept wavelength and galvo voltages. A dichroic mirror 88 (Thorlabs DMSP950R) in combination with an additional short-pass optical filter (Semrock FF01-750) transmits the Epi-generated signals to a hybrid Photodetector 88 (HPD, Hamamatsu R10467U-40) with high quantum efficiency (45%). The high time resolution of the HPD 88 in combination with a fast digitizer 92 (˜3 GS/s) leads to a fast instrument response function (IRF) of only 1026 μs, measured by detecting the instantaneous signal of SHG in urea crystals.

Example 2

(43) For cell classification and detection of rare cells, such as circulating tumour and fetal cells, it is important to measure a high number of cells quickly, accurately and as non-invasively as possible. Two-photon microscopy has high three dimensional resolution, can operate in blood flow and offers deeper penetration than one-photon techniques through the use of longer wavelengths. Two photon imaging in flow may also be used for non-invasive in vivo cancer cell detection through the skin barrier.

(44) To further illustrate the capabilities of the system, Two-Photon Fluorescence Lifetime Imaging (2P-FLIM) based flow cytometry at an 88 MHz pixel rate was demonstrated. The particles were fluorescent beads used in blood flow determination studies with diameters in the range 2 μm to 15 μm, similar to typical cell sizes. The flow-rate was set to 0.2 m/s, limited by diffraction spot size and fluorescent lifetime.

(45) In the flow cytometry recordings, the flow-rate was set by two fundamental properties, namely the fluorescence lifetime and the imaging diffraction limit. The lifetime limits the repetition rate to approximately 100 MHz, while the diffraction limit is sampled at approximately 380 nm. Consequently, an 88 MHz repetition rate at 256 pulses per 2.92 μs linescan rate was used with a 100 μm field-of-view. The flow rate was equally set to sample each line at 380 nm, i.e. 380 nm/2.92 μs=0.13 m/s. The scale bars in the flow cytometry images were generated using the known 10 μm size of the Red-species bead to calibrate the actual flow speed. The Red bead was sampled with 18 lines, calculating to a line spacing of 556 nm. Using the line scan rate of 342 kHz, this calculates to a flow speed of ˜0.2 m/s. At 100 μm field-of view and 10 μm average particle size, this corresponds to the possibility of imaging up to 200,000 particles per second via 2P-FLIM.

(46) The vertical axis was scanned by the SLIDE swept laser scan at 342 kHz line-scanning rate. At 550 nm resolution sampling, the imaging flow-rate was 0.2 m/s. Five different species of blood-flow determination fluorescent beads were imaged and color-coded based on their fluorescent lifetime. The images that were obtained clearly showed the five different species. The fitted lifetimes of the Crimson, Nile Red and Red-Orange beads were clearly distinguishable. Each lifetime curve was taken from a single pixel after a 9×9 box blur filter was applied. The lifetimes of the Red and Orange beads were very close together and were difficult to distinguish by mere lifetime (Ci). However, their different sizes of 10 μm and 15 μm, respectively, were clearly resolved in the lifetime images. Each line was scanned at 2.92 μs, so for a 256×170 image the recording time is only 497 μs. The pixel rate was 88 MHz, i.e. single excitation pulse per pixel without averaging. The power used was 15 mW, scale bars represent 10 μm.

(47) Accordingly, the high-throughput and the combination of different, independent physical information (morphology, fluorescence, lifetime etc.) could be applied to targeted detection of e.g. rare tumour cells in blood or rapid cell sorting at high specificity by intelligently analyzing the features with artificial intelligence and machine learning. By further combining this imaging setup with GPU-based machine learning, this setup can lead to high-speed, high-throughput cell classification and screening.

Example 3

(48) To further demonstrate the capabilities of the system, high speed two photon fluorescent images and fluorescent lifetime images of pollen and algae cells were obtained and evaluated. Fluorescent imaging can be used for classifications of algae cells used in biofuels based on their lipid content. Euglena gracilis algae cells with rich lipid content were stained with Nile Red. The cell's chloroplasts provide endogenous autofluorescence and the difference in fluorescent lifetimes clearly highlight the different sub-cellular features. These images were unaveraged and acquired within 497 μs for both TPEF and 2P-FLIM images that were acquired simultaneously. The lifetimes were extracted by de-convolving with the instrument's response function.

(49) For precise measurement, a deconvolution with the IRF was conducted in order to extract the fluorescent lifetimes. However, this was time consuming, so for faster processing and qualitative results a tail-fitting algorithm was used. In some settings, different species need to be discerned so a qualitative value is sufficient.

(50) A direct signal processing approach was conducted, not requiring any fitting and thus being very fast. In the Euglena algae cell images, the first 1 ns of the decay signal was integrated and used for the red image channel in order to visualize the rapidly decaying chlorophyll autofluorescence. For the green channel, the Nile Red lipids were visualized by integrating the signal from 2 ns to 8 ns, i.e. later in the decay curve. This resulted in a clear molecular contrast based on fluorescence lifetime. For all images, the data was processed and images created in LabVIEW. The 2P-FLIM images were generated as HSL-images, where Hue was given by the lifetime-values, lightness by the integrated TPEF signal and constant saturation. For the TPEF images, the “Red Hot” look-up table was applied in ImageJ. The plots were generated in GNUPlot and the figures produced using Inkscape.

(51) Two-Photon excited fluorescence (TPEF) image of a pollen grain were obtained with the image size of 512×340 px, pixel-rate 176 MHz, 100-times averaged, 80 mW on the sample. A Two-Photon fluorescence lifetime images (2P-FLIM) were generated from the same data by fitting an exponential decay to the analogue fluorescence decay curve. The autofluorescence reveals different lifetimes for the body and the spikes, which was not visible in the mere TPEF image.

(52) Euglena gracilis algae, whose chloroplasts provide autofluorescence were imaged with the lipids stained with Nile Red. The unaveraged image consisted of 256×170 pixels and was acquired within 497 μs (2 kHz frame-rate, 30 mW optical power). The 2P-FLIM revealed differences in fluorescence lifetime based on the molecular environment inside the sample. For all 2P-FLIM images, a 3×3 box blur filter was applied in the time-domain.

(53) Since the fluorescent excitation pattern can be digitally programmed it can adapt to the sample being imaged. Applications of this to foveated (non-uniform) sampling for image compression and to digital zoom were evaluated. By engineering the temporal pulse density, the excitation pixel density can be adapted to the sparsity of the sample.

(54) In one example, high pixel resolution was achieved in the central field of view with lower density in the peripheral vision. Higher resolution by a factor 2.5 could be achieved with same number of pixels. It is important to note that this was achieved through direct non-uniform sampling in contrast to warped (anamorphic) stretch of the image prior to uniform sampling as recently demonstrated. In high-speed imaging, this optical data compression reduces the amount of data generated thereby alleviating the digital processing and storage requirements.

(55) In SLIDE, the excitation pattern can also be digitally sculpted through waveform controlling the wavelength sweep of the FDML laser. It was possible to digitally control the optical zoom for TPEF and 2P-FLIM. Unlike conventional digital zoom, the resolution was not lost at high magnifications.

(56) It was shown that digitally sculpted waveforms enable flexible imaging parameters. For example, the horizontal pixel rate can be reduced to achieve lower average power, while keeping the frame-rate constant. A pixel rate of only 11 MHz was programmed, corresponding to 32 Pixels per line, lowering the average power to 20 mW. When using a linear sampling pattern, the sharp features of the pollen grain were under-sampled. After interpolation the spikes of the pollen grain were almost not visible. However, when programming a foveated warped sampling pattern, a higher sampling density was allotted to the centre of the image. After interpolation, the pollen grain could be nicely resolved even at only 32 horizontal pixels per line. The resolution enhancement in the centre was observed to be 2.5.

(57) Another capability of the system is scale invariant digital optical zoom, which was achieved by digitally decreasing the sweep span of the FDML laser. The TPEF and 2P-FLIM images showing a high-detailed Pollen grain could be more effectively sampled by reducing the spectral span 1.5-fold or 3-fold while maintaining the optical resolution.

(58) From the description herein, it will be appreciated that the present disclosure encompasses multiple embodiments which include, but are not limited to, the following:

(59) 1. A laser scanning apparatus, comprising: (a) a wavelength agile laser multi-color light source; (b) a modulator configured for modulating said multi-color light source into a dynamic time pattern; and (c) a diffractive element configured for diffracting said dynamic time pattern of wavelength agile light onto a sample; (d) wherein different wavelengths of light are preferentially diffracted at different angles.

(60) 2. The apparatus of any preceding embodiment, wherein the wavelength agile laser light source is a wavelength swept laser.

(61) 3. The apparatus of any preceding embodiment, said modulator further comprising: an optical amplifier for amplifying the modulator output to instantaneous powers higher than an average power.

(62) 4. The apparatus of any preceding embodiment, wherein said pulse modulator comprises stimulated Raman scattering (SRS) providing both pulse modulation and amplification.

(63) 5. The apparatus of any preceding embodiment, wherein the dynamic time pattern of the modulator encodes a diffraction pattern imposed on the sample.

(64) 6. The apparatus of any preceding embodiment, wherein the diffractive element comprises a spatially adjustable grating.

(65) 7. The apparatus of any preceding embodiment, further comprising: a high numerical aperture lens for focusing diffracted beams on to the sample.

(66) 8. The apparatus of any preceding embodiment, further comprising: a detector configured to detect interactions of the dynamic time pattern with the sample; and an imager.

(67) 9. The apparatus of any preceding embodiment, further comprising: a controller configured to control laser, modulator, diffractive element and detector functions.

(68) 10. The apparatus of any preceding embodiment, wherein the detector is selected from the group of detectors consisting of an avalanche photodetector, a photomultiplier tube, a hybrid photodetector, a multichannel plate, charged coupled detector, a CMOS detector, an arrayed detector, a gated detector, and an image intensifier.

(69) 11. The apparatus of any preceding embodiment, wherein an illumination pattern applied to the sample can be dynamically formed by control of one or more of the wavelength outputs of the agile laser, the modulation dynamic time pattern, and an adjustable diffractive element.

(70) 12. The apparatus of any preceding embodiment, further comprising: an electro-optical element configured for time modulation; and a time-dependent bias voltage applied to the electro-optical element by the controller to match a wavelength dependent bias voltage to the instantaneous color output of the wavelength agile laser.

(71) 13. A laser scanning apparatus, comprising: (a) a wavelength swept laser configured for generating a broadband light source; (b) a pulse modulator configured for modulating said broadband light source into short pulses; and (c) a diffraction grating configured for diffracting said wavelength swept short pulses into a spectral brush directed onto a line or a two-dimensional array on a sample; and (d) a detector configured to detect interactions of the spectral brush with the sample; (e) wherein each of said short pulses are diffracted at a different angle in response to their differing wavelength inducing a pixel wise interaction with the sample.

(72) 14. The apparatus of any preceding embodiment, further comprising: an optical amplifier for amplifying the short pulses.

(73) 15. The apparatus of any preceding embodiment, further comprising: an adjustable beam scanner configured to direct beams from the diffraction grating to the sample.

(74) 16. The apparatus of any preceding embodiment, further comprising: a high numerical aperture lens for focusing diffracted beams from the beam scanner on to the sample.

(75) 17. The apparatus of any preceding embodiment, further comprising: a controller configured to control laser, modulator, diffractive element, beam scanner and detector functions.

(76) 18. The apparatus of any preceding embodiment, wherein the wavelength swept laser is controlled with an electronic waveform from the controller to produce a linear wavelength sweep.

(77) 19. The apparatus of any preceding embodiment, wherein the wavelength swept laser is controlled with an electronic waveform from the controller to produce a k-space linear frequency sweep.

(78) 20. The apparatus of any preceding embodiment, wherein detection by the detector is synchronized with the pulse modulation by the controller to only detect signals generated synchronously with the applied pulses thereby suppressing any background signals.

(79) 21. The apparatus of any preceding embodiment, wherein the modulator is operated by the controller with both a pulse pattern and a sweep pattern to improve modulation depth of the pulses.

(80) 22. The apparatus of any preceding embodiment, wherein a non-linear interaction comprising the simultaneous absorption of two or more photons is induced at the sample.

(81) 23. The apparatus of any preceding embodiment, wherein a digitally sculpted waveform is applied to the pulse modulation of the modulator by the controller to produce non-uniform sampling of the sample.

(82) 24. The apparatus of any preceding embodiment, wherein said interaction detected by the detector is selected from the group consisting of absorption, non-linear absorption, reflection, scattering, ionization, plasma formation, polymerization, lithography, ablation, spectroscopy, and laser induced breakdown spectroscopy.

(83) 25. The apparatus of any preceding embodiment, further comprising: a flow apparatus where objects pass the optical beam in flow; wherein fluorescence lifetime imaging is performed of the objects in flow.

(84) 26. The apparatus of any preceding embodiment, further comprising an imager operably coupled to the detector.

(85) 27. The apparatus of any preceding embodiment, wherein individual pulse length, repetition rate, pulse pattern, individual pulse height and individual pulse form of the broadband light source are controlled by the controller.

(86) Although the description herein contains many details, these should not be construed as limiting the scope of the disclosure but as merely providing illustrations of some of the presently preferred embodiments. Therefore, it will be appreciated that the scope of the disclosure fully encompasses other embodiments which may become obvious to those skilled in the art.

(87) In the claims, reference to an element in the singular is not intended to mean “one and only one” unless explicitly so stated, but rather “one or more.” All structural, chemical, and functional equivalents to the elements of the disclosed embodiments that are known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the present claims. Furthermore, no element, component, or method step in the present disclosure is intended to be dedicated to the public regardless of whether the element, component, or method step is explicitly recited in the claims. No claim element herein is to be construed as a “means plus function” element unless the element is expressly recited using the phrase “means for”. No claim element herein is to be construed as a “step plus function” element unless the element is expressly recited using the phrase “step for”.