METHOD AND APPARATUS FOR SIMULTANEOUS NONLINEAR EXCITATION AND DETECTION OF DIFFERENT CHROMOPHORES ACROSS A WIDE SPECTRAL RANGE USING ULTRA-BROADBAND LIGHT PULSES AND TIME-RESOLVED DETECTION

Abstract

The described method and system allow the simultaneous detection of multicolored samples, e.g. in live cells or tissues, in a simple experimental geometry. It relies on combining ultrashort ultra- broadband laser sources (10) with a fluorescence microscope setup able to collect fluorescence intensities and/or photon arrival times per excitation volume, as well as nonlinear signals, such as second/third-harmonic and sum-frequency generation. In the description, the presented method is referred to as “SyncRGB method”.

Claims

1. A method for simultaneous multicolor nonlinear imaging of multiple chromophores of different types in a sample, the method comprising: a) emitting ultrashort broadband light pulses from a few-cycle laser system for the excitation of the multiple chromophores; b) focusing the ultrashort broadband light pulses in the sample plane of the sample; c) controlling the focused ultrashort broadband light pulses temporal duration in the sample plane; d) preventing the ultrashort broadband light pulses from directly reaching the detection system; e) measuring the nonlinear signals generated in the sample plane; f) scanning the excitation and measurement on individual points (1D), or point-by-point in a the sample plane (2D), or point-by-point across focal planes (3D); g) synchronizing the measurement of the non-linear signals generated in the sample plane to a detector in order to acquire time resolved nonlinear signal information on photon arrival time histograms from the sample plane; h) processing the time resolved nonlinear signal information; i) analyzing the time resolved non-linear signal information for determination of decay parameters associated to the photon arrival time histograms in the individual points (1D), or point-by-point in the sample plane (2D), or point-by-point across focal planes (3D).

2. The method according to claim 1, wherein the sample interacts with at least two photons from the ultrashort broadband light pulses generating a non-linear response comprising at least two photon fluorescence, higher harmonic generation, sum-frequency generation or difference-frequency generation.

3. The method according to claim 1, wherein the time resolved nonlinear signal information is obtained via Time-domain FLIM by gated image intensifiers, Frequency-domain FLIM, time correlated single photon counting or streak camera.

4. The method according to claim 1, wherein processing the time resolved nonlinear signal comprises any 1D, 2D or 3D image representation correlating measured non-linear signal information with a specific sample position.

5. (canceled)

6. A system configured to perform the method as described in claim 1 for the simultaneous multicolour nonlinear imaging of multiple chromophores of different types in a sample, comprising: a) an excitation light system emitting laser pulses from a few-cycle laser system for the excitation of the multiple chromophores; b) a focusing element adjusted to produce a near diffraction-limited laser spot of said excitation laser pulses a sample plane; c) a pulse characterization and compression section configured to control the focused laser pulses to deliver near-transform-limited pulses at the sample plane; d) an optical element guiding the laser pulses to the sample plane and consequently direct the nonlinear signal to the detectors; e) an optical element preventing the laser pulses from directly reaching the detectors; f) a photon counting electronics configured to detect single photons and photon arrival times from the generated non-linear signal from the sample; g) a scanning section configured to perform excitation and measurement on individual points (1D) or point-by-point in the sample plane (2D) or point by point across focal planes (3D); h) a control section for correlation of the detection with the scanning in order to acquire nonlinear signal associated to the scanning position(s) at the sample plane; i) a signal processing section configured to provide information related with the time resolved nonlinear signal; j) an analysis section software configured to determine the decay parameters associated to the photon arrival time histograms in each of individual points (1D) or point-by-point in the sample plane (2D) or point by point across focal planes (3D).

7. The system according to claim 6, wherein the excitation light system comprises an ultrashort pulsed femtosecond laser with a spectrum configured to excite at least two fluorophores simultaneously.

8. The system according to claim 6, wherein the focusingt element comprises one of the following optical elements: single lens, lens combinations, microscope objectives, immersion objectives, dipping objectives and focusing mirrors.

9. The system according to claim 6, wherein the pulse characterization and compression section configured to measure of the spectral phase, and based on the spectral phase information, compressing the broadband excitation laser pulse to near Fourier-limited ultrashort durations at the sample plane.

10. The system according to claim 6, wherein the optical element (18) comprises at least one of the following optical elements: metal mirror, dichroic mirror, prism, grating, or combinations of these elements.

11. The system according to claim 6, wherein the optical element comprises at least one of a band pass, short pass and multiband optical filters, wavelength selective detection units, using dispersive elements, such as prisms and gratings or detectors with selective wavelength range sensitivity.

12. The system according to claim 6, wherein the photon counting detection section comprises a single photo multiplier tube (PMT), fast photodiode, avalanche photodiode, streak camera, EM-CCD or sCMOS sensor.

13. The system according to claim 6, wherein the photon counting detectors comprises multiple detectors to detect specific spectral portions of the nonlinear signal from the sample.

14. (canceled)

15. The system according to claim 6, wherein the control section for correlation of the detection with the scanning is performed via a device control software, such that detected nonlinear signal from the sample plane can be correlated with the scanning position point(s) in 1D, 2D or 3D space.

16. The system according to claim 6, wherein the signal processing section correlates the time-resolved nonlinear signal with the sample position via a data processing software, or manually.

17. (canceled)

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0064] For an easier understanding of the present application, the appended figures represent embodiments that, however, do not intend to limit the art disclosed herein.

[0065] FIG. 1: Schematic drawing of our apparatus in accordance with the present invention.

[0066] FIG. 2: Zoom of sample plane in accordance with the present invention.

[0067] FIG. 3: Pulse characterization and compression d-scan traces of the ultra-broadband laser source and examples of sample and laser sources of one specific embodiment in accordance with the invention. a) Normalized spectra of a narrowband fs and of an ultra-broadband 7 fs laser system with single-photon absorption spectra of typical fluorescent dyes that form part of a sample. b) Autocorrelation measurements of the 70 fs laser in the uncompressed (grey curves, 200 fs pulse width) and compressed (black curves, 70 fs pulse width) configurations, measured at the focus of the microscope objective (FIGS. 2-44). The Fourier-limited duration of the narrowband laser is 70 fs, hence the autocorrelation measurements indicate that the laser is close to optimum compression. c) d-scan measurements of the ultra-broadband laser at the focus (44). Top: Measured d-scan trace. Bottom: Retrieved d-scan trace, corresponding to a 7 fs pulse at optimum compression. d) Comparison of measured pulse intensity profiles. Black curve—7 fs laser pulse measured at the focus (44) with d-scan, having almost 80% of the power in the transform-limited peak. Grey curve: Gaussian laser pulse with 70 fs intensity FWHM and the same average laser power as the 7 fs pulse. The peak intensity achievable with the narrowband 70 fs laser is approximately 10 times lower than for the 7 fs ultra-broadband laser.

[0068] FIG. 4: Comparison of a (a) standard MP FLIM using a single narrowband fs laser and (b) SyncRGB FLIM data obtained with one embodiment of the invention using an ultra-broadband laser for MP-FLIM measurements. (a) MP FLIM image of 2D FluoCells® #1 obtained with 70 fs narrowband laser system at 730 nm, showing only resonant absorption with DAPI in the cell nuclei (white) and Alexa Fluor™ 488 in the cytoplasm (white), that have similar lifetimes and giving rise to one lifetime throughout the cell. Other areas in the cytoplasm do not show any signal (black). (b) 7 fs ultra-broadband few-cycle laser system resonant with all three chromophores (DAPI, Alexam 488 and Mito Tracker® Red labelling the mitochondria located in the cytoplasm) in the sample simultaneously, giving rise to three distinct lifetimes throughout the cell and enabling clear identification of distinctive cell constituents (white—nucleus/DAPI, light grey—actin filaments/Alexam488, dark grey—mictochondria/MitoTracker®). Both images were taken with 36 mW average power for both laser systems with 110×110 pixels and a pixel dwell time of 30 ms.

DESCRIPTION OF AN EMBODIMENT

[0069] One embodiment of the invention is described. The description of this embodiment is exemplary and not intended to limit the scope of the invention.

[0070] The schematic drawing of the system is given in FIG. 1, which shows the main components of the SyncRGB method, together with a zoom view of the sample plane in FIG. 2. The ultrashort ultra-broadband light source (10) is compressed using an optical pulse compressor (11). An electronic sync signal (40) that contains the repetition rate information of the light source shall be connected for synchronization with the detection electronics (36). The ultrashort ultra-broadband light passes a partly reflecting optical element (18) before reaching the focussing element (20) which focuses the ultrashort ultra-broadband light into the sample (24). The focal volume is spatially scanned through the sample either by stage scanning (22) or beam scanning (option not shown in figure). The scanning is controlled by a software interface, while for a single point measurement no control software is required. The nonlinear signal is detected with a photon counting detector (32), on the way to the detector remaining ultrashort ultra-broadband light is prevented from reaching the detection system either by an optical element (26) or by using an optoelectronic transducer that is insensitive to the wavelength range of the ultrashort ultra-broadband light of the light source. The electronic signal of the detector is connected to the photon counting electronics (36) and together with the information of the sync signal, the time resolved signal can be retrieved and read out by the computer (41) to build photon arrival time histograms.

[0071] The computer is used to control the scanner (22) detection with the scanning in order to acquire the nonlinear signal associated to the scanning position(s) at the sample plane. Data is read out with a computer (41). From the collected photon arrival time histograms, fluorescence lifetimes can be determined using a fitting algorithm, even if the pixel contains multiple chromophores. From the photon arrival time histograms in each scanning volume or pixel, a 2D or 3D intensity of FLIM image can be created.

[0072] Results from a specific embodiment of our invention, where we use an ultrashort ultra-broadband Ti:Sapphire laser with pulse spectra covering the spectral range from 690 to 1040 nm are given in FIG. 3 and FIG. 4.

[0073] The few-cycle laser is compressed at the focus of the microscope objective using the d-scan method by recording the d-scan traces (see FIG. 3c), which can be used to determine the spectral phase of the laser pulse and to compress the pulse to its transform-limited pulse length, ˜7 fs (see FIG. 3d). We show additionally the spectrum of a standard fs laser (here a Spectra-Physics Tsunami system) (FIG. 3a) and the interferometric autocorrelation curves obtained when uncompressed (see FIG. 3b, dark grey) with a pulse length of about ˜200 fs and when compressed compensating for dispersion on the way to the focus of the microscope objective (light grey) reaching approximately a transform-limited pulse duration of ˜70 fs.

[0074] The laser repetition rate is 80 MHz for both laser systems. The SYNC signal is picked up by a fast photodiode connected to a fast electronic correlation card for synchronized time-correlated single photon counting (TCSPC) measurements.

[0075] The femtosecond laser is coupled to a microscope platform, passing a partly reflective/transmissive metallic mirror and focussed using a microscope objective, and signal collected in epi-configuration after passing a 680 nm short pass filter and additional two filters mounted in series. The detector is a Photon Counting PMT. The detector output is connected to the fast electronic correlation card.

[0076] We use the SyncRGB method to analyse the nonlinear signal from three fluorescent molecule types with emission in the visible range, which we define here as the R: red, G: green and B: blue RGB range, from about 400 to 700 nm, using the broadband femtosecond laser for two photon excitation and TCSPC technology for time resolved nonlinear signal acquisition.

[0077] The sample chosen is a fixed cell sample (FluoCell® #1, Thermofisher) labelled with three different dyes. In FIG. 3a we show the two-photon absorption spectra of those three dyes with absorption across the RGB range, namely, DAPI, Alexam488, and CMXRoc (MitoTracker® Red).

[0078] The sample is mounted on a sample holder on top of a computer-controlled scanning stage. The stage is scanned to move the sample through the excitation voxel. Using a control software interface the scan position can be correlated with the nonlinear signal information from the sample plane.

[0079] The nonlinear signal information is processed to reconstruct image data (see FIG. 4). In each position, time resolved nonlinear signal information is detected and collected in the form of photon arrival time histograms. These signals are subsequently analysed using a decay curve analysis method. Here the mean decay time is determined by building the mean over the weighed decay components resulting from a multiexponential fit of the photon arrival time histograms.

[0080] The merits of the SyncRGB method become evident when comparing the obtained information with a standard Multi-Photon Fluorescence Lifetime Imaging Microscopy (MP-FLIM) configuration based on a relatively narrowband femtosecond laser.

[0081] While for the narrowband laser the excitation power is available only in a restricted spectral range and only a fraction of the dyes with visible emission are resonantly excited via a two photon absorption process (see FIG. 4a), in the case of the ultrashort ultra-broadband source, excitation intensity is instead provided across the full spectral range, leading to resonant excitation conditions for all three dyes within the sample (FIG. 4b).

[0082] In one single SyncRGB scan, the position of the multiple dyes can therefore be retrieved simultaneously.

REFERENCES

[0083] 1. Entenberg D, Wyckoff J, Gligorijevic B, Roussos E T, Verkhusha V V., Pollard J W, et al. Setup and use of a two-laser multiphoton microscope for multichannel intravital fluorescence imaging. Nat Protoc. 2011; 6(10):1500-20. [0084] 2. Mahou P, Zimmerley M, Loulier K, Matho KS, Labroille G, Morin X, et al. Multicolor two-photon tissue imaging by wavelength mixing. Nat Methods. 2012; 9(8):815-8. [0085] 3. Wang K, Liu T-M, Wu J, Horton N G, Lin C P, Xu C. Three-color femtosecond source for simultaneous excitation of three fluorescent proteins in two-photon fluorescence microscopy. Biomed Opt Express. 2012; 3(9):1972. [0086] 4. Li K-C, Huang L L H, Liang J-H, Chan M-C. Simple approach to three-color two-photon microscopy by a fiber-optic wavelength convertor. Biomed Opt Express. 2016; 7(11):4803. [0087] 5. J. R. Lakowicz, Henryk Szmacinski, Kazimierz Nowaczyk, Klaus W. Berndt, Michael Johnson, Fluorescence lifetime imaging, Analytical Biochemistry Volume 202, Issue 2, 1 May 1992, Pages 316-330) [0088] 6. Wolfgang Becker, Alex Bergmann, Christoph Biskup, Multispectral Fluorescence lifetime imaging by TCSPC, Microscopy research and technique (2007), 70; 403-409 [0089] 7. Hildner, R., Brinks, D. & van Hulst, N. F. Femtosecond coherence and quantum control of single molecules at room temperature.Nat. Phys. 7, 172-177 (2010). [0090] 8. Brinks, D., Hildner, R., Stefani, F. D. & van Hulst, N. F. Coherent control of single molecules at room temperature. Faraday Discuss. 153, 51 (2011). [0091] 9. Hildner, R., Brinks, D., Nieder, J. B., Cogdell, R. J. & van Hulst, N. F. Quantum coherent energy transfer over varying pathways in single light-harvesting complexes TL—340. Science (80−). 340 VN−, 1448-1451 (2013). [0092] 10. Miranda M, Fordell T, Arnold C, L'Huillier A, Crespo H. Simultaneous compression and characterization of ultrashort laser pulses using chirped mirrors and glass wedges. Opt Express. 2012;20(1):688. [0093] 11. Miranda M, Arnold C L, Fordell T, Silva F, Alonso B, Weigand R, et al. Characterization of broadband few-cycle laser pulses with the d-scan technique. Opt Express. 2012; 20(17):18732.

[0094] This description naturally does not impose any constraints on the embodiments presented in this document, and any person with average knowledge in this field will be able to foresee many possibilities for the modification thereof, without departing from the general idea as defined in the claims. The preferred embodiments described above may obviously be switched around in different ways. The following claims additionally define preferred embodiments.