Method of stimulated emission depletion microscopy having high spatial resolution
11372224 · 2022-06-28
Assignee
Inventors
- Luca Lanzano' (Genoa, IT)
- Paolo Bianchini (Genoa, IT)
- Giuseppe Vicidomini (Genoa, IT)
- Alberto Diaspro (Genoa, IT)
Cpc classification
G02B21/365
PHYSICS
G02B21/0084
PHYSICS
G01N21/6408
PHYSICS
G01N21/6486
PHYSICS
International classification
Abstract
Method for increasing the optical resolution of a stimulated emission depletion microscope, or STED microscope (Stimulated Emission Depletion), based on the modulation of the intensity of a STED beam on an arbitrary time scale during the acquisition of an image and the analysis of the induced dynamics, without increasing the intensity of the STED beam and in a simple and economic manner.
Claims
1. Method of modulated stimulated emission depletion microscopy at high spatial resolution (STED microscopy), comprising the following steps: A. illuminating a sample including one or more fluorophores in an observation volume with an excitation light beam having a constant excitation intensity, to energize said one or more fluorophores in the sample; B. illuminating the sample with a donut-shaped depletion light beam, to de-energize by stimulated emission said one or more excited fluorophores, obtaining an actual observation volume, the depletion light beam having an intensity I.sub.STED modulated over time I.sub.STED=I.sub.STED(t) with a temporal pattern having a modulation period T; C. acquiring one or more fluorescence signals emitted from the sample by an image plane (x, y) of pixels; D. obtaining an image modulation M(x,y) of the sample on the image plane (x, y) of pixels on the basis of said one or more fluorescence signals acquired at step C; E. processing the image modulation M(x,y) to obtain a fraction f.sub.center(x,y) of fluorescence intensity on the image plane (x, y) of pixels, corresponding to a contribution to said one or more fluorescence signals, acquired at step C, originating from fluorophores present in a center of the actual observation volume of the sample; F. calculating a final image F.sub.m-STED(x,y) of the sample on the image plane (x, y) of pixels, from said one or more fluorescence signals acquired at step C and from the image modulation function M(x,y) obtained at step D, as follows:
F.sub.m-STED(x,y)=f.sub.center(x,y)F′.sub.STED(x,y) wherein F.sub.STED(x,y) is selected between a fluorescence image <F.sub.t-STED(x,y,t)> averaged in time and any image of a temporal series F.sub.t-STED(x,y,t).
2. Method according to claim 1, wherein step C includes acquiring a time series of fluorescence images F.sub.t-STED(x,y,t), whereby step D includes calculating the image modulation M(x,y) from variations |δF.sub.t-STED(x,y,t)/F.sub.t-STED(x,y,t)| of intensity of the acquired fluorescence images F.sub.t-STED(x,y,t).
3. The method according to claim 1, wherein step C is carried out by scanning an xy area of the sample in a synchronized manner with the modulation period T, whereby, a number of time points acquired being set equal to n, the scan temporal resolution required is T/n.
4. The method according to claim 3, wherein T is equal to a total pixel dwell time.
5. Method according to claim 3, wherein T/n is equal to a line scan time and n consecutive lines at different STED power are acquired.
6. Method according to claim 3, wherein the temporal pattern of I.sub.STED has a linear pattern with a period T>>1 ns.
7. Method according to claim 6, wherein the period T is comprised between 10 μs and 100 μs.
8. Method according to claim 7, wherein the period T is equal to 50 μs.
9. Method according to claim 1, wherein the intensity I.sub.STED is modulated at a frequency ω and step C includes a frequency acquisition of fluorescence signals with a lock-in acquisition and analysis apparatus directly implementing step D, providing as output a modulation M.sub.ω(x,y) and also providing an output fluorescence image <F.sub.t-STED(x,y,t)> averaged in time, whereby the final image F.sub.m-STED(x,y) of the sample is calculated at step F as:
10. Method according to claim 9, wherein the temporal pattern of I.sub.STED has a sinusoidal pattern at frequency ω/2π<<1 GHz.
11. Method according to claim 10, wherein the frequency ω/2π of the sinusoidal pattern is between 10 kHz to 1 MHz.
12. Method according to claim 11, wherein the frequency ω/2π of the sinusoidal pattern is equal to 100 kHz.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The present invention will be now described, for illustrative but not limiting purposes, according to its preferred embodiments, with particular reference to the Figures of the accompanying drawings, wherein:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
DETAILED DESCRIPTION
(9) In the Figures the same reference numerals will be used for similar elements.
(10) With reference to
(11)
(12)
wherein dS is an infinitesimal surface element and w is the spatial resolution expressed by Eq. 1, whereby the Eq. 2 can be rewritten as:
(13)
with F.sub.STED an image function obtained with STED microscopy. It should be noted that the Eq. 2 and 3 represent the integral of the contributions of all fluorophores to the fluorescence signal. The intensity modulation of the STED beam performed at step 200 also causes the image function of the Eq. 3 to be a function of time:
(14)
wherein the subscript “t-STED” indicates an image resolved in time, obtained through modulation of the intensity of the STED beam. The modulation of the image function F is then obtained by the modulation of I.sub.STED(t) for each pixel.
(15) In other words, if in a given pixel (x, y), the intensity I.sub.STED=I.sub.STED(x, y, t) of the STED beam is modulated over time, a modulation M(x,y) of the value of the image function in that pixel, F=F(x, y, t) will result. Modulation M(x,y) of an image is defined as the quantity:
(16)
(17) The term m(x,y) contains sub-diffractive information on the distribution of the object ρ(x, y) in the vicinity of the position (x,y). The multiplication factor δ(I.sub.STED(t)/I.sub.sat) is a function of the modulation of the intensity of I.sub.STED(t) of the STED beam.
(18) In the first preferred embodiment of the method of
(19)
wherein N.sub.t is the total number of points in time wherein the signal F.sub.t-STED(x,y,t) is sampled. The modulation M(x,y) is then calculated in each pixel, as:
M(x,y)=√{square root over ((g(x,y)).sup.2+(s(x,y)).sup.2)} Eq.7
(20) By the term M(x,y), one fraction f.sub.center(x,y) of intensity of the fluorescence signal, corresponding to the contribution to the fluorescence signal coming from the fluorophores at the centre of the observation volume, is calculated. In fact the modulation M(x,y) in a given pixel can be expressed as a combination of the modulation value at the centre of the observation volume M.sub.center and the modulation value in the periphery of the observation volume M.sub.periph, according to the formula: M(x,y)=f.sub.center(x,y)M.sub.center+f.sub.center(x, y)) M.sub.periph, wherein M.sub.center and M.sub.periph are two constant having non negative value. From this formula it is obtained:
f.sub.center(x,y)=1−[M(x,y)−M.sub.center]/└M.sub.periph−M.sub.center┘, Eq.8
(21) The values of the constants M.sub.centerr and M.sub.periph that allow to obtain a significant increase in resolution without the introduction of artefacts in the image, must be determined in the specific embodiment of the method, since they depend on some experimental features such as the modulation amplitude of the of the intensity of the STED beam and the signal to noise ratio of the acquired signals.
(22) In the first preferred embodiment of the method of
M.sub.periph=M.sub.center+σ.sub.2/(2|σ.sub.1−σ.sub.2|) Eq.9.
(23) wherein σ.sub.1 and σ.sub.2 are the values of the standard deviation of the bi-dimensional gaussian distribution approximating a bi-dimensional histogram of g(x,y) and s(x,y) values.
(24) In other embodiments, the values of constants M.sub.center and M.sub.periph can be determined by using a known sample of fluorescent beads and evaluating the quality of the images obtained at different values of M.sub.center and M.sub.periph.
(25)
(26) By multiplying the fraction f.sub.center(x,y) for a STED image F′.sub.STED(x,y) a final image of higher resolution is obtained:
F.sub.m-STED(x,y)=f.sub.center(x,y)F′.sub.STED(x,y) Eq.10,
wherein the subscript “m-STED” indicates the STED technique with modulation of the intensity of the STED beam. The STED image F′.sub.STED(x,y) used to generate the image F.sub.M-STED(x,y) can be chosen between an image averaged in time <F.sub.t-STED(x,y,t)> and any image of the temporal series F.sub.t-STED(x,y,t).
(27) All the above equations 2 to 9 are valid for slow modulations, i.e. for temporal variations slow with respect to r that is the fluorescence lifetime of the singlet excited state. Since τ is in the range of nanoseconds, it is in theory possible to modulate the STED intensity on any time scale T higher than nanoseconds, T>>1 ns. The speed of the actual modulation is limited by the specific hardware device used to modulate the STED beam. In general, the response of the modulation hardware device represents the lower limit at the time scale that can be used by the method. In fact, a too slow modulation could be disadvantageous in applications wherein a data acquisition high speed is required. In the first preferred embodiment of the method according to the invention, acoustic-optical modulators (AOM, acoustic-optical modulator) commonly employed in confocal microscopes are used, which are much faster than any mechanical device. The response of the AOM is approximately limited to the transit time of the sound wave through the beam, typically <50 ns. In further embodiments, opto-electronic modulators (EOM, Electro-optic modulator) are used, wherein the time limit of the response is equal to tens of nanoseconds.
(28) In the first preferred embodiment, the modulation of the STED beam in step 200 has a temporal pattern corresponding to a linear ramp whereby from a minimum value I.sub.min, optionally equal to zero at time to up to a maximum value I.sub.max at time t.sub.1=t.sub.0+T, i.e. in a time window T, wherein T is the modulation period. For which the intensity of the STED beam, set for the sake of simplicity also t.sub.0=0, is given by:
(29)
(30) In the first preferred embodiment of the method, the time window T coincides with the typical time of integration of intensity in a pixel of a confocal or STED microscope (pixel dwell time), whose values are equal to about 10 μs up to about 100 μs.
(31) The linear ramp temporal pattern has the advantage of making the analysis of the signal in the time domain more direct. In other embodiments of the present invention the modulation 200 of the STED beam is obtained with different temporal pattern, such as sinusoidal patterns.
(32) Returning to the flow chart of
σ.sub.I.sub.
wherein h.sub.STED(X′,Y′) is a donut-shaped PSF of the STED microscope.
(33) The fluorescence signal f(X′,Y′) from each single fluorophore inside the observation volume is approximated with an exponential decay:
(34)
with a time constant of depletion τ.sub.dep(x′, y′) which depends accordingly on the donut-shape of the PSF, on the saturation value I.sub.sat, on the maximum intensity I.sub.STED of the STED beam and the size of the time window T, according to the following equation:
(35)
(36) It should be noted that, in this case, (x′,y′) corresponds to the distance from the center of a given pixel (x,y), whereby one more fluorophores can contribute to the fluorescence signal measured in a single pixel F(x,y).
(37) The Equation 14 also shows that a spatial distribution of the depletion decay rate τ.sub.dep.sup.−1(x′, y′) is provided determined by the spatial distribution of h.sub.STED(x′, y′).
(38) Since h.sub.STED(x′, y′) has a donut shape, the signal from the fluorophores located at the periphery of the observation volume (maximum values of h.sub.STED) will decay more quickly while the signal from the center of the observation volume (values close to zero of h.sub.STED) will remain approximately constant, as schematically shown in the graph of
(39)
(40) In a second preferred embodiment of the method of
I.sub.STED(t)=I.sub.0−ΔI.sub.STED sin(ωt) Eq. 11′
where I.sub.0 is a value of average intensity and ΔI.sub.sted is the intensity of modulation amplitude of the STED beam. The fluorescence signal f(x′,Yy) coming from each single fluorophore inside the observation volume is also modulated according to the equation:
(41)
(42) The fluorescence signal f(x′, y′, t) is phase shifted with respect to a signal of the STED beam and will contain the main frequency ω and the higher harmonics due to the non-linearity of the exponential factor. The modulation M of the image can be obtained by analysing the fluorescence signal at a frequency ω or at higher frequencies. This can be done via a suitable hardware setting, wherein an analysis instrument acquires in a step 300′ fluorescence signals from a sample and directly outputs, in a step 400′, the values of the average intensity <F.sub.t-STED(x, y, t)> and of the modulation M.sub.ω(x,y) of the fluorescence signal. A suitable hardware setting can be for example a standard lock-in detecting apparatus at frequency ω, wherein a lock-in amplifier directly provides, in addition to the average value of intensity <F.sub.t-STED(x, y, t)>, the modulation values M.sub.ω(x,y) and phase ϕ.sub.ω(x,y) during an acquisition 300′ of fluorescence signals. Therefore, given an image F.sub.t-STED(x,y,t) obtained by modulating the intensity of the STED beam at a frequency ω, the increase of the resolution can be obtained in a step 600′ by using the average intensity <F.sub.t-STED(x, y, t)> in pixel (x,y) and the signal modulation M.sub.ω(x,y) on the same pixel:
F.sub.m-STED(x,y)=f.sub.center(x,y)F.sub.t-STED(x,Y,t)
Eq. 10′
where the fraction f.sub.center is calculated at a step 500′ according to Equation 8:
f.sub.center(x,y)=1−[M.sub.ω(x,y)−M.sub.center]/└M.sub.periph−M.sub.center┘ Eq.8′
(43) The values of the constants M.sub.center and M.sub.periph can be determined as described above, taking into account that the values of g(x,y) and s(x,y) can be obtained from M.sub.ω(x,y) and ϕ.sub.ω(x,y) according to the following formulas:
g(x,y)=M.sub.ω(x,y)cos(ϕ.sub.ω(x,y))
s(x,y)=M.sub.ω(x,y)sin(ϕ.sub.ω(x,y)) Eq. 14
(44) Similarly to the case of the modulation of the intensity of the STED beam in the time domain, it is in theory possible to modulate the STED intensity on any frequency scale lower to Gigahertz, ω<<2π/1 ns i.e. ω/2π<<1 GHz. The frequency of the actual modulation is limited by the specific hardware device used to modulate the STED beam.
(45) It should be noted that, in contrast to the first preferred embodiment of the method, in the case of the second preferred embodiment of the method step 400 for calculating the modulation M(x,y) of the image to obtain the final image F.sub.M-STED(x,y) at higher resolution is not necessary.
(46) In a further embodiment of the method wherein the modulation is sinusoidal with frequency ω, M.sub.center=0 is set, for which it is
(47)
where K corresponds to a constant having a positive value M.sub.periph above defined between 0 and 1. Thus the final image that is obtained from Eq. 10′ becomes:
(48)
By changing the value of the constant K, it is possible to adjust the increase in resolution,
(49)
(50) A sample is illuminated at step 100 with constant excitation intensity and is illuminated at step 200′ with a STED intensity modulated with a sine wave at a frequency ω, shown in
(51) The authors have also performed experimental tests on fluorescent beads analysed with a STED microscopy apparatus integrated with the first preferred embodiment of the method. Some experimental results are reported in
(52) In the foregoing the preferred embodiments were described and some modifications of this invention have been suggested, but it should be understood that those skilled in the art can make modifications and changes without departing from the relative scope of protection, as defined by the appended claims.