DEVICES AND METHODS FOR THE CHARACTERIZATION OF THE 3D ORIENTATION OF LIGHT EMITTING DIPOLES
20220365330 · 2022-11-17
Assignee
- Université d'Aix-Marseille (Marseille, FR)
- Centre National De La Recherche Scientifique (Paris, FR)
- CENTRALE MARSEILLE (Marseille, FR)
Inventors
Cpc classification
G02B21/367
PHYSICS
G02B21/361
PHYSICS
International classification
Abstract
The disclosure may relate to a method for the characterization of the 3D orientation of an emitting dipole within a specimen. The method comprises splitting a light beam emitted by the emitting dipole and exiting an objective lens into a first and a second beams; spatially filtering said first beam by using a spatial frequency filter; splitting each of said filtered first beam and said second beam into two beams linearly polarized using polarizing beam splitters; detecting with an optical detection unit four beams linearly polarized in a detection plane optically conjugated with the front focal plane of said microscope objective lens; determining, from four intensity images, in a predefined frame of the specimen, the mean orientation and the angular aperture of the distribution of the 3D orientation of the emitting dipole, during an acquisition time of said four intensity images.
Claims
1. A method for the characterization of the 3D orientation of at least one emitting dipole (10) within a specimen, wherein the specimen is positioned in a front focal plane of a microscope objective lens with a given numerical aperture, the method comprising: splitting a light beam emitted by said at least one emitting dipole and exiting said objective lens into a first and a second beams, wherein the first beam is directed to a first detection channel and the second beam is directed to a second detection channel; spatially filtering said first beam to select a given range of spatial low frequencies of said first beam, by using a spatial frequency filter arranged in a filtering plane of the first detection channel, wherein said filtering plane is optically conjugated with a back focal plane of said microscope objective lens; splitting each of said filtered first beam and said second beam into two beams linearly polarized, thus providing four beams linearly polarized having four different directions of polarization; detecting with an optical detection unit said four beams linearly polarized in a detection plane optically conjugated with the front focal plane of said microscope objective lens, thus forming four intensity images of said at least one emitting dipole; determining, from said four intensity images, in a predefined frame of the specimen, the mean orientation and the angular aperture of the distribution of the 3D orientation of said at least one emitting dipole, during an acquisition time of said four intensity images.
2. The method according to claim 1, wherein said spatial filtering of said first beam results from a spatial limitation of the aperture of said first beam in said filtering plane.
3. The method according to claim 2, wherein a ratio between said limited aperture of said first beam in the filtering plane and a full aperture of said first beam is comprised between about 0.2 and about 0.8.
4. The method according to claim 1, wherein said four directions of polarization are angularly spaced in four separate quadrants of a [0-180°] range of directions.
5. The method according to claim 1, wherein determining the mean orientation and the angular aperture of the distribution of the 3D orientation of said at least one emitting dipole comprises: deriving from said four intensity images, a first column vector; determining an optical propagation matrix based on said four directions of polarization of said linearly polarized beams and said range of spatial low frequencies of said filtered first beam; deriving a second column vector from the product of the first column vector and the inverse matrix of the optical matric propagation; deriving from the components of said second column vector the mean orientation and the angular aperture of the distribution of the 3D orientation of said at least one emitting dipole.
6. The method according to claim 1, wherein 3D orientation of a dense specimen is characterized, each pixel of each of said four intensity images representing an optical response from a collection of emitting dipoles spatially averaged within the size of an optical resolution of the microscope objective lens.
7. A device for the characterization of the 3D orientation of at least one emitting dipole within a specimen, wherein said device is configured to be connected to a microscope system comprising a microscope objective lens with a given numerical aperture and a detection unit having a detection plane optically conjugated with a front focal plane of said microscope objective lens, the device comprising: A non-polarizing beam splitter configured to split a light beam emitted by said at least one emitting dipole of the specimen positioned in a front focal plane of said microscope objective lens and exiting said objective lens, into a first and a second beams, wherein the first beam is directed to a first detection channel and the second beam is directed to a second detection channel; a spatial frequency filter arranged in the first detection channel, configured for spatially filtering said first beam to select a given range of spatial low frequencies of said first beam, wherein said spatial frequency filter is configured to be positioned in a filtering plane conjugated with a back focal plane of said microscope objective lens when said device is connected to said microscope system; in each of said first and second detection channels, respectively a first polarizing beam splitter and a second polarizing beam splitter, wherein said first and second polarizing beam splitters are configured to split each of said filtered first beam and second beam into two beams linearly polarized, thus providing four beams linearly polarized having four different directions of polarization; a calculation unit configured to determine, from four intensity images resulting from the detection of said four beams linearly polarized by the detection unit in said detection plane, the mean orientation and the angular aperture of the distribution of the 3D orientation of said at least one emitting dipole, in a predefined frame of the specimen, during an acquisition time of said four images.
8. The device according to claim 7, wherein said spatial frequency filter is configured to spatially limit the aperture of said first beam in said filtering plane by comparison to a full aperture of said first beam, wherein said full aperture is only limited by the numerical aperture of the microscope objective lens.
9. The device according to claim 8, wherein a ratio between said limited aperture and said full aperture is comprised between about 0.2 and about 0.8.
10. The device according to claim 8, wherein said spatial frequency filter is configured to work in transmission and comprises a disc shaped aperture having a given inner radius.
11. The device according to claim 8, wherein said four directions of polarization are angularly spaced in four separate quadrants of the [0-180°] range of directions.
12. The device according to claim 8, further comprising a relay lens for optically conjugating the back focal plane of the microscope with said filtering plane.
13. A microscope system comprising a microscope objective lens with a given numerical aperture, a detection unit having a detection plane optically conjugated with a front focal plane of said microscope objective lens, and a device according to claim 8.
14. The microscope system according to claim 13, wherein said microscope is configured to work in one of the following illumination configurations: wide field illumination, TIR illumination, scanning illumination.
15. The microscope system according to claim 13, wherein said microscope is configured to work in one of the following detection configurations: pure wide field fluorescence imaging, STORM, PALM, nonlinear imaging.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0062] The present disclosure will be better understood and other advantages and embodiments will become clear on reading the description that follows, given purely by way of indication and in no way limiting, and by referring to the appended figures.
[0063]
[0064]
[0065]
[0066]
[0067]
[0068]
[0069]
[0070]
[0071]
[0072]
[0073]
DETAILED DESCRIPTION OF EMBODIMENTS
[0074] Embodiments of the present disclosure will now be described in detail with reference to the accompanying figures. In the following detailed description of embodiments of the present disclosure, numerous specific details are set forth in order to provide a more thorough understanding of the present disclosure. However, it will be apparent to one of ordinary skill in the art that the present disclosure may be practiced without these specific details. In other instances, well-known features have not been described in detail to avoid unnecessarily complicating the description.
[0075] In what follows, the term “comprise” is synonym of (means the same as) “include” and “contains”, is inclusive and open and does not exclude other non-recited elements.
[0076] The following description provides a particular, non-limiting example of a device.
[0077]
[0078] The microscope system 300 generally comprises a microscope objective lens 302 with a given numerical aperture NA and a detection unit 303. A specimen 11 with light emitting dipoles is positioned in a front focal plane P.sub.1 of the microscope objective lens. In the example of
[0079] The microscope system illustrated in
[0080] The microscope system 300 further comprises a device 301 for the characterization of the 3D orientation of at least one emitting dipole within the specimen 11.
[0081] The device 301 comprises a non-polarizing beam splitter 314 configured to split a light beam B.sub.0 emitted by at least one emitting dipole of the specimen and exiting the objective lens 302 and the tube lens 304, into first and second beams B.sub.1, B.sub.2, thus forming a first detection channel and a second detection channel.
[0082] The device 301 further comprises a spatial frequency filter 315 arranged in the first detection channel, and configured for spatially filtering the first beam to select a given range of spatial low frequencies. The spatial frequency filter 315 is positioned in a filtering plane P.sub.2 conjugated with a back focal plane of the microscope objective lens 302.
[0083] In the example of
[0084] As shown in
R.sub.0≥NA.Math.f/M
[0085] Where NA is the numerical aperture of the objective lens 302, f is the focal length of the relay lens 312 and M is the microscope magnification.
[0086] As it will be described in greater details, R.sub.1 is determined such that a ratio α between the limited aperture of the filtered first beam in the filtering plane and the full aperture of said first beam only limited by the numerical aperture NA of the microscope objective lens, α=R.sub.1.Math.M/(NA.Math.f), is smaller than about 0.8, preferably comprised between about 0.2 and about 0.8, and more preferably comprised between about 0.5 and about 0.8.
[0087] Obviously, the spatial frequency filter 315 may also work in reflection. In that case, it may comprise for example an elliptic shaped mirror whose dimensions are determined to take into account the angle of incidence of the first beam on said mirror in order to achieve the desired spatial limitation of the first beam.
[0088] As shown in
[0089] The first polarizing beam splitter may comprise for example a Wollaston prism 318 or a polarizing beam splitter cube. In case of using a polarizing beam splitter cube, an extra mirror (not shown in
[0090] The second polarizing beam splitter may comprise for example a Wollaston prism 328 before which is arranged a half wave plate 326 or a polarizing beam splitter cube before which is arranged a half wave plate 326.
[0091] The first and second detection channels may also comprise respectively a first lens 316 and a second lens 324 to optically conjugate the front focal plane P.sub.1 and the detection plane P″.sub.1.
[0092] The second detection channel further comprises a mirror 322 to direct the second beam towards the polarizing beam splitter 326, 328 and a detection unit 303.
[0093] The detection unit 303 may comprise a sensitive CCD (charge coupled device) camera or a scientific CMOS (sCMOS) camera. In the case of scanning microscopy (in both scanned and descanned versions), the detection unit may comprise a point detector such as a Photomultiplier or sensitive photodiode.
[0094] The detection unit 303 comprises a detection plane P″.sub.1 optically conjugated with the plane P.sub.1 of the specimen (or front focal plane of the microscope objective lens) and acquires 4 intensity images I.sub.1, I.sub.2, I.sub.3, I.sub.4 resulting from the detection of the four linearly polarized beams LP.sub.1, LP.sub.2, LP.sub.3, LP.sub.4.
[0095] The device 301 further comprises a calculation unit 305 configured to determine, from the four intensity images I.sub.1, I.sub.2, I.sub.3, I.sub.4 the mean orientation (ρ, η) and the angular aperture (δ) of the distribution of the 3D orientation of at least one emitting dipole, as explained below.
[0096] The directions of polarizations i=1, 2, 3, 4 of the four linearly polarized beams L.sub.1, LP.sub.2, LP.sub.3, LP.sub.4 are for example located in four different quadrants of an angle extension between 0° and 180°, as shown in
[0097] The directions of polarization are defined in a frame (X′, Y′, Z′) of the detection plane, wherein the frame (X′, Y′, Z′) is optically conjugated with a predefined frame (X, Y, Z) of the specimen used to determine the mean orientation and angular aperture of the 3D orientation of at least one emitting dipole. More specifically, by convention in the present direction, the Z axis is parallel to an optical axis of the microscope objective lens. The directions of polarization are thus angularly spaced in the X′Y′ plane, and by convention, the 0° direction of polarization is parallel to the X′ direction, also referred below as the “horizontal axis”.
[0098] A specific case is given below, in which the four image intensities (I.sub.0, I.sub.90, I.sub.45, I.sub.135).correspond to the projections in the polarization directions (0°, 90°, 45°, 135°) with respect to the horizontal axis (X′).
[0099] An example of such image intensities is shown in
[0100] Images were obtained using a normal-incidence illumination of a cell with an illumination laser diode at 488 nm, and an objective lens of numerical aperture 1.45 for excitation and collection of the fluorescence signal. A ratio a between the apertures of the detection channels was fixed at 0.7. An emission bandpass filter centered on 525 nm (spectral width 30 nm) was used to filter the fluorescence signal. Each bright spot of the images represents the image of a fluorescent single molecule. The visible structures show actin fibers within the cell, each image full size is 30 μm.
[0101] The section below describes how the parameters (ρ, η, δ) can be retrieved per pixel/region in an image, based on the measurement of the four intensities (I.sub.1, I.sub.2, I.sub.3, I.sub.4) resulting from detection of the four beams linearly polarized LP.sub.1, LP.sub.2, LP.sub.3, LP.sub.4.
[0102] For single molecule detection, the region of integration is the isolated point spread function of the single molecule (e.g. its image spot).
[0103] As shown in
[0104] The radiated intensity I.sub.i.sup.μalong the analyser direction i can be expressed in the Fourier plane P.sub.2 of the imaging system (or back focal plane image) with local cylindrical coordinates (σ, γ) (
[0105] Such radiated intensity I.sub.i.sup.μalong the analyser direction i can be defined based on the approached developed in A. S. Backer et al. (“Determining the rotational mobility of a single molecule from a single image: a numerical study”, Optics Express 23(4), 4255-4276 (2015)):
[0106] With E.sub.i.sup.X(σ, γ) the component of the field radiated by the X component of the dipole, along the direction i. The field component, which only depends on (σ, γ) and the i direction projection in (X, Y), can be calculated following the formalism developed in D. Axelrod et al. (“Fluorescence excitation and imaging of single molecules near dielectric-coated and bare surfaces: a theoretical study”, J. of Microscopy, 247, 147-160 (2012)), with expressions given in A. S. Backer et al.
[0107] The total intensity measured is the sum over all dipoles' directions explored during the measurement time and over the number of molecules detected in a given pixel.
[0108] To model the corresponding dipole distribution, the method developed in A. S. Backer et al. is applied, which has demonstrated that a cone distribution of orientation (η, ρ) and aperture δ is equivalent to three orthogonal dipoles (61, 62, 63
with amplitudes λ.sub.a, λ.sub.b, λ.sub.c:
[0109] Note that (λ.sub.a+2λ.sub.b)=1 since the total dipole amplitude is normalized to 1.
[0110] The intensity in channel i=(1, 2, 3, 4) is therefore given by the sum of intensities from three dipoles:
I.sub.i(σ,γ)=I.sub.i.sup.μ.sup.
[0111] To estimate the complete measured intensity in the channel i, the signal is summed over the corresponding back focal plane aperture (full numerical aperture for channels (1, 2), reduced numerical aperture for channels (3, 4)):
I.sub.i=1,2=∫.sub.γ=0.sup.2π∫.sub.σ=0.sup.σ.sup.
with
the numerical aperture angle for channels (1, 2)
I.sub.i=3,4=∫.sub.γ=0.sup.2π∫.sub.σ=0.sup.σ.sup.
with
the numerical aperture angle for channels (3, 4)
[0112] With NA the numerical aperture of the objective and n the refractive index of the immersion medium.
[0113] After development, the intensities I.sub.i are finally linear combinations of the dipoles' squared projections along directions (X,Y,Z) of the sample. These projections are named M.sub.XX, M.sub.YY, M.sub.ZZ, and M.sub.XY in what follows, with:
M.sub.XX=ϵ.sub.X.sup.2(μ.sub.a,X.sup.2+μ.sub.b,X.sup.2+μ.sub.c,X.sup.2)
M.sub.YY=ϵ.sub.Y.sup.2(μ.sub.a,Y.sup.2+μ.sub.b,Y.sup.2+μ.sub.c,Y.sup.2)
M.sub.ZZ=ϵ.sub.Z.sup.2(μ.sub.a,Z.sup.2+μ.sub.b,Z.sup.2+μ.sub.c,Z.sup.2)
M.sub.XY=ϵ.sub.Xϵ.sub.Y(μ.sub.a,Xμ.sub.a,Y+μ.sub.b,Xμ.sub.b,Y+μ.sub.c,Xμ.sub.c,Y)
[0114] The coefficients ϵ.sub.X, ϵ.sub.Y and ϵ.sub.Z are introduced to account for the excitation efficiencies (e.g. excitation fields amplitudes) along the directions X,Y,Z. For wide field imaging at normal incidence, ϵ.sub.X=ϵ.sub.Y=1 and ϵ.sub.Z=0.
[0115] The four intensities (I.sub.1, I.sub.2, I.sub.3, I.sub.4) can therefore be grouped in a matrix relation:
[0116] The K matrix contains all terms concerning the optical propagation (e.g. NA, polarization projection directions, α, wavelength detected λ), while the M vector contains information on the dipoles' orientation parameters (e.g. (η, ρ) and δ). They are explicited below.
[0117] The K matrix components are given by:
κ.sub.1,j=∫.sub.γ=0.sup.2π∫.sub.σ=0.sup.σ.sup.
κ.sub.2,j=∫.sub.γ=0.sup.2π∫.sub.σ=0.sup.σ.sup.
κ.sub.3,j=∫.sub.γ=0.sup.2π∫.sub.σ=0.sup.σ.sup.
κ.sub.4,j=2Re∫.sub.γ=0.sup.2π∫.sub.σ=0.sup.σ.sup.
where j=(1,2).
[0118] Similarly, when j=3,4, κ.sub.(1,2,3),(3,4) and κ.sub.4,(3,4) write similarly as κ.sub.(1,2,3),(1,2) and κ.sub.4,(1,2) by replacing σ.sub.0 with σ.sub.1.
[0119] Note that in the specific case of a projection along the (0°,90°,45°,135°) directions, the matrix K simplifies into a more reduced form, with “0” values making the inversion quicker and easier:
[0120] The M vector components are given by:
M.sub.XX=λ.sub.a sin.sup.2η cos.sup.2ρ+λ.sub.b[¼(cos.sup.2η+1)sin.sup.22ρ+sin.sup.4ρ+cos.sup.2η cos.sup.4ρ]
M.sub.YY=λ.sub.a sin.sup.2η cos.sup.2ρ+λ.sub.b[¼(cos.sup.2η+1)sin.sup.22ρ+sin.sup.4ρ+cos.sup.2η cos.sup.4ρ]
M.sub.ZZ=λ.sub.a cos.sup.2η+λ.sub.b sin.sup.2η
M.sub.XY=½ sin 2ρ sin.sup.2η(λ.sub.a−λ.sub.b)
[0121] With (λ.sub.a+2 λ.sub.b)=1.
[0122] It is then described below how the parameters are retrieved.
[0123] First, the vector M=(M.sub.XX, M.sub.YY, M.sub.ZZ, M.sub.XY).sup.T (where T symbolizes the transpose of a matrix) is retrieved from the measured intensities I=(I.sub.1, I.sub.2, I.sub.3, I.sub.4).sup.T by an inversion of the matrix K:
M=K.sup.−1.Math.I
[0124] In the specific case of polarization detection directions (0°,90°,45°,135°), with NA=1.45, n=1.515, a=0.7 and using a wavelength λ=520 nm, then K.sup.−1 is given by:
[0125] Second, the parameters (ρ, η, δ) are retrieved from the quantities (M.sub.XX, M.sub.YY, M.sub.ZZ, M.sub.XY) We use combinations of these quantities, normalized to their sum, to defined new factors:
[0126] Which allow to finally retrieve the searched parameters:
[0127] It is thus possible to retrieve from all four image intensities derived from the four beams linearly polarized, the mean orientation and the angular aperture of the distribution of the 3D orientation of isolated emitting dipoles. The applicants have shown that by choosing directions of polarizations angularly spaced in four separate quadrants in the [0°-180] range of directions, inversion of the K matrix in unambiguous, while in other cases, uncertainties may limit the precision of the final results.
[0128] Further, with the method for characterization as described above, even characterization of emitting dipoles in dense specimen is possible. In dense specimen, each pixel of the image represents the optical response from a collection of dipoles spatially averaged within the size of the optical resolution of the microscope objective, and temporally averaged over the integration time of the intensity images. This collection of dipoles represents a distribution, oriented towards a given 3D mean direction within a cone of aperture which comprises the wobbling of each individual dipoles as well as the alignment aperture of all dipoles.
[0129]
[0130] A series of image intensities data (I.sub.1, I.sub.2, I.sub.3, I.sub.4) were generated directly from the matrix equation I=K. M, starting from variable values of (ρ, η, δ).
[0131] More specifically, (I.sub.1, I.sub.2, I.sub.3, I.sub.4) are deduced from the relation:
[0132] Written for the case of a polarization detection directions (0°,90°,45°,135°) , NA=1.45, n=1.515, a=0.7 and using a wavelength λ=520 nm. The vector M contains values calculated for each dataset (ρ, η, δ):
[0133] This generates a collection of data, which is then noised; said collection of data is treated by inverting the same matrix K, as experimental data would be treated, e.g. deduce a vector M is deduced from M=K.sup.−1.Math.I. This gives a “simulated” determination of (ρ, η, δ) that can be compared to expected values. This generates a ‘bias=retrieved value−expected value’ which is reported in the graphs.
[0134] More specifically, the simulation is based on 500 realizations, which starting parameters are known (δ, η, ρ) values. These values are then varied every few degrees for (δ, η) and ρ=20° and for each of them, the bias (difference between retrieved value and expected value) is reported. Noise is applied as Poisson noise on the simulated intensities, supposing a total intensity of N=1000 photons (which is a low value for single molecules detection).
[0135] The measurements conditions are: polarization detection directions (0°,90°,45°,135°), NA=1.45, n=1.515, a=0.7, wavelength λ=520 nm. The simulation of parameters retrieval is achieved with a total intensity N=1000 photons, a signal to noise ratio SNR=10.
[0136] The graphs
[0137] All parameters can be retrieved with bias less than a few degrees even in the presence of noise. Only three cases show an increase of bias (which still remains very small): very low δ, δ˜180° when measuring η, and η˜0° when measuring ρ. These cases can be explained by the fact that in these extreme situations, the searched angles cannot be physically defined.
[0138] Although described by way of a number of detailed example embodiments, the systems and methods according to the present description comprise various variants, modifications and improvements that will be obvious to those skilled in the art, it being understood that these various variants, modifications and improvements fall within the scope of the invention such as defined by the following claims.