HIGH-RESOLUTION SCANNING MICROSCOPY WITH DISCRIMINATION BETWEEN AT LEAST TWO WAVELENGTH RANGES
20170227749 · 2017-08-10
Inventors
Cpc classification
G02B27/58
PHYSICS
G02B21/0072
PHYSICS
G02B21/008
PHYSICS
International classification
Abstract
A microscopy high-resolution scanning method, including exciting a sample with illumination radiation focused at a point to form a diffraction-limited illumination spot so as to emit fluorescence radiation. The point is imaged in a diffraction image on a spatially resolving two-dimensional detector. The sample is scanned at scanning positions with increments that are smaller than half the diameter of the spot. An image of the sample with a resolution increased beyond a resolution limit of the image is generated from the data of the two-dimensional detector and the scanning positions. To discriminate between at least two predetermined wavelength ranges in the fluorescence radiation of the sample, Airy disks corresponding to the wavelength ranges are generated on the two-dimensional detector, the Airy disks being offset laterally from one another such that the diffraction image consists of the mutually offset Airy disks. The Airy disks are evaluated when generating the sample image.
Claims
1. A method for high-resolution scanning microscopy of a sample, including: exciting the sample by illumination radiation to emit fluorescent radiation, wherein the illumination radiation is focused to a point in or on the sample to form a diffraction-limited illumination spot, imaging the point to a diffraction image on a spatially resolving two-dimensional detector in diffraction-limited manner, wherein the two-dimensional detector has a spatial resolution which resolves a diffraction structure of the diffraction image, displacing the point into various scanning positions relative to the sample with an increment which is smaller than half a diameter of the illumination spot, reading the two-dimensional detector and an image of the sample with a resolution which is increased beyond a resolution limit of the imaging is generated from data of the two-dimensional detector and from the scanning positions assigned to these data, for the purposes of discriminating between at least two predetermined wavelength ranges in the fluorescent radiation of the sample, generating on the two-dimensional detector by means of a spectrally selective element a number of Airy disks, with the number corresponding to the at least two predetermined wavelength ranges, the Airy disks being offset laterally from one another such that the diffraction image consists of the mutually offset Airy disks, wherein the Airy disks lie completely on the two-dimensional detector, and evaluating the Airy disks when generating the image of the sample.
2. The method according to claim 1, wherein the Airy disks overlap but do not cover each other completely.
3. The method according to claim 1, wherein the spectrally selective element spaces the Airy disks apart on the two-dimensional detector such that the center of each Airy disk lies outside the other Airy disk.
4. The method according to one of claim 1, wherein the spectrally selective element is chromatically corrected in such a way that the mutually offset Airy disks have the same size.
5. The method according to claim 1, wherein the spectrally selective element only modifies illumination in such a way that the illumination spot consists of illumination Airy disks which are offset laterally from one another.
6. The method according to claim 1, wherein the spectrally selective element only influences the imaging, and is arranged upstream of the two-dimensional detector.
7. The method according to claim 1, wherein the point is displaced into various scanning positions relative to the sample, in that the sample is shifted.
8. The method according to claim 1, wherein the Airy disks offset laterally from one another lie in a common image plane.
9. A microscope for high-resolution scanning microscopy, the microscope comprising: a sample space for receiving a sample which can be excited to emit fluorescent radiation, a lens system comprising a focal plane lying in the sample space and a resolution limit, an illumination device comprising an input for receiving illumination radiation and illuminating the sample space with the illumination radiation via the lens system, wherein the lens system focuses the illumination radiation to a diffraction-limited illumination spot at a point in the focal plane, an imaging apparatus for imaging the point in the focal plane to a diffraction-limited manner through the lens system to a diffraction image on a spatially resolving two-dimensional detector which lies in a detector plane conjugate with the focal plane, wherein the two-dimensional detector has a spatial resolution which resolves a diffraction structure of the diffraction image, a scanning device for displacing the point into various scanning positions with an increment which is smaller than the diameter of the illumination spot, an evaluation device for reading the two-dimensional detector, for evaluating the diffraction structure of the diffraction image from data of the two-dimensional detector and from the scanning positions assigned to the data and for generating an image of the sample with a resolution which is increased beyond the resolution limit, wherein for the purposes of discriminating between at least two predetermined wavelength ranges in the fluorescent radiation of the sample, the microscope comprises a spectrally selective element which generates a number of Airy disks corresponding to the at least two predetermined wavelength ranges on the two-dimensional detector, the Airy disks being offset laterally from one another such that the diffraction image consists of the mutually offset Airy disks, wherein the two-dimensional detector and the spectrally selective element are formed such that the Airy disks lie completely on the two-dimensional detector, and wherein the evaluation device analyzes the Airy disks when generating the image of the sample.
10. The microscope according to claim 9, wherein the Airy disks overlap but do not cover each other completely.
11. The microscope according to claim 9, wherein the spectrally selective element spaces the Airy disks apart on the two-dimensional detector such that the center of each Airy disk lies outside the other Airy disk.
12. The microscope according to claim 9, wherein the spectrally selective element is chromatically corrected in such a way that the mutually offset Airy disks have the same size.
13. The microscope according to claim 9, wherein the spectrally selective element is arranged in the illumination device but not in the lens system which also acts for the imaging with the result that the illumination spot consists of illumination Airy disks which are offset laterally from one another.
14. The microscope according to claim 9, wherein the spectrally selective element is arranged in the imaging device but not in the lens system which also acts for the illumination.
15. The microscope according to claim 9, wherein the scanning device is a sample stage for shifting the sample in the sample volume.
16. The microscope according to claim 9, wherein the spectrally selective element comprises a grating, a prism, a wedge plate and/or a doublet lens.
17. The microscope according to claim 9, wherein the Airy disks offset laterally from one another lie in a common image plane.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0035]
[0036]
[0037]
[0038]
DETAILED DESCRIPTION
[0039]
[0040] The LSM 1 illuminates the sample 2 by means of a laser beam 5 provided which is guided to a mirror 8 via an optional deflecting mirror 6 and a lens 7. The mirror 8 ensures that the laser beam 5 is incident on a coupling-in element, e.g., an emission filter 9, under an angle of reflection. For a clearer representation, only the main axis of the laser beam 5 is shown.
[0041] After reflection at the emission filter 9, the laser beam 5 is deflected biaxially by a scanner 10 and focused by means of lenses 11 and 12 through an objective 13 as di action-limited illumination spot 14 into a focal plane 29 in the sample 2. In the representation of
[0042] The diffraction image 17 of the illumination spot 14 is captured in the detection plane 18 by a two-dimensional detector 19, an exemplary design of which is explained in more detail below with reference to
[0043] The control device C controls all of the components of the LSM 1, in particular the scanner 10 and the two-dimensional detector 19. The control device captures the data of each individual images 17 for different scanning positions, analyzes the diffraction structure of each image and generates a high-resolution overall image of the sample 2.
[0044] The LSM 1 of
[0045]
[0046] It is to be mentioned that the design of the two-dimensional detector 19 according to
[0047] In the description of the microscope 1, the element 15 has not yet been mentioned. It is a spectrally selective element which is arranged in the imaging device 4 or in the illumination device 3. For the arrangement in the illumination apparatus 3
[0048] Without spectrally selective element 15 the diffraction-limited imaging in the focal plane 29 of the point illuminated by the illumination spot 14 would yield, a diffraction image 17 in the assigned conjugate detection plane 18, which image is an Airy disk because of the circular aperture of the objective 13. The formation of such Airy disks has already been explained in the general part of the description. In the case of microscopy as described in EP 2317362 A1, the structure of the diffraction image 17 is analyzed by oversampling and, in connection with the scanning positions which have an increment which is small compared with the minimum dimension of the illumination spot 14, a structure determination is made which goes beyond the resolution limit of the diffraction-limited imaging. To understand this, one may look at two locations which lie so close to each other in the focal plane 29 that they cannot be resolved within diffraction-limited resolution. When scanning the illumination spot 14 at increments which are small compared with the diameter of the (in this theoretical experiment circular) illumination spot, one of the two locations enters the illumination spot first. The radiation intensity in the diffraction image 17 increases the further this first location goes into the illumination spot 14. Because of its diffraction-limited properties, the illumination spot 14 has an intensity which increases towards the center. The intensity of the radiation in the diffraction image 14 thus increases to the extent that the observed first location advances more and more into the center of the illumination spot 14. When the observed location has passed over and away from the center of the illumination spot 14, the intensity of the radiation coming from this first position decreases again. If the theoretically assumed second location was not adjacent, the radiation intensity in the diffraction image 17 would fade away again, wherein the rise and fall of the radiation intensity in the diffraction image 17 correlates exactly with the course of the illumination intensity of the illumination spot 14 (taking into account the increment and the fluorescence sensitivity of the first location). Since, however, a second location is present in close proximity, this second location likewise begins to contribute fluorescent radiation to the diffraction image 17, and in fact more the closer the second location is to the center of the illumination spot 14. Apart from that, exactly the same applies to the second location, of course, as applies to the first location. As a result, illumination intensities in the diffraction image 17 are obtained for the step positions, which are different from intensities occurring if only a single fluorescing location were present. Through evaluation of data of the two-dimensional detector 19 and taking into account the actual scanning position, it can thus be mathematically determined that and at what spacing two locations were fluorescing in the focal plane 29 although these two locations could not have been resolve within diffraction-limited resolution. A person skilled in the art, knows realizations to evaluate the data of the two-dimensional detector 19 for each scanning position in which, an equation is formulated which contains several unknowns, in particular the intensity and spacing of the locations in the focal plane 29. Due to the plurality of scanning positions, a system of equations is obtained which is overdetermined and enables the radiation intensity and spacing, i.e., thus also the position, of the fluorescing positions to be calculated. This will be explained below.
[0049] This principle of high-resolution microscopy is now improved with the microscope 1 to the effect that the spectrally selective element 15 changes the diffraction image 17 in the detection plane 18, which is conjugate with the focal plane 29, such that, for two wavelength ranges (color channels), two Airy disks are forming which are displaced with respect to each other. The diffraction image as now obtained according to the situation shown in
[0050] The combination of the Airy disks 30 and 31 is the diffraction image 17, i.e., the Airy disks do not move spatially during microscopy. The diffraction image 17 which was a single Airy disk in the microscope according to EP 2317362 A1 is now replaced by the two Airy disks 30 and 31.
[0051] If two locations lying in the focal plane 29 and spaced so close to each other that they could not be resolved by diffraction-limited imaging per se are again viewed, the following behavior arises in the microscope 1 because of the spectrally selective element 15, if it is assumed that the first position fluoresces in the first color channel to which the Airy disk 30 is assigned and the second position fluoresces in the second color channel to which the Airy disk 31 is assigned: as soon as the illumination spot 14 covers the first location, the first Airy disk 30 starts to light up in the diffraction image 17. In contrast, the second Airy disk 31 stays dark since no radiation comes into the second color channel, as long as the second position is not also illuminated by the illumination spot 14. The intensity in the Airy disk 30 increases until the first position is covered by the center of the illumination spot 14. The intensity in the Airy disk 30 of the first color channel is then at a maximum. The same applies to the Airy disk 31 and the second color channel as well as the second position. As a result, as the two locations are surest by the illumination spot 14, a brightening and fading again of the first Airy disk 31 and a brightening and fading of the second Airy disk 31 occurring somewhat later in time are observed.
[0052] The evaluation of the data of the two-dimensional detector 19 in combination with the scanning positions thus enables an equation to be formulated for each scanning position which includes not only the position and fluorescence intensity of the two positions but also a statement about whether the first or second location limits in the first or second color channel (the assignment is not already known in advance). The plurality of scanning positions again results in an overdetermined system of equations which also enables to additionally assign the emitting locations to one of the two color channels.
[0053] In this way, the microscope 1 and the assigned microscopy method discriminates between two wavelength ranges (color channels) in the high-resolution image and obtains a two-color image without additional detectors needed.
[0054] It is emphasized that the spacing between the Airy disks 30 and 31 remains constant during the microscopy, in particular the spacing does not scale any color information. It only ensures that the Airy disks 30 and 31 do not lie completely over each other spatially because they could not be discriminated otherwise.
[0055] It is, of course, possible to separate Airy disks such that they do not overlap. However a comparatively larger detector is needed, then.
[0056] In the embodiment of the spectrally selective element 15 shown in
[0057] The described approach is not only limited to the use of two wavelength ranges (color channels).
[0058] In the description hitherto it was assumed that the spectrally selective element 15 is in the imaging device 4 and, thus, in a part of the beam path which acts exclusively for the imaging. In other words, in this embodiment the spectrally selective element 15 is not penetrated by illumination radiation. The color channels, which are generated by the spectrally selective element 15 through the displacement of the Airy disks with respect to each other, are thus color channels of the fluorescing sample. These embodiments of the microscope or microscopy method discriminate the fluorescing radiation with respect to its wavelength range (color channel).
[0059] However, the spectrally selective element 15 can also be arranged in the illumination devices 3. This arrangement is drawn in
[0060] In a variant from the above-named alternatives, the spectrally selective element 15 can also be placed in a part of the beam path which is passed through both by the illumination and also by the imaging, or two spectrally selective elements 15 are used. In this way, crosstalk during the simultaneous excitation of two dyes by one wavelength can be suppressed. In addition, this opens possibilities for calibration measurements.
[0061] By arranging the spectrally selective element 15 in the illumination device 3, a case can arise where, on illumination by two or more illumination color channels, the shorter illumination wavelength stimulates a fluorescence signal in the wavelength range of fluorescence stimulated by the longer-wave illumination. The consequence of this would be that one of the structures would again appear as a displaced shadow image. By means of a suitable correlation calculation, the shadow image part can be determined and eliminated.
[0062] The embodiment according to
[0063] On using a two-dimensional detector 19 with optical fibers, as is shown by way of example in
[0064] To explain the mathematical analysis of the formulation of the system of equations more precisely an introduction first considered, the case of only one color, i.e., without spectrally selective element 15. If the object is identified with O(r), the point spread function (PSF) of the excitation with E(r) and the PSF of the detection with H(r), signal D(r,p) for each pixel is obtained the following equation, wherein r denotes the spacing from the location p of the illumination spot:
A Fourier transformation of D(r,p) with respect to the location p gives:
D(r,ω)=O(ω)FT.sub.r′{E(r′)H(r′+r)} (2)
The product in the real domain gives the following convolution in the Fourier domain:
If a support function is introduced at the location r:
EH(r,ω)=FT.sub.r′{E(r′)H(r′+r)} (4)
the following equation (2) results
D(r,ω)=O(ω)EH(r,ω) (5)
[0065] Different locations r on the two-dimensional detector are combined by means of a Wiener filter
wherein |O(ω)|.sup.2
and
|n(ω)|.sup.2
are the corresponding spectral power densities of the signal (“O”) and of the noise (n).
[0066] Having said this, the following weightings predetermined by the PSF are obtained for several color channels which are mixed at each pixel of the two-dimensional detector 19:
In this equation, c is the color channel index. If the equation (7) is written as a matrix, we obtained:
[D(r,ω)].sub.r=[O.sub.c(ω)].sub.c[EH.sub.c(r,ω)].sub.c,r (8)
If additional noise is taken into consideration, equation (8) takes the following form:
[{tilde over (D)}(r,ω)].sub.r=[O.sub.c(ω)].sub.c[EH.sub.c(r,ω)].sub.c,r+[N(r,ω)].sub.r (9)
The object [O.sub.c(ω)].sub.c can be obtained by means of an operator [G.sub.c(r,ω)].sub.r,c, which combines frequency filtering and color channel un-mixing:
[O.sub.c(ω)].sub.c=[G.sub.c(r,ω)].sub.r,c[{tilde over (D)}(r,ω)].sub.r. (10)
As in deriving the Wiener filter, the quadratic spacing between the reconstructed and the actual object must now be minimized for each frequency and each color channel:
E|[O.sub.c(ω)].sub.c−[{tilde over (D)}(r,ω)].sub.r[G.sub.c(r,ω)].sup.r,c|.sup.2=min (11)
By using equation (9), the following is thus obtained:
E|{[O.sub.c(ω)].sub.c[EH.sub.c(r,ω)].sub.c,r+[N(r,ω)].sub.r}[G.sub.c(r,ω)].sub.r,c−[O.sub.c(ω)].sub.c|.sup.2=min (12)
Using the same principles as in deriving the Wiener filter, which are known to a person skilled in the art, for example, from http://en.wikipedia.org/wiki/Wiener_deconvolution, the following is obtained:
[O.sub.c(ω)].sub.c=[D(r,ω)].sub.r{[EH.sub.c(r,ω)].sub.c,r*[I].sub.c[EH.sub.c(r,ω)].sub.c,r+[σ.sup.2].sub.r}.sup.−1[EH.sub.c(r,ω)].sub.c,r*[I].sub.c (13)
Herein, [I].sub.c and [σ.sup.2].sub.r are the spectral power densities of the signal for each color channel and the noise:
[I].sub.c=E|[O.sub.c(ω)].sub.c|.sup.2; [σ.sup.2].sub.r=E|[N(r,ω)].sub.r|.sup.2 (14)
[0067] When the emission spectra of fluorophores overlap it can be that, in one color channel, shadows of an object arise from the other color channel. Such shadow images are distorted by the same detection PSF as the main image in the actual color channel. An image detected in the channel c, O.sub.c(ω) is therefore an overlay of the images O.sub.c.sup.TRUE(ω) corresponding to the objects assigned to the different color channels:
[O.sub.c(ω)].sub.c=[M].sub.c[O.sub.c(ω)].sub.c (15)
Here, [M].sub.c is a un-mixing matrix. In the case, for example, of two colors, the following is then obtained:
[0068] Obtaining the true images O.sub.c.sup.TRUE(ω) is simple when their mixing matrix [M].sub.c is known. If this is not the case, it can be obtained by minimizing a cross-correlation between the generated images, i.e., the matrix is to be determined such that its values ensure the lowest cross-correlation for the best segregated objects.