DEVICE AND METHOD FOR OBSERVING A SAMPLE WITH A CHROMATIC OPTICAL SYSTEM
20190187453 ยท 2019-06-20
Assignee
Inventors
Cpc classification
G01N2021/6491
PHYSICS
G03H2001/005
PHYSICS
G01N21/6486
PHYSICS
G01N2015/1454
PHYSICS
G03H1/0443
PHYSICS
G02B21/16
PHYSICS
G03H1/0866
PHYSICS
G06V20/69
PHYSICS
G02B21/367
PHYSICS
International classification
G02B21/36
PHYSICS
G02B21/16
PHYSICS
Abstract
The invention relates to a method for observing a fluorescent sample (10), lying in a plane (P.sub.10), called the sample plane, the sample comprising a fluorescent agent (10f) able to emit a fluorescence light wave (.sub.f), in a fluorescence spectral band (.sub.f), when it is illuminated by an excitation light wave (.sub.e), in an excitation spectral band (.sub.e), the method comprising the following steps: a) illuminating the sample (10) using a first light source (11), in a first illumination spectral band (.sub.1), in the excitation spectral band (.sub.e0, and acquiring a first image (I.sub.1) of the sample, in the fluorescence spectral band, using an image sensor (30); b) illuminating the sample (10) using a second light source (12), in a second spectral band (.sub.2), outside of the fluorescence spectral band, and acquiring a second image (I.sub.2) of the sample, in the second apectral band, using the image sensor;
the image sensor (30) being coupled to an optical system (20) such that: in the fluorescence spectral band (.sub.f), the object focal plane (P.sub.1) of the optical system is coincident with the plane (P.sub.10) of the sample; in the second spectral band, the object focal plane (P.sub.2) of the optical system is offset with respect to the plane (P.sub.10) of the sample, the offset being larger than 20 m.
Claims
1. A method for observing a fluorescent sample, lying in a sample plane, the sample comprising a fluorescent agent configured to emit a fluorescence light wave, in a fluorescence spectral band, when it is illuminated by an excitation light wave, in an excitation spectral band, the method comprising : a) illuminating the sample using a first light source, in a first illumination spectral band, the first illumination spectral band lying in the excitation spectral band, and acquiring a first image of the sample, in the fluorescence spectral band, using an image sensor, the image sensor defining a detection plane; b) illuminating the sample using a second light source, in a second spectral band, outside of the fluorescence spectral band, the sample lying between the second light source and the image sensor, and acquiring a second image of the sample, in the second spectral band, using the image sensor; the image sensor being coupled to an optical system placed between the image sensor and the sample, the optical system being such that: in the fluorescence spectral band, the object plane of the optical system is coincident with the sample plane; in the second spectral band, the object plane of the optical system is offset with respect to the sample plane, and/or the image plane of the optical system is offset with respect to the detection plane, the offset being larger than 20 m; such that: the first image is a focused image of the sample, which image is representative of a fluorescence of the sample; the second image is a defocused image of the sample, which image is representative of a structure of the sample; wherein the image sensor, the optical system and the sample remain stationary between the acquisition of the first image and the acquisition of the second image.
2. The method according to claim 1, comprising: c) applying a holographic reconstruction operator to the second image, so as to obtain a reconstructed image of the sample in a reconstruction plane.
3. The method according to claim 1, wherein the second spectral band is offset, with respect to the fluorescence spectral band, by at least 150 nm and preferably by at least 200 nm.
4. The method according to claim 1, wherein, in the second spectral band, the object focal plane is offset from the sample plane by a distance smaller than 1 mm, and preferably by a distance smaller than 500 m.
5. The method according to claim 1, wherein: the first light source is placed in a half-space bounded by the sample plane and comprising the image sensor; or the first light source is placed in a half-space bounded by the sample plane and comprising the second light source.
6. The method according to claim 1, wherein a) and b) are carried out successively, a) being carried out before b) or vice versa.
7. The method according to claim 1, wherein the second spectral band is at least 150 nm or at least 200 nm wide, so as to include fluorescence peaks of different fluorescent agents.
8. A device for observing a fluorescent sample, the sample being configured to emit a light wave in a fluorescence spectral band when it is illuminated in an excitation spectral band, the device comprising: a first light source configured to emit a light wave in a first spectral band lying in an excitation spectral band of the sample; a second light source configured to emit a light wave in a second spectral band outside of the fluorescence spectral band of the sample; an image sensor that is optically coupled to an optical system, the image sensor defining a detection plane; a holder intended to receive the sample, such that the sample lies in a sample plane, the latter lying between the optical system and the second light source; the optical system defining: in the fluorescence spectral band, a first object plane that is coincident with the sample plane; in the second spectral band, a second object plane that is distant from the sample plane by at least 20 m and/or a second image plane that is distant from the detection plane by at least 20 m; such that the image sensor is configured to acquire, without moving the sample or the image sensor or the optical system: a clear image of the sample, in the fluorescence spectral band, when the sample is illuminated by the first light source; a defocused image of the sample, in the second spectral band, when the sample is illuminated by the second light source.
9. The device according to claim 8, wherein the distance between the first object plane and the second object plane is smaller than 1 mm, and preferably smaller than 500 m.
10. The device according to claim 8, comprising a processor configured to apply a holographic reconstruction operator to an image acquired by the image sensor, so as to reconstruct an image representative of the sample, in a reconstruction plane distant from a detection plane in which the image sensor lies, and preferably in the sample plane.
11. The device according to claim 8, comprising a filter, lying between the sample and the image sensor, having a fluorescent pass band, corresponding to the fluorescence spectral band.
12. The device according to claim 11, wherein the filter has an auxiliary passband, distinct from the fluorescence passband, corresponding to the second spectral band.
13. The device according to claim 11, wherein the fluorescence passband of the filter has a bandwidth narrower than 100 nm.
14. The device according to claim 8, wherein: the first light source is placed in a half-space bounded by the sample plane and comprising the image sensor; or the first light source is placed in a half-space bounded by the sample plane and comprising the second light source.
15. The device according to claim 8, wherein the device is configured to form an in-focus image of the sample in a spectral band which is at least 150 nm or at least 200 nm wide.
Description
FIGURES
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
DESCRIPTION OF PARTICULAR EMBODIMENTS
[0051]
[0052] The sample comprises a sample holder 10s that is configured to receive a sample 10, such that the sample is held on the holder 10s so as to lie in a plane, called the sample plane P.sub.10. The sample 10 is a sample that it is desired to characterize. It especially comprises a liquid medium 10.sub.m, including particles 10.sub.p. The medium 10.sub.m may be a buffer liquid. It may also include a bodily liquid, in the pure or diluted state. By bodily liquid, what is meant is a liquid generated by a living body. It may in particular be a question, nonlimitingly, of blood, of urine, of cerebrospinal fluid, of sperm, of lymph. By particle, what is especially meant is a cell, for example a blood cell, or a microorganism, for example a bacterium. The sample 10 is, in this example, contained in a fluidic chamber 15. The fluidic chamber 15 is for example a fluidic chamber of 100 m thickness. The thickness of the fluidic chamber 15, and therefore of the sample 10, along the propagation axis Z, typically varies between 10 m and 1 cm, and is preferably comprised between 20 m and 500 m.
[0053] The sample may be a transparent or translucent solid sample. It may for example be a thin slide of biological tissue, for example an anatomical-pathology slide, or even a dry extract of a liquid, for example a biological liquid.
[0054] The sample contains a fluorescent agent 10.sub.f, or fluorophore. It may be an exogenous agent, added to the sample prior to its observation, or an endogenous agent, naturally present in the sample. When it is illuminated in an excitation spectral band .sub.e, the fluorescent agent 10.sub.f emits a fluorescence light wave .sub.f in a fluorescence spectral band .sub.f. An exogenous fluorescent agent is generally added to the object, so as to specifically bind to targets, for example a certain category of cells, or more generally to biological structures of interest, for example a nucleus of a cell, a DNA base, a tumour cell, or a biological structure comprising a ligand able to preferentially bind with the fluorescent agent. The fluorescent agent used may be IndoCyanine Green (or ICG). In this case, the excitation spectral band .sub.e is comprised between 750 nm and 800 nm, the fluorescence spectral band .sub.f being comprised between 820 nm and 870 nm. The fluorescent agent used may be DAPI (4, 6-diamidino-2-phenylindole). In this case, the excitation spectral band .sub.e is comprised between 350 nm and 400 nm, the fluorescence spectral band .sub.f being comprised between 430 nm and 530 nm. DAPI is known to bind to certain DNA bases. Its use for example allows DNA in a cell to be located. It is also possible to use a Hoechst stain, the optical properties of which are close to those of DAPI, but which is less toxic.
[0055] One of the objectives of the device 1 is to observe the sample 10 in a fluorescence mode. Thus, the first spectral band .sub.1 corresponds to the excitation spectral band .sub.e of the fluorescent agent 10.sub.f present in the sample 10.
[0056] The distance D between the second light source 12 and the sample 10 is preferably larger than 1 cm. It is preferably comprised between 2 and 30 cm. Advantageously, the second light source, seen by the sample, may be considered to be point-like. This means that its diameter (or its diagonal) is preferably smaller than one tenth, better still one hundredth of the distance between the sample and the light source. In
[0057] In the example shown in
[0058] Preferably, the first spectral band .sub.1 and/or the second spectral band .sub.2 have a bandwidth narrower than 200 nm, or even than 150 nm or 100 nm. By spectral bandwidth, what is meant is a full width at half-maximum of the spectral band.
[0059] According to another embodiment, the device comprises a wide-spectral-band light source called the main light source, which emits white light. The illumination of the sample in the first spectral band .sub.1 and in the second spectral band .sub.2 is respectively obtained by placing a first bandpass filter, defining the first spectral band, and a second bandpass filter, defining the second spectral band, between the main light source and the sample. The first light source 11 is obtained by associating the main light source and the first bandpass filter. The second light source 12 is obtained by associating the main light source and the second bandpass filter. The width of the first and second spectral bands are respectively determined by the respective passbands of the first and second bandpass filters.
[0060] The sample 10 is placed between the second light source 12 and an image sensor 30. The latter preferably lies parallel, or substantially parallel, to the plane P.sub.10 in which the sample 10 lies. The expression substantially parallel means that the two elements may not be rigorously parallel, an angular tolerance of a few degrees, lower than 20 or 10, being allowed. In this example, the sample lies in a plane P.sub.10 perpendicular to the propagation axis Z. The first light source 11 may be placed: [0061] in a half-space bounded by the sample plane P.sub.10 and comprising the second light source 12 [0062] or in a half-space bounded by the sample plane P.sub.10 and comprising the image sensor 30.
[0063] The image sensor 30 is configured to form an image of the sample in a detection plane P.sub.30. In the example shown, the image sensor 30 comprises a CCD or CMOS pixel matrix array. The detection plane P.sub.30 preferably lies perpendicular to the propagation axis Z of the incident second light wave .sub.2. In the example shown, the image sensor 30 is an IDS UI-1942LE-M CMOS sensor comprising 38402748 pixels, the size of each pixel being 1.67 m1.67 m.
[0064] The image sensor 30 is optically coupled to the sample 10 by an optical system 20. In the example shown, the optical system comprises an objective 21 and a tube lens 22. The optical system 20 is chromatic: for a given image focal plane, in the present case coincident with the detection plane P.sub.30, the position of the object focal plane is dependent on wavelength. Reciprocally, for a given object plane, in the present case coincident with the sample plane P.sub.10, the position of the image plane is dependent on wavelenght. Thus, when two wavelengths are separated by 100 nm, the object planes (or image planes) corresponding to each wavelength are spaced apart by at least 10 m, and preferably by at least 20 m or 30 m, or indeed 50 m, respectively. In this example, the objective 21 is a Motic CCIS EF-N Plan Achromat 10 objective, of 0.25 numerical aperture. It is optically coupled to the lens 22, the latter being the origin of the chromatic aberrations of the optical system 20 that result in the spacing between the object planes (or image planes) being wavelength-dependent. The lens is, in this example, the following lens: LBF254-050-N-BK7 Best Form Lens, 1, f=50 mm.
[0065] ae device in a first configuration in which the sample is illuminated, by the first light source, in the first spectral band .sub.1, which corresponds to the excitation spectral band .sub.f of the fluorescent agent 10.sub.f. Under the effect of this illumination, the fluorescent agent emits a fluorescence wave .sub.f, in the fluorescence spectral band .sub.f. The optical system 20 is placed such that, in the fluorescence spectral band .sub.f, the first object focal plane P.sub.1 corresponds to the plane P.sub.10 in which the sample 10 lies, this corresponding to the plane in which the fluorescence light wave .sub.f is emitted. The conjugate image focal plane of the first object focal plane P.sub.1 is the detection plane P.sub.30. Thus, in this configuration, the image sensor 30 acquires a clear first image I.sub.1 of the sample, this image being representative of the fluorescence of the sample 10. It allows a spatial distribution of the fluorescent agent 10.sub.f in the sample to be observed.
[0066] In this configuration, an optical filter 15, called the excitation filter, may be placed between the first light source 11 and the sample 10. The excitation filter 15 allows the first spectral band .sub.1 to be adjusted such that the light wave .sub.1 illuminating the sample corresponds to all or some of the excitation spectral band .sub.e.
[0067] An optical filter 16, called the fluorescence filter, may be placed between the sample 10 and the image sensor 30. The fluorescence filter 16 allows the light wave detected by the image sensor 30 to be limited to the fluorescence spectral band .sub.f. This especially makes it possible to prevent parasitic light not originating from fluorescence of the sample from degrading the image acquired by the image sensor. The optical filter 16 has a fluorescence passband, corresponding to the fluorescence spectral band .sub.f. It may also be a question of a multi-band bandpass filter the passband of which includes both the fluorescence spectral band .sub.f and a second spectral band .sub.2, which is described below. By multi-band bandpass filter, what is meant is a filter the passband of which includes distinct passbands that are spaced apart from one another. It may also be a question of a high-pass filter that lets wavelengths located beyond the excitation spectral band .sub.e pass and that blocks wavelengths in the excitation spectral band.
[0068] In another configuration, shown in
[0069] The optical system 20 is such that, in the second spectral band .sub.2, the second object focal plane P.sub.2 is offset with respect to the first object focal plane P.sub.1, the latter corresponding to the plane P.sub.10 in which the sample 10 lies. The image focal plane, conjugate of the second object focal plane P.sub.2, is the detection plane P.sub.30. Thus, in this configuration, the image sensor 30 acquires a defocused second image I.sub.2 of the sample 10, in the second spectral band .sub.2.
[0072] The second image I.sub.2 acquired by the image sensor 30 contains interference patterns (or diffraction patterns) that are representative of the sample 10, or of the particles 10.sub.p contained in the latter. Generally, the second image I.sub.2 acquired by the image sensor 30 is representative of the structure of the sample.
[0073] A processor 32, for example a microprocessor, is able to process the second image I.sub.2 acquired by the image sensor 30. In particular, the processor is a microprocessor 32 connected to a programmable memory 33 in which a sequence of instructions for carrying out the image-processing and computing operations described in this description is stored. The processor 32 may be coupled to a screen 34 allowing images acquired by the image sensor 30 or computed by the processor 32 to be displayed.
[0074] The defocused second image I.sub.2 acquired by the image sensor 30 in the second configuration, does not allow a precise representation of the observed sample to be obtained. Conventionally, in the holography field, a holographic reconstruction operator h may be applied to the second image I.sub.2 so as to calculate a complex expression A representative of the light wave .sub.2 to which the image sensor is exposed, at any point of spatial coordinates (x, y, z), and in particular in a plane, called the reconstruction plane P.sub.Z, located at a distance |z|, called the reconstruction distance, from the image sensor 30. The reconstruction plane is preferably the plane P.sub.10 in which the sample 10 lies. The complex expression A(x,y, z) at the point of coordinates (x, y, z) is obtained from the second image I.sub.2 , by calculating the convolution product given by the following equation:
A(x, y, z)=I.sub.2(x, y, z)*h, the symbol * representing the convolution operator.
[0075] The coordinates (x,y) designate a planar position in a radial plane perpendicular to the propagation axis Z. The z coordinate designates a coordinate along the propagation axis Z. Before application of the reconstruction operator, the second image I.sub.2 may be normalized or undergo pre-processing before the convolution by the reconstruction operator.
[0076] The function of the reconstruction operator h is to describe the propagation of the light between the image sensor 30 and a point, of coordinates (x, y, z), located at a distance |z| from the image sensor. The complex expression A of the exposure light wave .sub.2, at any point of spatial coordinates (x,y,z), is such that: A(x,y, z)=M(x, y, z)e.sup.j(x,y,z) where M(x, y, z) and (x, y, z) are the modulus and phase of the exposure light wave .sub.2, at the point of coordinates (x, y, z), respectively. Thus:
[0077] M(x, y, z)=abs[A(x, y, z)]; and
[0078] cp (x, y, z)=arg [A (x, y, z)].
[0079] The operators abs and arg designate the modulus and argument, respectively.
[0080] The complex expression A is a complex quantity the argument and the modulus of which are representative of the phase and amplitude of the exposure light wave detected by the image sensor 30, respectively. The product of convolution of the second image I.sub.2 and the reconstruction operator h may allow a complex image A.sub.z that represents a spatial distribution of the complex expression A in a reconstruction plane P.sub.Z lying at a distance |z| from the detection plane P.sub.30 to be obtained.
[0081] The complex image A.sub.z corresponds to a complex image of the sample in the reconstruction plane P.sub.Z. It also represents a two-dimensional spatial distribution of the complex expression A describing the exposure wave .sub.2. Such methods, which are referred to as holographic reconstruction methods, especially allow an image M.sub.Z of the modulus or an image .sub.Z of the phase of the complex expression defining the exposure light wave .sub.2 to be reconstructed in the reconstruction plane. The image of the modulus or of the phase of the exposure light wave .sub.2 is obtained using the following expressions:
M.sub.Z=mod(A.sub.z) and .sub.Z=arg(A.sub.z), respectively.
[0082] The reconstruction operator is for example the Fresnel-Helmholtz function, such that:
[0083] Examples of holographic reconstructions are described in the publication Seo S et al, High-Throughput lens-free blood analysis on a chip, Anal Chem. 2010 June 1; 82(11): 4621-4627, or even in document WO2017162985.
[0084] When the sample is transparent, the reconstructed image is preferably an image .sub.Z of the phase of the complex expression of the light wave .sub.2 striking the image sensor 30. When the reconstruction plane is plane P.sub.10 in which the sample lies, such an image gives a relatively precise visual representation of the structure of the sample.
[0085] Thus, the invention allows a first image I.sub.1 that is representative of the fluorescence of the sample, and a second image I.sub.2 that, after holographic reconstruction, is representative of the structure of the sample 10, to be obtained. A noteworthy aspect of the invention is that between the acquisition of the first image and the acquisition of the second image, neither the sample 10, nor the image sensor 30, nor the optical system 20 are moved. This avoids recourse to means for moving and positioning the optical system. It is thus possible to successively acquire a first image and a second image of the sample by successively activating the first light source 11, then the second light source 12. When the first image I.sub.1 is acquired, it is preferable for the second light source 12 to be turned off, so as to prevent parasitic light from degrading the first image. It is also desirable for the first light source 11 to be turned off when the second image I.sub.2 is acquired. Preferably, the first image and the second image are acquired sequentially. The device 1 allows bimodal observation of the sample in a simple way, requiring no deustment of a focal plane of the optical system 20 between implementation of the two modes. The exposure time of the first image may be longer than the exposure time of the second image, because the intensity of the fluorescence light wave is generally low.
[0086] When a multi-band optical filter such as described above is used, all the components of the device, including the sample 10, may remain stationary, no movement needing to be provided for between the acquisition of the first image I.sub.1 and of the second image I.sub.2. This allows a rapid switch between the acquisition of the first image and the acquisition of the second image.
[0087]
[0088]
[0089]
[0090] Implementation of the invention is somewhat summarized in
[0091]
[0092]
[0098] The chronological order in which steps 110 and 120 are implemented is unimportant.
[0099] In another experimental trial, living Madin-Darby Canine Kidney (MDCK) cells cultivated in an incubator were stained with the DNA-specific fluorescent agent Hoechst 33342. Six hours after staining, a first fluorescence image of the sample was acquired. The sample was then illuminated in the near UV, in order to make it emit a fluorescence light wave in the spectral band .sub.f centred on 452 nm. A defocused second image of the sample was also acquired by illuminating the latter in a second spectral band .sub.2 centred on 543.5 nm and of 2.1 nm bandwidth. To this second spectral band corresponded an object focal plane that was distant by 60 m from the object focal plane that corresponded to the fluorescence wavelength of the fluorescent agent. The method described with reference to
[0100] According to an embodiment, the optical system is such that the object focal plane of the optical system is coincident with the sample plane, or substantially coincident with the sample plane, in a wide fluorescence spectral band. By substantially coincident, it is meant concident within a 30 m margin. By wide spectral band, it is meant a spectral band which band width is at least 150 m wide, or preferably at least 200 m wide. In a second spectral band .sub.2, the object focal plane of the optical system is offset with respect to the sample plane P.sub.10, the offset being larger than 50 m. Due to the width of the fluorescence spectral band, this embodiment makes it possible to get a fluorescence image of different fluorescent agents, sequencially or simultaneously.
[0101]
[0102] Between 440 nm and 650 nm, the variation of the focal distance is not significant : the focal distance varies within a 30 m margin around 60 m. Below 440 nm, the variation of the focal distance is more significant.
[0103] The device shown in
[0104] In the device shown in
[0105] The first light source 11 includes three elementary light sources 11.sub.1, 11.sub.2, 11.sub.3. The first light source is configured to emit the first light wave .sub.1 in the elementary excitation spectral bands .sub.e1, .sub.e2, .sub.e3, simultaneously or sequentially. When using a monochrome image sensor, the elementary light sources should be activated sequentially.
[0106] As shown in
[0107] The optical system 20 is configured such that, in each of the fluorescence spectral bands .sub.f1, .sub.f2, .sub.f3, the object plane is coincident (or substantially coincident) to the sample plane P.sub.10. Depending on the elementary light source which is activated, first fluorescence images I.sub.1 are obtained, in different fluorescence spectral bands. Each first image I.sub.1 is an clear image. The fluorescence images I.sub.1 may be acquired successively. Each fluorescence image I.sub.1 show the spatial distribution of at least one fluorescent agent within the sample 10.
[0108] The image sensor is an IDS UI-1480SE monochrome CMOS sensor, comprising 25601920 pixels, the size of each pixel being 2.2 m2.2 m.
[0109] In a second configuration, a defocused second image I.sub.2 is acquired by the image sensor 30, as shown in
[0110] an illuminating light source 12;
[0111] a fiber optics 12.sub.f, extending between a proximal end 12.sub.p and a distal end 12.sub.d.
[0112] The proximal end 12.sub.p of the fiber optics 12.sub.f is placed facing the illuminating source 12.
[0113] The second light source 12 is configured to emit a second light wave .sub.2 in a second spectral band .sub.2. The second light wave .sub.2 propagates along a propagation axis Z. A pass band filter 17 defines a second spectral band .sub.2 of the second light wave .sub.2. In this example, the second spectral band .sub.2 in centred on 40 nm. The bandwidth of the the second spectral band .sub.2 is 10 nm.
[0114] The optical system 20 is placed such that, in the second spectral band .sub.2, the second object focal plane P.sub.2 is offset with respect to the first object focal plane P.sub.1, the latter corresponding to the plane P.sub.10 in which the sample 10 lies. The image focal plane, conjugate of the second object focal plane P.sub.2, is the detection plane P.sub.30. Thus, in this configuration, the image sensor 30 acquires a defocused second image I.sub.2 of the sample 10, in the second spectral band .sub.2.
[0115] Alternatively, in the second spectral band .sub.2, the second object plane P.sub.2 is coincident to the sample plane P.sub.10 and the second image plane is offset with respect to the detection plane P.sub.30.
[0116] In this example, the defocus distance is 70 m.
[0117]
[0118] A noticeable feature of this embodiment is that it enables clear (i-e in-focus) fluorescence images of different fluorescence agents to be acquired successively or simultaneously.
[0119] The device, because of the absence of adjustment of the focal planes between two image acquisitions in the various modes, is compact and may easily be placed inside an incubator. It allows samples to be observed with a large field of observation. This field of observation may for example extend over an area of 4 mm.sup.2, this allowing simultaneous observation of many biological species. The area depends on the magnification of the optical system.