METHOD FOR DETERMINING PARAMETERS OF A PARTICLE
20200110017 ยท 2020-04-09
Assignee
Inventors
Cpc classification
G01N2015/035
PHYSICS
G01N2015/1454
PHYSICS
G03H1/0443
PHYSICS
G03H1/0866
PHYSICS
G03H2001/0471
PHYSICS
International classification
Abstract
A method for determining a parameter of a particle present in a sample, the method comprising the following steps: a) illuminating the sample with the light source, the light source emitting an incident light wave that propagates along a propagation axis; b) acquiring an image of the sample with the image sensor, the image sensor being exposed to an exposure light wave; c) determining a position of the particle in the detection plane; d) on the basis of the acquired image, applying a propagation operator, for a plurality of distances from a detection plane, so as to estimate, at each distance, a complex amplitude of the exposure light wave; e) on the basis of the complex amplitude estimated, at various distances, obtaining a profile representing a variation of the complex amplitude of the exposure light wave along an axis parallel to the propagation axis and passing through the position of the particle.
The particle may associated with a set of parameters, comprising at least a size of the particle and a refractive index of the particle.
Claims
1. A method for determining parameters of a particle present in a sample, the sample lying between an image sensor and a light source, the image sensor lying in a detection plane, the method comprising: a) illuminating the sample with the light source, the light source emitting an incident light wave that propagates along a propagation axis; b) acquiring an image of the sample with the image sensor, the image sensor being exposed to an exposure light wave; c) determining a position of the particle in the detection plane or in a plane parallel to the detection plane; d) on the basis of the acquired image, applying a propagation operator, for a plurality of distances from the detection plane, so as to estimate, at each distance, a complex amplitude of the exposure light wave; e) on the basis of the complex amplitude estimated, at various distances, obtaining a profile representing a variation of the complex amplitude of the exposure light wave along an axis parallel to the propagation axis and passing through the position of the particle; wherein the particle is associated with a set of parameters, comprising at least a size of the particle and a refractive index of the particle, the method also comprising: f) modelling a particle, taking into account a value of each parameter of the set of parameters, and modelling an exposure light wave, propagating toward the image sensor, under the effect of an illumination, with the light source, of the modelled particle; g) on the basis of the modelled exposure light wave, forming a profile representing a variation in the complex amplitude of the modelled exposure light wave, along an axis parallel to the propagation axis; h) comparing the profile obtained in e) with the modelled profile resulting from g), so as to determine the value of at least one parameter of the particle.
2. The method as claimed in claim 1, wherein the refractive index comprises a real part and an imaginary part.
3. The method as claimed in claim 1, wherein the set of parameters also comprises a distance of the particle with respect to the detection plane.
4. The method as claimed in claim 1, wherein: f) comprises modelling particles respectively having various values of at least one parameter, so as to obtain, following g), a database of modelled profiles, each modelled profile being associated with one set of parameters; h) comprises minimizing a deviation between the profile resulting from e) and the modelled profiles of the database, the respective values of the parameters of the particle being those minimizing the deviation.
5. The method as claimed in claim 1, wherein f), g) and h) are carried out iteratively, the value of a parameter of the particle resulting from one iteration being used to initialize a following iteration.
6. The method as claimed in claim 1, wherein: f) comprises modelling particles of various sizes and/or of various refractive indices, so as to obtain, following g), a database of modelled profiles, each modelled profile being associated with a size and/or a refractive index; h) comprises determining the size of the particle and/or the refractive index of the particle.
7. The method as claimed in claim 1, wherein: f) comprises modelling particles located at various distances from the detection plane, so as to obtain, following g) a database of modelled profiles, each modelled profile being associated with a distance with respect to the detection plane; h) comprises determining the distance between the particle and the detection plane.
8. The method as claimed in claim 1, wherein steps f) to h) are implemented iteratively, such that, in each iteration, the profile modelled in g) gets gradually closer to the profile determined in e).
9. The method as claimed in claim 8, wherein step h) of an iteration comprises: determining a deviation between the profile modelled in g) of the same iteration, and the profile resulting from e); determining a gradient of the deviation as a function of at least one parameter of the set of parameters, so as to determine the values of the parameters of the particle modelled in f) of the following iteration.
10. The method as claimed in claim 1, also comprising: applying a propagation operator to the acquired image, while considering a plurality of distances with respect to the detection plane, so as to obtain a stack of reconstructed images, each reconstructed image being associated with a distance with respect to the detection plane; on the basis of a reconstructed image, estimating a size of the particle; such that h) comprises taking into account the size of the particle estimated on the basis of the reconstructed image.
11. The method as claimed in claim 1, wherein the particle is a cell, the method comprising determining an alive or dead state of the cell depending on the refractive index.
12. The method as claimed in claim 11, wherein the refractive index comprises a real part and an imaginary part, the alive or dead state of the cell being defined depending on a comparison between the real part and the imaginary part.
13. The method as claimed in claim 1, wherein there is no image-forming optic between the sample and the image sensor.
14. The method as claimed in claim 1, wherein an optical system lies between the sample and the image sensor, the optical system defining an image plane and an object plane, and wherein, in b), the image is acquired in a defocused configuration, the detection plane being offset with respect to the image plane, and/or a plane of the sample, in which the sample lies, being offset with respect to the object plane.
15. A device for observing a sample, the sample comprising particles, the device comprising: a light source, configured to illuminate the sample; a sample holder, configured to receive the sample; an image sensor, placed such that when the sample is placed on the holder, it lies between the image sensor and the light source, the image sensor being configured to acquire an image of the sample; a processor, configured to implement steps d) to h) of a method as claimed in claim 1, on the basis of an image acquired by the image sensor.
16. The device as claimed in claim 15, wherein no image-forming optic is placed between the image sensor and the processor.
17. The device as claimed in claim 15, comprising an optical system lying between the sample and the image sensor, the optical system defining an image plane and an object plane, the device comprising a means for adjusting the optical system, or the sample, or the image sensor, such that: the detection plane is offset from the image plane; and/or the object plane is offset from a plane of the sample, in which the sample lies.
Description
FIGURES
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
DESCRIPTION OF PARTICULAR EMBODIMENTS
[0050]
[0051] The sample 10 is a sample that it is desired to characterize. It notably comprises a medium 10m in which particles 10.sub.i bathe. The medium 10m may be a liquid medium. It may comprise a bodily liquid, for example obtained from blood or urine or lymph or cerebrospinal fluid. It may also be a culture medium, comprising nutrients allowing the development of microorganisms or cells. By particle, what is notably meant, non-exhaustively is: [0052] a cell, whether it be a question of a culture cell or a bodily cell, for example a blood cell; [0053] a microorganism, for example a bacterium or a yeast or a microalgae; [0054] a solid particle, for example a microsphere, the microsphere possibly being functionalized, so as to promote grafting with an analyte; [0055] a particle forming an emulsion in the medium 10m, in particular a particle that is insoluble in the medium 10m, one example being a lipid droplet in an aqueous medium.
[0056] A particle 10.sub.i may be solid or liquid.
[0057] The sample 10 is, in this example, contained in a fluidic chamber 15. The fluidic chamber 15 is for example a Gene Frame fluidic chamber of thickness e=250 m. The thickness e of the sample 10, along the propagation axis, typically varies between 10 m and 1 cm, and is preferably comprised between 20 m and 500 m. The sample lies in a plane P.sub.10, called the plane of the sample, perpendicular to the propagation axis Z. The plane of the sample is defined by the axes X and Y shown in
[0058] The distance D between the light source 11 and the fluidic chamber 15 is preferably larger than 1 cm. It is preferably comprised between 2 and 30 cm. Advantageously, the light source 11, seen by the sample, may be considered to be point-like. This means that its diameter (or its diagonal) is preferably smaller than one tenth, and better still one hundredth of the distance between the fluidic chamber 15 and the light source. In
[0059] Preferably, the emission spectral band of the incident light wave 12 has a width smaller than 100 nm. By spectral bandwidth, what is meant is a fullwidth at half maximum of said spectral band.
[0060] The sample 10 is placed between the light source 11 and the aforementioned image sensor 16. The image sensor 16 defines a detection plane P.sub.0, which preferably lies parallel, or substantially parallel, to the plane P.sub.10 in which the sample lies. The term substantially parallel means that the two elements may not be rigorously parallel, an angular tolerance of a few degrees, smaller than 20 or 10, being acceptable.
[0061] The image sensor 16 is configured to form an image I.sub.0 of the sample 10 in the detection plane P.sub.0. In the example shown, it is a question of a CCD or CMOS image sensor 16 comprising a matrix array of pixels. The detection plane P.sub.0 preferably lies perpendicular to the propagation axis Z of the incident light wave 12. The distance d between the sample 10 and the matrix array of pixels of the image sensor 16 is preferably comprised between 50 m and 2 cm, and preferably comprised between 100 m and 2 mm.
[0062] The absence of magnifying or image-forming optics between the image sensor 16 and the sample 10 will be noted in this embodiment. This does not prevent focusing micro-lenses potentially being present level with each pixel of the image sensor 16, said micro-lenses not having the function of magnifying the image acquired by the image sensor, their function rather being to optimize detection performance.
[0063] The light source 11 may comprise elementary light sources, emitting in the various spectral bands. The image sensor is then configured to acquire, simultaneously or successively, an image I.sub.0 in each spectral band. Thus, the term image I.sub.0 acquired by the image sensor may designate a set of images acquired in various spectral bands, following the illumination of the sample in the various spectral bands.
[0064] As mentioned in the patent applications cited with respect to the prior art, under the effect of the incident light wave 12, the particles 10.sub.i present in the sample may generate a diffracted wave 13, liable to produce, in the detection plane P.sub.0, interference, in particular with a portion 12 of the incident light wave 12 transmitted by the sample. Moreover, the sample may absorb a portion of the incident light wave 12. Thus, the light wave 14, transmitted by the sample, and to which the image sensor 16 is exposed, designated by the term exposure light wave, may comprise: [0065] a component 13 resulting from the diffraction of the incident light wave 12 by each particle of the sample; [0066] a component 12 resulting from the transmission of the incident light wave 12 by the sample, a portion of the latter possibly being absorbed in the sample.
[0067] These components form interference in the detection plane. Thus, each image acquired by the image sensor comprises interference patterns (or diffraction patterns), each interference pattern possibly being associated with a particle 10.sub.i of the sample.
[0068] A processor 20, for example a microprocessor, is configured to process each image I.sub.0 acquired by the image sensor 16. In particular, the processor is a microprocessor connected to a programmable memory 22 in which a sequence of instructions for performing the image-processing and computing operations described in this description is stored. The processor may be coupled to a screen 24 allowing the display of images acquired by the image sensor 16 or computed by the processor 20.
[0069] An image I.sub.0 acquired by the image sensor 16, also called a hologram, may be the subject of a reconstruction, called a holographic reconstruction. As described with reference to the prior art, it is possible to apply, to the image acquired by the image sensor, a holographic propagation operator h, so as to compute a complex amplitude A(x,y,z) representative of the exposure light wave 14, and to do so at any point of spatial coordinates (x,y,z), and more particularly between the image sensor and the sample. The coordinates (x,y) designate coordinates, called radial coordinates, parallel to the detection plane P.sub.0. The coordinate z is a coordinate along the propagation axis Z, expressing a distance between the sample 10 and the image sensor 16.
[0070] The complex amplitude may be obtained via one of the following expressions: A(x,y,z)=I.sub.0(x,y,z)*h, * designating the convolution operator, or, and preferably, A(x,y,z)={square root over (I.sub.0(x,y,z))}*h, or indeed:
[0071] The function of the propagation operator h is to describe the propagation of light between the image sensor 16 and a point of coordinates (x,y,z) located at a distance |z| from the image sensor.
[0072] It is then possible to determine a property of the exposure light wave 14, for example the modulus M(x,y,z) and/or the phase (x,y,z), at the distance |z| with: [0073] M (x,y,z)=abs [A(x,y,z)]; [0074] (x,y,z)=arg [A(x,y,z)];
[0075] The operators abs and arg designate the modulus and argument, respectively.
[0076] The distance |z| is a reconstruction distance.
[0077] The propagation operator is for example the Fresnel-Helmholtz function, such that:
[0078] The complex expression A(x,y,z) of the light wave 14, at any point of spatial coordinates (x,y,z), is such that: A(x,y,z)=M (x,y,z)e.sup.j(x,y,z).
[0079] The complex expression A is a complex quantity the argument and modulus of which are respectively representative of the phase and intensity of the exposure light wave 14 detected by the image sensor 16 in order to form the image I.sub.0.
[0080] By determining the complex amplitude, for a given radial position (x,y), along the Z-axis, at a plurality of coordinates z, it is possible to form a profile representative of the exposure light wave. It may be a question of a profile of the phase or of the modulus of the exposure light wave. Generally, it is a question of a profile of an optical property of the exposure light wave, the term optical property designating a property obtained using the complex amplitude A(x,y,z), and representative of the latter. It may be a question of the modulus, of the phase, of the real part, of the imaginary part, or of a combination thereof.
[0081] According to one embodiment, the image I.sub.0 is convoluted with the propagation operator h. This allows a complex image A.sub.z representing a spatial distribution of the complex expression A in a reconstruction plane P.sub.z, lying at a distance |z| from the detection plane P.sub.0, to be obtained. In this example, the detection plane P.sub.0 has the equation z=0. The complex image A.sub.z corresponds to a complex image of the sample in the reconstruction plane P.sub.z. It also represents a two-dimensional spatial distribution of the optical properties of the exposure light wave 14. Such a method, designated by the term holographic reconstruction, notably allows an image of the modulus or of the phase of the exposure light wave 14 in the reconstruction plane to be reconstructed.
[0082] It is possible to form images M.sub.z and .sub.z respectively representing the modulus or phase of a complex image A.sub.z in a plane P.sub.z located at a distance |z| from the detection plane P.sub.0, with M.sub.z=mod (A.sub.z) and .sub.z=arg(A.sub.z). When the reconstruction plane corresponds to a plane in which the sample lies, the images M.sub.z and .sub.z allow the sample to be observed with a correct spatial resolution.
[0083] When complex images A.sub.z are formed for various reconstruction distances, a stack of complex images A.sub.z.sub.
[0084] The complex images A.sub.z.sub.
[0085] According to a first option, described in WO2017050672, a stack of complex images A.sub.z.sub.
[0086] According to another option, each complex image A.sub.z of the stack of images A.sub.z.sub.
[0087] It is not absolutely necessary to use a stack of complex images to establish a profile F.sub.x.sub.
[0088] One important aspect of the invention is the use of modelled profiles established on the basis of modelled particles 10(par). To do this, a set of parameters par of a particle is taken into account. Then, via a numerical model, the complex amplitude of an exposure light wave 14.sub.mod, propagating between the modelled particle and the image sensor 16, and resulting from an illumination of the modelled particle 10(par) with the light source 11, is modelled.
[0089] The model may notably be based on Mie scattering. Mie scattering is a model of elastic scattering allowing a solution to be obtained to Maxwell's equations, describing a light wave diffracted by a spherical particle illuminated by a monochromatic incident light wave of wavelength . Apart from its spherical shape, the particle is characterized by a refractive index n, the latter possibly notably being a complex refractive index n=Re(n)+jIm(n), with j.sup.2=1. Re et Im are operators that return the real part and imaginary part, respectively.
[0090] A modelled particle may also be characterized by its dimension, for example its diameter or its radius. The application of the Mie-scattering model allows a diffraction pattern I.sub.mod (par) to be simulated at various distances from the sample. This notably allows a diffraction pattern I.sub.0,mod (par) to be formed in the detection plane P.sub.0, as shown in
[0091]
[0092] In order to take into account in the imperfections of the image sensor 16, the modelled diffraction patterns have been spatially sampled considering a pixel pitch, the latter being, in this example, equal to 1.67 m. The figures were then blurred by applying a Gaussian filter in order to take into account the noise of the image sensor. The distance between the image sensor 16 and the modelled particle 10(par) was considered to be equal to 1000 m.
[0093] Each of these figures was obtained by modelling, in the detection plane P.sub.0, the complex amplitude A(x,y,z) of the exposure light wave 14.sub.mod propagating toward the detection plane, the modelled exposure light wave resulting from the illumination of the modelled particle. The model of the complex amplitude A(x,y,z), in the detection plane P.sub.0, was then extracted so as to make it possible to simulate the diffraction pattern formed in the image acquired by the image sensor.
[0094] From the modelled diffraction pattern I.sub.0,mod (par), it is possible to form a profile, called the modelled profile F(par), representing a variation, parallel to the propagation axis Z, of the complex amplitude A(x,y,z) of the modelled exposure light wave 14.sub.mod. The modelled profile F(par) is preferably established, from the modelled diffraction pattern I.sub.0,mod, in the same way as the profile F.sub.x,y was established from the acquired image I.sub.0. When the profile F.sub.x,y was established by forming a stack of complex images from the acquired image I.sub.0, the modelled profile F(par) is established by forming a stack of complex images A.sub.z.sub.
[0095]
[0096]
[0097] Comparison of
[0098]
[0099] The parameters of the particle form a set par that may comprise: [0100] a refractive index n of the particle, this index possibly being a complex quantity, or a variation in the refractive index n of the particle with respect to the ambient medium 10m; [0101] and/or a dimension of the particle, of the radius r or diameter d type; [0102] and/or a distance z of the particle with respect to the detection plane.
[0103] Each modelled profile also depends on wavelength .
[0104] This is one notable difference with respect to the prior art, in which the standard profiles are obtained experimentally, using known samples. The invention makes it possible to avoid using known samples to form the standard profiles. In addition, generating modelled profiles allows precise quantitative values to be obtained for the parameters of a particle. The invention notably allows a quantitative value to be obtained for the refractive index of a particle.
[0105] In the preceding paragraphs, with reference to
[0108] Alternatively, the modelled profiles may be obtained without necessarily modelling a diffraction pattern I.sub.0,mod in the detection plane. The complex amplitude of the exposure light wave 14.sub.mod along the propagation axis Z is then modelled. However, the inventors believe that it is preferable to model the diffraction pattern I.sub.0,mod (par), then to form the profile F(par) corresponding to the modelled particle in the same way as a profile F.sub.x.sub.
[0109] Whatever the way in which they are obtained, the profiles F(par) thus modelled may be stored in a database, so as to be exploited in a method the main steps of which are described below, with reference to
[0110] Step 100: illuminating the sample 10 using the light source 11.
[0111] Step 110: Acquiring an image I.sub.0 of the sample 10 with the image sensor 16, this image forming a hologram. One of the advantages of the lensless configuration, which is shown in
[0112] Step 120: Detecting particles in the sample. The acquired image I.sub.0 generally contains a high number of interference patterns. Because of the overlap between the various interference patterns, the acquired image is generally not easily usable to locate the particles present in the observed field. The latter are more easily identifiable in a complex image reconstructed by applying a holographic propagation operator h to the acquired image I.sub.0.
[0113] Thus, the step 120 comprises reconstructing at least one image, called the observation image I, of the sample. A holographic reconstruction operator is applied to the acquired image, for a reconstruction distance, so as to obtain a complex image representing the complex amplitude of the exposure light wave 14 in a reconstruction plane parallel to the detection plane and located at the reconstruction distance of the latter. The observation image I may be the image of the modulus or phase of the complex image thus reconstructed. The reconstruction plane in which the observation image is defined is preferably a plane Rio in which the sample 10 lies. Its position may be set beforehand, or determined using a numerical focusing algorithm, this type of algorithm be known to those skilled in the art.
[0114] In the observation image I, the particles 10.sub.i appear sufficiently contrasted to be easily discernible from the ambient medium 10m.
[0115] Step 130: Determining a radial position (x.sub.i, y.sub.i) of each particle 10.sub.i. It is a question of obtaining a radial position representative of each particle discernible in the observation image or in the acquired image I.sub.0, when the latter is exploitable. A segmenting algorithm may be applied to the observation image, so as to extract regions of interest ROI.sub.i respectively corresponding to each particle 10.sub.i.
[0116] Step 140: Forming a profile F.sub.x.sub.
[0117] Step 150: Comparing the profile F.sub.x.sub.
[0118] In the method shown in
[0119] When the profile F.sub.x.sub.
where M(par) corresponds to modelled profiles of the modulus of a complex amplitude of a modelled exposure light wave 14.sub.mod taking into account various values of the vector of parameters par.
[0120] When the profile F.sub.i is a profile representing a variation in the phase of the complex amplitude of the exposure light wave,
where (par) corresponds to modelled profiles of the phase of a complex amplitude of a modelled exposure light wave 14.sub.mod taking into account various values of the vector of parameters par.
[0121] According to one embodiment, the determination of the parameters of a particle may combine various profiles, for example in the form of a minimization of a weighted sum, of type:
where k.sub.1 and k.sub.2 are scalars, forming the weighting terms.
[0122] Preferably, the vector of parameters par of a particle comprises at least the refractive index. When the refractive index is expressed in the form of a complex quantity, the parameters comprise the real part Re(n) of the refractive index and its imaginary part Im(n). As indicated above, the parameters may comprise a dimension (diameter or radius) or a distance z of the particle with respect to the detection plane, along the propagation axis Z.
[0123] Step 150 requires recourse to be made to modelled profiles F(par), for various values of the vector of parameters par. As described with reference to
[0124] When the algorithm is based on a database of profiles, forming the latter is the objective of steps 90 and 95. In a step 90, the parameters that it is desired to determine are taken into account, these parameters forming a set of parameters, possibly taking the form of a vector of parameters. In a step 95, various particles are modelled using various values of the vector of parameters par so as to obtain, for each value of the vector of parameters par, a modelled profile F(par). Step 95 may also comprise an interpolation between modelled profiles F(par), F(par), where par is a vector of parameters the values of which are close to the vector par. The interpolation allows profiles corresponding to parameters comprised between par and par to be obtained.
[0125] According to another embodiment, illustrated in
[0126] The vector of parameters par.sup.q+1 considered in the following iteration may be estimated using a gradient-descent algorithm, during which, in each iteration q, a gradient of the deviation .sup.q is determined, the latter corresponding to a variation in the deviation .sup.q as a function of one or more parameters, and preferably each parameter, of the vector of parameters par.sup.q. The vector of parameters par.sup.q+1 taken into account in the following iteration is determined depending on .sup.q, so as to minimize the deviation .sup.q+1.
[0127] Substeps 151, 152 and 153, respectively corresponding to the formation of the modelled profile F(par.sup.q) and to the computation of the deviation .sup.q and its gradient .sup.q, so as to define the parameters par.sup.q+1 to be taken into account in the following iteration, have been shown in
[0128] In the first iteration (q=1), the iterative algorithm is initialized with an initial vector of parameters par.sup.q=1. The initial vector of parameters may be preset.
[0129] In one embodiment, the two embodiments described above are combined: a database of profiles is used and the vector of parameters par.sub.i that minimizes the comparison between the profiles of the database F(par) and the measured profile F.sub.x.sub.
[0130] As a variant, the steps of which are shown in
[0131]
[0132] Curve a shows a profile F (init) used for the initialization of the algorithm, the profile using the radius estimated with an observation image of the sample I. The radius was estimated to be equal to 8.83 m. This profile corresponds to the parameters [r.sub.i=8.15 m; Re(n.sub.i)=0.025]. Curve b corresponds to the measured profile F.sub.x.sub.
[0133]
[0134]
[0135] According to one embodiment, the steps of which are illustrated in
[0136]
[0137]
[0138] The invention may be employed to characterize particles in the field of biology or health. Other applications may be envisioned, for example environmental inspection or industrial processes, or in the field of food processing.