Device and method for acquiring a particle present in a sample
10831156 · 2020-11-10
Assignee
Inventors
Cpc classification
G03H1/0866
PHYSICS
G01N15/1468
PHYSICS
G01N2015/1454
PHYSICS
G03H1/0443
PHYSICS
G03H1/041
PHYSICS
International classification
G03H1/08
PHYSICS
Abstract
A device for acquisition of particles present in a sample includes a spatially coherent light source, an optical system, and an image sensor placed in the focal plane of the optical system. The image sensor is configured to capture an intensity image. A computational unit of the device is configured to construct a series of electromagnetic propagation matrices obtained for a plurality of defocusing offsets relative to a plane of focus of the optics. The computational unit is also configured to determine a first average focused electromagnetic matrix for the particles from the series of electromagnetic matrices, identifying at least one of the particles in the first electromagnetic matrix and storing the coordinates of said particle, and determining a second electromagnetic matrix at a distance of focus on a particle identified from the components of the series of electromagnetic matrices having the stored coordinates.
Claims
1. A device of acquisition of a plurality of particles present in a sample, said acquisition device comprising: a spatially coherent or pseudo-coherent light source directed towards a first surface of said sample; an optical system having an optical axis and achieving the conjugation between a plane of focus and a focal plane, directed towards a second surface of said sample opposite to said first surface, and placed relative to the sample so that the particles are not in the plane of focus; an image sensor placed in the focal plane of the optical system and configured to acquire an intensity image (Ih) formed by the interference between said light source and said sample; and a computational processing unit comprising: a unit of digital construction of a series of electromagnetic matrices (I1-IN) modeling, from the acquired image (Ih), an electromagnetic wave in planes parallel to the plane of focus and comprised in the sample for a plurality of offsets relative to said plane, a unit for determining a first electromagnetic matrix (Ifmoy) at an average distance of focus on the particles from the series of electromagnetic matrices (I1-IN); a unit for identifying at least one of the particles in the first electromagnetic matrix (Ifmoy) and for storing the coordinates of said particle; and a unit for determining a second electromagnetic matrix (Ifp) at a distance of focus on a particle identified from the components of the series of electromagnetic matrices (I1-IN) having the stored coordinates.
2. The device of acquisition of claim 1, wherein said image sensor is configured to acquire an image flow (Ih), and wherein the processing unit is configured to track a particle in the flow of first electromagnetic matrices (Ifmoy).
3. The device of acquisition of claim 2, wherein the particles are microorganisms and wherein the duration between two acquired images (Ih) originating from said image sensor is shorter than or equal to 1 minute.
4. The device of acquisition of claim 1, wherein said series of electromagnetic matrices (I1-IN) is obtained by a model of digital propagation of light through said sample, the electromagnetic matrices (I1-IN) varying by modulating a distance (z) to an optical axis of said propagation model.
5. The device of acquisition device of claim 4, wherein the processing unit comprises a unit for transforming the electromagnetic matrices originating from the propagation model by a surjective application from the complex space into the real space.
6. The device of acquisition device of claim 4, wherein the first electromagnetic matrix (Ifmoy) is obtained by representing, for each coordinate, the components at said coordinate of the electromagnetic matrices (I1-IN) according to said distance (z) to said optical axis, and by searching for an average of the maximum values of all representations.
7. The device of acquisition device of claim 5, wherein the second electromagnetic image is obtained by representing, for each coordinate of the identified particle, the components at said coordinate of the electromagnetic matrices (I1-IN) according to said distance (z) to said optical axis, and by searching for an average of the maximum values of all representations.
8. The device of acquisition of claim 1, wherein the matrices of said series of electromagnetic matrices (I1-IN) used to determine said first electromagnetic matrices (Ifmoy) and/or to determine said second electromagnetic matrix are sub-sampled according to said distance.
9. The device of acquisition device of claim 1, wherein said device comprises a plurality of acquisition units, each acquisition unit comprising an image sensor and specific focusing means, said device being configured to represent an image of a particle of each sample.
10. A method of analysis of at least one particle present in a sample, said analysis method comprising the steps of: emitting a spatially coherent or pseudo-coherent light source directed towards a first surface of said sample; acquiring by means of an image sensor an intensity image (Ih), said sensor being placed in the focal plane of an optical system having an optical axis and performing the conjugation between a plane of focus and the focal plane, directed towards a second surface of said sample opposite to said first surface, and placed relative to the sample so that the particle is not in the plane of focus, the image (Ih) being formed by interference between said light source and said sample; digitally constructing a series of electromagnetic matrices (I1-IN) modeling, from the acquired image (Ih), an electromagnetic wave in planes parallel to the plane of focus and comprised in the sample for a plurality of offsets with respect to said plane; obtaining an electromagnetic matrix (Ifp) at a distance of focus on the particle from the series of electromagnetic matrices (I1-IN); and determining a state of said particle according to the electromagnetic matrix (Ifp) at the distance of focus on the particle.
11. The method of analysis of claim 10, wherein the step of obtaining the electromagnetic matrix (Ifp) at the distance of focus on the particle comprises the steps of: determining a first electromagnetic matrix (Ifmoy) at an average distance of focus on the at least one particle from the series of electromagnetic matrices (I1-IN); identifying a particle in the first electromagnetic matrix (Ifmoy) and storing the coordinates of said particle; and determining the electromagnetic matrix (Ifp) at a distance of focus on the particle from the components of the series of electromagnetic matrices (I1-IN) having the stored coordinates.
12. The method of analysis of claim 10, wherein said step of determining a state of said particle comprises the steps of: rotating the electromagnetic matrix (Ifp) at the distance of focus on the particle to align the particle with a predefined axis; and calculating a distribution of the matrix aligned along said predefined axis.
13. The method of analysis of claim 10, wherein the steps of acquiring by means of an image sensor an intensity image (Ih) until the step of obtaining the electromagnetic matrix (Ifp) at the distance of focus on the particle are carried out over time for a plurality of images, the step of determining a state of said particle being carried out according to a time variation of said particle.
14. The method of analysis of claim 13, wherein said step of determining a state of said particle comprises the steps of: rotating for each acquired image, the electromagnetic matrix at the distance of focus (Ifp) on the particle to align the particle with a predefined axis; calculating for each acquired image, a distribution of the matrix aligned along said predefined axis; and creating a matrix representation of the distributions associated with each image over time.
15. The method of analysis of claim 10, wherein said step of determining a state of said particle is carried out according to a division state of said particle.
16. The method of analysis of claim 10, wherein said step of determining a state of said particle is carried out according to a morphological characteristic of said particle.
17. The method of analysis of claim 10, wherein said step of determining a state of said particle is carried out according to a physiological characteristic of said particle.
18. The method of analysis of claim 10, wherein said particle corresponds to a bacterium and said sample integrates an antibiotic.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The way to implement the presently described embodiments, as well as the resulting advantages, will better appear from the description of the following non-limiting embodiment, given as an indication, based on the accompanying drawings, where
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
DETAILED DESCRIPTION OF THE SPECIFICATION
(11)
(12) Sample 12 is a liquid such as water, a buffer solution, a culture medium or a reactive medium (comprising or not an antibiotic), containing the particles 11a-11f to be observed.
(13) As a variation, sample 12 may appear in the form of a solid medium, preferably translucent, such as an agar-agar gelose, containing particles 11a-11f. Sample 12 may also be a gaseous medium. Particles 11a-11f may be located within the medium or at the surface of sample 12.
(14) Particles 11a-11f may be microorganisms such as bacteria, fungi, or yeasts. They may also be cells, multicellular organisms, or any other particle of contaminating particle type, dust. The size of the observed particles 11a-11f varies from 500 nm to several hundreds of m, or even of a few millimeters.
(15) Sample 12 is contained in an analysis chamber, vertically delimited by a lower plate and an upper plate, for example, conventional microscope plates. The analysis chamber is laterally delimited by an adhesive or by any other tight material. The lower and upper plates are transparent to the wavelength of light source 15, the sample and the chamber for example giving way to more than 50% of the wavelength of the light source under a normal incidence on the lower plate.
(16) Preferably, particles 11a-11f are arranged in sample 12 at the level of the upper plate. The lower surface of the upper plate comprises for this purpose ligands enabling to bind the particles, for example, polycations (e.g. poly-L-lysine) in the case of micro-organisms. This enables to contain the particles within a thickness equal to or close to the depth of field of the optical system, that is, within a thickness smaller than 1 mm (e.g. tube lens), and preferably smaller than 100 m (e.g. microscope lens). Particles 11a-11f may however displace in sample 12.
(17) Preferably, the device comprises an optical system 23 for example formed of a microscope lens and of a tube lens, arranged in the air and at a fixed distance from the sample. Optical system 23 is optionally equipped with a filter capable of being located in front of the lens or between the lens and the tube lens. Optical system 23 is characterized by its optical axis, its object plane, also called plane of focus, at a distance from the lens, and its image plane, conjugate of the object plane relative to the optical system. In other words, an object located in the object plane has a corresponding sharp image of this object in the image plane, also called focal plane. The optical properties of system 23 are fixed (e.g. fixed focus optics) The object and image planes are orthogonal to the optical axis.
(18) Image sensor 16 is located, opposite a second surface 14 of the sample, in the focal plane or close thereto. The sensor, for example, a CCD or CMOS sensor, comprises a periodic two-dimensional grating of sensitive elementary sites, and a proximity electronic system which sets the exposure time and the resetting of the sites, in a way known per se. The output signal of an elementary site is a function of the quantity of radiation of the spectral range incident on said site during the exposure time. This signal is then converted, for example, by the proximity electronic system, into an image point or pixel of a digital image. The sensor thus generates a digital image in the form of a matrix of C columns and L rows. Each pixel of this matrix, of coordinates (c,l) in the matrix, corresponds in a way known per se to a position of Cartesian coordinates (x(c,l),y(c,l))) in the focal plane of optical system 23, for example, the position of the center of the elementary sensitive site of rectangular shape.
(19) The pitch and the filling factor of the periodic grating are selected to respect the Shannon-Nyquist criterion regarding the size of the observed particles, to define at least two pixels per particle. Thus, image sensor 16 acquires a transmission image of the sample in the spectral range of the light source.
(20) The image Ih acquired by image sensor 16 comprises holographic information since it results from the interference between a wave Fi diffracted by particles 11a-11f and a reference wave Fn having crossed the sample without having interacted therewith. It can of course be understood, as described hereabove, that in the case of a CMOS or CCD sensor, the digital image Ih acquired and stored in unit 20 is an intensity image, the phase information being thus here coded in intensity, with Ih according to relation:
(21)
(22) As a variation, it is possible to divide the coherent signal Sn originating from light source 15 into two components, for example, by means of a beam splitter. The first component is then used as a reference wave and the second component is diffracted by sample 12, the image in the image plane of optical system 23 resulting from the interference between the diffracted wave and the reference wave.
(23) The intensity image Ih acquired by image sensor 16 is not focused on the particle to be observed and the obtaining of information focused on the particle is digitally achieved by a processing unit 20 connected to image sensor 16 to receive the images acquired by the latter.
(24) Out of focus here means that there is no intersection between the plane of focus and the particle which is to be observed.
(25) Processing unit 20 may correspond to a computer, a microcontroller, a touch tablet or a smart phone, or generally any computer system based on a processor capable of receiving data, processing the data by implementing computational instructions stored in a computer memory, and of delivering and/or storing in a computer memory the result of the processing. Processing unit 20 may be connected in wired or wireless fashion to image sensor 16 or by means of a wireless communication. The unit may be associated with a screen to display intermediate or final results of the method.
(26)
(27) A first unit 51 constructs a series of complex matrices I1, . . . , In, . . . , IN, called electromagnetic matrices EM, modeling from image Ih the light wave front propagated along the optical axis by a plurality of offsets relative to the plane of focus of optical system 23, and in particular the offsets positioned in the sample.
(28) A method of calculating wave fronts by digital propagation is explained in Sang-Hyuk Lee et al.'s article entitled Holographic microscopy of holographically trapped three-dimensional structures published in Optics Express, Vol. 15; Nr. 4, Feb. 19, 2017, pp. 1505-1512.
(29) More particularly, noting h.sub.z(r) the Rayleigh-Sommerfeld propagation function, that is:
(30)
(31) where: z is the so-called defocusing height, in other words the distance relative to the plane of focus, r=(|r|,) is the position in polar coordinates in the image plane, of radial coordinate |r| and of angular coordinate, R.sup.2=|r|.sup.2+z.sup.2, and k=2n/ is a wave number relative to the propagation medium of refraction index n at wavelength of the light source.
(32) Based on this relation, electromagnetic wave a(r,z), of amplitude |a(r,z)| and of phase (r,z), in ordinate plane z may be expressed as:
(33)
(34) where b(r) is the measured intensity, i.e. image Ih (the intensity of the reference wave is here assumed to be constant), B(q) is the Fourier transform of b(r), H.sub.z(q) is the Fourier transform of h.sub.z(r), and q is the dual variable of r in the Fourier transform.
(35) The above equations define an analytic formulation of amplitude a(r,z). Although this model is developed for a propagation in a homogeneous medium (and thus with no modification of the wave number, without the presence of an interface creating a reflection and/or a deviation of the wave, etc.), and accordingly with no relation with the sample and the enclosure (which comprise many interfaces and changes of index, for example), the inventors have noted that it enables to reconstruct rich electromagnetic information in relation with the observed particles, as will be described hereafter. Thus, advantageously, processing unit 20 stores a single wave number, common for all the involved mediums, for example, the index of air. As a variation, unit 20 stores the refraction indexes of the different involved mediums along the optical axis and constructs matrices I1-IN from close to close to take into account the phenomena at the interfaces.
(36) For bacteria, the sampling pitch in the z direction is preferably smaller than one tenth of the thickness of the bacterium, for example, smaller than 0.1 m, and preferably smaller than 0.03 m.
(37) It can thus be understood that a stack of electromagnetic matrices I1-IN can be constructed for ordinates z.sub.1, z.sub.2, . . . , z.sub.n, z.sub.N along the optical axis, the origin of ordinates (z=0) being taken at the axial focusing position, each matrix In being defined by a complex amplitude a(r,z.sub.n) according to relations:
(38)
(39) Processing unit 20 then calculates on each matrix In a positive surjective application AS from the complex space .sup.CL to the real space
.sup.CL:
(40)
(41) For example, unit 20 calculates the Hermitian norm (or its square) of the components a(c,l).sub.z.sub.
(42) Without being bound by theory, matrices AS(I1)-AS(IN) do not necessarily represent a light intensity, but the inventors have noted their resemblance with intensity images obtained under a non-coherent illumination. Particularly, the particles are represented, as in a photograph, in their particle form.
(43) It is thus possible to apply any type of conventional image processing (segmentation, thresholding, detection of particles based on their morphology, etc.), and even for an operator to identify with the naked eye the particles (conversely to an image coding interferences which are coded in intensity in the form of fringes). In the following, to simplify the notations, matrices AS(I1)-AS(IN) are noted 1-IN, and notation a(c,l).sub.z.sub.
(44) The method then comprises identifying particles in the sample according to the matrices I1-IN, and for each identified particle, determining an optimum distance of focus z for this particle, and then determining in the matrix of the series I1-IN corresponding to this distance, a set of pixels belonging to this particle.
(45) Second unit 52 aims at determining an average distance of focus zfmoy from the series of matrices I1-IN and at selecting in this series the matrix, noted Ifmoy, having its distance z equal or the closest to distance zfmoy. As a variation, unit 20 recalculates matrix Ifmoy, for distance zfmoy. Average focusing distance zfmoy is that which best corresponds to the ideal conditions of focusing on the set of particles 11a-11f in the sense of a predetermined focusing criterion. This distance can be determined by all known techniques of signal processing or in the field of photography, for example, of autofocus. The resulting electromagnetic matrix Ifmoy is sufficiently focused to be able to detect particles at different depths in matrix Ifmoy. The detected particles are particularly those comprised in a depth of the sample equal to the depth of field. As previously described, in a preferred embodiment, the particles are arranged in a volume having a thickness close or equal to this depth of field, so that all or almost all the particles of the sample can be detected in matrix Ifmoy.
(46)
(47) Although the average focusing distance zfmoy illustrates a general focusing of the image, the focusing on each particle 11a-11f is not optimal, particularly due to the depth variations of particles 11a-11f with respect to one another. To improve the focusing on a specific particle 11a-11f, the disclosed embodiments provide determining an optimum focusing distance for each particle and determining a focused matrix specific to the particle. For this purpose, processing unit 20 comprises a particle identification unit 53 and a unit 54 for determining an optimal focusing distance for each identified particle and for determining the pixels of the particle for this distance.
(48) Unit 53 of identification of the particles in matrix Ifmoy may take a plurality of shapes of image segmentation of the state of the art, such as a scanning of this matrix to detect the contours of a finite element. As a variation, unit 20 applies a prior thresholding to matrix Ifmoy, the threshold value being for example equal to Moy(Ifmoy)+pE(Ifmoy), where Moy(Ifmoy) is the average of the pixels of matrix Ifmoy, E(Ifmoy) is their standard deviation, and p is an integer greater than 1, for example, equal to 6. The values greater than this threshold are then determined as belonging to particles, and an image segmentation is implemented on the thresholded matrix. At the end of the identification, l sets of pixel coordinates (c,l), noted Part_1, . . . , Part_i, . . . Part_I are thus obtained. Each set, stored in unit 20, lists the coordinates of the image pixels Ifmoy belonging to a same particle.
(49) The method then determines, at 54, for each set of coordinates Part_i, which distance z provides the best focusing for the corresponding particle, and then determines what matrix in series I1-IN corresponds to this distance (or calculates a new image for this distance), and finally stores in a set Ri the pixels of the selected matrix which correspond to the coordinates listed in set Part_i.
(50)
(51) Further, the embodiments of
(52) For each identified particle, an image Ifp_i is preferably displayed on a screen 22. This image is for example a rectangular window of the matrix I_i comprising the pixels Ri. As illustrated in the drawings, a rod bacteria effectively has the shape of a rod in the focused matrix I_i. A practitioner can thus very rapidly observe the shape of particle 11a-11f without any manipulation on optical system 23. To improve the analysis of particle 11a-11f, the latter may be represented over time via a plurality of successive acquisitions.
(53) For this purpose, when set Ri is obtained, it is stored in a memory 21 coupled to processing unit 20. After a predefined time period, a new set Ri is searched for via a new image acquisition Ih, the time pitch being shorter than or equal to 5 minutes in the case of bacteria, and preferably shorter than or equal to 1 minute. The inventors have noted through the disclosed embodiments that this period enables to follow the phenotypic or morphological modifications of any type of bacterium. Indeed, it can be observed, by the simple visual inspection of a time series of images Ifp_i of a bacterium, that certain bacteria change from one minute to the other.
(54) The new set Ri should correspond to the same particle 11a-11f as the first set Ri. For this purpose, unit 53 determines sets Part_1-Part_N according to the position and/or to the shape of a particle 11a-11f selected on a previous matrix Ifmoy. The focused Ifp_i sets Ri are all stored in memory 21 and screen 22 enables the practitioner to send a flow of focused images Ifp_i on a particle 11a-11f to analyze its behavior.
(55) The device may also simultaneously perform the analysis of a plurality of samples 12, for example to perform an antibiogram of a bacterium. For this purpose, processing unit 20 may be coupled to a plurality of image sensors 16 associated with a plurality of samples 12. Processing unit 20 then processes a plurality of images Ih originating from a plurality of image sensors 16 and screen 22 illustrates the focused images Ifp.
(56) In the embodiment which has just been described, the optimal focal distance zfopt_i corresponds to an average focusing on the particle, usual resulting in a focusing on a median plane of the particle. This particularly enables to compare sets Ri between a plurality of acquisition times. As a variation, a focusing is searched for each pixel (e.g. calculation of the distance corresponding to the optimum value of a(c,l).sub.z.sub.
(57) The acquisition being performed with no focus, it may be carried out at a very high frequency and, if need be, the processing may be performed after the acquisition.
(58)
(59) In the embodiment of
(60) Unit 60 for determining a state of particle 11a-11f may implement different indicators and processings. For example, the state of particle 11a-11f may be analyzed according to the state of its division cycle, its morphological characteristics, its physiological characteristics or a combination of a plurality of indicators.
(61) Preferably, the indicators are defined according to the nature of the particle 11a-11f, the state of which is searched for.
(62) For a particle 11a-11f similar to a bacterium in the presence of an antibiotic, the embodiment of
(63) A rotation 61 is applied to set Ri to align and position particle 11a-11f on a time-invariable predefined axis, for example, by aligning on the left-hand side the particle on axis x of abscissas (i.e. the axis corresponding to the rows of the acquired images). The aligned set Ri is then projected on the alignment axis, for example, by calculating the average of the pixels on each ordinate y, (i.e. the column axis of the acquired images). The distribution Ip thus obtained is shown at 62 in the form of a distribution of sum Im per column according to the position of ordinate x of the pixels, and is for example stored in unit 20 in the form of a row vector.
(64) The distributions are then represented over time by concatenating distributions Ip in a matrix. Noting Ip_q the distribution obtained from the q-th acquired image Ih, and Q the last acquisition time, the matrix, noted Dist_Q, can thus be written as:
(65)
(66) The matrix representation thus obtained is particularly efficient to determine the state of particle 11a-11f. For example, such a matrix representation enables to observe the lengthening of a particle or the presence of at least one cellular division.
(67) A simple thresholding on the shape of the matrix representation then enables to define whether an antibiotic has had an efficient action or not on a bacterium. Particularly, as illustrated in
(68) The disclosed embodiments thus enable to obtain an accurate image of a particle 11a-11f present in a sample 12. Typically, the disclosed embodiments have enabled to obtain a thumbnail image representing a bacterium with a number of pixels in the range from 100 to 400 pixels. As a result, it is visually or digitally possible to visualize, and thus with no marking (e.g. fluorescent), the content of a microorganism. Particularly, the distribution of the intracellular material in a bacterium can be observed. Without being bound by theory, the inventors were able to observe the occurrence of two poles in a bacterium before its division, which might correspond to the meiosis of a bacterium, as illustrated in
(69) Further, the disclosed embodiments also enable to obtain the variation of particle 11a-11f over time to visualize its behavior, for example, its displacement speed or its cellular division process.
(70) Particularly, due to the resolution obtained by the disclosed embodiments (several hundreds of pixels per bacterium for the system designed by the inventors), it is possible to observe the influence of an antibiotic on the morphology and the intracellular content of the bacteria. Further, the high acquisition rate of the disclosed embodiments enables to very finely track along time the variations of the bacterium (e.g. growth, division, reaction to a culture medium, to a medium with an antibiotic, etc.).
(71) An object in the air and at a distance from the sample has been described. Other types of arrangement are possible, for example, a microscopic lens immersed in a liquid tank receiving the sample and/or capable of displacing with respect to the sample.