INTERFEROMETRIC SCATTERING CORRELATION (ISCORR) MICROSCOPY
20230288307 · 2023-09-14
Assignee
Inventors
- Quentin Alexis Peter (Cambridge, GB)
- Raphaël Jacquat (Cambridge, GB)
- Georg Krainer (Cambridge, GB)
- Tuomas Pertti Jonathan Knowles (Cambridge, GB)
Cpc classification
G03H2001/005
PHYSICS
G02B21/367
PHYSICS
G03H1/0443
PHYSICS
International classification
G02B21/36
PHYSICS
G03H1/00
PHYSICS
Abstract
A method of characterizing one or more particles in a fluid, e.g. a liquid, using interferometric scattering optical (iSCAT) microscopy. The method involves illuminating a region of a fluid using an objective lens so that light is scattered by one or more particles in the fluid. The scattered light and reference light are captured using the objective lens and interfere at an imaging device. A succession of images of the interference is processed to determine image correlation values which define a gradual decorrelation over time from which a property of the particle(s) is determined.
Claims
1. A method of characterizing one or more particles in a fluid using interferometric scattering optical microscopy, comprising: illuminating a region of a fluid with illuminating light using an objective lens to generate scattered light scattered by one or more particles in the fluid; providing reference light, wherein the reference light and illuminating light are coherent with one another; capturing the reference light and the scattered light using the objective lens; providing the reference light and the scattered light to an imaging device, such that the reference light and the scattered light interfere at the imaging device; capturing a succession of images of the interference; processing the succession of images of the interference to determine a succession of image correlation values, wherein the succession of image correlation values defines a decorrelation over time of the captured images of the interference; and determining a property of the one or more particles from the succession of image correlation values defining the decorrelation over time.
2. A method as claimed in claim 1 wherein providing the reference light comprises illuminating the region of the fluid through an interface such that light is reflected from the interface to provide the reference light.
3. A method as claimed in claim 1 wherein determining a property of the one or more particles comprises determining a size of the one or more particles by fitting a decorrelation function to the succession of image correlation values, wherein the decorrelation function is dependent upon a diffusion coefficient for the one or more particles in the fluid.
4. A method as claimed in claim 3 further comprising locating a focal plane of the objective lens above the interface, and wherein the decorrelation function is substantially independent of a distance of the one or more particles from the focal plane in a direction along an optical axis of the objective lens.
5. A method as claimed in claim 3 further comprising locating a focal plane of the objective lens adjacent to or below the interface, and wherein the decorrelation function comprises an average over at least a region beyond the interface.
6. A method as claimed in claim 3 wherein the succession of images spans a time period sufficient to allow the one or more particles to, on average, diffuse a distance of at least half that between the interface and the focal plane or diffuse a distance equal to a depth of field of the objective lens.
7. A method as claimed in claim 3 wherein fitting the decorrelation function comprises identifying which of one or more basis functions best fits the succession of image correlation values, wherein each of the basis functions is defined by the size of the one or more particles.
8. A method as claimed in claim 7 wherein each of the basis functions is integrated over the region between the interface and the focal plane.
9. A method as claimed in claim 3 wherein the decorrelation function is also dependent upon an intensity of the scattered light, and wherein determining a property of the one or more particles further comprises determining a concentration or count and/or molecular weight of the one or more particles in the fluid by fitting the decorrelation function.
10. A method as claimed in claim 3 wherein fitting the decorrelation function to the succession of image correlation values includes fitting an offset representing a noise level.
11. A method as claimed in claim 1 comprising capturing the succession of images of the interference with the imaging device at a frame rate greater than a threshold frame rate, wherein the threshold frame rate is such that, on average, one of the particles does not diffuse in a z-direction by more than λ/4 between captured images, where λ is a wavelength of the illuminating light and the z-direction is defined by an optical axis of the objective lens.
12. A method as claimed in claim 1 wherein processing the succession of images of the interference comprises combining images of the interference before determining the succession of image correlation values, wherein the combining comprises combining images separated in time by no more than a characteristic time of the decorrelation.
13. A method as claimed in claim 1 wherein processing the succession of images of the interference comprises determining a square root of an intensity of the images of the interference before determining the succession of image correlation values.
14. A method as claimed in claim 1 wherein processing the succession of images of the interference comprises performing a space-frequency transform to transform each of the images to a frequency space image before determining the succession of image correlation values.
15. A method as claimed in claim 14 further comprising spatially filtering the frequency space image to attenuate spatial frequencies greater than a maximum expected spatial frequency.
16. A method as claimed in claim 14 further comprising estimating a flow rate measure of the fluid from a succession of the frequency space images, and using the flow rate measure to compensate for a flow of the fluid.
17. A method as claimed in claim 16 wherein estimating the flow rate measure comprises determining a ratio of two of the frequency space images, wherein the ratio defines a phase angle, and wherein compensating for the flow of the fluid comprises adjusting a phase angle of one or more of the frequency space images.
18. An interferometric scattering optical microscope system for characterizing one or more particles in a fluid, the system comprising: a particle detection region wherein, in use, the particle detection region comprises one or more particles in a fluid; a source of illuminating light; a source of reference light, wherein the reference light and illuminating light are coherent with one another; an objective lens to direct the illuminating light to illuminate the particle detection region through the interface such that the illuminating light is scattered by the one or more particles, wherein the objective lens is configured to capture the reference light and the scattered light; an imaging device; an optical system to provide the reference light and the scattered light to the imaging device such that the reference light and the scattered light interfere at the imaging device; and a processor configured to: capture a succession of images of the interference process the succession of images of the interference to determine a succession of image correlation values, wherein the succession of image correlation values defines a decorrelation over time of the captured images of the interference; and determine a property of the one or more particles from the succession of image correlation values defining the decorrelation over time.
19. An interferometric scattering optical microscope system as claimed in claim 18 wherein the particle detection region has a boundary defined by an interface; wherein the source of reference light comprises the interface; and wherein the objective lens is configured to direct the illuminating light to illuminate the particle detection region through the interface such that the illuminating light is reflected from the interface to generate the reference light.
Description
DRAWINGS
[0046] These and other aspects of the system will now be further described by way of example only, with reference to the accompanying figures, in which:
[0047]
[0048]
[0049]
[0050]
[0051] In the figures like elements are indicated by like reference numerals.
DESCRIPTION
[0052] This specification describes techniques for characterizing particles using correlations between images captured using interferometric scattering optical microscopy (iSCAT). The techniques may be used, for example, to detect and size proteins in aqueous solution, and to determine their concentration. The proteins do not need to be labelled, and single particles as well as large concentrations can be detected.
[0053]
[0054] The objective lens 112, e.g. an oil immersion objective, may be adjusted to provide generally uniform illumination in a detection region 114. The objective lens 112 may be an oil immersion objective, that is a region between the objective lens and the interface may be filled with index matched oil to reduce the intensity of oil-glass reflections and hence reduce the number of interfaces seen by the laser illumination.
[0055] In some implementations the detection region 114 may be defined by upper and lower surfaces of a chamber or channel (not shown), fabricated e.g. from glass or polymer containing a solution including the one or more particles 120. A channel/channel may be used to contain/flow the solution through the detection region; in other implementations the solution may be contained on a surface by surface tension with no chamber used.
[0056] Part of the laser illumination is reflected from an optical interface 122, e.g. a transparent support such as a cover slip or a boundary of the channel/chamber, and part is transmitted to be scattered by the particle(s) 120. The reflected light and the scattered light are captured by objective lens 112, passed back along the optical path of the illumination, directed into a separate path 124 by the beam splitter 126, and imaged. As illustrated the reflected and scattered light are focused onto an image sensor 130, e.g. a high speed camera, by imaging optics 128 such as a tube lens. The image sensor 130 may be, for example, a CMOS image sensor or an EMCCD image sensor; it may have a frame rate sufficient to capture and track movement of an imaged particle. The image sensor captures interference between the reflected and scattered light. Merely by way of example, a camera for the system may have one or more of: a field of view of around 10 μm or greater; a similar depth of field; and a pixel size of less than λ/2.
[0057] A focal plane of the objective lens 112 may be located below the optical interface 122, confining the particle(s) to a region above the focal plane. Alternatively the focal plane may be located above the optical interface 122, in which case particle(s) in a region between the focal plane and the optical interface may be characterized; this region may also extend above the focal plane. The focal plane of the objective lens 112 may be viewed, conceptually, as representing a location of the image sensor.
[0058] The iSCAT system captures images of the interference between the scattered light and reference light. In the above example the reference light comprises the reflected light generated by reflection from the optical interface 122, but reference light may be provided in other ways e.g. by splitting the beam 104 to generate a reference beam.
[0059] In some implementations the source of coherent light is linearly or circularly polarized. For example in the illustrated example the optical path from the laser to the objective lens 112 includes a quarter wave plate 109 that converts linearly polarized light from the laser into circularly polarized light (and vice-versa on the return path).
[0060] In some implementations the particle(s) 120 may be illuminated at an oblique angle, e.g. by displacing an axis of the illuminating laser beam away from an optical axis of the objective lens 112. This facilitates separating the interference (i.e. signal) from the directly reflected light (a source of noise), e.g. with a spatial filter.
[0061] In some implementations the laser 102 is a laser diode. The limited coherence length of a laser diode can reduce unwanted coherent reflections within the system. However the coherence length should be at least twice a distance from the particle to the interface. A wavelength of the laser may be in the visible; shorter wavelengths are scattered more but a sensitivity of the image sensor and transmission of the optics may reduce at shorter wavelengths.
[0062] The iSCAT system of
[0063]
[0064] At step 200 the process captures a succession of interference images of a solution containing one or more particles to be characterized; each image may be termed an iSCAT signal.
[0065] The images may be captured at a frame rate sufficient that, on average, a particle does not diffuse more than
in the z-direction between successive frames, where λ is a wavelength of the illumination and the z-direction is along the optical axis of the objective lens 112. This can facilitate tracking the (de)correlation between frames. For example assuming a textbook diffusion equation a minimum frame rate may be given by f.sub.minimum=2.sup.5D/λ.sup.2 where D is a diffusion coefficient for the particle(s) (in m.sup.2/s).
[0066] At step 202 the process optionally takes a square root of each image, for example by taking a square root of the intensity value of each image pixel. This can facilitate determining a level of the scattering signal (intensity), which in turn facilitates estimating properties dependent upon the scattering signal such as particle size, number, or molecular weight.
[0067] Taking the square root separates reflected (r) and scattered (s) intensity contributions to the iSCAT signal I=I.sub.0(|r|.sup.2+|r∥s|cos ϕ) where ϕ is an interference phase given by a path difference between the reference (reflected) light and the scattered light at a focal plane of the image sensor and I.sub.0 is the illumination intensity. A Taylor series expansion of √I separates the reflected and scattered contributions,
This also reduces the shot noise variance of the iSCAT signal by a factor of 4. That is, for an iSCAT signal I and a normalised noise variance σ.sub.n.sup.2 the shot noise variance of the iSCAT signal σ.sub.I.sup.2=Iσ.sub.n.sup.2≈I.sub.0|r|.sup.2σ.sub.n.sup.2 and the noise variance of the square rooted signal √I is σ.sub.n.sup.2/4.
[0068] At step 204 the interference images may optionally be transformed to the spatial frequency domain, as shown in
[0069] At step 206 the process determines a succession of image correlation values e.g. from the captured image frames, or from their square roots, or from the transformed images in the spatial frequency domain. For example one way a correlation value may be determined, for two space- or frequency-domain images separated in time by Δt, is by determining a difference between the corresponding pixel values of each image and summing the result. There are many other ways of determining a measure of correlation between two images.
[0070] In some implementations the image correlation values are determined for successively increasing time intervals to obtain the succession of image correlation values. For example, as illustrated in
[0071] Then, at step 208, a decorrelation function is fitted to the succession of image correlation values to determine one or more properties of the particle(s). More particularly the decorrelation time depends on the diffusion coefficient of the particle(s), from which particle size, specifically hydrodynamic radius, can be determined.
[0072] In some implementations the decorrelation function may be fitted by fitting the succession of image correlation values to an equation describing the decorrelation. In some implementations the decorrelation function may be fitted by numerically calculating a set of basis functions, that is one or more functions using which the actual decorrelation may be modelled, and identifying one or a combination of the basis functions which best match the succession of image correlation values. Examples of both techniques are described later. The form of the basis functions may depend on the configuration of the iSCAT system and in principle could be determined by a system calibration.
[0073] The scattering signal also depends on the particle size, more particularly volume, and this in turn allows a weight or molecular weight to be estimated from an assumed particle or protein density. Also or instead a scale linking scattering signal to particle property e.g. molecular weight may be determined by calibration. The scattering signal may be determined by fitting the decorrelation function or more directly e.g. by integrating signal intensity over the scattering circle in the spatial frequency domain.
[0074] In an iSCAT system shot noise of the reflected light, more generally reference light, is a dominant source of noise. However the iSCAT signal depends on the reflected light intensity and thus naively increasing the image sensor exposure time does not improve the signal to noise ratio. When correlating two iSCAT images the noise signal is substantially the same no matter what the elapsed time between the images but the mean correlation increases as the elapsed time reduces. This recognition underlies the improved performance of iSCAT when the interference signal is used for determining a decorrelation signal from which to infer a property of the subject particle(s).
[0075] In general the correlation, g.sup.2, between two images (I, √{square root over (I)}, or frequency domain) may be defined as the normalized time average of the squared signal difference. For example in one implementation a (de)correlation between two square root images separated in time by Δt is defined as
where .sub.T denotes averaging over time and Δ√{square root over (I)} denotes a difference between the two images. Then in this example the (de)correlation between the square rooted iSCAT interference images is given by the decorrelation function
where a characteristic decorrelation time τ is defined as τ=(q.sup.2D).sup.−1 where
and σ.sub.n.sup.2/2I.sub.0 represents a noise variance of the correlation signal. Here Z denotes a distance of the particle from the focal plane of the objective lens along the z-direction, and p denotes a distance of the particle from the optical axis of the objective lens perpendicular to the z-direction.
[0076] When averaging over n frames the noise variance reduces to
which depends linearly on image sensor exposure time (∝I.sub.0) and on the square root of the number of frames. Thus noise can be reduced if image frames are combined or integrated then correlated, provided that the integration time is less than the correlation time τ (the signal to noise ratio maximum is for a single frame exposure time of less than half the correlation time).
[0077]
[0078] The curve of
[0079] The scattering intensity s.sup.2/4, optionally with the noise level (at Δt=0) subtracted, depends on the size (volume) of the particle(s) as the scattering cross-section of a single particle is given by
ϵ.sub.p is the permittivity of the particle, ϵ.sub.m is the permittivity of the medium (solution) and V is the particle volume. For a particular particle type e.g. a protein, a particle density and permittivity may be assumed. The particle volume then allows a measure of the total particle “weight”, and an estimate of a particle molecular weight if the number of particles is known. Alternatively a number or concentration of the particles may be estimated if the particle molecular weight (and permittivity) is known.
[0080] In another approach the scattering intensity s.sup.2/4 may be calibrated using known numbers of particles of different molecular weights to establish a (linear) calibration curve. This can then be used to estimate the molecular weight or number/concentration of particles in a solution to be characterized by the system.
[0081]
[0082] In some implementations a value for the characteristic decorrelation time τ, and hence for the diffusion coefficient D, may be found by fitting the decorrelation function to the data i.e. to the correlation values. In one approach this involves calculating a set of curves of the type shown in
[0083] In some implementations the dependence on Z (and ρ) is integrated out, especially where Z>0. Physically this corresponds to an assumption that multiple particles are present with a distribution of values of Z (and ρ), and/or to integration over a time period over which the particle(s) move in Z. For example the integration may be over a time period sufficient to allow a particle to diffuse in Z a distance equal to the depth of field of the objective lens; or to diffuse in Z at least half the distance between the interface and the focal plane.
[0084] For example, in some implementations a basis function is given by:
where Zf defines a location of the interface 122, a negative value indicating that the interface is below the focal plane (i.e. nearer to the illuminating source than the focal plane), ρ.sub.max is a value which may be chosen e.g. dependent on the horizontal field of view of the objective lens, and θ is defined by ρ and Z (as shown in
[0085]
[0086] Not shown in
[0087] The basis function curves cease to be significantly dependent on Zf when the interface 122 is around 20 μm or more below the focal plane i.e. Zf≤−20 μm. In this regime, i.e. where the focal plane of the objective lens lies within the bulk of the fluid, the scattering intensity is also a reliable metric. An added benefit is that the interface 122 may not be in focus, reducing unwanted scattering from this surface.
[0088] Some implementations of the system may be used to characterize particles in flow, by separating a component of the signal due to the flow, most easily done by processing in the spatial frequency domain.
[0089] In the Fourier domain a translation is equivalent to a phase difference and thus for a translation (Δx, Δy) the Fourier transform of f.sub.n+1(x, y)=f.sub.n(x+Δx,y+Δy) is F.sub.n+1(ϵ, η)=exp(iθ)F.sub.n(ϵ, η) where θ≡2π(ϵΔx+ηΔy). As before taking the square root of the iSCAT signal separates the reflected and scattered intensity and the Fourier transform of frame n can be written as F{√{square root over (I)}.sub.n}≈F.sub.r+F.sub.s,n. The Fourier transform of frame n+1, F.sub.s,n+1 is related to F.sub.s,n by a difference in the scattering pattern δF.sub.s,n arising from diffusion of the particle, and by a translation, F.sub.s,n+1=exp (iθ)F.sub.s,n+δF.sub.s,n+1. The difference used to compute the interferometric iSCAT signal is therefore
Δ.sub.n+1=F.sub.s,n+1−F.sub.s,n=(exp (iθ)−1)F.sub.s,n+δF.sub.s,n+1
and a similar forward calculation gives
Δ.sub.n=F.sub.s,n−F.sub.s,n−1=(exp (−iθ)((exp (iθ)−1F.sub.s,n+δF.sub.s,n).
where θ=0 corresponds to no flow. The ratio Δ.sub.n+1/Δ.sub.n may be taken as constant between pairs of frames to detect the offset by assuming δF to be small so that δ.sub.n+1/Δ.sub.n≈exp(iθ). This can be used to calculate a value for θ, and hence the translation between frames and flow rate. Further, when θ is known, a difference ΔΔ.sub.n dependent upon δF terms (which can be evaluated more easily than F) can be determined as follows:
ΔΔ.sub.n=Δ.sub.n+1−exp (iθ)Δ.sub.n=δF.sub.s,n+1−δF.sub.s,n
[0090] Since ΔΔ.sub.n is a sum of Gaussian random variables with the same variance, ΔΔ.sub.n may be used as a correlation value as previously described, the contribution due to the flow having been removed.
[0091] Many alternatives will occur to the skilled person. The invention is not limited to the described embodiments and encompasses modifications apparent to those skilled in the art lying within the scope of the claims appended hereto.