3-D holographic imaging continuous flow cytometry
10670510 ยท 2020-06-02
Assignee
Inventors
- Yongjin Sung (Boston, MA, US)
- Niyom Lue (Nahant, MA, US)
- Zahid Yaqoob (Cambridge, MA)
- Ramachandra Dasari (Shererville, IN, US)
- Peter T. C. So (Boston, MA)
Cpc classification
G03H1/0866
PHYSICS
G03H2001/005
PHYSICS
G01N2015/1445
PHYSICS
G03H1/0443
PHYSICS
International classification
Abstract
Refractive index of biological specimens is a source of intrinsic contrast that can be explored without any concerns of photobleaching or harmful effects caused by extra contrast agents. This feature also contains rich information that can be related to the metabolism of cells at the cellular and subcellular levels. The present invention relates to systems and methods that can provide, without any moving parts, the 3-D refractive index map of continuously flowing biological samples in a micro-fluidic channel, for example.
Claims
1. A method of flow cytometry comprising: continuously moving a sample in a flowing medium through a channel, the channel having a size to enable flow of the sample during illumination of the sample; illuminating the moving sample passing through a sample light path with converging light within the channel using a single shot of illuminating light at each of a plurality of locations of the sample within the channel, the converging light forming a line focused beam having a plurality of plane waves; detecting light from the continuously moving sample in response to the illuminating light and reference light directed along a reference light beam path with a detector at each of the plurality of locations, the reference light beam path and the sample light path being angularly offset at the detector; processing the detected light from the continuously moving sample and the reference light with a data processor to form a plurality of angular spectra related to the plurality of locations; mapping phase data and amplitude data of the plurality of angular spectra to a three-dimensional representation; forming a two-dimensional Fourier transform of the mapped angular spectra; and mapping the Fourier-transformed angular spectrum to a scattering potential of the sample in a spatial frequency space.
2. The method of claim 1 further comprising generating a plurality of phase images of the sample.
3. The method of claim 1 further comprising illuminating the channel on a line extending across the channel.
4. The method of claim 1 further comprising displaying the three-dimensional representation on a display.
5. The method of claim 1 further comprising determining a refractive index or refractive index distribution of the sample.
6. The method of claim 1 further comprising focusing light onto the channel with a converging cylindrical optical element.
7. The method of claim 1 further comprising adjusting a flow speed of a fluid within the channel.
8. The method of claim 1 further comprising generating an interferogram image of the sample.
9. The method of claim 1 further comprising performing an iterative computation to provide a computed scattering potential.
10. The method of claim 1 further comprising performing an inverse Fourier transform to determine a three dimensional scattering potential.
11. The method of claim 1 further comprising tilting with a mirror the reference light beam path relative to the sample light path to select the angular offset.
12. The method of claim 11 wherein the reference light beam path and the sample light beam path are tilted at an angle greater than zero.
13. The method of claim 1 further comprising moving an illumination beam with an actuated optical element.
14. The method of claim 13 wherein the actuated optical element comprises a movable mirror.
15. The method of claim 13 wherein the actuated optical element comprises a scanner.
16. The method of claim 1 further comprising processing image data with at least one of a smoothness constraint or a positivity constraint.
17. The method of claim 1 further comprising generating data to populate a region of a frequency space.
18. The method of claim 1 further comprising illuminating the sample at a first wavelength and at a second wavelength.
19. The method of claim 1 wherein the detector generates data and further comprising regularizing the data.
20. The method of claim 1 further comprising measuring a rotation of a region of the sample in the channel.
21. The method of claim 1 further comprising detecting fluorescence in the sample.
22. The method of claim 1 further comprising programming a control system with scan parameters to scan light on the sample.
23. The method of claim 1 further comprising delivering illuminating light into a full field of view of the channel.
24. The method of claim 1 further comprising obtaining a confocal image of the sample in the channel.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
DETAILED DESCRIPTION OF THE INVENTION
(12) Refractive index (RI) of biological specimens is a source of intrinsic contrast that can be explored without any concerns of photobleaching or harmful effects caused by extra contrast agents. In addition, RI contains rich information related to the metabolism of cells at the cellular and subcellular levels. The subject application discloses a no-moving parts approach that provides three-dimensional (3-D) RI maps of biological samples continuously flowing in a microfluidic channel. Specifically, line illumination and off-axis digital holography is used to record the angular spectra of light scattered from flowing samples at high speed. In addition, an optical diffraction tomography algorithm is applied to obtain accurate RI maps of the samples from the measured spectra. As demonstrated in empirical studies described herein, the systems and methods of the present disclosure have proven effective in label-free 3-D imaging of live RKO human colon cancer cells and RPMI8226 multiple myeloma cells, as well as in obtaining the volume, dry mass, and density of these cells from the measured 3-D RI maps. These results show that the disclosed systems and methods, alone or in combination with the existing flow cytometry techniques, advantageously enable quantitative stain-free characterization of large number of cells.
(13) The present invention relates to systems and methods for performing holographic phase cytometry. Tomographic phase imaging has been developed to measure phase images of objects and has enabled the measurement of refractive index of small prepared samples that have been stabilized in a holder for measurement. Additional details regarding tomographic phase microscopy systems and methods can be found in U.S. application Ser. No. 12/218,029 filed on Jul. 10, 2008, the entire contents of which is incorporated herein by reference. Further improvements in the quantitative measurement of refractive index and providing diffraction free high resolution 3-D images are described in Sung et al., Optical diffraction tomography for high resolution live cell imaging, Optics Express, Vol. 17, No. 1 (2009), the entire contents of which is incorporated herein by reference. The refractive index map can be used to determine molecular concentrations of sample components without the addition of exogenous contrast agents. Thus additional quantitative characteristics can be determined using the methods described herein.
(14) Huygens' principle states that a plane wave can be synthesized by superposing multiple point sources that are in-phase and aligned on a planar wavefront. Synthetic-aperture radar, for example, utilizes this principle in order to image an extended sample by incrementally moving a point source and detector. Preferred embodiments of the present invention provide a system for translating a specimen across a line-focused beam, such that a detector system can collect the information needed to reconstruct a 3-D structure of scattering points within the specimen. In the optical regime, this can be implemented with synthetic aperture tomography (SAT) using phase shifting interferometry. However, previously the specimen had to be stationary during the phase-shifting step; therefore, the specimen was mounted on a translation stage and was moved across the line-focus beam in discrete steps.
(15) A converging cylindrical wave (
u.sub.in(x,y,z)=P(fp)exp[i2(px+w(p)z)]dp(1)
where the integrand represents a plane wave with the complex amplitude F(fp) and wave vector (p, 0, w(p)). Here, the function w(p) is defined as w(p)=((1/).sup.2p.sup.2).sup.1/2, and the variables and f are the wavelength of the illuminating light and the focal length of the cylindrical lens, respectively. The pupil function P(x) represents the optical aberration of the cylindrical lens or apodization, if any. In quantitative phase imaging, the pupil function can be directly measured and subtracted from the images; therefore, we drop the pupil function in the formulation hereafter.
(16) Consider the scattered field from a specimen is measured in the far field and transmission mode for a general incident field (
u.sub.scat({right arrow over (r)})=V({right arrow over (r)})u.sub.in({right arrow over (r)})G(|{right arrow over (r)}{right arrow over (r)}|)a.sup.3r(2)
(17) Here, G(r)=exp(ikr)/4r is the Green's function for the scalar wave equation (the Helmholtz equation). is again the wavelength of the incident light in the medium, and k=2/ is the wavenumber.
(18) The function V(x,y,z)=k.sup.2(1(n(x,y,z)/n.sub.0).sup.2) is the scattering potential of the specimen in which n(x,y,z) and n.sub.0 represent the refractive indices of the specimen and surrounding medium, respectively. Note that for plane wave illumination equation (2) provides the complex scattered phase in conventional optical diffraction tomography. According to the present disclosure systems and methods are provided which illuminate the specimen with a line-focused beam, which includes multiple plane waves, and measure the angular spectra of the scattered light.
(19) For tomographic reconstruction, a series of the angular spectra E.sub.samp (k.sub.x, y;) may be recorded for varying locations of the sample while it passes across the line-focused beam, wherein the variable k.sub.x is the spatial frequency coordinate corresponding to the spatial coordinate x. In order to remove any background phase due to optical aberration, one may also record an angular spectrum E.sub.bg (k.sub.x, y) before starting the experiment. With the first-order Rytov approximation, the measured angular spectra E.sub.samp (k.sub.x, y;) and E.sub.bg (k.sub.x, y) can be related to the specimen's scattering potential V(x,y,z) as:
(20)
where .sub.scat(k.sub.x, y;)=log E.sub.samp(k.sub.x, y;)/E.sub.bg(k.sub.x, y), and w(u)=(k.sup.2u.sup.2).sup.1/2. Again, the variable k.sub.x is the spatial frequency corresponding to the spatial coordinate x and the angular spectrum .sub.scat(k.sub.x, y;) is measured for different values of (see
(21) Taking the Fourier transform of Eq. (3) with respect to y and , the following equation is derived:
{tilde over (V)}(k.sub.x,k.sub.y,k.sub.z)=i4w(k.sub.x)
where k.sub.z=w(k.sub.x)w(k.sub.xk.sub.). {tilde over ()}.sub.scat(k.sub.x,k.sub.y;k.sub.) is the 2-D Fourier transform of .sub.scat(k.sub.x, y;) with respect to y and . Equation (4) relates the measured angular spectra with the specimen's scattering potential in the spatial frequency space. Thus:
(22)
Equation (5) provides a way to map the measured angular spectra scattered from a specimen to the scattering potential of the specimen in the spatial frequency space.
(23)
(24) In exemplary embodiments, the flow channel may include a cross-sectional diameter, e.g., a height, that is between 150-200% the size of an estimated width of the sample. In some embodiments, at least one of (i) a cross-sectional height and (ii) a cross-sectional width of the flow-channel may be selected to at least one of (i) reduce rotation of the sample in the flow channel and (ii) increase stability of the sample in the flow channel. In some embodiments, the cross-dimensional height and cross-dimensional width of the flow channel may be approximately equal. In such embodiments, rotation may be estimated as described herein. In some embodiments, at least one of (i) the cross-sectional height and (ii) the cross-sectional width of the flow-channel may be selected based on empirical data, e.g., based on rotation estimations for a plurality of tested flow channels derived from imaging of a reference material flowing in each of the tested flow channels. For example, a convolution may be applied based on an estimated or actual rotation of a sample to compensate for such rotation.
(25) A data processor 45 is connected to the detector 44 to process the image data. A memory 47 can store the data for display to the user on electronic display device 49. Note that processor 45 can also be used to control system operating parameters.
(26)
(27)
(28)
(29)
(30)
(31) Measuring the mass and volume of cells is connected to the fundamental question of biology: how the cells grow and their growth is regulated. The refractive index of a biological specimen is proportional to the concentration of organic molecules within the specimen. Adopting this relationship, one can obtain the density of non-aqueous materials inside a cell, called dry density, from:
(32)
(33) where the quantity a is the average specific refractive index increment, =0.18 (g/mL).sup.1. From the refractive index map, the volume of a sample can be calculated directly with thresholding (e.g., by counting the number of voxels) or from the projected area assuming a spherical shape. The total dry mass within the cell can be obtained by taking an integral of the 3-D density map, Eq. (6), over the cell volume, and the mean dry density is obtained by dividing the total dry mass by the cell volume. To validate this method, 10-m polystyrene beads have been imaged that are flowing in the index matching oil of refractive index 1.54. The measured diameter of the polystyrene beads (N=8) were 9.89 m with a standard deviation of 0.35 m, and the refractive index were 1.583 with a standard deviation of 0.005. These values match well with the values provided by the manufacturer (10 m, 1.585). When normalized with the manufacturer's values, the volume and refractive index of the beads are 0.9800.110 and 0.9860.032, respectively, which are shown in
(34)
(35) A 3-D holographic imaging flow cytometry (3-D HIFC) provides 3D refractive index map of cells continuously flowing in a micro-fluidic channel. Specifically, samples flow across a line-focused beam, and the system recorded angular spectra scattered from the samples using off-axis digital holography. By adopting a reconstruction algorithm that properly handles the diffraction and missing angle artifacts, the system generates the 3-D refractive index map of cells with high spatial resolution and accuracy. The method does not require any moving system elements, and thus it can be readily incorporated into the downstream of existing flow cytometry configurations to further increase the accuracy of screening. More importantly, the refractive index map contains rich information that can be related to the distribution of mass at cellular or subcellular levels, and thus used for measuring the metabolism of cellular organelles. The system provides for stain-free, accurate single cell characterization using refractive index contrast.
(36) RKO human colon cancer cells were cultured in Dulbecco Modified Eagle medium (Invitrogen, 21063-029) supplemented with 10% FBS (Invitrogen, 10438026) and 1% 100 penicillin-streptomycin solution (Invitrogen, 15140-122). RPMI8226 human multiple myeloma cells were cultured in RPMI 1640 media (Invitrogen, 11835-030) supplemented with 10% FBS, and 1% 100 penicillin-streptomycin solution. At 70-80% confluency, cells were collected with 0.25% Trypsin-EDTA (Invitrogen, 25200-114), diluted 1:100 in fresh culture media, and injected into the micro-fluidic channel with a syringe. 10-m polystyrene beads and refractive index liquids were purchased from Polysciences, Inc. (17136-5) and Cargille (1809X), respectively.
(37) Returning to
(38) Notably, the use of off-axis holography enables recording both the amplitude and phase of angular spectrum in a single shot for each location of the flowing sample. Thus, in exemplary embodiments, the slight tilt in the reference beam with respect to the sample beam is configured to cause a three pixel fringe period in raw interferogram images. In exemplary embodiment, an angular offset between the detected reference light and the detected scattered light is characterized by a fringe period in raw interferogram images of between 2.5-4 pixels.
(39) In exemplary embodiments the detector system may utilize a scanning resolution of at least 30 images per sample, preferably of at least 100 images per sample or even more preferably of at least 200 images per sample. In some embodiments, the detected angular range may be at least 30 degrees to 30 degrees, preferably at least 45 degrees to 45 degrees, or even more preferably at least 60 degrees to 60 degrees. Thus, detected angular resolution may be at least 2 degrees or more preferably at least 1 degree.
(40) Three-dimensional refractive index measurement enables one to quantify the cell metabolism by measuring the mass of entire cell and internal organelles with minimal perturbation. Using plane-wave tomography, it is demonstrated that adherently growing cells have size-dependent growth rate as floating cells, while division asymmetry is higher in the former. In conjunction with low-noise diffraction phase microscopy, it is further demonstrated herein also showed that mammalian chondrocytes undergo three distinct phases of volume increase. Recent results show that molecular-specific signatures of cells can be obtained from refractive index measurement at multiple wavelengths.
(41) As described herein, systems and methods are provided for refractive index imaging of continuously flowing cells in a microfluidic channel. In particular, the systems and methods described utilize off-axis digital holography that can measure the complex angular spectrum in a single-shot for each location of the flowing sample. For tomographic reconstruction, an algorithm based on the scalar diffraction theory may be adopted to correct the artifacts due to defocused organelles or cells flowing at different heights. Using these techniques, one may obtaine 3-D maps of refractive index of different cell types in the flow configuration, from which one may quantify characteristics such as volume, dry mass and dry density of the cells.
(42) This presents significant advantages over prior techniques for obtaining the cell density in flow configuration which rely on the buoyant mass measurement using a suspended micro-channel resonator for two different density liquids. where switching the liquids for every measurement may not be ideal for high throughput or long-term imaging of cells in an intact, natural condition.
(43) The tomographic reconstruction algorithm derived and adopted herein assumes that cells' vertical position in the channel is fixed and their rotation is negligible for the period of data collection or for complete passage of each cell across the line-focused beam. Observing the cells under a collimated laser illumination and with a high-speed camera, it can be confirmed that cell tumbling is minimal for the design and flow conditions described herein. However, without a mechanism to stabilize the cells flowing in a micro-fluidic channel, the possibility of cell rotation cannot be completely ruled out. In microfluidic systems the cell rotation is caused by shear forces acting on a cell which is proportional to the speed of the flow and inversely with size of the cell. A cell larger than half the height of the channel will be less affected by this shear as the difference in fluid velocity on the sides of the cell diminishes when the cell straddles the mid-height of the channel. By imaging PDMS beads with air defects, one can estimate that the maximum rotation of cells (mean diameter 15 m) during the data acquisition (0.1 sec) is about 4 degrees at a Reynolds number of about 510.sup.3. The minimal effect of this rotation is further confirmed by the sharp boundaries of the cell and nucleus in the reconstructed example images in
(44) In a preferred embodiment a plurality of different wavelengths of light can be used to illuminate material flowing in the channel to measure the refractive index dispersion. Further details regarding the use a plurality of wavelengths for tomographic imaging can be found in Sung et al., Stain-Free Quantification of Chromosomes in Live Cells Using Regularized Tomographic Phase Microscopy, PLOSONE, Vol, 7, 11 (2012), the entire contents of which is incorporated herein by reference. Thus, images of the sample can be obtained at different illumination wavelengths.
(45) The amplitude and phase of each angular spectrum are recorded by an off-axis holography set-up described above.
I(x,y)=I.sub.S(x,y)+I.sub.R+2{square root over (I.sub.S(x,y)I.sub.R)} cos(2(px+qy)(x,y))(7)
where I.sub.S(x,y) and I.sub.R are the irradiances of the sample and reference beams, respectively, and (x,y) is the phase difference between the two beams. The vector (u,q) indicates the angle of incidence of the sample beam on the detector plane with respect to the angle of the reference beam. The magnitude and angle of the vector explain the spacing and orientation of the fringes (see the inset of
{circumflex over (I)}(u,v)={square root over (I.sub.S(x,y)I.sub.R)}e.sup.i(2(px+qy)(x,y))e.sup.i2(ux+vy)dxdy={circumflex over ()}(up,vq)(8)
where {circumflex over ()}(u, v) is the Fourier transform of (x,y)={square root over (I.sub.S(x,y)I.sub.R)}e.sup.i(x,y). Note that one can obtain the function (x,y) by selecting the region in the dotted circle, moving it to the origin of the frequency coordinates, and taking its inverse Fourier transform. The images in
(46) Microfluidic devices were manufactured by molding of polydimethylsiloxane (PDMS, Dow Corning, Midland, Mich.) on a micro-fabricated master mold. The mold was fabricated using standard photolithographic technologies as described below. A silicon wafer was baked in an oven set to 200 C. for 30 minutes, cleaned with oxygen plasma (March, Concord, Calif.), and then spun coated with SU-8 25 photoresist (SU8, Microchem, Newton, Mass.) at 1850 rpm to achieve a final thickness of approximately 30 m and processed following the standard protocol as recommended by the manufacturer. A thin layer of PDMS (thickness <200 m) was prepared, degassed in a vacuum chamber for 1 hour, and then spun on the wafer at 600 rpm for 15 seconds. After baking for 8 hours at 65 C., the thin PDMS layer covering the master along with thicker, cured, and previously-cut PDMS pieces (length 1 cm, width 0.5 cm, height 0.3 cm) were exposed to 20 seconds of oxygen plasma and bonded on the inlet and outlet regions (
(47) Illustrated in
(48) Preferred embodiments of the present invention can utilize a multimodal imaging capability to generate complementary information regarding the sample. This can also provide additional analytical processes to further characterize the material being measured.
(49) As seen in the process sequence 250 of
(50) While the present invention has been described herein in conjunction with certain preferred embodiments, a person with ordinary skill in the art, after reading the present application, can effect changes, substitutions of equivalents and other alterations to the devices and methods set forth herein. Each embodiment described herein can also have included therein such variations as disclosed with other embodiments.