Systems and Methods for Automated Single Cell Cytological Classification in Flow
20170333903 · 2017-11-23
Assignee
Inventors
Cpc classification
B01L2200/0652
PERFORMING OPERATIONS; TRANSPORTING
B01L2200/025
PERFORMING OPERATIONS; TRANSPORTING
B01L3/50273
PERFORMING OPERATIONS; TRANSPORTING
B01L2400/086
PERFORMING OPERATIONS; TRANSPORTING
B01L2400/0487
PERFORMING OPERATIONS; TRANSPORTING
B01L3/502715
PERFORMING OPERATIONS; TRANSPORTING
B01L2200/0636
PERFORMING OPERATIONS; TRANSPORTING
B01L3/502761
PERFORMING OPERATIONS; TRANSPORTING
International classification
Abstract
Systems and methods in accordance with various embodiments of the invention are capable of rapid analysis and classification of cellular samples based on cytomorphological properties. In several embodiments, cells suspended in a fluid medium are passed through a microfluidic channel, where they are focused to a single stream line and imaged continuously. In a number of embodiments, the microfluidic channel establishes flow that enables individual cells to each be imaged at multiple angles in a short amount of time. A pattern recognition system can analyze the data captured from high-speed images of cells flowing through this system and classify target cells. In this way, the automated platform creates new possibilities for a wide range of research and clinical applications such as (but not limited to) point of care services.
Claims
1. A cytological classification system comprising: an imaging system; a flow cell comprising: an inlet; an outlet; and a microfluidic channel comprising an imaging region, wherein the microfluidic channel receives flow via the inlet and having channel walls formed to: focus cells from a sample into a single stream line; space cells within a single stream line; and rotate cells within a single stream line; a perfusion system configured to inject a sample into the flow cell via the inlet; and a computing system configured by software to perform cytological cell classification based upon images captured of a cell by the imaging system, wherein: the imaging system is configured to capture multiple images of individual cells rotating within the imaging region of the microfluidic channel of the flow cell and each captured image contains an image of a single cell; and the computing system is configured by software to: superimpose multiple images of a single cell to create a superimposed image; and classify the single cell based upon characteristics of the superimposed image.
2. The cytological classification system of claim 1, wherein the computing system is configured to classify the single cell using a plurality of classifiers.
3. The cytological classification system of claim 2, wherein at least one of the plurality of classifiers are learned using a training data set.
4. The cytological classification system of claim 1, wherein the computing system is configured to classify the single cell using a Neural network model.
5. The cytological classification system of claim 1, wherein the imaging system comprises a light source configured to illuminate the imaging region of the microfluidic channel.
6. The cytological classification system of claim 5, wherein the imaging system further comprises an objective lens system configured to magnify the cells passing through the imaging region of the microfluidic channel.
7. The cytological classification system of claim 5, wherein the imaging system further comprises a high-speed camera system configured to capture images at between 100,000 and 500,000 frames/s.
8. The cytological classification system of claim 1, wherein the microfluidic channel is formed so that the imaging system captures a sequence of images of a rotating cell within the imaging region of the microfluidic channel that provides full 360° views of the cell.
9. The cytological classification system of claim 1, wherein the imaging system captures at least 10 images of a cell within the imaging region of the microfluidic channel.
10. The cytological classification system of claim 1, wherein the imaging system captures of images of at least 1000 cells/second and the computing system classifies at least 1000 cells/second.
11. The cytological classification system of claim 1, wherein the microfluidic channel further comprises a filtration region.
12. The cytological classification system of claim 1, wherein a subsection of the channel walls comprises a focusing region formed to focus cells from a sample into a single stream line of cells using inertial lift forces.
13. The cytological classification system of claim 12, wherein the inertial lift forces act on cells at Reynolds numbers where laminar flow occurs.
14. The cytological classification system of claim 12, wherein the focusing region includes contracted and expanded sections.
15. The cytological classification system of claim 14, wherein the contracted and expanded sections have an asymmetrical periodic structure.
16. The cytological classification system of claim 1, wherein a subsection of the channel walls comprises an ordering region formed to space cells within a single stream line using inertial lift forces and secondary flows that exert drag forces on the cells.
17. The cytological classification system of claim 16, wherein the ordering region forms at least one pinching region.
18. The cytological classification system of claim 16, wherein the ordering region forms a sequence of curved channels and pinching regions.
19. The cytological classification system of claim 1, wherein a subsection of the channel walls comprises a cell rotation region formed to rotate cells by applying a velocity gradient to the cells within the single stream line of cells.
20. The cytological classification system of claim 19, wherein the cell rotation region applies a velocity gradient to cells using a co-flow.
21. The cytological classification system of claim 19, wherein the cell rotation region applies a velocity gradient to cells by increasing at least one dimension of the channel.
22. A cytological classification system comprising: a two-layered flow cell comprising: an inlet; an outlet; and a microfluidic channel comprising: a focusing region for focusing cells from a sample into a single stream line; an ordering region for spacing cells within a single stream line; a cell rotation region for rotating cells within a single stream line; and an imaging region that provides a field of view of rotating cells; a perfusion system configured to inject a sample into the flow cell via the inlet; an imaging system comprising: a camera configured to collect images of the imaging region; a light source for illuminating the imaging region; and an objective lens system configured to provide magnification of the imaging region; and a computing system configured by software to perform cytological cell classification based upon images captured of a cell by the imaging system, wherein: the imaging system is configured to capture multiple images of individual cells rotating within the imaging region of the microfluidic channel of the flow cell and each captured image contains an image of a single cell; and the computing system is configured by software to: superimpose multiple images of a single cell to create a superimposed image; and classify the single cell based upon characteristics of the superimposed image.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0028] The description and claims will be more fully understood with reference to the following figures and data graphs, which are presented as exemplary embodiments of the invention and should not be construed as a complete recitation of the scope of the invention.
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
DETAILED DESCRIPTION
[0042] Systems and methods in accordance with various embodiments of the invention are capable of rapid analysis and classification of cellular samples based on cytomorphological properties. In several embodiments, cells suspended in a fluid medium are passed through a microfluidic channel, where they are focused to a single stream line and imaged continuously. In a number of embodiments, the microfluidic channel establishes flow that enables individual cells to each be imaged at multiple angles in a short amount of time. A pattern recognition system can analyze the data captured from high-speed images of cells flowing through this system and classify target cells. In this way, the automated platform creates new possibilities for a wide range of research and clinical applications such as (but not limited to) point of care services.
[0043] Systems and methods in accordance with a number of embodiments of the invention utilize inertial lift forces in a miniaturized fluidic device to position cells in flow and to transfer cells to a single lateral position. The cells can then be ordered to prevent arrival of multiple cells in a single frame during imaging. In this way, the need for image segmentation can be avoided. In a number of embodiments, the cells are caused to spin while they are imaged to capture images of individual cells at multiple angles.
[0044] In many embodiments, the cytological classification system can detect and track cells as they pass through the microfluidic system, capturing multiple images per cell at different angles. In several embodiments, the system can be easily integrated with other miniaturized platforms to automate staining and eliminate manual sample preparation altogether. In certain embodiments, the cytological classification system allows for classification of cells individually by ordering them at desired distances from each other. When the cells are imaged in this way, the cytological classification system can reconstruct three-dimensional images from the images of an imaged cell at different angles. Furthermore, analysis can be performed based upon characteristics of the imaged cells including (but not limited to) the morphology of the cytoplasm and nuclear envelope.
[0045] Cytological classification systems and methods for performing cytological classification in flow in accordance with various embodiments of the invention are discussed further below.
Cytological Classification Systems
[0046] A cytological classification system in accordance with an embodiment of the invention is illustrated in
[0047] In several embodiments, a cell suspension sample is prepared at concentrations ranging between 1×10.sup.5-5×10.sup.5 cells/mL. The specific concentration utilized in a given cytological classification system typically depends upon the capabilities of the system. Cells may be fixed and stained with colored dyes (e.g., Papanicolaou and Wright Giemsa methods). Cytological classification systems in accordance with various embodiments of the invention can operate with live, fixed and/or Wright Giemsa-stained cells. Staining can help increase the contrast of nuclear organelles and improve classification accuracy. After preparation, the cell suspension sample can be injected into the microfluidic device using a conduit such as (but not limited to) tubing and a perfusion system such as (but not limited to) a syringe pump. In many embodiments, a syringe pump injects the sample at ˜100 μL/min. As can readily be appreciated, any perfusion system, such as (but not limited to) peristalsis systems and gravity feeds, appropriate to a given cytological classification system can be utilized.
[0048] As noted above, the flow cell 106 can be implemented as a fluidic device that focuses cells from the sample into a single stream line that is imaged continuously. In the illustrated embodiment, the cell line is illuminated by a light source 108 and an optical system 110 that directs light onto an imaging region 138 of the flow cell 106. An objective lens system 112 magnifies the cells by directing light toward the sensor of a high-speed camera system 114. In certain embodiments, a 40×, 60×, or 100× objective is used to magnify the cells. As can readily be appreciated by a person having ordinary skill in the art, the specific magnification utilized can vary greatly and is largely dependent upon the requirements of a given imaging system and cell types of interest.
[0049] In a number of embodiments, image sequences from cells are recorded at rates of between 100,000-500,000 frames/s using a high-speed camera, which may be color, monochrome, and/or imaged using any of a variety of imaging modalities including (but not limited to) the near-infrared spectrum. In the illustrated embodiment, the imaging area is illuminated with a high-power LED with exposure times of <1 μs to help prevent motion blurring of cells. As can readily be appreciated, the exposure times can differ across different systems and can largely be dependent upon the requirements of a given application or the limitations of a given system such as but not limited to flow rates. Images are acquired and can be analyzed using an image analysis algorithm. In many embodiments, the images are acquired and analyzed post-capture. In other embodiments, the images are acquired and analyzed in real-time continuously. Using object tracking software, single cells can be detected and tracked while in the field of view of the camera. Background subtraction can then be performed. In a number of embodiments, the flow cell 106 causes the cells to rotate as they are imaged and multiple images of each cell are provided to a computing system 116 for analysis. The flow rate and channel dimensions can be determined to obtain multiple images of the same cell and full 360° view of the cells (e.g. 4 images in which the cell rotates 90° between successive frames). A two-dimensional “hologram” of a cell can be generated by superimposing the multiple images of the individual cell. The “hologram” can be analyzed to automatically classify characteristics of the cell based upon features including (but not limited to) the morphological features of the cell. In many embodiments, 10 or more images are captured for each cell. As can readily be appreciated, the number of images that are captured is dependent upon the requirements of a given application.
[0050] In several embodiments, the flow cell has different regions to focus, order, and rotate cells. Although the focusing regions, ordering regions, and cell rotating regions are discussed as affecting the sample in a specific sequence, a person having ordinary skill in the art would appreciate that the various regions can be arranged differently, where the focusing, ordering, and rotating of the cells in the sample can be performed in any order. Regions within a microfluidic device implemented in accordance with an embodiment of the invention are illustrated in
[0051] As cytological classification systems in accordance with various embodiments of the invention deliver single cells for imaging, the systems eliminate the variability involved in manual preparation of slides, which rely on expertise of the operator. Furthermore, image segmentation can be avoided. As the cytological classification systems rely on inertial effects, relatively high flow rates and high-throughputs (e.g. analyzing>1000 cells/second) can be achieved. In many embodiments, the cytological classification system includes an imaging system that can capture images of at least 1000 cells/second and a computing system that can classify at least 1000 cells/second. The imaging system can include, among other things, a camera, an objective lens system and a light source. In a number of embodiments, flow cells similar to those described above can be fabricated using standard 2D microfluidic fabrication techniques, requiring minimal fabrication time and cost.
[0052] Although specific cytological classification systems, flow cells, and microfluidic devices are described above with respect to
Microfludic Device Fabrication
[0053] Microfluidic devices in accordance with several embodiments of the invention can be fabricated using a variety of methods. In many embodiments, a combination of photolithography and mold casting is used to fabricate a microfluidic device. Conventional photolithography typically involves the use of photoresist and patterned light to create a mold containing a positive relief of the desired microfluidic pattern on top of a substrate, typically a silicon wafer. Photoresist is a photo-curable material that can be used in photolithography to create structures with feature sizes on the order of micrometers. During fabrication, the photoresist can be deposited onto a substrate. The substrate can be spun to create a layer of photoresist with a targeted desired height. The photoresist layer can then be exposed to light, typically UV light (depending on the type of photoresist), through a patterned mask to create a cured pattern of photoresist. The remaining uncured portions can be developed away, leaving behind a positive relief mold that can be used to fabricate microfluidic devices.
[0054] From the mold, material can be cast to create a layer containing a negative relief pattern. Inlet and outlet holes can be formed at appropriate regions, and the device can then be bonded to a backing to create a flow-through device, or flow cell, with microfluidic channels. In many embodiments utilizing a rotation section, a two-layer fabrication process can be used to orient the rotation section so that imaging of the cells as they rotate will provide images of cells at different angles with a more accurate representation of cellular features. As can be readily appreciated, the microfluidic device can be fabricated using a variety of materials as appropriate to the requirements of the given application. In imaging applications, the microfluidic device is typically made of an optically transparent material such as (but not limited to) polydimethylsiloxane (“PDMS”).
[0055] Although a specific method of microfluidic device fabrication is discussed, any of a variety of methods can be implemented to fabricate a microfluidic device utilized in accordance with various embodiments of the invention as appropriate to the requirements of a given application.
Microfludic Filters
[0056] Microfluidic devices in accordance with several embodiments of the invention can include one or more microfluidic filters at the inlets, or further down, of the microfluidic device to prevent channel clogging. In other embodiments, filtration can occur off device. A microfluidic filter system in accordance with an embodiment of the invention is illustrated in
[0057] Although a specific microfluidic filter system is illustrated in
Focusing Regions
[0058] Focusing regions on a microfluidic device can take a disorderly stream of cells and utilize inertial lift forces (wall effect and shear gradient forces) to focus the cells within the flow into a single line of cells.
[0059] The focusing region 300 receives a flow of randomly arranged cells via an upstream section 302. The cells flow into a region of contracted 304 and expanded 306 sections in which the randomly arranged cells are focused into a single stream line of cells. The focusing is driven by the action of inertial lift forces (wall effect and shear gradient forces) acting on cells at Reynolds numbers>1, where channel Reynolds number is defined as follows: Re.sub.c=ρU.sub.mW/μ, where U.sub.m is the maximum fluid velocity, ρ is the fluid density, μ is the fluid viscosity, and W is the channel dimension. In some embodiments, Reynolds numbers around 20-30 can be used to focus particles ˜10-20 μm. In many embodiments, the Reynolds number is such that laminar flow occurs within the microfluidic channels. As can readily be appreciated, the specific channel Reynolds number can vary and is largely determined by the characteristics of the cells for which the microfluidic device is designed, the dimensions of the microfluidic channels, and the flow rate controlled by the perfusion system.
[0060] In many embodiments, the focusing region is formed with curvilinear walls that forms periodic patterns. In some embodiments, the patterns form a series of square expansions and contractions. In other embodiments, the patterns are sinusoidal. In further embodiments, the sinusoidal patterns are skewed to form an asymmetric pattern. The focusing region illustrated in
[0061] While specific implementations of focusing regions within microfluidic channels are described above with reference to
Ordering Regions
[0062] Microfluidic channels can be designed to impose ordering upon a single stream line of cells formed by a focusing region in accordance with several embodiments of the invention. Microfluidic channels in accordance with many embodiments of the invention include an ordering region having pinching regions and curved channels. The ordering region orders the cells and distances single cells from each other to facilitate imaging. In a number of embodiments, ordering is achieved by forming the microfluidic channel to apply inertial lift forces and Dean drag forces on the cells. Dean flow is the rotational flow caused by fluid inertia. The microfluidic channel can be formed to create secondary flows that apply a Dean drag force proportional to the velocity of the secondary flows. Dean drag force scales with ˜ρU.sub.m.sup.2αD.sub.h.sup.2/r, where ρ is the fluid density, U.sub.m is the maximum fluid velocity,
is the channel hydraulic diameter, α is the particle dimension, and R is the curvature radius. The force balance between inertial lift and Dean drag forces determines particle equilibrium position.
[0063]
[0064] Although a specific combination of curved channels and particle pinching regions that order and control the spacing between cells are illustrated in
Cell Rotation Regions
[0065] Microfluidic channels can be configured to impart rotation on ordered cells in accordance with a number of embodiments of the invention. Cell rotation regions of microfluidic channels in accordance with many embodiments of the invention use co-flow of a particle-free buffer to induce cell rotation by using the co-flow to apply differential velocity gradients across the cells. In several embodiments, the cell rotation region of the microfluidic channel is fabricated using a two-layer fabrication process so that the axis of rotation is perpendicular to the axis of cell downstream migration and parallel to cell lateral migration. Cells are imaged in this region while tumbling and rotating as they migrate downstream. This allows for the imaging of a cell at different angles, which provides more accurate information concerning cellular features than can be captured in a single image or a sequence of images of a cell that is not rotating to any significant extent. This also allows for a 3D reconstruction of the cell using available software since the angles of rotation across the images are known. In many embodiments, a similar change in velocity gradient across the cell is achieved by providing a change in channel height (i.e. the dimension that is the smaller of the two dimensions of the cross section of the microfluidic channel and the dimension perpendicular to the imaging plane). This increase in channel height should be such that the width continues to be greater than the height of the channel. Also in the case of increasing channel height, there can be a shift in cell focusing position in the height dimension, which should be accounted for during imaging and adjustment of the imaging focal plane.
[0066] A cell rotation region of a microfluidic channel incorporating an injected co-flow prior to an imaging region in accordance with an embodiment of the invention is illustrated in
[0067] Although specific techniques for imparting velocity gradients upon cells are described above with reference to
Imaging and Classification
[0068] A variety of techniques can be utilized to classify images of cells captured by cytological classification systems in accordance with various embodiments of the invention. Using image analysis software, the different cell types can be classified. In a number of embodiments, images are captured at very high frame rates on the order of 100,000s of frames per second and classification is performed in real time. In several embodiments, 2D “holograms” are formed from captured images and provided to one or more classifiers. In many embodiments, classifiers that are utilized can be categorized according to: i) classifiers that identify specific features of interest (specific size, round vs rough nuclear shape, specific nuclear-to-cytoplasmic ratio); and ii) classifiers that use training sets to identify specific target cell types. The distinction between the two different classes of classifier are discussed more formally below.
Classification Based Upon Defined Cell Characteristics
[0069] The classification problem within a cytological classification system can involve assigning image h.sub.i of cell i to a set C of m classes C={c.sub.1, . . . , c.sub.m}. In several embodiments, the classification processes utilized in cytological classification systems start by finding the center of cell i in the superposition image h.sub.i (i.e. an image formed by the superposition of the images of cell i) and calculate a set of k values and normalizes them to x.sub.1.sup.(i), . . . , x.sub.k.sup.(i) according to a predefined set of parameters P.sub.1, . . . , P.sub.k which depend on the application and the type of cells that are going to be classified. The classification process outputs Y:=f(W.sup.TX), where X is a k×n matrix of n observations (cells) over values of k parameters, W is a k×m matrix, and f is a classification function defined on R.sup.m.fwdarw.C.
[0070] Suppose k=5 as an example.
x.sup.(i)=[x.sub.1.sup.(i),x.sub.2.sup.(i),x.sub.3.sup.(i),x.sub.4.sup.(i),x.sub.5.sup.(i)]
y(x.sup.(i))=f(W.sub.11x.sub.1.sup.(i)+ . . . +W.sub.15x.sub.5.sup.(i), W.sub.21x.sub.1.sup.(i)+ . . . +W.sub.25x.sub.b.sup.(i), . . . , W.sub.m1x.sub.1.sup.(i)+ . . . +W.sub.m5x.sub.5.sup.(i))
[0071] Classification function f(.) and weight matrix W can either be manually tuned or optimized using conventional optimization processes.
[0072] Referring to 6A and 6B, the classification process is conceptually illustrated. Three mock examples of cells being imaged while rotating in a microfluidic channel are shown. An overlay of the images is first calculated for each cell. The parameters described below in more detail are calculated. Note the difference between two cells with different nuclear sizes (center and right) and cells with single versus two nuclei (left vs. center/right). As can readily be appreciated, thresholds can be applied to the parameters by the classifier(s) and determinations made concerning the characteristics of the cells.
Analysis Using Trained Classifiers
[0073] Generalized classifiers g can be learned using machine learning techniques such as (but not limited to) a Support Vector Machine (SVM) or other appropriate process for generating a classifier from a training data set, where Y=g(X,Γ), where Γ are the parameters of the function, using a training set {(x.sup.(1), y.sup.(1)), (x.sup.(2), y.sup.(2)), . . . , (x.sup.(t), y.sup.(t))} of size t, where x.sup.(i) is still defined by the parameters P.sub.1 through P.sub.k: [x.sub.1.sup.(i), . . . , x.sub.k.sup.(i)].
Analysis Via Neural Networks
[0074] Neural networks can also be trained using a training data set of images and used to perform classification. In several embodiments, after background correction, thresholding and edge detection (using a Canny filter), the resulting sequence of images of a cell are flattened and loaded into an array that is provided to an l layer Neural network model with q nodes to perform classification. In several embodiments, the number of nodes in the Neural network are selected based upon the number of pixels of the edges typically observed in images following application of the Canny filter.
[0075] For each cell, one array can be generated. The sequence of processes for each cell is: [0076] a) The number of images per cell is determined using particle tracking software [0077] b) For each image the following is done: [0078] i) background correction [0079] ii) thresholding [0080] iii) edge detection [0081] iv) binary edge image [0082] c) the binary images are then superimposed (2D hologram) [0083] d) the final 2D image (the superimposed edge image) is converted into a 1D array.
[0084] While a variety of different classification approaches exists, the choice of approaches used depends on the application. While a Neural network model could offer an enhanced classification accuracy, for more rapid classification (for real-time analysis) the predefined parameters P.sub.1 through P.sub.5 can be advantageous. As can readily be appreciated, the specific classification process(es) utilized in a cytological classification system in accordance with an embodiment of the invention are largely dependent upon the requirements of a given application.
Application: Fetal Nucleated Red Blood Cell (fNRBC) Detection in Blood
[0085] In order to illustrate the performance of a cytological classification system similar to the cytological classification systems described above, three sets of cell images are provided in
[0089] Further examples of cell images classified using a cytological classification system in accordance with an embodiment of the invention are illustrated in
[0090] The following set of 5 parameters P.sub.1, . . . , P.sub.5 was utilized by the cytological classification system to classify fNRBCs against adult RBCs and WBCs: [0091] P1: Cell diameter, [0092] P2: Nucleus diameter, [0093] P3: Entropy of the image, defined as: −sum(p*log(p)), p: pixel intensity histogram, [0094] P4: Number of times lines crossing x-y plane intersection pass the cell/nucleus border. [0095] P5: Maximum area difference between the projection of image onto two lines crossing x-y plane intersection.
[0096] For the fnRBC detection application explained above, weights for parameters P.sub.1 through P.sub.5 were found by least squares optimization as part of a manually defined classification function f(.) that classified cells into the three classes c.sub.1(label: 0), c.sub.2, (label: 1) and c.sub.3 (label: 2).
[0097] The weight matrix W for the classier is:
[0098] Images successfully classified at high throughput using the classifier are shown in
[0099] A Neural network model with l=3 and q=2.sup.11 on 128×128 pixel image sizes was also trained using a small training data set and achieve good precision and recall (>75%) for the detection of fNRBCs. As can readily be appreciated, further tuning and improvements can be done on a larger training set.
[0100] Since cells in the blood have distinct morphological properties, the ability to image individual cells from different angles using cytological classification systems in accordance with various embodiments of the invention means that a wide variety of classifiers can be developed to identify different cell types in blood and/or other applications.
[0101] Although the present invention has been described in certain specific aspects, many additional modifications and variations would be apparent to those skilled in the art. It is therefore to be understood that the present invention can be practiced otherwise than specifically described without departing from the scope and spirit of the present invention. Thus, embodiments of the present invention should be considered in all respects as illustrative and not restrictive. Accordingly, the scope of the invention should be determined not by the embodiments illustrated, but by the appended claims and their equivalents.