METHOD FOR THE AUTOMATED ANALYSIS OF CELLULAR CONTRACTIONS OF A SET OF BIOLOGICAL CELLS
20220005197 · 2022-01-06
Inventors
- Tessa Homan (Lyon, FR)
- Hélène Delanoe-Ayari (Lyon, FR)
- Adrien Moreau (Claret, FR)
- Alexandre Mejat (Bondoufle, FR)
Cpc classification
G06T7/246
PHYSICS
G06T2207/20016
PHYSICS
International classification
Abstract
A method for analysis of cellular contractions of cells comprises recording a sequence of images of the cells. The sequence comprises a first image and a second image. The position of points of note in the first image are determined. The position of the same points of note in the second image, and for at least one point of note of the first image, is determined. A correspondence is established between the point of note of the first image and a point of note of the second image. The movement of the point of note, between the first image and the second image, is determined by comparing the position of the point of note of the first image and the position of the corresponding point of note of the second image.
Claims
1-10. (canceled)
11. A method for automated analysis of cellular contractions of a set of biological cells, the method comprising: determining a position of a set of points of note in a first image of a temporal sequence of images of a set of biological cells, the temporal sequence comprising the first image and a set of at least one second image; determining a position of a set of points of note in a second image, of the set of at least one second image; and for at least one point of note, determining a movement of the at least one point of note between the first image and the second image, the determining comprising comparing a position of a first point of note of the first image and a position of a corresponding second point of note of the second image.
12. The method of claim 11, further comprising: defining a first region of interest around the point of note of the first image; computing an intensity of the first region of interest of the first image; defining a second region of interest in the second image, the second region of interest being centered on a point in the second image having same coordinates as the point of note of the first image, the second region of interest being of a same shape and of a same size as the first region of interest; and moving the second region of interest to a set of positions in an arrival window of the second image and, at each position: computing an intensity of the second region of interest; and computing a correlation between the intensity of the second region of interest of the second image and the intensity of the first region of interest of the first image.
13. The method of claim 12, wherein determining the movement of the at least one point of note between the first image and the second image further comprises: decreasing a resolution of the first image and a resolution of the second image according to an image pyramid; and searching for the first region of interest of the first image in one of images of the image pyramid.
14. The method of claim 12, further comprising, for each arrival window: computing a correlation matrix corresponding to the set of positions of the second region of interest in the arrival window; detecting a position of a correlation peak in the correlation matrix; and assigning, as a position of the point of note in the second image, the position corresponding to the correlation peak.
15. The method of claim 11, further comprising: displaying, on a display screen, at least one among the first image and the second image; and on at least one displayed image, graphically representing a vector between the point of note of the first image and the point of note of the second image.
16. The method of claim 11, further comprising: determining a cellular contraction wave of the set of biological cells, the determining comprising computing the movement of the point of note between the first image and the set of at least one second image as a function of time; and computing at least one value among: an amplitude of the cellular contraction wave of the set of biological cells, a speed of propagation of the cellular contraction wave of the set of biological cells, at least one propagation-speed gradient of the cellular contraction wave of the set of biological cells, a period of the cellular contraction wave of the set of biological cells, a frequency of the cellular contraction wave of the set of biological cells, a time interval between: the first image, and a first second image, of the temporal sequence, in which the movement of the point of note between the first image and the second image is maximal, and a time interval between: the first second image in which the movement of the point of note between the first image and the second image is maximal, and a first second image, of the temporal sequence, in which the movement of the point of note between the first image and the second image is zero.
17. The method of claim 16, further comprising: detecting, during at least one period of the cellular contraction wave of the set of biological cells, whether the amplitude of the cellular contraction wave of the set of biological cells: passes through a preset maximum number a value of which is higher than a preset threshold value, or passes through a preset minimum number a value of which is lower than a preset threshold value.
18. The method of claim 11, further comprising pharmacological screening.
19. The method of claim 11, further comprising, prior to the determinations: employing phase-contrast microscopy to image the set of biological cells to obtain the temporal sequence of images.
20. A computer program comprising program-code instructions for executing, on a computer, the method of claim 11.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
DETAILED DESCRIPTION
[0059] Proposed here is a solution that allows the cellular contractions of a set of contractile biological cells to be analyzed and which is based on digital processing of images of the set of cells.
[0060] For the sake of brevity, the terms “cells,” “biological cells,” and “contractile biological cells” have been used synonymously.
[0061] For example, the cells are induced pluripotent stem cells (IPS), which have the potential to differentiate into any cell in the human body, and in particular into the contractile cells or “cardiomyocytes” from which cardiac muscle is formed.
[0062] Cardiomyocytes differentiated from IPS are of particular interest because, as the heart is an organ that regenerates little, it is difficult to gain access to the cardiomyocytes of a patient. However, since heart diseases are often hereditary, genetic heritage is therefore important and the advantageousness of the present disclosure in this respect will be discussed below.
[0063] For the sake of brevity, only cardiomyocytes are described below. Of course, the invention is not limited to this type of cell and relates to any type of contractile biological cell: heart cells, muscle cells, etc.
[0064] Induced pluripotent stem cells derived from a sick patient or a healthy person and differentiated into cardiomyocytes exhibit a spontaneous, rhythmic contraction, which may be obtained in a few weeks, and have the particular advantage of preserving the genetic heritage of the patient. They may therefore advantageously be used to test new drugs and to study pathologies, including side effects, associated with these drugs.
[0065] However, induced pluripotent stem cells differentiated into cardiomyocytes are not only used to test drugs on diseased cells but may also be used to test the toxicity of substances to healthy cells.
[0066] Previously, it was almost impossible to work directly on human heart cells because taking heart samples is very complicated. Now, by virtue of pluripotent stem cells (obtained from easily taken samples of skin, blood or urine) it is easy to obtain healthy or diseased human cardiomyocytes.
[0067] Although techniques are already available for characterizing cardiomyocytes, such as for example electrophysiology techniques or atomic force microscopy (AFM), such techniques are expensive, often difficult to apply on large scales and to set up, and often require special consumables requiring the cells to be subcultured, which is not always possible or desirable.
[0068] A more complete, more flexible, simpler and less expensive solution is proposed here. It is easily accessible and allows the characterization of parameters of contractions of the cells.
[0069] Furthermore, embodiments of the present disclosure have the advantage of not requiring fluorescence.
[0070] Embodiments of the present disclosure are based on image processing. Provision is therefore made to record beforehand a temporal sequence of images of a set of cells. The image processing may be carried out in real time on a temporal sequence of images, or in deferred mode, on a temporal sequence of images recorded beforehand.
[0071] The sequence of images comprises a first image 10 (for example at time t=1) and a set of at least one second image 20, in the present case consecutive to the first image 10, i.e., a second image 20 (for example at time t=1+dt), a third image (for example at time t=1+2dt), a fourth image (for example at time t=1+3dt), etc., with dt a preset time interval.
[0072] For example, the sequence of images may be recorded in video form.
[0073] Provision may be made for the sequence of images to be obtained by virtue of a prior step of employing phase-contrast microscopy to image the set of biological cells, in particular in monolayer form.
[0074] For simplicity, the first image 10 is considered to be the first image 10 of the sequence and the second image 20 is considered to be the second image 20 of the sequence.
[0075] Provision is made to determine the position of a set of points of note in the first image 10. Since the cells are contractile, it is highly probable that the position of these points of note will vary from image to image. Provision is therefore made to determine the position of this set of points of note in the second image 20, as described in more detail below.
[0076] Preferably, provision is made to determine the position of the set of points of note in each image of the sequence.
[0077] For the sake of brevity, the term “second image” is understood to mean, irrespectively: the second image of the sequence, one of the images of the sequence, a plurality of images of the sequence or all the images of the sequence other than the first image 10.
[0078] Identification of a Point of Note 11 in the First Image:
[0079] Provision is made to identify a set of at least one point of note 11 in the first image 10. For the sake of brevity, the expressions “a set of at least one point of note 11” and “a point of note 11” have been used synonymously.
[0080] By “point of note,” what is meant is a pixel or a set of pairwise adjacent pixels that has a brightness or an intensity (where, by intensity what is meant is the luminous intensity measured by a sensor, i.e., the number of photons per unit time and area of the sensor) higher than a threshold value; or for which the contrast or intensity gradient, in a predefined direction and over a predefined distance, is higher than a predefined threshold value.
[0081] Typically, the points of note are the brightest points of the first image 10, i.e., local intensity maxima, or the points of the first image 10 that have the highest contrast. It is, for example, possible to use a LOCALMAX function of the software package MATLAB® or other equivalent functions of equivalent software packages applied to the first image 10.
[0082] Once the points of note have been identified, the coordinates of the points of note are known.
[0083] If the cell has undergone a contraction between the first image 10 and the second image 20, then at least one point of note 11 of the first image 10 has a different position in the second image 20, which it is necessary to determine as described below.
[0084] Once the position of a point of note 11 in the first image 10 and the position of the point of note 11 in the second image 20 are known, it is then possible to determine the movement of the point of note 11 between the first image 10 and the second image 20.
[0085] Specifically, by comparing the position (the coordinates) of the point of note 11 of the first image 10 and the position of the point of note 11 of the second image 20, the time interval between the first image and the second image 20 being known, it is possible to compute the movement of the point of note 11, i.e., at least one among: [0086] the speed of movement of the point of note 11 between its position in the first image 10 and its position in the second image 20, and [0087] the distance separating the position of the point of note 11 in the first image 10 and its position in the second image 20.
[0088] Identification of the Position of the Point of Note 11 in the Second Image:
[0089] The position of the point of note in the second image 20 is determined as follows.
[0090] First of all, provision is made to define a first region of interest 12 around the point of note 11 of the first image 10.
[0091] A region of interest is the set of pixels comprised in a sub-portion of an image and that has a preset shape, in the present case a rectangle the centroid of which is the point of note 11. The coordinates of the first region of interest are therefore known.
[0092] It is then possible to compute the intensity of the first region of interest 12 of the first image 10.
[0093] Next, similarly, provision is made to define a second region of interest 22, in the second image 20.
[0094] The second region of interest 22 (in the second image 20) has the same shape and the same size as the first region of interest 12 (in the first image 10), and preferably initially has the same position.
[0095] It is then a question of determining the position of the second region of interest 22 in the second image 20 such that the position corresponds to the movement of the point of note 11 between the first image 10 and the second image 20.
[0096] To this end, provision is made to move the second region of interest 22 to a set of preset positions in an arrival window 23 of the second image 20, the arrival window 23 itself having a preset shape, a preset size and a preset position.
[0097] At each position of the second region of interest 22 in the arrival window 23 of the second image 20, provision is made to compute the intensity (or grayscale value) of the second region of interest 22, and to compute a correlation between the intensity of the second region of interest 22 of the second image 20 for this position and the intensity of the first region of interest 12 of the first image 10.
[0098] For example, in
[0099] Each correlation value computed for a given position of the second region of interest 22 in the arrival window 23 is recorded as one coefficient of a correlation matrix, which comprises as many columns and rows as there are pixels of movement of the second region of interest 22.
[0100] It is then possible to detect, i.e., compute, the position of the correlation peak in the correlation matrix.
[0101] It is then possible to select the position of the second region of interest 22 that has the maximum correlation (correlation peak), i.e., the position for which the intensity of the second region of interest 22 is closest to the intensity of the first region of interest 12, in order to define, i.e., assign, the position of the point of note 11 of the second image 20, this ensuring the determination of the position of the point of note 11 in the second image 20.
[0102] Preferably, as many correlation matrices are computed as there are points of note, per image of the set of at least one second image 20. Purely by way of illustration, for a sequence of images of 101 images, i.e., a first image 10 and a set of 100 second images 20, and a set of 25 points of note per second image 20, thus 25*100=2500 correlation matrices are computed. Preferably, provision is therefore made to perform the correlation-matrix computations in parallel, in the present case on a graphics card.
[0103] The size of the arrival window 23 of the second image 20 may be proportional to the size of the region of interest of the first image 10.
[0104] For example, the size of the arrival window 23 of the second image 20 is equal to the size of the region of interest of the first image 10. For example, the second region of interest 22 is moved by one pixel for each position in the arrival window 23.
[0105] It is also possible to provide a step of estimating beforehand the average movement of the points of interest and of dimensioning the size of the arrival window 23 depending on the average movement of the points of interest.
[0106] If a point of note 11 moves to a position that is not comprised in one of the positions of the second region of interest 22 of the arrival window 23, then it will not be seen in the second image 20.
[0107] To limit this risk and to optimize the computations, provision may be made for a step of creating an image pyramid, which consists in obtaining multi-resolution representations of the first image 10 or of the second image 20, the resolution decreasing from that of the initial image to that of a very rough version thereof.
[0108] Thus, provision may be made to decrease the resolution of the second image 20 according to an image pyramid, in the present case a Gaussian pyramid, and to record the set of images obtained, each image having a corresponding resolution and a corresponding size.
[0109] It is then possible to search for the first region of interest 12 of the first image 10 in at least one of the images of the image pyramid, and to preferably do so, in a loop, in all the images of the pyramid, starting with the image of smallest size.
[0110] As the size of the images of the pyramid is smaller than the size of the original image, but the size of the region of interest remains the same, the ratio between the two differs in each image of the pyramid, this making it possible, on the one hand, to obtain a robust solution and, on the other hand, to be able to estimate the movement of the point of note 11 between the first image and the second image 20.
[0111] By virtue of the image pyramid, the movement is estimated at least roughly in the images of the pyramid of small size and more and more accurately in each image of larger size.
[0112] Typically, it is possible to use, for this purpose, a motion-tracking or point-tracking algorithm that is applied to each image of the image pyramid; in the present case, the KLT algorithm (KLT standing for Kanade-Lucas-Tomasi), which is notably known for its use in automatic control of on-board cameras, was used.
[0113] From a graphical point of view, provision may be made to display, on a display screen, at least one among the first image 10 and the second image 20 and, on at least one displayed image, provision may be made to graphically represent a vector between the point of note 11 of the first image 10 and the point of note 11 of the second image 20.
[0114] For example, provision may be made to draw a vector in the first image 10 or the second image 20 the origin of which is the position of the point of note 11 in the first image 10 and the end of which is the position of the point of note 11 in the second image 20, this allowing the movement of the point of note 11 between two successive images of the sequence to be illustrated graphically.
[0115] From image to image, it is possible to obtain movement field vectors, which contain spatial and temporal information on the movement of points of note, and therefore on the contraction.
[0116] It is possible to compute the norm of all of the vectors of an image and the strength of the vector field by averaging all the vectors.
[0117] The image processing thus carried out allows the movement of a point of note 11 between the first image 10 and the set of second images to be computed. The time separating the first image 10 from the set of second images in the sequence is known. The distance separating the position of the point of note 11 in the first image 10 and the position of the point of note 11 in the set of second images is computed, based on the pixel size, which is known.
[0118] Thus, it is possible to determine the variation in the movement of a point of note 11 as a function of time t, this variation as a function of time being a cellular contraction wave, as illustrated in
[0119] By averaging the movements of the set of points of note, it is possible to determine a cellular contraction wave of the set of biological cells.
[0120] Provision may be made to display a curve representative of the cellular contraction wave on a display screen.
[0121] Provision may be made for a step of interpolating the curve representative of the cellular contraction wave.
[0122] By virtue of the values of the curve, and where appropriate by Fourier transform, it is possible to make provision to compute at least one of the values among: [0123] the amplitude A of the cellular contraction wave of the set of biological cells, and notably the maximum amplitude Amax, i.e., the maximum distance between the position of the point of note 11 of the first image 10 and the set of corresponding positions of the point of note 11 among the set of at least one second image 20, [0124] the propagation speed of the cellular contraction wave of the set of biological cells, i.e., the speed of propagation of the point of note 11, which is a marker of the coupling between adjacent cells, [0125] the gradients of the speed of propagation of the cellular contraction wave of the set of biological cells, [0126] the period T of the cellular contraction wave of the set of biological cells, [0127] the frequency 1/T of the cellular contraction wave of the set of biological cells, [0128] the rise time Tm, i.e., the time interval between: [0129] the first image 10, and [0130] the first second image 20 of the sequence in which the distance between the point of note 11 of the second image 20 and the point of note 11 of the first image 10 is maximal, and [0131] the fall time Td, i.e., the time interval between: [0132] the second image 20 in which the distance between the point of note 11 of the second image 20 and the point of note 11 of the first image 10 is maximal, and [0133] the first second image 20 of the sequence in which the distance between the point of note 11 of the second image 20 and the point of note 11 of the first image 10 is zero.
[0134] Thus, it is possible to determine the speed and duration of contraction, the speed and duration of relaxation, and the frequency and amplitude of contraction.
[0135] It is also possible to make provision to detect during at least one period of the cellular contraction wave whether the amplitude of the cellular contraction wave passes through: [0136] at least two extrema the values of which are higher than a preset threshold value, or [0137] comprises a number of extrema higher or lower than a preset threshold value.
[0138] As illustrated in
[0139] It is thus possible to detect variations in the rhythm of the cellular contractions, and to detect aberrant contractile events.
[0140] It is thus possible to test the safety, efficacy or toxicity of a particular molecule on biological cells, and in particular human cells, prior to any test on an animal model. Provision may therefore be made for a step of pharmacological screening.
[0141] For example, the cellular contraction wave is recorded for a healthy individual (
[0142] The present disclosure is therefore particularly advantageous with respect to testing new molecules, new drugs, but also in a pharmacovigilance context, or even to studying associated pathologies, including side effects, as described below.
Video Analysis
[0143] Each point in
[0144] In
[0148]
[0149]
[0150]
[0151]
[0152] It is clear that the effects of a given molecule on cell contraction may thus be measured. This not only makes it possible to directly test, for example, the effect of a molecule, in particular a therapeutic molecule, for example typically one intended to treat a disease of the heart, but also to test the side effects on human or animal cardiomyocytes of a therapeutic molecule typically intended to treat a disease of another organ, the liver for example.
[0153] Beyond the imaging of cellular contractions, embodiments of the disclosure may be implemented in fields other than biology, for example in chemistry or in physics, to study, by imaging, any, preferably periodic, wave, resonant or vibratory effect.
NOMENCLATURE
[0154] E1: First maximum [0155] E2: First minimum [0156] E3: Second maximum [0157] 10 First image [0158] 11 Point of note [0159] 12 First region of interest [0160] 20 Second image [0161] 22 Second region of interest [0162] 23 Arrival window