Method and device for microscopy-based imaging of samples
11428917 · 2022-08-30
Assignee
Inventors
Cpc classification
G02B21/006
PHYSICS
B01L3/502715
PERFORMING OPERATIONS; TRANSPORTING
G02B21/361
PHYSICS
G02B21/367
PHYSICS
B01L2300/087
PERFORMING OPERATIONS; TRANSPORTING
International classification
G02B21/36
PHYSICS
Abstract
A method for performing microscopy-based imaging of samples comprises: loading a sample holder (100) onto a support (50) configured to receive the sample holder (100); moving the sample holder (100) in a first direction, from a starting position on a first strip of the sample holder (100), to move the sample holder (100) relative to an imaging line of a line camera (10), to capture an image of the first strip of the sample holder (100); monitoring a focal plane using an autofocus system (15) as the sample holder (100) is moved in the first direction; in response to a signal from the autofocus system (15), moving an objective lens (25) along the optical axis to adjust the focal plane; and moving the sample holder (100) in a second direction, to align the imaging line of the line camera (10) with a position on a second strip of the sample holder (100).
Claims
1. A method for performing microscopy-based imaging of samples comprising: loading a sample holder onto a support configured to receive the sample holder, wherein the sample holder includes a plurality of antimicrobial agents, each at a plurality of concentrations, for performing an antimicrobial susceptibility testing (AST) analysis; moving the sample holder in a first direction, from a starting position on a first strip of the sample holder, to move the sample holder relative to an imaging line of a line camera, to capture an image of the first strip of the sample holder; determining a focal plane using an autofocus system as the sample holder is moved in the first direction; in response to receiving a signal from the autofocus system, a lens holder moves an objective lens along an optical axis to adjust the focal plane; and moving the sample holder in a second direction, to align the imaging line of the line camera with a position on a second strip of the sample holder, wherein the first and second strips follow radial lines, and wherein the image of the first strip is captured by linearly translating the sample holder across the imaging line of the line camera, and wherein the imaging line of the line camera is aligned with the position on the second strip of the sample holder by rotating the sample holder.
2. The method according to claim 1, wherein the image captured by the line camera is an area image constructed from a plurality of serially captured line images.
3. The method according to claim 1, wherein the autofocus system adjusts the focal plane at least every 0.5 ms as the sample holder moves.
4. The method according to claim 1, wherein the autofocus system determines an initial focal plane when the sample holder is loaded onto the support.
5. The method according to claim 1, wherein light from an autofocus system light source passes through a dichroic mirror, to pass through the objective lens and to be incident onto a bottom surface of the sample holder, and light from the sample holder that has passed through the objective lens is reflected by the dichroic mirror towards the line camera.
6. The method according to claim 1, wherein light from an autofocus system light source is reflected by a dichroic mirror, to pass through the objective lens and to be incident onto a bottom surface of the sample holder, and light from the sample holder that has passed through the objective lens passes through the dichroic mirror towards the line camera.
7. The method according to claim 1, wherein the objective lens is moved along an axis perpendicular to a plane defined by a plane of the sample holder, and wherein the optical axis is vertical and the objective lens is moved substantially vertically upwardly or downwardly.
8. The method according to claim 1, wherein the line camera images the sample holder from below the sample holder.
9. The method according to claim 1, wherein the sample holder comprises a plurality of sample chambers, and: a first plurality of sample chambers are distributed along the first strip, and a second plurality of sample chambers are distributed along the second strip; or a single sample chamber is located along one of the first or second strips, and a plurality of sample chambers are distributed along the other of the second or first strip; or a single sample chamber is located along the first strip, and a single sample chamber is located along the second strip.
10. The method according to claim 1, wherein the support comprises a platform lid and a vertical clamping force is applied by the platform lid to the sample holder to maintain the sample holder in a fixed position with respect to the vertical axis, and wherein the sample holder is held horizontally.
11. The method according to claim 1, comprising aligning the sample holder in a specific position such that the starting position for imaging is known.
12. The method according to claim 1, comprising illuminating the sample holder with a monochromatic or narrow-band light source from above the sample holder.
13. The method according to claim 1, comprising moving the sample holder by translating the sample holder linearly at a speed selected to give an undistorted image, taking into consideration the line camera imaging rate, the width of the pixels in the line camera imaging line, and the magnification provided by the objective lens.
14. The method according to claim 1, comprising translating the sample holder linearly at a speed of 10 to 20 millimetres per second (mm/s) and rotating the sample holder at a speed of approximately 30° per second.
15. The method according to claim 1, comprising checking the image to check whether it is in focus by checking whether a focal structure is in focus.
16. The method according to claim 1, wherein the sample holder comprises samples which include pathogens present in a microbiological growth medium for performing a broth microdilution assay.
17. The method according to claim 1, comprising imaging the sample holder at a plurality of time points.
18. The method according to claim 17, comprising determining at least one of: the presence or absence, or amount of growth of pathogens in the sample chamber(s) at each time point.
Description
(1) Embodiments of the present invention will now be described by reference to the accompanying figures, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12) In one example, the line camera 10 is a Linea LA-CM-16K05A (comprising a CMOS digital image sensor) manufactured by Teledyne DALSA, coupled with an XTIUM-CL MX4 frame grabber (not shown), also by Teledyne DALSA. The camera array size is 1×16,384 pixels, with each pixel being 3.5 μm×3.5 μm. The line width is therefore 3.5 μm, and its length is 57.7 mm. Only a portion of this length may be used, in practice (for example, fewer than half of the pixels may be used). The autofocus system 15 comprises a system from WDI WISE Device Inc., comprising the ATF6 SWIFT digital autofocus system (with laser wavelength of 785 nm) and an MCZ controller for controlling the position of the objective lens 25 in the z-direction. The objective lens 25 is a Nikon CFI Plan-fluor (10× magnification, NA 0.3). The dichroic mirror 20 is a 662 nm edge BrightLine single-edge imaging-flat dichroic beamsplitter manufactured by Semrock. The dichroic mirror 20 is held in a holder 21, which is shown in
(13) The system further comprises a sample holder 100 comprising a plurality of sample chambers 116 (described in greater detail below, with reference to
(14) The platform 52 is provided on linear tracks 56a, 56b attached to the support, and a motor may be provided to drive the platform in either direction along the tracks. The motor (not shown) may drive movement of the platform along the tracks via a rack and pinion arrangement (not shown), for example.
(15) The platform 52 comprises a platform lid 53 which, particularly during imaging, holds the sample holder 100 in a fixed position with respect to the vertical axis, i.e. such that the sample holder 100 does not move upwardly or downwardly.
(16) The platform lid 53 is hingedly connected to the platform, so that it can pivot upwardly and away from the platform 52 about the hinged connection. In particular, the platform lid 53 is configured to move in this way when the platform 52 is translated to an extreme position at one end of the linear tracks 56a, 56b (to the far right, as shown in
(17) The sample holder 100 is loaded from above onto the support 50 (i.e. into the recessed region 51 of the platform 52) at the extreme position. In this position, the sample holder 100 rests within the recessed region 51 and is prevented from lateral movement by the recessed region 51. As the platform 52 moves from the extreme position, the platform lid 53 is guided down by the guide rail to press down on the sample holder 100, so that the sample holder 100 is prevented from movement upwardly by the downward force applied by the platform lid 53. That is, the platform lid 53 provides a vertical clamping function. The sample holder 100 is prevented from movement downwardly by being supported by the recessed region 51.
(18) The support comprises a through-hole 54, below the plane at which the sample holder 100 is supported, which allows a portion of the sample holder 100 to be imaged by the line camera 10, from below.
(19) In order to bring different radial lines of sample chambers 116 into line with the line camera 10 for imaging, the support 50 comprises a drive wheel 57 configured to rotate the sample holder 100 (about a vertical axis of the sample holder 100). When a sample holder 100 is held in the support 50, the drive wheel 57 is located adjacent to the rim of the sample holder 100, to frictionally engage the rim of the sample holder. The drive wheel 57 is pressed to the rim using a spring action. The drive wheel is driven by a second motor 55, via a drive belt (not shown).
(20) The drive wheel 57 is configured to disengage from the rim of the sample holder 100 (i.e. the spring action pressing the drive wheel 57 to the rim of the sample holder 100 is relaxed) when the platform 52 is translated to the extreme position at the right-hand end (as shown in
(21) The support 50 is configured to align the sample holder 100 in a specific position such that the starting position for the imaging is known. The support 50 comprises a dedicated detector (for example, a photodetector, not shown) configured to detect a single alignment structure which is present on the sample holder 100 at a distance from the centre of the sample holder 100 where no other structures are present. This structure defines the absolute position, and then a predetermined offset gives the rotational position of the starting imaging position. The sets the rotational position of the sample holder to within ±500 μm, as measured at the outermost sample chamber. A fine positioning procedure is then done, by translating the platform 52 to position the imaging line in the outermost sample chamber of the first radial line, and imaging the sample chamber. Based on image analysis (for example, comprising edge analysis to find the edges of the sample chamber), the sample holder is rotated until the midpoint of the sample chamber is positioned on the optical axis. This sets the starting position for the imaging to within ±50 μm.
(22) In the use of the device, the sample holder 100 is provided with appropriate samples in sample chambers 116 and images of the samples are gathered using the line camera 10.
(23) Referring to
(24) Similarly, in the system shown in
(25) The sample holder 100 is moved in a first linear direction (by translating the platform 52) in the horizontal plane, such that the imaging line of the line camera 10 successively images different lines perpendicular to the radial line along which the sample chambers 116 are distributed.
(26) The speed at which the sample holder is translated is, in this example, matched to the imaging rate (line rate) of the line camera, such that the resultant image is not distorted. The speed s of the linear movement of the sample holder is given by
(27)
(28) Here, the pixel width is 3.5 μm, the line camera imaging rate is 48 kHz and the magnification is 10×. This gives a speed s of 16.8 mm/s. This allows imaging of 50 radial lines, each of 50 mm length, within 6 minutes (including the time taken for rotation to each new radial line, and data transfers). A sample holder comprising 384 sample chambers can be fully scanned in 7 minutes. The total analysis time per sample chamber, including movement to the sample chamber, adjusting the focal plane during imaging, and acquiring images within the sample chamber is less than 2 seconds.
(29) Following the completion of the translational movement of the sample holder 100, the sample holder is rotated by the support 50 (using the drive wheel 57) in order to bring another radial line of sample chambers 116 into alignment with the imaging line of the line camera 10. The sample holder 100 is then translated in a linear direction in the opposite direction to the first linear direction, to image the second radial line of sample chambers.
(30) As mentioned, the system comprises an autofocus system 15. The relative positions of the line camera 10, autofocus system 15, objective lens 25, dichroic mirror 20 (not shown in
(31) The autofocus system 15 comprises a laser light source (not shown) with wavelength of 785 nm. The laser light 15a passes through the dichroic mirror 20 and the objective lens 25 (in the opposite direction to the light gathered by the objective lens 25 from the sample chambers 116), to be incident onto a bottom surface of the sample holder 100. The autofocus system 15 sets the focal plane at the bottom surface of the sample chambers 116 in the sample holder. The focal plane of the line camera may be set at a predetermined upward offset therefrom (such that the focal plane lies at a plane within the sample chamber 116, above and parallel to the bottom surface of the sample chamber 116), by offsetting the line camera 10 along the optical axis (by between 0 mm and 20 mm).
(32) The autofocus system 15 can adjust the focal position (if necessary) every 0.15 ms. This allows the autofocus system 15 to recheck the focal position approximately every 7 lines read by the line camera 10 (which has an imaging rate of 48 kHz). If the focal position needs to be adjusted, the autofocus system 15 outputs a signal which causes the lens holder 26 (see
(33) As a radial line of sample chambers 116 is imaged by the line camera 10, a composite image comprising the plurality of imaged lines is built up. The composite image obtained by the line camera 10 includes all of the sample chambers 116 along the radial line. This composite image may be processed by an image processing algorithm to split the composite into separate image areas, each including one sample chamber 116, for example.
(34) An image analysis system may receive the images taken by the system, and may carry out further image analysis, for example to determine the presence, absence, or amount of microscopic objects and/or to determine the type of microscopic objects (for example, as disclosed in Q-Linea AB's application PCT/EP2017/064713 (WO 2017/216312 A1)).
(35) An exemplary sample holder 100 which is suitable for use with the device is now described in greater detail, with reference to
(36) All of the layers 110, 114, 120 have a central hole 126 that is used during loading of the sample holder 100 into the device for microscopy-based imaging of the samples.
(37) The channels 118 extend outward from the centre of the sample holder 100 toward the outer circumference, and they are spaced about along radial lines.
(38) The first layer 110 and the third layer 120 are transparent to light in the wavelengths used for imaging the samples and are typically transparent to visible light. The second layer 114 need not be transparent, although it may be.
(39) In case of use in a fluorescent analysis, the first layer 110 second layer 114, and third layer 120 should be non-fluorescent in the relevant wavelength region (for example, 450-700 nm).
(40) Focus-checking structures 112 (for example, pyramid-shaped indentations or grooves), may be provided in the first layer 110—such a focus-checking structure 112 is shown in
(41) As shown in
(42) As explained above, as the line of sample chambers 116 is imaged by the line camera 10, a composite image comprising the plurality of imaged lines is built up. The composite image obtained by the line camera 10 includes all of the sample chambers 116 and focal structures 112 along the channel 118. This composite image may be processed by an image processing algorithm to split the composite into separate image areas, each including a sample chamber and at least one focal structure 112. In one example, the focal structure 112 associated with a given sample chamber 116 comprises two pyramid indentations at each end of the sample chamber 116. In another example, there is a focal structure 112 comprising four pyramid indentations 30 at the end of each sample chamber 116. In each case the geometry (i.e. layout of the pyramid indentations) may be the same, but the subsequent association of a focal structure 112 with a sample chamber 116 in the imaging processing is different.
(43) An image analysis system may check the images to determine if they are in focus by identifying the focal structures 112 and checking whether or not they are in focus (as described for example in Q-Linea AB's application PCT/EP2017/064711 (WO 2017/216310 A1)). If any of the images are not in focus then an indication can be given to the user and/or remedial action can be taken.
(44) Referring to
(45) In the foregoing description, the sample holder 100 comprises sample chambers aligned along radial lines. The movement of such a sample holder (in order to image the sample chambers) is shown in more detail in
(46) The sample chambers (not shown in
(47) In
(48) In alternative embodiments, the sample holder comprises sample chambers aligned along concentric circles (positioned at different radii). The movement of the sample holder in order to image the sample chambers is shown in more detail in
(49) The sample chambers (not shown in
(50) In
(51) In alternative embodiments, the sample holder comprises sample chambers aligned along parallel lines. The movement of the sample holder in order to image the sample chambers is shown in more detail in
(52) The sample chambers (not shown in
(53) In
(54) Where the sample holder comprises sample chambers aligned along parallel lines, there is no need for the drive wheel 57 in the system described in