METHOD AND DEVICE FOR MICROSCOPY-BASED IMAGING OF SAMPLES
20220382030 · 2022-12-01
Assignee
Inventors
Cpc classification
G02B21/006
PHYSICS
G02B21/367
PHYSICS
G02B21/361
PHYSICS
B01L3/502715
PERFORMING OPERATIONS; TRANSPORTING
B01L2300/087
PERFORMING OPERATIONS; TRANSPORTING
International classification
Abstract
A method for performing microscopy-based imaging of samples comprises: loading a sample holder (100) onto a support (50) configured to receive the sample holder (100); moving the sample holder (100) in a first direction, from a starting position on a first strip of the sample holder (100), to move the sample holder (100) relative to an imaging line of a line camera (10), to capture an image of the first strip of the sample holder (100); monitoring a focal plane using an autofocus system (15) as the sample holder (100) is moved in the first direction; in response to a signal from the autofocus system (15), moving an objective lens (25) along the optical axis to adjust the focal plane; and moving the sample holder (100) in a second direction, to align the imaging line of the line camera (10) with a position on a second strip of the sample holder (100).
Claims
1. An imaging device for microscopy-based imaging of samples comprising: a line camera; a support, configured to receive a sample holder; an objective lens received by a lens holder, wherein the lens holder is operable to move the objective lens along an optical axis; and an autofocus system, wherein the support is configured to move the sample holder in a first direction relative to an imaging line of the line camera to capture an image of a first strip of the sample holder, wherein the autofocus system is configured to determine a focal plane, and is configured to output a signal which causes the lens holder to translate the objective lens in order to adjust the focal plane, during movement of the sample holder in the first direction by the support, and wherein the support is configured to move the sample holder in a second direction to align the imaging line of the line camera with a position on a second strip of the sample holder, wherein the first direction is a straight line, and the second direction is a rotational direction.
2. The imaging device according to claim 1, wherein the device comprises a frame grabber configured to create an area image from a plurality of serially captured line images captured by the line camera.
3. The imaging device according to claim 1, wherein the autofocus system is a tracking autofocus system, and is configured to adjust the focal plane as the sample holder moves, and optionally, the autofocus system is configured to adjust the focal position at least every 0.5 ms.
4. The imaging device according to claim 1, wherein the autofocus system comprises an autofocus system light source, wherein the autofocus light source is an additional light source that is different from an illumination source and has a different wavelength from the wavelength of the illumination source.
5. The imaging device according to claim 1, wherein the light from the autofocus system light source is configured to pass through the objective lens, to be incident onto a bottom surface of the sample holder.
6. The imaging device according to claim 1, wherein a focal plane of the line camera is set at the same plane as the focal plane determined by the autofocus system.
7. An imaging device according to claim 1, wherein the line camera is mounted with a slight offset in the direction of the optical axis in order to place the focal plane of the line camera at a different level than the focal plane for the autofocus system, wherein optionally the line camera is offset by greater than 0 mm and less than 20 mm, for example by 15 mm, 10 mm, 5 mm, 2 mm or 1 mm.
8. An imaging device according to claim 1, wherein the device comprises a dichroic mirror, and optionally wherein the dichroic mirror is configured to be broadly transparent to light from an illumination source but to reflect light from the autofocus system, or is configured to be broadly transparent to light from the autofocus system but to reflect the light from an illumination source.
9. An imaging device according to claim 1, wherein the optical axis along which the lens holder is configured to move the objective lens is vertical and the objective lens is configured to be moved substantially vertically upwardly or downwardly.
10. An imaging device according to claim 1, wherein the line camera is configured to image the sample holder from below a plane at which the support is arranged to hold the sample holder.
11. An imaging device according to claim 1, wherein the line camera is mounted in a fixed position such that it does not move.
12. An imaging device according to claim 1, wherein the imaging device comprises an illumination source, wherein the illumination source is optionally monochromatic, or a narrow-band source, and/or wherein the illumination source is provided at a position above the support to illuminate the sample holder from above.
13. An imaging device according to claim 12, wherein the device comprises a condenser, for shaping the light beam emitted from the illumination source to provide substantially homogenous illumination at the position where the sample holder is imaged by the line camera.
14. An imaging device according to claim 1, wherein the device comprises a tube lens, for focusing a collimated beam coming out of the objective lens onto the line camera.
15. An imaging device according to claim 12, wherein the device comprises a narrow-band single band bandpass filter, wherein the central wavelength of the band is at approximately the central wavelength of the illumination source, and/or wherein the bandwidth of the bandpass filter is less than 200 nm, and is optionally approximately 100 nm, or less.
16. An imaging device according to claim 12, wherein the illumination source comprises a plurality of light sources; and/or wherein a diffuser is positioned between the illumination source and the sample holder.
17. An imaging device according to claim 1, wherein the support comprises a platform comprising a recessed region shaped to conform to the outer dimensions of the sample holder.
18. An imaging device according to claim 17, wherein the platform is provided on linear tracks attached to the support, allowing the platform to be linearly translated.
19. An imaging device according to claim 17, wherein the platform comprises a platform lid which is hingedly connected to the platform, and optionally wherein the platform lid is caused to move upwardly and downwardly, for example by engagement with a guide rail.
20. An imaging device according to claim 1, wherein the support comprises a drive wheel configured to rotate the sample holder about a vertical axis of the sample holder, wherein optionally, the drive wheel is located adjacent to the rim of the sample holder, to frictionally engage a rim of the sample holder, and/or wherein the drive wheel is configured so as to disengage from a rim of the sample holder to allow the sample holder to be removed from the support.
21. An imaging device according to claim 1, wherein the support comprises a detector, optionally a photodetector, configured to detect a single alignment structure which is present on the sample holder at a distance from the centre of the sample holder where no other structures are present, in order to determine an absolute rotational position of the sample holder, and optionally wherein the device is configured to carry out an adjustment to the rotational position by: positioning the imaging line in the outermost sample chamber of the first radial line; imaging the outermost sample chamber; carrying out image analysis, for example, comprising edge analysis to find the edges of the sample chamber; and rotating the sample holder until the midpoint of the imaged sample chamber is positioned on the optical axis.
22. A system for microscopy-based imaging of samples comprising the imaging device as claimed in claim 1, and a sample holder.
23. A system as claimed in claim 22, wherein the sample holder comprises a single sample chamber, or wherein the sample holder comprises a plurality of sample holders, for example up to 600 sample chambers, for example, 50 to 500 sample chambers, for example 80 to 400 sample chambers, for example 96 chambers, 336 chambers or 384 chambers.
24. A system as claimed in claim 22, wherein the sample holder comprises a plurality of sample chambers located along radial lines of the sample holder, wherein a single sample chamber is located along each radial line, or a plurality of sample chambers are located along each radial line.
25. A system as claimed in claim 22, wherein the sample holder comprises a plurality of sample chambers located along a plurality of concentric circles having different radii on the sample holder, wherein a single sample chamber is located along each coaxial circle, or a plurality of sample chambers are located along each coaxial circle.
26. A system as claimed in claim 22, wherein the sample holder comprises a plurality of sample chambers located along a plurality of parallel lines, wherein a single sample chamber is located along each parallel line, or a plurality of sample chambers are located along each parallel line.
27. A system as claimed in claim 22, wherein the sample holder comprises focus-checking structures, which are optionally pyramid-shaped or groove-shaped indentations, wherein optionally the focal structures are spaced to appear in every 10th line, every 50th line, or every 100th line, captured by the line camera.
28. A system as claimed in claim 22, wherein the sample chambers include a plurality of antimicrobial agents, each at a plurality of concentrations, for performing an AST analysis.
29. A system as claimed in claim 22, wherein the sample holder comprises samples, which include microscopic objects contained in a sample fluid.
30. A system as claimed in claim 29, wherein the samples include pathogens present in a microbiological growth medium for performing a broth microdilution assay.
Description
[0167]
[0168]
[0169]
[0170]
[0171]
[0172]
[0173]
[0174]
[0175]
[0176]
[0177] In one example, the line camera 10 is a Linea LA-CM-16K05A (comprising a CMOS digital image sensor) manufactured by Teledyne DALSA, coupled with an XTIUM-CL MX4 frame grabber (not shown), also by Teledyne DALSA. The camera array size is 1×16,384 pixels, with each pixel being 3.5 μm×3.5 μm. The line width is therefore 3.5 μm, and its length is 57.7 mm. Only a portion of this length may be used, in practice (for example, fewer than half of the pixels may be used). The autofocus system 15 comprises a system from WDI WISE Device Inc., comprising the ATF6 SWIFT digital autofocus system (with laser wavelength of 785 nm) and an MCZ controller for controlling the position of the objective lens 25 in the z-direction. The objective lens 25 is a Nikon CFI Plan-fluor (10× magnification, NA 0.3). The dichroic mirror 20 is a 662 nm edge BrightLine single-edge imaging-flat dichroic beamsplitter manufactured by Semrock. The dichroic mirror 20 is held in a holder 21, which is shown in
[0178] The system further comprises a sample holder 100 comprising a plurality of sample chambers 116 (described in greater detail below, with reference to
[0179] The platform 52 is provided on linear tracks 56a, 56b attached to the support, and a motor may be provided to drive the platform in either direction along the tracks. The motor (not shown) may drive movement of the platform along the tracks via a rack and pinion arrangement (not shown), for example.
[0180] The platform 52 comprises a platform lid 53 which, particularly during imaging, holds the sample holder 100 in a fixed position with respect to the vertical axis, i.e. such that the sample holder 100 does not move upwardly or downwardly.
[0181] The platform lid 53 is hingedly connected to the platform, so that it can pivot upwardly and away from the platform 52 about the hinged connection. In particular, the platform lid 53 is configured to move in this way when the platform 52 is translated to an extreme position at one end of the linear tracks 56a, 56b (to the far right, as shown in
[0182] The sample holder 100 is loaded from above onto the support 50 (i.e. into the recessed region 51 of the platform 52) at the extreme position. In this position, the sample holder 100 rests within the recessed region 51 and is prevented from lateral movement by the recessed region 51. As the platform 52 moves from the extreme position, the platform lid 53 is guided down by the guide rail to press down on the sample holder 100, so that the sample holder 100 is prevented from movement upwardly by the downward force applied by the platform lid 53. That is, the platform lid 53 provides a vertical clamping function. The sample holder 100 is prevented from movement downwardly by being supported by the recessed region 51.
[0183] The support comprises a through-hole 54, below the plane at which the sample holder 100 is supported, which allows a portion of the sample holder 100 to be imaged by the line camera 10, from below.
[0184] In order to bring different radial lines of sample chambers 116 into line with the line camera 10 for imaging, the support 50 comprises a drive wheel 57 configured to rotate the sample holder 100 (about a vertical axis of the sample holder 100). When a sample holder 100 is held in the support 50, the drive wheel 57 is located adjacent to the rim of the sample holder 100, to frictionally engage the rim of the sample holder. The drive wheel 57 is pressed to the rim using a spring action. The drive wheel is driven by a second motor 55, via a drive belt (not shown).
[0185] The drive wheel 57 is configured to disengage from the rim of the sample holder 100 (i.e. the spring action pressing the drive wheel 57 to the rim of the sample holder 100 is relaxed) when the platform 52 is translated to the extreme position at the right-hand end (as shown in
[0186] The support 50 is configured to align the sample holder 100 in a specific position such that the starting position for the imaging is known. The support 50 comprises a dedicated detector (for example, a photodetector, not shown) configured to detect a single alignment structure which is present on the sample holder 100 at a distance from the centre of the sample holder 100 where no other structures are present. This structure defines the absolute position, and then a predetermined offset gives the rotational position of the starting imaging position. The sets the rotational position of the sample holder to within ±500 μm, as measured at the outermost sample chamber. A fine positioning procedure is then done, by translating the platform 52 to position the imaging line in the outermost sample chamber of the first radial line, and imaging the sample chamber. Based on image analysis (for example, comprising edge analysis to find the edges of the sample chamber), the sample holder is rotated until the midpoint of the sample chamber is positioned on the optical axis. This sets the starting position for the imaging to within ±50 μm.
[0187] In the use of the device, the sample holder 100 is provided with appropriate samples in sample chambers 116 and images of the samples are gathered using the line camera 10.
[0188] Referring to
[0189] Similarly, in the system shown in
[0190] The sample holder 100 is moved in a first linear direction (by translating the platform 52) in the horizontal plane, such that the imaging line of the line camera 10 successively images different lines perpendicular to the radial line along which the sample chambers 116 are distributed.
[0191] The speed at which the sample holder is translated is, in this example, matched to the imaging rate (line rate) of the line camera, such that the resultant image is not distorted. The speed s of the linear movement of the sample holder is given by:
[0192] Here, the pixel width is 3.5 μm, the line camera imaging rate is 48 kHz and the magnification is 10×. This gives a speed s of 16.8 mm/s. This allows imaging of 50 radial lines, each of 50 mm length, within 6 minutes (including the time taken for rotation to each new radial line, and data transfers). A sample holder comprising 384 sample chambers can be fully scanned in 7 minutes. The total analysis time per sample chamber, including movement to the sample chamber, adjusting the focal plane during imaging, and acquiring images within the sample chamber is less than 2 seconds.
[0193] Following the completion of the translational movement of the sample holder 100, the sample holder is rotated by the support 50 (using the drive wheel 57) in order to bring another radial line of sample chambers 116 into alignment with the imaging line of the line camera 10. The sample holder 100 is then translated in a linear direction in the opposite direction to the first linear direction, to image the second radial line of sample chambers.
[0194] As mentioned, the system comprises an autofocus system 15. The relative positions of the line camera 10, autofocus system 15, objective lens 25, dichroic mirror 20 (not shown in
[0195] The autofocus system 15 comprises a laser light source (not shown) with wavelength of 785 nm. The laser light 15a passes through the dichroic mirror 20 and the objective lens 25 (in the opposite direction to the light gathered by the objective lens 25 from the sample chambers 116), to be incident onto a bottom surface of the sample holder 100. The autofocus system 15 sets the focal plane at the bottom surface of the sample chambers 116 in the sample holder. The focal plane of the line camera may be set at a predetermined upward offset therefrom (such that the focal plane lies at a plane within the sample chamber 116, above and parallel to the bottom surface of the sample chamber 116), by offsetting the line camera 10 along the optical axis (by between 0 mm and 20 mm).
[0196] The autofocus system 15 can adjust the focal position (if necessary) every 0.15 ms. This allows the autofocus system 15 to recheck the focal position approximately every 7 lines read by the line camera 10 (which has an imaging rate of 48 kHz). If the focal position needs to be adjusted, the autofocus system 15 outputs a signal which causes the lens holder 26 (see
[0197] As a radial line of sample chambers 116 is imaged by the line camera 10, a composite image comprising the plurality of imaged lines is built up. The composite image obtained by the line camera 10 includes all of the sample chambers 116 along the radial line. This composite image may be processed by an image processing algorithm to split the composite into separate image areas, each including one sample chamber 116, for example.
[0198] An image analysis system may receive the images taken by the system, and may carry out further image analysis, for example to determine the presence, absence, or amount of microscopic objects and/or to determine the type of microscopic objects (for example, as disclosed in Q-Linea AB's application PCT/EP2017/064713 (WO 2017/216312 A1)).
[0199] An exemplary sample holder 100 which is suitable for use with the device is now described in greater detail, with reference to
[0200] All of the layers 110, 114, 120 have a central hole 126 that is used during loading of the sample holder 100 into the device for microscopy-based imaging of the samples.
[0201] The channels 118 extend outward from the centre of the sample holder 100 toward the outer circumference, and they are spaced about along radial lines.
[0202] The first layer 110 and the third layer 120 are transparent to light in the wavelengths used for imaging the samples and are typically transparent to visible light. The second layer 114 need not be transparent, although it may be.
[0203] In case of use in a fluorescent analysis, the first layer 110, second layer 114, and third layer 120 should be non-fluorescent in the relevant wavelength region (for example, 450-700 nm).
[0204] Focus-checking structures 112 (for example, pyramid-shaped indentations or grooves), may be provided in the first layer 110—such a focus-checking structure 112 is shown in
[0205] As shown in
[0206] As explained above, as the line of sample chambers 116 is imaged by the line camera 10, a composite image comprising the plurality of imaged lines is built up. The composite image obtained by the line camera 10 includes all of the sample chambers 116 and focal structures 112 along the channel 118. This composite image may be processed by an image processing algorithm to split the composite into separate image areas, each including a sample chamber and at least one focal structure 112. In one example, the focal structure 112 associated with a given sample chamber 116 comprises two pyramid indentations at each end of the sample chamber 116. In another example, there is a focal structure 112 comprising four pyramid indentations 30 at the end of each sample chamber 116. In each case the geometry (i.e. layout of the pyramid indentations) may be the same, but the subsequent association of a focal structure 112 with a sample chamber 116 in the imaging processing is different.
[0207] An image analysis system may check the images to determine if they are in focus by identifying the focal structures 112 and checking whether or not they are in focus (as described for example in Q-Linea AB's application PCT/EP2017/064711 (WO 2017/216310 A1)). If any of the images are not in focus then an indication can be given to the user and/or remedial action can be taken.
[0208] Referring to
[0209] In the foregoing description, the sample holder 100 comprises sample chambers aligned along radial lines. The movement of such a sample holder (in order to image the sample chambers) is shown in more detail in
[0210] The sample chambers (not shown in
[0211] In
[0212] In alternative embodiments, the sample holder comprises sample chambers aligned along concentric circles (positioned at different radii). The movement of the sample holder in order to image the sample chambers is shown in more detail in
[0213] The sample chambers (not shown in
[0214] In
[0215] In alternative embodiments, the sample holder comprises sample chambers aligned along parallel lines. The movement of the sample holder in order to image the sample chambers is shown in more detail in
[0216] The sample chambers (not shown in
[0217] In
[0218] Where the sample holder comprises sample chambers aligned along parallel lines, there is no need for the drive wheel 57 in the system described in