SYSTEMS AND METHODS FOR AUTOMATED IMAGING AND MANIPULATION OF SMALL ANIMALS
20210084867 ยท 2021-03-25
Assignee
Inventors
Cpc classification
G02B21/365
PHYSICS
A61B5/107
HUMAN NECESSITIES
C12M41/00
CHEMISTRY; METALLURGY
G01N21/6486
PHYSICS
G02B21/16
PHYSICS
B25J11/00
PERFORMING OPERATIONS; TRANSPORTING
A01K1/031
HUMAN NECESSITIES
International classification
A01K67/033
HUMAN NECESSITIES
G02B21/16
PHYSICS
Abstract
Systems and methods for automated imaging and manipulation of a plurality of small organisms are provided. In exemplary embodiments, the disclosed subject matter provides a housing, comprising an upper gantry, a lower gantry, and a tray with an array of plates, wherein the tray includes at least one source plate and at least one destination plate. The tray is adapted to hold the plurality of small organisms. A carriage, disposed within the upper gantry, is adapted to move relative to the tray. A camera, also disposed within the carriage, is adapted to acquire images of at least a portion of the small organisms. A computational processor, coupled to the camera, is adapted to identify an approximate size and shape for at least a portion of the small animals from the images, and to select one or more small animals based therefrom on its size and shape. A motorized picking assembly, also disposed within the carriage, is coupled to the processor and adapted to remove the one or more selected small organisms from the at least one source plate and effect transfer thereof to the at least one destination plate. In some embodiments, the disclosed subject matter provides methods, which include identifying at least one parameter for the small organisms, selecting one or more small organisms based the at least one parameter, removing the one or more selected small organisms from at least one source plate, and effecting transfer thereof to at least one destination plate.
Claims
1. A system for automated imaging and manipulation of a plurality of small animals, comprising: a housing, comprising an upper gantry, a lower gantry, and a tray with an array of plates, adapted to hold the plurality of small animals, wherein the tray includes at least one source plate and at least one destination plate; a carriage, disposed within the upper gantry, adapted to move relative to the tray; a camera, disposed within the carriage, adapted to acquire images of at least a portion of the plurality of small animals; a computational processor, coupled to the camera, adapted to identify an approximate size and shape for at least a portion of the plurality of small animals from the images and to select one or more small animals based therefrom on its size and shape; and a motorized picking assembly, disposed within the carriage, coupled to the processor such that a motorized picking tool is adapted to remove the one or more selected small animals from the at least one source plate and effect transfer thereof to the at least one destination plate.
2. The system of claim 1, further comprising a capacitive touch sensor, disposed within the motorized picking assembly, adapted to detect contact between the motorized picking tool and a substrate on the at least one source plate.
3. The system of claim 1, further comprising a lid manipulator, disposed within the carriage, adapted to take a lid off the at least one source plate before the motorized picking tool removes the one or more selected small animals and to replace the lid on the at least one source plate after the motorized picking tool removes the one or more selected small animals.
4. The system of claim 1, further comprising a retractable heating coil, disposed within the motorized picking assembly, adapted to sterilize the motorized picking tool through resistive heating and subsequent radiative and convective transfer of heat.
5. The system of claim 1, wherein the motorized picking tool is loop-shaped such that a current is adapted to run through the motorized picking tool, wherein the current sterilizes the motorized picking tool through resistive heating.
6. The system of claim 1, further comprising a heating coil, disposed within the tray, adapted to sterilize the motorized picking tool through resistive heating and subsequent radiative and convective transfer of heat.
7. The system of claim 1, further comprising an illuminator, disposed within the lower gantry, adapted to align with a position of the camera such that the illuminator illuminates upwards through the tray into the camera.
8. The system of claim 7, further comprising at least one motor, disposed within the lower gantry, adapted to align the illuminator with the position of the camera.
9. The system of claim 1, further comprising at least one motor, disposed within the upper gantry, adapted to move the carriage relative to the tray.
10. The system of claim 1, further comprising a fluorescence microscope with at least one channel, disposed within the carriage, adapted to measure fluorescence of at least a portion of the plurality of small animals, wherein the processor is further coupled to the fluorescence microscope and further adapted to select the one or more selected small animals based on its fluorescence.
11. The system of claim 1, further comprising an self-sterilizing loop device that is a handheld tool for manual manipulation of the small animals, wherein the self-sterilizing loop comprises a tip assembly and a handle.
12. The system of claim 11, wherein the tip assembly comprises the wire loop and contact pins, and wherein the handle comprises a battery.
13. The system of claim 12, wherein the wire loop is configured to be connected to the battery through the contact pins, and the battery is configured to generate a current that passes through the wire loop and the contact pins, heating the wire loop for sterilization.
14. The system of claim 1, wherein the motorized picking assembly comprises a tip assembly, wherein the tip assembly includes a wire loop and contact pins.
15. The system of claim 14, wherein a current is adapted to pass through the wire loop and contact pins, heating the wire loop for sterilization.
16. A method for automated imaging and manipulation of small animals, comprising: identifying at least one parameter for a plurality of small animals; selecting one or more small animals based the at least one parameter; removing the one or more selected small animals from at least one source plate; and effecting transfer thereof to at least one destination plate.
17. The method of claim 16, wherein the at least one parameter is an approximate size and shape for at least a portion of the plurality of small animals.
18. The method of claim 16, wherein the at least one parameter is a fluorescence signal for at least a portion of the plurality of small animals.
19. The method of claim 16, wherein the removing step further comprises lowering a motorized picking tool, removing the one or more selected small animals with the motorized picking tool, and raising the motorized picking tool.
20. The method of claim 19, further comprising sterilizing the motorized picking tool.
21. The method of claim 19, further comprising detecting contact between the motorized picking tool and a substrate on the at least one source plate.
22. The method of claim 16, further comprising taking a lid off the at least one source plate before removing the one or more selected small animals from the at least one source plate.
23. The method of claim 33, further comprising replacing the lid on the at least one source plate after removing the one or more selected small animals from the at least one source plate.
24. The method of claim 17, wherein the approximate size and shape for the at least a portion of the plurality of small animals is identified with a camera.
25. The method of claim 24, further comprising aligning an illuminator with a position of the camera such that the illuminator illuminates upwards into the camera.
26. The method of claim 16, further comprising manually manipulating the small animals using a self-sterilizing loop tool, wherein the self-sterilizing loop tool comprises a tip assembly and a handle.
27. The method of claim 26, further comprising sterilizing the self-sterilizing loop loop tool by generating a current that passes through the wire loop and contact pins of the self-sterilizing loop tool.
28. The method of claim 27, wherein a battery in the handle is configured to generate the current heating the wire loop to a temperature in excess of 1000 degrees or as needed for sterilization and/or cleaning.
29. The method of claim 16, wherein the motorized picking assembly comprises a tip assembly, wherein the tip assembly includes a wire loop and contact pins.
30. The method of claim 29, further comprising sterilizing and cleaning the wire loop by generating a current that passes through the wire loop and the contact pins heating the wire loop for sterilization and cleaning.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034] Throughout the drawings, the same reference numerals and characters, unless otherwise stated, are used to denote like features, elements, components or portions of the illustrated embodiments. Moreover, while the present invention will now be described in detail with reference to the Figs., it is done so in connection with the illustrative embodiments.
DETAILED DESCRIPTION
[0035] Techniques for automated imaging and manipulation of a plurality of small organisms are presented. The housing includes an upper gantry, a lower gantry, and a tray. The tray holds the plurality of small organisms. A carriage is disposed within the upper gantry and includes a camera and a motorized picking assembly. The carriage moves relative to the tray. The camera acquires images of at least a portion of the plurality of small organisms, e.g., one animal. A processor receives the images from the camera, identifies an approximate size and shape for at least a portion of the plurality of small organisms, and selects one or more small animals based therefrom based on its size, shape, or similarity to predetermined images as assessed by machine vision techniques including machine learning algorithms. The motorized picking assembly removes the one or more selected small animals from a source plate on the tray and effects transfer thereof to a destination plate on the tray.
[0036]
[0037] The upper gantry 102 can have a carriage 108, in which a camera 110 and a motorized picking assembly 112 can reside. The carriage 108 can move relative to the tray 106. For example, at least one motor can move the carriage 108 relative to the tray 106. In some embodiments, an X-axis motor 120, a Y-axis motor 122, and a Z-axis motor 124 can move the carriage in three dimensions along an X-axis travel rail 126, a Y-axis travel rail 128, and a Z-axis travel rail 130, respectively.
[0038] The camera 110 can acquire images of the small animals. For example, the camera can be a 25921944 pixel GigE CMOS camera with a field of view of approximately 10 mm8 mm. In some embodiments, the lower gantry 104 can have an illuminator 114. The illuminator 114 can align with a position of the camera such that the illuminator illuminates upwards through the tray into the camera. For example, the illuminator can be a 1W LED.
[0039]
[0040] For example, the processor can use a machine vision algorithm that relies on simple shape analysis to identify the approximate size and shape for the small organisms. The processor can preprocess and smooth the images to correct for light intensity variations and noise across the image. A binary threshold can be applied to identify regions of dark pixels as depicted in
[0041] The geometry of each small animal can then be evaluated. First, the length of each small animal can be approximately half of the perimeter of the small organisms. Second, the width of the small animal can be approximated as the length of the small organisms divided by the area of the small animal. Third, the aspect ratio of the small animal can be the length of the small animal divided by the width of the small organisms. If small organisms are not identified, the binary threshold can be automatically adjusted until small organisms are found.
[0042] As shown in
[0043] In some embodiments, a fluorescence microscope with at least one channel can be disposed within the carriage and measure fluorescence of the small animals. For example, the fluorescence channel can have a single channel or multiple channels. The fluorescence microscope can then send the fluorescence measurements to the processor such that the processor can select the one or more small animals based on its fluorescence.
[0044] In some embodiments, a lid manipulator 116 can be disposed within the carriage 108. The lid manipulator 116 can take a lid off the at least one source plate before the motorized picking tool 118 removes the one or more selected small animals and replace the lid on the at least one source plate after the motorized picking tool 118 removes the one or more selected small animals. For example, the lid manipulator 116 can be a vacuum pump. To take a lid off the at least one source plate, the vacuum pump can be activated. The vacuum pump can engage and lift the lid. To replace the lid on the at least one source plate, the vacuum pump can be deactivated. Once the vacuum pump is deactivated, the lid can be released and returned to its original position.
[0045]
[0046] The motorized picking tool 302 can be sterilized prior to and between removing and transferring each small animal to prevent unintentional transfer of contaminants or worm larvae during subsequent removals and transfers. In some embodiments, as depicted in
[0047]
[0048] In certain embodiments, the disclosed loop-shaped picking to can be a wire loop. The wire loop can be used for removal and/or transfer of one or more selected small animals from a plate. For example, the wire loop can be used to remove and transfer C. elegans. As shown in
[0049] In certain embodiments, as shown in
[0050] In some embodiments, a capacitive touch sensor can be disposed within the motorized picking assembly and adapted to detect contact between the motorized picking tool and a substrate on the at least one source plate. When the motorized picking tool is lowered to a substrate on the at least one source plate, it can touch the surface of the substrate. Because the surface of the substrate is electrically conductive, touching the motorized picking tool to the surface of the substrate can be detected by the capacitive touch sensor. In some embodiments, the capacitive touch sensor can detect proximity between the motorized picking tool and the substrate on the at least one source plate. The capacitive touch sensor can ensure that the motorized picking tool does not damage the surface of the substrate, as such damage can make it difficult to image the small animals clearly and can allow the small animals to crawl beneath the surface of the surface such that the small animals become inaccessible to the motorized picking tool.
[0051]
[0052] As shown in
[0053] The selected first small animal 500 can be swept on to the surface of the at least one destination plate by moving the motorized picking tool 502 across the surface of the at least one destination plate. In some embodiments, the motorized picking tool 502 can be coated in bacteria to adhere the selected first small animal 500 to the motorized picking tool 502. For example, the motorized picking tool 502 can be lowered in to a plate containing bacteria before it is lowered on to the surface of the substrate containing the selected first small animal.
[0054]
[0055] In certain embodiments, the disclosed subject matter provides a system, which can include a fluorescence microscopy and/or a bright-field microscopy for automated imaging and manipulation of small animals.
[0056] In non-limiting embodiments, in order to reduce the size of the optical system, the disclosed system can image bright-field images and fluorescence images partially through the same optics. For example, as shown in
[0057] A bright-field image acquired by the low magnification system is shown in
[0058] The system for automated imaging and manipulation of a plurality of small animals can be used to increase throughput in labor intensive experiments, increasing the quality of the results. A C. elegans procedure that can benefit from such automation is the integration of a transgene into the chromosome to generate a stable line of transgenic animals. For example, to integrate a gene, 20-50 worms carrying an extrachromosomal array that contains many copies of the gene are exposed to ultraviolet light or gamma radiation. During the breakdown and subsequent repair of the animal's DNA, there can be a small probability that the extrachromosomal material is incorporated into the chromosome. Animals with such integrations can be subcultured to generate a stable line of transgenic animals. To identify these lines, the extrachromosomal can be designed such that the worms have a clearly observable behavioral or morphological trait or fluorescent marker.
[0059] Worms can be allowed to reproduce for two generations and then 300-1000 individuals that exhibit the desired trait are picked to individual plates and allowed to reproduce for one more generation. As integrant lines can be those in which all progeny carry the desired trait, manual re-screening of all plates after 1-2 weeks can be required. The probability of successfully isolating an integrant line increases with the number of individuals picked at the final step. In certain embodiments, an integrant can be found after picking 800-1000 individuals.
[0060] A factor limiting the number of worms picked is the person-hours available to pick worms. Thus, an automated picking strategy not only reduces the manual labor required, but also increases the chance of success. To integrate a transgene using the disclosed apparatus, a user can prepare 5-10 plates containing about 100 F2 animals ready to by singled and load them as the source plate on the tray. The distribute script, as shown in
[0061] In certain embodiments, the disclosed subject matter provides a handheld self-sterilizing loop device. As shown in
[0062] In certain embodiments, as shown in
[0063] In certain embodiments, the nose cone 801 can be configured to be connected to the disclosed system. For example, the motorized picking tool 302 of the disclosed system can be configured to include the nose cone and perform self-sterilization.
[0064] In certain embodiments, the self-sterilizing loop device can be a handheld tool that can be used for manipulating the small organisms. The nose cone 801 can be configured to be connected to the handle 802. For example, as shown in
[0065] In certain embodiments, the self-sterilizing loop can be configured to be self-sterilized. As shown in
[0066] In certain embodiments, the self-sterilizing loop can be powered by pressing a button on the surface of the handle (
[0067] Exemplary processors, such as the processors described herein, can perform the techniques described herein, for example and not limitation, by executing software embodied in one or more tangible, computer-readable media, such as a memory unit. The memory unit can read the software from one or more other computer-readable media, such as a mass storage device or from one or more other sources via a communication interface. The software can cause the processor to execute the particular analysis or response process or particular processes including defining data structures stored in the memory unit and modifying such data structures according to the processes defined by the software.
[0068] The foregoing merely illustrates the principles of the disclosed subject matter. Various modifications and alterations to the described embodiments will be apparent to those skilled in the art in view of the teachings herein. It will thus be appreciated that those skilled in the art will be able to devise numerous techniques which, although not explicitly described herein, embody the principles of the disclosed subject matter and are thus within its spirit and scope.