Method and apparatus for automatic staining of tissue samples
09599630 ยท 2017-03-21
Assignee
Inventors
- Doug Sweet (Santa Barbara, CA, US)
- Marc Key (Ojai, CA, US)
- Gordon Feingold (Santa Barbara, CA, US)
- Kristopher Buchanan (Fort Collins, CO, US)
- Bob Lathrop (San Jose, CA, US)
- John Favuzzi (Santa Barbara, CA, US)
Cpc classification
Y10T436/25
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
G16H50/20
PHYSICS
Y10T436/113332
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
Y10T436/114165
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
Y10S901/41
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
Y02A90/10
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
Y10T436/2575
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
Y10T436/11
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
G01N35/00732
PHYSICS
G01N1/30
PHYSICS
Y10T436/114998
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
G01N35/00871
PHYSICS
G01N2035/00039
PHYSICS
Y10T436/112499
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
International classification
G01N1/30
PHYSICS
Abstract
The present invention concerns an apparatus for staining tissue samples, said apparatus including a reagent section or reagent containers; at least one staining section or tissue samples, a robotic head or robotic element that may move reagent to a predetermined tissue sample, said robotic element being moveable above the reagent and the staining sections, a control element that may manage a staining process, a 2-D optical sensor to detect two-dimensional image data of a relevant property and that can feed the captured image data to the control element. By providing the robotic element with a 2-D optical sensor, a common image processor may be provided having multiple functions. By using a 2-D optical image processing system, the control system of the apparatus may easily be adapted to read various types of data presentations, just as actual images for sections of the apparatus may be identified in order to assess the condition of the apparatus. The optical sensor may be used to automatically identify the slides and the reagent containers present in the apparatus, just as the optical sensor may be used for checking if a slide is misplaced at or absent from a slide position, etc.
Claims
1. An automatic staining apparatus comprising: at least one removable reagent container positioned within at least one reagent section; at least one slide positioned within a slide section; a robotic element configured to move above the slide section during a staining process, wherein the at least one reagent section is situated to enable the at least one removable reagent container to be added to or removed from the apparatus without interrupting the movement of the robotic element during dispensing of at least one reagent during the staining process; and wherein the slide section is situated to enable the at least one slide to be added to or removed from the apparatus without interrupting the movement of the robotic element during dispensing of at least one reagent during the staining process; an optical sensor associated with the robotic element; and a control element, the control element configured to establish communication with a server; direct operation of the robotic element; direct operation of the optical sensor to obtain data; communicate the data obtained by the optical sensor to the server; continue movement of the robotic element and dispensing of at least one reagent during insertion or removal of the at least one removable reagent container; and continue movement of the robotic element and dispensing of at least one reagent during insertion or removal of the at least one slide.
2. The apparatus of claim 1, wherein the a least one slide to be inserted or removed during processing is arranged in a staining section capable of retaining a batch of slides.
3. The apparatus of claim 1, wherein the optical sensor detects the misplacement or absence of a slide.
4. The apparatus of claim 3, wherein the detection of the misplacement or absence of a slide produces a warning.
5. The apparatus of claim 1, wherein the optical sensor is adapted to locate pre-selected reference features for self-calibration of the robotic element.
6. The apparatus of claim 1, wherein a sample is placed on the at least one slide, and wherein the optical sensor is adapted to record an image of the finalized sample after said sample has been subjected to the staining process.
7. The apparatus of claim 1, further comprising: at least one element provided on the at least one removable reagent container and the at least one slide.
8. The apparatus of claim 7, wherein the at least one element comprises a two-dimensional high-resolution symbology code.
9. The apparatus of claim 7, wherein the at least one element comprises a datamatrix code.
10. The apparatus of claim 7, wherein the at least one element comprises a bar code.
11. The apparatus of claim 7, wherein the at east one element comprises an adhesive label.
12. The apparatus of claim 7, wherein the at least one element comprises a two dimensional symbology zone.
13. The apparatus of claim 7, wherein the at least one element comprises a human readable text zone.
14. The apparatus of claim 1, wherein the optical sensor is configured to identify a feature selected from a group consisting of: the texture of the sample, the outline of the sample, a visual property of the sample, and an individual identification feature of the sample.
15. The apparatus of claim 1, wherein the optical sensor comprises a camera.
16. The apparatus of claim 15, wherein the camera comprises a CCD element.
17. The apparatus of claim 1, wherein the optical sensor is configured to image at least one optical identification element.
18. The apparatus of claim 17, wherein the optical identification element has reiterated information, and the reiterated information comprises multiple reiterated information.
19. The apparatus of claim 18, wherein said reiterated information comprises redundant information.
20. The apparatus of claim 18, wherein said optical identification element comprises an element selected from a group consisting of: a two-dimensional high-resolution symbology code, a datamatrix code, and a bar code.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1) In the following the invention is described with reference to the accompanying drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
MODE(S) FOR CARRYING OUT THE INVENTION
(9) An automatic staining apparatus 1 according the invention is shown in
(10) As mentioned, the present invention may include a robotic element, which may somehow affect the reagent container and tissue sample. Thus any sort of action to, action resulting from, or merely information from the reagent container or tissue sample may be facilitated through the robotic element. The robotic element, in embodiments, may be adapted to perform staining of the slides with (including as a result of or in conjunction with) the reagent application or the like. The robot arm or robotic element 20 may also remove reagent from a reagent container to a predetermined tissue sample. For example, a robotic element 20 for moving a probe 10 in X and Y (as well as Z) direction as indicated by the arrows X and Y is arranged above the frame 4 of the staining apparatus. A robot arm, may position the probe 10 above all reagent vials 3 as well as above all the slides 7, and may further operate the probe 10 to aspirate portions of reagent contained in any of the vials 3, to transfer the portion of reagent and apply it to any of the slides 7 in order to provide a selected staining or treatment of the sample on each slide 7. A control element may manage a staining process by controlling the entire processor even any portion of it. By use of a suitable control element or alternatively a control means e.g. capability within a computer (not shown) having the appropriate software and input data for the purpose, this staining apparatus 1 may be able to automatically stain or treat samples requiring different staining or treatment reagents and processes.
(11) As shown in
(12) In some embodiments a robotic element 20 or even a robotic head 22 may include a variety of components, including but not limited to a push tool 38 that may be connected to an air cylinder 39, a probe 10 that may be responsive to a probe movement element 36 which may even be connected to a syringe pump 37, and an optical sewer 86 as shown in
(13) In embodiments, the optical sensor may detect two-dimensional image data of a relevant property. It may also be adapted to sense a two-dimensional image of an element in general. The camera may be utilized to determine status information of the slides and the reagent bottles and other features of the apparatus in the work area, for example reading a code provided on a reagent container to determine the reagent type and the reagent location within the system. The camera may also determine status of the tissue sample carriers, for example the location of a particular slide, informational indicia, such as a code, that indicate information about the tissue sample presented on the slide or the processing protocol to be performed. A camera may be used for diagnostic purposes. In some embodiments, the sample may be scanned for further analysis, potentially by a computer. The present invention may include, in embodiments, a computer image biological analysis element or perhaps even biologically analysing image data of a sample with a computer.
(14) As previously discussed, the invention may include recording a variety of relevant image data. Of course, a variety of relevant image data may be recorded. Importantly, this may include recording element calibration reference points, or perhaps even robotic element calibration reference positions on or in the apparatus. As mentioned, the invention may also provide for recording slide identification image data and reagent identification image data. A significant aspect of an embodiment is the possibility of recording an optical identification element of a particular slide or perhaps merely recording information relevant to an element. Such information may include information concerning the tissue sample, of course. Similarly, optical identification may be recorded on a reagent container that may include information concerning the reagent contained therein. It may provide for recording a two dimensional symbology on a slide or even on a reagent container. Two-dimensional symbology recorded an a slide may represent data including, but not limited to: tissue sample related date, patient identification data, staining protocol data, or the like. Two-dimensional symbology recorded on a reagent container may represent data including, but not limited to: reagent related data, reagent type data, reagent volume related data, reagent durability related data, or the like. It may also provide a connection element through which captured image data may be transferred to the control element. It may include feeding the image data to a control element so that the robotic element may respond. After the relevant image data has been recorded, and perhaps as a result of feeding that data to the control element, the invention may manipulate a staining or other process according to that relevant image data. Thus the invention may perform staining of slides according to tissue specific protocols.
(15) The staining apparatus 1 of the present embodiment further comprise a probe washing station 8 and a reagent mixer 9, and the robotic element 20 is furthermore arranged to transfer the probe to the washing station 8 as well as to the reagent mixer 9.
(16) As shown in
(17)
(18) In
(19) In
(20)
(21) In an embodiment, the optical identifiers on the slides and on the reagent bottles are the same type. This may facilitate the image processing of the identification process in the staining apparatus.
(22) A different approach to identifying the individual slides or as a way of facilitating the new capabilities of confirming identification or storing confirmatory information may be to record the contour and/or the texture of the tissue ample 74 itself, such as shown in
(23) Besides identifying the microscope slides and the reagent bottles in the staining apparatus, the 2-D optical sensor can also be used for self-calibration of the apparatus, e.g. after maintenance, if the apparatus has been disassembled or moved to another location. By identifying critical locations within the apparatus by capturing an image by the camera, the image processing software can compare the captured image with a reference image to determine if certain critical components in the apparatus are offset from their predetermined positions, e.g. if a slide rack or a slide is slightly off-set, and if so, a set of correction data for the robotic motion control system may be calculated and this set of data may be used for calibrating the apparatus. If the correction needed exceeds a certain size, a warning could be automatically issued to an operator, so that it is ensured that the apparatus does not malfunction during the processing of the slides. Furthermore, this image analysis system could also be used for determining if a slide is present or dislocated in the rack in order to produce a warning signal.
(24) By the invention, it is realised that a variety of changes of the above description of some preferred embodiments of the invention may be made without departing from the scope of the invention as set forth in the claims. As can be easily understood, the basic concepts of the present invention may be embodied in a variety of ways. It involves both staining techniques as well as various systems, assemblies, and devices to accomplish staining and other functions. In this application, the staining techniques are also disclosed as part of the results shown to be achieved by the various systems, assemblies, and devices described and as steps that are inherent to utilization. They should be understood to be the natural result of utilizing the devices as intended and described. In addition, while some devices are disclosed, it should be understood that these not only accomplish certain methods but also can be varied in a number of ways. Importantly, as to all of the foregoing, all of these facets should be understood to be encompassed by this disclosure.
(25) The reader should be aware that the specific discussion may not explicitly describe all embodiments possible; many alternatives are implicit. It also may not fully explain the generic nature of the invention and may not explicitly show how each feature or element can actually be representative of a broader function or of a great variety of alternative or equivalent elements. Again, these are implicitly included in this disclosure. Where the invention is described in device-oriented terminology, each element of the device implicitly performs a function. Apparatus claims may not only be included for the device described, but also method or process claims may be included to address the functions the invention and each element performs. Neither the description nor the terminology is intended to limit the scope of the disclosure.
(26) It should also be understood that a variety of changes may be made without departing from the essence of the invention. Such changes are also implicitly included in the description. They still fall within the scope of this invention. A broad disclosure encompassing both the explicit embodiment(s) shown, the great variety of implicit alternative embodiments, and the broad methods or processes and the like are encompassed by this disclosure and may be relied upon to support additional claims for presentation in this or subsequent patent application.
(27) Further, each of the various elements of the invention and claims may also be achieved in a variety of manners. This disclosure should be understood to encompass each such variation, be it a variation of an embodiment of any apparatus embodiment, a method or process embodiment, or even merely a variation of any element of these. Particularly, it should be understood that as the disclosure relates to elements of the invention, the words for each element may be expressed by equivalent apparatus terms or method termseven if only the function or result is the same. Such equivalent, broader, or even more generic terms should be considered to be encompassed in the description of each element or action. Such terms can be substituted where desired to make explicit the implicitly broad coverage to which this invention is entitled. As but one example, it should be understood that all actions may be expressed as a means for taking that action or as an element which causes that action. Similarly, each physical element disclosed should be understood to encompass a disclosure of the action which that physical element facilitates. Regarding this last aspect, as but one example, the disclosure of a sensor should be understood to encompass disclosure of the act of sensingwhether explicitly discussed or notand, conversely, were there effectively disclosure of the act of sensing, such a disclosure should be understood to encompass disclosure of a sensor and even a means for sensing. It should also be understood that in jurisdictions where specific language may be construed as limiting, as but one example in the United States where some interpretations of means for elements can be construed narrowly, broader equivalent language (such as element or the like) may be used to avoid the narrow interpretation and should be understood as encompassed by this specification. Such changes and alternative terms are to be understood to be explicitly included in the description.
(28) Any patents, patent applications, publications, or other references mentioned in this application for patent are hereby incorporated by reference. In addition, as to each terra used it should be understood that unless its utilization in this application is inconsistent with such interpretation, common dictionary definitions should be understood as incorporated for each term and all definitions, alternative terms, and synonyms such as contained in the Random House Webster's Unabridged Dictionary, second edition are hereby incorporated by reference. Finally, any priority case for this application is hereby appended and hereby incorporated by reference.
(29) Thus, the applicant(s) should be understood to have support to claim at least: i) each of the sample processing systems and subsystems as herein disclosed and described, ii) the related methods disclosed and described, iii) similar, equivalent and even implicit variations of each of these systems, assemblies, devices and methods, iv) those alternative designs which accomplish each of the functions shown as are disclosed and described, v) those alternative designs and methods which accomplish each of the functions shown as are implicit to accomplish that which is disclosed and described, vi) each feature, component, and step shown as separate and independent inventions, vii) the applications enhanced by the various systems or components disclosed, viii) the resulting products produced by such systems or components, and ix) methods and systems, assemblies, devices, and apparatuses substantially as described hereinbefore and with reference to any of the accompanying examples, x) the various combinations and permutations of each of the elements disclosed, xi) each potentially dependent claim or concept as a dependency on each and every one of the independent claims or concepts presented, xii) processes performed with the aid of or on a computer as described throughout the above discussion, xiii) programmable system as described throughout the above discussion, xiv) a computer readable memory encoded with data to direct a computer comprising means or elements which function as described throughout the above discussion, xv) a computer configured as herein disclosed and described, xvi) individual or combined subroutines and programs as herein disclosed and described, xvii) the related methods disclosed and described, xviii) similar, equivalent, and even implicit variations of each of these systems and methods, xix) those alternative designs which accomplish each of the functions shown as are disclosed and described, xx) those alternative designs and methods which accomplish each of the functions shown as are implicit to accomplish that which is disclosed and described, xxi) each feature, component, and step shown as separate and independent inventions, and xxii) the various combinations and permutations of each of the above.
(30) Further, if or when used, the use of the transitional phrase comprising or the like is used to maintain the open-end claims herein, according to traditional claim interpretation. Thus, unless the context requires otherwise, it should be understood that the term comprise or variations such as comprises or comprising or the like, are intended to imply the inclusion of a stated element or step or group of elements or steps but not the exclusion of any other element or step or group of elements or steps. Such terms should be interpreted in their most expansive form so as to afford the applicant the broadest coverage legally permissible.
(31) Any claims set forth at any time are hereby incorporated by reference as part of this description of the invention, and the applicant expressly reserves the right to use all of or a portion of such incorporated content of such claims as additional description to support any of or all of the claims or any element or component thereof, and the applicant further expressly reserves the right to move any portion of or all of the incorporated content of such claims or any element or component thereof from the description into the claims or vice-versa as necessary to define the matter for which protection is sought by this application or by any subsequent continuation, division, or continuation-in-part application thereof, or to obtain any benefit of reduction in fees pursuant to, or to comply with the patent laws, rules, or regulations of any country or treaty, and such content incorporated by reference shall survive during the entire pendency of this application including any subsequent continuation, division, or continuation-in-part application thereof or any reissue or extension thereon.