Observation device
10983039 · 2021-04-20
Assignee
Inventors
Cpc classification
G02B21/365
PHYSICS
C12M1/34
CHEMISTRY; METALLURGY
G02B21/36
PHYSICS
C12Q1/025
CHEMISTRY; METALLURGY
G01N2015/0003
PHYSICS
International classification
C12M1/34
CHEMISTRY; METALLURGY
Abstract
In the present invention, information is analyzed, the positional relationship of cells/microbes in the optical axis direction is detected, and motility of cells/microbes is evaluated even in an out-of-focus view from an image obtained by a single image capture in an observation view of the cells/microbes. The present invention is provided with an optical system used to measure microparticles present in a sample liquid in a sample container, a drive mechanism for driving the sample container and/or a portion of the optical system in order to three-dimensionally search a bottom surface of the sample container, a control unit for controlling the optical system or the drive mechanism, an image processing unit for dividing an image of microparticles in the sample container at a first time and a second time into an in-focus region and an out-of-focus region and acquiring information relating to the microparticles, and a display unit for displaying the information relating to the microparticles as information representing a temporal change between the first time and the second time.
Claims
1. An observation device comprising: an optical system which is used to measure microparticles present in a sample liquid in a sample container; a drive mechanism which drives at least any one of the sample container and a portion of the optical system to three-dimensionally search a bottom surface of the sample container; a control unit which controls the optical system or the drive mechanism; an image processing unit which divides an image of microparticles in the sample container at a first time and a second time into an in-focus region and an out-of-focus region, and acquires information relating to the microparticles; and a display unit which displays the information relating to the microparticles as information representing a temporal change between the first time and the second time; wherein the image processing unit performs division into the in-focus region and the out-of-focus region by performing an outline extraction using a contrast of the image; wherein the information representing the temporal change is information representing a relation between information of an amount of microparticles floating in the sample liquid and a time, and the information on the amount of the microparticles floating in the sample liquid is calculated with a variation in luminance of an out-of-focus region as an index.
2. The observation device according to claim 1, wherein the out-of-focus region is further partitioned into a plurality of regions according to a defocus amount, and an image processing is performed for each of the partitioned regions, and an amount of the microparticles is calculated for each of the partitioned regions to obtain a spatial distribution of the microparticles in the sample liquid.
3. The observation device according to claim 2, wherein a defocus correction is performed for each of the regions partitioned according to the defocus amount to obtain the spatial distribution of the microparticles in the sample liquid.
4. The observation device according to claim 2, wherein the display device displays information on the spatial distribution of the microparticles at the first time and information on the spatial distribution of the microparticles at the second time.
5. The observation device according to claim 1, the information relating to the microparticles is at least one of the number of the microparticles, a size of the microparticles, a shape of the microparticles, and an occupation percentage of the microparticles on the focal plane.
6. The observation device according to claim 1, wherein the microparticles are microbes, the observation device further includes a mechanism which performs temperature control on the sample liquid, and the information representing the temporal change is information representing a relation between information on an amount of the microbes floating in the sample liquid and a time.
7. The observation device according to claim 6, wherein a data analyzing unit obtains information on a motility of the microbes from the information representing the temporal change.
8. The observation device according to claim 6, wherein a data analyzing unit obtains information on a response of a drug solution to the microbes from the information representing the temporal change before and after the drug solution is put in the sample liquid.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
DESCRIPTION OF EMBODIMENTS
(15) This application includes a plurality of units for solving the above problem. For example, an observation device is provided which includes an optical system such as an objective lens which is used to measure cells/microbes present in a bottom surface of a sample container, a capturing element which converts an image thereof to a digital signal, and a personal computer which receives and analyzes a digital signal of the image. An image processing device has an outline extraction function that extracts a boundary line of the image having a focal point in the cells/microbes present on the bottom surface of the sample container, and a dividing function of a detection region and a background region which are divided by the boundary line thereof. The image processing device includes a detection region analyzing unit that detects the information of the cells/microbes of the detection region, a background region analyzing unit that detects the defocused microbes/cells of the background region, and a display unit that displays the analyzed information of the detection region and the background region on a monitor.
(16) Hereinafter, the embodiments of the invention will be described with reference to the accompanying drawings. Incidentally, the accompanying drawings illustrate specific embodiments according to the principal of the invention. However, these drawings are for the purpose of understanding of the invention, and are not used for limited interpretation of the invention.
(17) The following embodiments relate to a method or a device which inspects an activity of a drug solution of cells/microbes present in liquid including a drug solution. The following items will be described about the embodiments.
(18) 1. Outline of measurement method of observation device
(19) 2. Inspection method and result output
(20) In the following description, an XYZ orthogonal coordinate system is set. A predetermined direction in a horizontal plan is set as an X-direction, a direction orthogonal to the X-direction in the horizontal plan is set as a Y-direction, and a direction (that is, vertical direction) orthogonal to each of the X-direction and the Y-direction is set as a Z-direction.
First Embodiment
(21) 1. Outline of Measurement Method of Observation Device
(22)
(23) The illumination 101 is desirably a Kohler illumination which is optically designed such that the bottom surface of the sample container 102 is lit uniformly. The sample container 102 has a storage unit which can hold at least one or more sample liquid. The pedestal 103 can hold the sample container 102, and has a structure that the light is made incident from the upper surface, and the light is discharged from the bottom surface. An XY stage 104 can move the pedestal 103 on which the sample container 102 is placed in the X-direction and the Y-direction. The XY stage 104 includes a heater (not illustrated) which performs temperature control on the sample container 102. For example, the sample container 102 may be surrounded by a transparent glass heater. In addition, the entire optical system may be surrounded by a heat insulating material, and the temperature control may be performed on the inside thereof by a heater. The objective lens actuator 106 is an actuator which moves the objective lens 105 in the Z-direction, and can scan a focal point position of the objective lens 105 in a depth direction of the sample container 102. The capturing element 107 forms the image in a focal point position of the objective lens 105. The imaging lens may be provided between the capturing element 107 and the objective lens 105. The capturing element 107 has a structure in which the image formed on the capturing element is converted into a digital signal and is transferred to the computer 108.
(24) The computer 108 includes at least a processor such as a CPU (Central Processing Unit), a memory unit such as a memory, and a memory device such as a hard disk. In addition, the computer 108 includes an input device (such as a mouse and a keyboard) which receives the input from the user, and a display device (such as a display) which displays a measurement result.
(25) The sample container 102 is prepared which receives the sample liquid in which the microbes and an antimicrobial to be measured is suspended. The bottom surface of the sample container 102 is desirably thin and smooth. In addition, the sample container 102 may use a microtiter plate having a plurality of sample holding units. The sample container 102 is fixed to the pedestal 103. The light having a uniform intensity is radiated from the illumination 101 on the bottom surface of the sample container 102. An image optical system such as a light field, a dark field, and a phase difference is desirable as the optical system. A light is condensed on the microbes image which is present near the lit bottom surface of the sample container 102 by the objective lens 105. The microbes image on which the light is condensed by the objective lens 105 is formed in the capturing element 107. At this time, in a case where the focal point position of the objective lens 105 does not match with the bottom surface of the sample container 102, the objective lens actuator 106 is operated to adjust a Z height position of the objective lens 105. An autofocus function which performs a process to monitor the contrast of the image captured by the capturing element 107 may be used in order to adjust the Z height position of the objective lens 105.
(26) The image captured by the capturing element 107 is transmitted as digital data to the computer 108. The transmitted image is preserved in the storage device of the computer 108.
(27)
(28) The data acquisition unit 201 is a module which acquires the image formed by the capturing element 107. For example, the data acquisition unit 201 two-dimensionally reproduces an image from the digital data transmitted from the capturing element 107.
(29) The data analyzing unit 202 is a module which uses the image generated in the data acquisition unit 201 as input information and outputs the analysis result of the measurement data. For example, the data analyzing unit 202 may analyze the image information at a plurality of different times, and calculate at least one quantitative value of the number of the microbes, the shape of the microbes, the size of the microbes, the amount of the floating microbes, and the occupation percentage of the microbes on the focal plane. As one example, the data analyzing unit 202 may count the number of portions having a predetermined variation value or more in the image information, and may obtain the number of the microbes. The shape of the microbes, the size of the microbes, and the occupation percentage of the microbes on the focal plane may be obtained from the size of the portions having the predetermined variation value or more in the image information.
(30) The data analyzing unit 202 may obtain the information on the motility of the microbes from the information of the floating microbes. In addition, the data analyzing unit 202 may obtain the information on the temporal change of the motility of the microbes from the information which indicates a relation between the information of the floating microbes and the time. For example, in a case where the number of the microbes in a position separated from the bottom surface of the sample container decreases, it can be determined that the drug solution affects the microbes having taxis, and the response of the drug solution to the microbes can be detected.
(31) As described above, the data analyzing unit 202 may include statistical software which can inspect the state change of the microbes from the temporal change of the information on the microbes.
(32) The data displaying unit 203 is a module which displays the analysis result output from the data analyzing unit 202 on the display of the computer 108. For example, the data displaying unit 203 displays the information on the microbes in a plurality of focal planes on the display such that the temporal change can be compared.
(33) The data displaying unit 203 may display the analysis result of the temporal change of the information on the microbes on the display. For example, the data displaying unit 203 may display the determination result about the motility of the microbes and the information on the response of the drug solution to the microbes on the display.
(34) The control unit 204 is a module which controls each component of the microbes observation device. For example, the control unit 204 can control each component of the microbes observation device to manage the start of the measurement and the end of the measurement. In addition, when the measurement data is acquired, the control unit 204 can control the driving of the objective lens actuator 106 and the driving of the XY stage 104.
(35) Incidentally, the processing unit described above may be operated by function of a program executed on the computer 108. In the above-described processing unit, the program code corresponding to each processing is stored in the memory. The processing unit may be operated when the process executes each program code. Incidentally, a portion of the above-described processing unit may be configured by hardware such as a dedicated circuit substrate.
(36) 2 Inspection Method and Result Output
(37)
(38)
(39) The data analyzing unit 202 analyzes two-dimensional planar data acquired in the data acquisition unit 201 (312). As one example, the data analyzing unit 202 may convert two-dimensional planar data to the image information. As another example, the data analyzing unit 202 may analyzes the image information, and calculate at least one quantitative value of the number of the microbes, the shape of the microbes, the size of the microbes, the amount of the floating microbes, and the occupation percentage of the microbes on the focal plane. In addition, the data analyzing unit 202 may measure the motility of the microbes from the calculated quantitative value. In addition, the data analyzing unit 202 may inspect the state change of the microbes from the temporal change of the information on the microbes.
(40) The data analyzing unit 202 outputs the analysis result (313). Incidentally, at this time, the data displaying unit 203 may display the analysis result output from the data analyzing unit 202 on the display of the computer 108.
(41) Next, it is determined whether the measurement is ended (314). In a case where the measurement is not ended, after waiting for the measurement interval (315), the procedure returns to step 311. Therefore, in this embodiment, the data analyzing unit 202 analyzes two-dimensional planar data or the image at the plurality of different times after the drug solution is put in the sample liquid. The data analyzing unit 202 can obtain the information on the response of the drug solution to the microbes from the information which indicates the temporal change of the information on the microbes. For example, after the drug solution is put in, the data analyzing unit 202 outputs the analysis result of the measurement data after one hour (first time) and the analysis result of the measurement data after five hours (second time). In step 309 of
(42) Incidentally, the data acquisition unit 201 may acquire two-dimensional planar data in the plurality of focal planes before and after the drug solution is put in the sample liquid, and the data analyzing unit 202 may obtain the information which indicates the temporal change of the information on the microbes before and after the drug solution is put in. In this case, the data analyzing unit 202 obtains the information on the response of the drug solution to the microbes from the information before and after the drug solution is put in.
(43)
(44)
(45) In the screen of this embodiment, an amount relating to the amount of the floating microbes in the incubation solution is displayed in addition to the number of the microbes which are present near the bottom surface of the sample container 102. In addition, the information on the number of the microbes at different times is displayed side by side such that the time change of the number of the microbes can be compared. Therefore, it is possible to observe the response of the drug solution to the microbes according to the time elapse.
(46) Incidentally, in the example of
(47) The microbes observation device of the above-described embodiments includes the optical system which measures microparticles (such as microbes and cells) present in the focal plane of the objective lens 105 in the sample liquid in the sample container 102, and the drive mechanism (the objective lens actuator 105 and the XY stage 104) which makes the focal point match with the bottom surface of the sample container 102. The measurement result (observation view) of the capturing element 107 is converted to the digital data and is transferred to the computer 108. The computer 108 converts the digital data to the image information and displays the image information on the display. Herein, the computer 108 displays the measurement result at a plurality of different times on the display. In addition, the computer 108 has a processing that divides the image into two of the region of the microbes and the background region by imaging the image information. The quantitative values such as the number, the size, and the shape of the microbes are calculated from the region of the microbes. The amount of the floating microbes is calculated from the background region. The computer 108 may measure the proliferation potency or the motility of the microbes from the quantitative value, and inspect the state change of the microparticles from the time change of the motility.
(48) According to the above-described embodiments, the shape can be measured accurately near the bottom surface of the sample container of the microparticles (such as the cells or the microbes), and the spatial distribution information indicating that the microbes float in the sample liquid can be measured from the defocused image. The information on the motility of the microparticles can be obtained from one still image without acquiring a plurality of images and photographing a moving image. In addition, after applying the drug solution (for example, antimicrobial), the effect of the microbes on the antimicrobial can be inspected from the time change of the distribution of the number of the microbes.
(49) In addition, the presence of the taxis of the microbes and the degree of the taxis can be measured from the spatial distribution of the microbes. In addition, the degree of the taxis of the microbes can be inspected by measuring the degree of spread of the distribution of the microbes into the liquid
Second Embodiment
(50) 1 Outline of Measurement Method of Observation Device
(51) A second embodiment is similar to the first embodiment.
(52) 2 Inspection Method and Result Output
(53) As described above, by using
(54)
(55)
(56)
(57) In the screen of this embodiment, an amount relating to the amount of the floating microbes in the incubation solution is displayed in addition to the number of the microbes which are present near the bottom surface of the sample container 102. In addition, the information on the number of the microbes at different times is displayed side by side such that the time change of the number of the microbes can be compared. Therefore, it is possible to observe the response of the drug solution to the microbes according to the time elapse.
(58) Incidentally, in the example of
(59)
(60) The microbes observation device of the above-described embodiments includes the optical system which measures microparticles (such as microbes and cells) present in the focal plane of the objective lens 105 in the sample liquid in the sample container 102, and the drive mechanism (the objective lens actuator 105 and the XY stage 104) which makes the focal point match with the bottom surface of the sample container 102. The measurement result (observation view) of the capturing element 107 is converted to the digital data and is transferred to the computer 108. The computer 108 converts the digital data to the image information and displays the image information on the display. Herein, the computer 108 displays the measurement result at a plurality of different times on the display. In addition, the computer 108 has a processing that divides the image into two of the region of the microbes and the background region by imaging the image information. The quantitative values such as the number, the size, and the shape of the microbes are calculated from the region of the microbes. The amount of the floating microbes is calculated from the background region. The computer 108 may measure the proliferation potency or the motility of the microbes from the quantitative value, and inspect the state change of the microparticles from the time change of the motility. Otherwise, the gravity of the microparticles or the change of the surface state may be evaluated from the natural sedimentation of the microparticles.
(61) According to the above-described embodiments, the shape can be measured accurately near the bottom surface of the sample container of the microparticles (such as the cells or the microbes), and the spatial distribution information indicating that the microbes float in the sample liquid can be measured from the defocused image. The information on the motility of the microparticles can be obtained from one still image without acquiring a plurality of images and photographing a moving image. In addition, after applying the drug solution (for example, antimicrobial), the effect of the microbes on the antimicrobial can be inspected from the time change of the distribution of the number of the microbes.
(62) In addition, the presence of the taxis of the microbes and the degree of the taxis can be measured from the spatial distribution of the microbes. In addition, the degree of the taxis of the microbes can be inspected by measuring the degree of spread of the distribution of the microbes into the liquid.
REFERENCE SIGNS LIST
(63) 101: illumination
(64) 102: sample container
(65) 103: pedestal
(66) 104: XY stage
(67) 105: objective lens
(68) 106: objective lens actuator
(69) 107: capturing element
(70) 108: computer
(71) 201: data acquisition unit
(72) 202: data analyzing unit
(73) 203: data displaying unit
(74) 204: control unit
(75) 501: experimental-condition display unit
(76) 502: measurement condition display unit
(77) 503: image display unit 1
(78) 504: image display unit 2
(79) 505: microbes number display unit
(80) 506: floating microbes amount display unit
(81) 701: experimental-condition display unit
(82) 702: measurement condition display unit
(83) 703: image display unit 1
(84) 704: image display unit 2
(85) 705: microbes number display unit
(86) 706: floating microbes amount display unit
(87) 707: microbes number distribution display unit