Sample observation device and sample observation method
11391935 · 2022-07-19
Assignee
Inventors
Cpc classification
G02B21/0072
PHYSICS
G02B21/367
PHYSICS
G02B21/008
PHYSICS
International classification
Abstract
In a sample observation device, when the angle formed by an optical axis of an emission optical system and a normal of a scanning surface is θ1 and the angle formed by an optical axis of an imaging optical system and the normal of the scanning surface is θ2, both θ1 and θ2 are 80° or less, and θ1+θ2 is 100° or more. In an image acquisition unit, an image acquisition region F.sub.n+1, m+1 in the (m+1)-th frame of the (n+1)-th pixel is shifted from an image acquisition region F.sub.n, m in the m-th frame of the n-th pixel in a scanning direction of a sample according to the scanning amount of the sample in the exposure time of one frame.
Claims
1. A device, comprising: an emission optical system configured to emit planar light to a sample; a scanner configured to scan the sample in one direction within a scanning surface so as to pass through an emission surface of the planar light; an imaging optical system configured to form an image of observation light generated in the sample by emission of the planar light; an image acquisition unit configured to have a plurality of pixels arranged in a two-dimensional manner and to acquire a plurality of pieces of image data corresponding to an optical image of the observation light formed by the imaging optical system; and an image generation unit configured to generate observation image data of the sample based on the plurality of pieces of image data acquired by the image acquisition unit, wherein, when an angle formed by an optical axis of the emission optical system and a normal of the scanning surface is θ1 and an angle formed by an optical axis of the imaging optical system and the normal of the scanning surface is θ2, both θ1 and θ2 are 80° or less and a sum of θ1 and θ2 is 100° or more, and in the image acquisition unit, an image acquisition region of an (n+1)-th pixel is shifted from an image acquisition region of an n-th pixel in a scanning direction of the sample according to a scanning amount of the sample in an exposure time of one frame.
2. The device according to claim 1, wherein both θ1 and θ2 are 70° or less, and the sum of θ1 and θ2 is 110° or more.
3. The device according to claim 1, further comprising: a sample container having, as the scanning surface, a surface serving as an input surface of the planar light and an output surface of the observation light.
4. The device according to claim 1, further comprising: an analyzer configured to analyze the observation image data and to generate an analysis result.
5. A method, comprising: emitting planar light to a sample using an emission optical system; scanning the sample in one direction within a scanning surface so as to pass through an emission surface of the planar light; forming an image of observation light, which is generated in the sample by emission of the planar light, using an imaging optical system; acquiring a plurality of pieces of image data corresponding to an optical image of the observation light formed in the image forming step using an image sensor having a plurality of pixels arranged in a two-dimensional manner; and generating observation image data of the sample based on the plurality of pieces of image data, wherein, when an angle formed by an optical axis of the emission optical system and a normal of the scanning surface is θ1 and an angle formed by an optical axis of the imaging optical system and the normal of the scanning surface is θ2, both θ1 and θ2 are 80° or less and a sum of θ1 and θ2 is 100° or more, and in the acquisition, an image acquisition region of an (n+1)-th pixel is shifted from an image acquisition region of an n-th pixel in a scanning direction of the sample according to a scanning amount of the sample in an exposure time of one frame.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
DESCRIPTION OF EMBODIMENTS
(11) Hereinafter, preferred embodiments of a sample observation device according to an aspect of the present disclosure will be described in detail with reference to the diagrams.
(12)
(13) Examples of the sample S as an observation target include human or animal cells, tissues, organs, animals or plants themselves, and plant cells and tissues. The sample S may be contained in a solution, a gel, or a substance having a refractive index different from that of the sample S.
(14) The light source 2 is a light source that outputs light L1 to be emitted to the sample S. Examples of the light source 2 include a laser light source, such as a laser diode and a solid-state laser light source. In addition, the light source 2 may be a light emitting diode, a super luminescent diode, or a lamp light source. The light L1 output from the light source 2 is guided to the emission optical system 3.
(15) The emission optical system 3 is an optical system that shapes the light L1 output from the light source 2 into the planar light L2 and emits the shaped planar light L2 to the sample S along an optical axis P1. In the present embodiment, the optical axis P1 of the emission optical system 3 matches the optical axis of the planar light L2. The emission optical system 3 is configured to include a light shaping element, such as a cylindrical lens, an axicon lens, or a spatial light modulator, and is optically coupled to the light source 2. The emission optical system 3 may be configured to include an objective lens. The planar light L2 formed by the emission optical system 3 is emitted to the sample S. In order to reduce the aberration, the emission optical system 3 may include an optical element, such as a prism. In the sample S to which the planar light L2 is emitted, observation light L3 is generated on the emission surface R of the planar light L2. The observation light L3 is, for example, fluorescence excited by the planar light L2, scattered light of the planar light L2, or diffused reflection light of the planar light L2.
(16) In the case of performing observation in the thickness direction of the sample S, it is preferable that the planar light L2 is thin planar light having a thickness of 2 mm or less in consideration of resolution. In addition, when the thickness of the sample S is very small, that is, when observing the sample S having a thickness equal to or less than the Z-direction resolution described later, the thickness of the planar light L2 does not affect the resolution. In this case, therefore, the planar light L2 having a thickness of more than 2 mm may be used.
(17) The scanning unit 4 is a mechanism for scanning the sample S with respect to the emission surface R of the planar light L2. In the present embodiment, the scanning unit 4 is configured by a moving stage 12 that moves a sample container 11 holding the sample S. The sample container 11 is, for example, a microplate, a slide glass, a petri dish, or the like and is transparent to the planar light L2 and the observation light L3. In the present embodiment, a microplate is exemplified. As shown in
(18) In arranging the sample S inside the well 13, the well 13 may be filled with a medium, such as water. The transparent member 15 has an input surface of the planar light L2 with respect to the sample S arranged in the well 13 and a bottom surface 15a as an output surface of the observation light L3 generated in the sample S by emission of the planar light L2. The bottom surface 15a forms a scanning surface K when the sample S is scanned by the scanning unit 4. In the present embodiment, the optical axis P1 of the emission optical system 3 is inclined at an angle θ1 with respect to a normal P3 of the scanning surface K. The material of the transparent member 15 is not particularly limited as long as this is a member transparent to the planar light L2, and is, for example, glass, quartz, or synthetic resin. In addition, the other end of the well 13 is open to the outside. The sample container 11 may be fixed to the moving stage 12.
(19) As shown in
(20) The imaging optical system 5 is an optical system that forms an image of the observation light L3 generated in the sample S by the emission of the planar light L2. As shown in
(21) As shown in
(22) The computer 7 is physically configured to include a memory such as a RAM and a ROM, a processor (arithmetic circuit) such as a CPU, a communication interface, a storage unit such as a hard disk, and a display unit such as a display. Examples of the computer 7 include a personal computer, a cloud server, and a smart device (a smartphone, a tablet terminal, and the like). The computer 7 functions as a controller that controls the operations of the light source 2 and the moving stage 12, an image generation unit 8 that generates observation image data of the sample S, and an analysis unit 10 that analyzes observation image data, by executing a program stored in the memory using the CPU of the computer system.
(23) The computer 7 as a controller receives an input of a measurement start operation by the user, and drives the light source 2, the moving stage 12, and the image acquisition unit 6 in synchronization with each other. In this case, the computer 7 may control the light source 2 so that the light source 2 continuously outputs the light L1 while the sample S is being moved by the moving stage 12, or ON/OFF of the output of the light L1 from the light source 2 may be controlled in accordance with the image capturing by the image acquisition unit 6. In addition, when the emission optical system 3 includes an optical shutter (not shown), the computer 7 may turn ON/OFF the emission of the planar light L2 to the sample S by controlling the optical shutter.
(24) In addition, the computer 7 as the image generation unit 8 generates observation image data of the sample S based on a plurality of pieces of image data generated by the image acquisition unit 6. For example, the image generation unit 8 configures three-dimensional data of the sample S based on the plurality of pieces of image data output from the image acquisition unit 6, and generates observation image data. The image generation unit 8 stores the generated observation image data and displays the generated observation image data on a monitor or the like according to a predetermined operation by the user.
(25) As shown in
(26) The computer 7 as the analysis unit 10 performs an analysis based on the observation image data 32 generated by the image generation unit 8 and generates an analysis result. The analysis unit 10 stores the generated analysis result and displays the generated analysis result on the monitor or the like according to a predetermined operation by the user. The observation image data generated by the image generation unit 8 may not be displayed on the monitor or the like, and only the analysis result generated by the analysis unit 10 may be displayed on the monitor or the like. In addition, the observation image data 32 generated by the image generation unit 8 may not be displayed on the monitor or the like, and only the analysis result generated by the analysis unit 10 may be displayed on the monitor or the like.
(27)
(28) In the emission step S01, the planar light L2 is emitted to the sample S. When the user inputs a measurement start operation, the light source 2 is driven based on a control signal from the computer 7, and the light L1 is output from the light source 2. The light L1 output from the light source 2 is shaped by the emission optical system 3 to become the planar light L2, which is emitted to the sample S.
(29) In the scanning step S02, the sample S is scanned with respect to the emission surface R of the planar light L2. When the user inputs a measurement start operation, the moving stage 12 is driven in synchronization with the driving of the light source 2 based on a control signal from the computer 7. Accordingly, the sample container 11 is linearly driven at a predetermined speed in the Y-axis direction, and the sample S in the well 13 is scanned with respect to the emission surface R of the planar light L2.
(30) In the image forming step S03, using the imaging optical system 5 having the observation axis P2 inclined with respect to the emission surface R, an image of the observation light L3 generated in the sample S by the emission of the planar light L2 is formed on the image forming surface of the image acquisition unit 6. In the image acquisition step S04, a plurality of pieces of image data corresponding to the optical image of the observation light L3 formed by the imaging optical system 5 are acquired. The image data is sequentially output from the image acquisition unit 6 to the image generation unit 8.
(31) In the image generation step S05, observation image data of the sample S is generated based on the plurality of pieces of image data. In the present embodiment, as shown in
(32) In the analysis step S06, the analysis unit 10 analyzes the observation image data 32 and generates an analysis result. For example, in drug discovery screening, the sample S and a reagent are put in the sample container 11, and the observation image data 32 is acquired. Then, the analysis unit 10 evaluates the reagent based on the observation image data 32, and generates evaluation data as an analysis result.
(33) Next, the configuration of the optical system of the sample observation device 1 and the generation of the observation image data 32 described above will be described in more detail.
(34) In the sample observation device 1, as shown in
(35) The upper limits of θ1 and θ2 are determined based on, for example, the transmittances of the planar light L2 and the observation light L3 with respect to the transparent member 15 of the sample container 11.
(36) From the result shown in
(37) In addition,
(38) In the image acquisition unit 6, as shown in a hatched portion in
(39) When the above-described relationship is satisfied, as shown in a dot portion in
(40)
[Equation 1]
Z.sub.reso=V′×cos θ.sub.1′ (1)
[Equation 2]
V=V′×sin θ.sub.1′ (2)
(41) In addition,
[Equation 3]
L=V/cos θ.sub.2 (3)
[Equation 4]
L′=L×cos θ.sub.2′ (4)
[Equation 5]
sin θ.sub.1′=(n1/n2)×sin θ.sub.1 (5)
[Equation 6]
sin θ.sub.2′=(n1/n2)×sin θ.sub.2 (6)
[Equation 7]
θ.sub.diff=|90−(θ.sub.1′+θ.sub.2′)| (7)
[Equation 8]
V′=L′/cos θ.sub.diff (8)
(42) When selecting the combination of θ1 and θ2 from the range of θ1 and θ2 shown in
(43) 1) As the value of θ.sub.diff decreases, the influence of defocus decreases.
(44) 2) As the value of Z.sub.reso, decreases, the resolution in the Z-axis direction in observation image data improves.
(45) 3) When the component of V′ in the Y-axis direction matches V, image acquisition regions of pixels adjacent to each other in the Z-axis direction are also adjacent to each other in the Y-axis direction, so that the positional relationship between the pieces of image data can be easily corrected.
(46) As described above, in the sample observation device 1, the optical axis P2 of the imaging optical system 5 is inclined with respect to the scanning surface K of the sample S. Therefore, since the image acquisition unit 6 can sequentially acquire the image data 31 of the tomographic plane in the optical axis P1 direction of the planar light L2, it is possible to acquire the image data 31 with high throughput. In addition, in the image acquisition unit 6, the image acquisition regions F in the adjacent pixels are shifted from each other according to the scanning amount V of the sample S in the exposure time of one frame. Therefore, since the positional relationship between the pieces of image data 31 can be easily corrected, each piece of image data 31 can be easily converted into three-dimensional data in the real space when constructing the observation image data 32.
(47) In addition, in the sample observation device 1, the optical axis P1 of the emission optical system 3 with respect to the scanning surface K is inclined within the range satisfying the conditions of θ1 and θ2. Therefore, since the influence of defocus is reduced, the resolution of the observation image data 32 in the depth direction can be sufficiently improved. When both θ1 and θ2 are 70° or less and the sum of θ1 and θ2 is 110° or more, the influence of defocus can be reduced more preferably.
(48) In addition, the sample observation device 1 also includes the sample container 11 having, as the scanning surface K, a surface serving as an input surface of the planar light L2 and an output surface of the observation light L3. By using such a sample container 11, it is possible to stably scan a plurality of samples S.
(49) In addition, the sample observation device 1 includes the analysis unit 10 that analyzes the observation image data 32 and generates an analysis result. As a result, the observation image data 32 generated by the image generation unit 8 can be analyzed by the analysis unit 10, so that the analysis throughput can also be improved.
(50) The present disclosure is not limited to the above-described embodiment. For example, in the above-described embodiment, the transparent member 15 is provided in the sample container 11 so as to close one end side of the well 13. However, the sample S may be held in a solid substance, such as gel, instead of the sample container 11. In addition, the sample S may be moved by flowing a fluid, such as water, into the transparent container as in a flow cytometer.
(51) In addition, a plurality of pairs of the imaging optical system 5 and the image acquisition unit 6 may be arranged. In this case, the observation range can be expanded, and observation light components L3 having a plurality of different wavelengths can be observed. In addition, a plurality of image acquisition units 6 may be arranged with respect to the imaging optical system 5, or the image acquisition unit 6 may be arranged with respect to a plurality of imaging optical systems 5. The plurality of image acquisition units 6 may be a combination of different types of photodetectors or imaging apparatuses. The light source 2 may be configured by a plurality of light sources that output light components having different wavelengths. In this case, excitation light components having different wavelengths can be emitted to the sample S.
(52) In addition, in order to reduce astigmatism, a prism may be arranged in the imaging optical system 5. In this case, for example, a prism may be arranged on the rear side of the objective lens 16 (between the objective lens 16 and the image acquisition unit 6). As a measure against defocus, the imaging surface of the imaging apparatus in the image acquisition unit 6 may be inclined with respect to the observation axis P2 of the imaging optical system 5. In addition to this, for example, a dichroic mirror or a prism may be arranged between the imaging optical system 5 and the image acquisition unit 6 for wavelength separation of the observation light L3.
REFERENCE SIGNS LIST
(53) 1: sample observation device, 3: emission optical system, 5: imaging optical system, 6: image acquisition unit, 8: image generation unit, 10: analysis unit, 11: sample container, 31: image data, 32: observation image data, F: image acquisition region, K: scanning surface, L2: planar light, L3: observation light, R: emission surface, P1: optical axis of emission optical system, P2: optical axis of imaging optical system, P3: normal of scanning surface, S: sample, V: scanning amount.