FLUORESCENCE OBSERVATION METHOD AND FLUORESCENCE OBSERVATION DEVICE
20170284937 · 2017-10-05
Assignee
Inventors
Cpc classification
A61B5/0059
HUMAN NECESSITIES
C09K2211/1044
CHEMISTRY; METALLURGY
A61B2576/00
HUMAN NECESSITIES
A61B10/00
HUMAN NECESSITIES
C09K11/00
CHEMISTRY; METALLURGY
International classification
Abstract
This fluorescence observation method is a method of observing a living organism into which a fluorescent dye is injected. The method includes the steps of: irradiating the living organism with excitation light including a wavelength for exciting the fluorescent dye using a light irradiation means, acquiring a first fluorescence image of the living organism generated by the irradiation with the excitation light using an image acquisition means, specifying an observation object in the living organism on the basis of the first fluorescence image; acquiring a second fluorescence image of the observation object generated by the irradiation with the excitation light using the image acquisition means; and specifying a linear fluorescence pattern appearing in the second fluorescence image.
Claims
1. A fluorescence observation method of observing a living organism into which a fluorescent dye is injected, the fluorescence observation method comprising the steps of: irradiating the living organism with excitation light including a wavelength for exciting the fluorescent dye using a light source; acquiring a first fluorescence image of the living organism generated by the irradiation with the excitation light using an image sensor; specifying an observation object in the living organism on the basis of the first fluorescence image; acquiring a second fluorescence image of the observation object generated by the irradiation with the excitation light using the image sensor; and specifying a linear fluorescence pattern appearing in the second fluorescence image.
2. The fluorescence observation method according to claim 1, wherein the second fluorescence image is an image acquired when one minute or more has elapsed from the injection of the fluorescent dye into the living organism.
3. The fluorescence observation method according to claim 1, wherein fluorescent light from the observation object and a part of background light are input to the image sensor using a light filter.
4. The fluorescence observation method according to claim 3, further comprising the step of: adjusting luminance of an image of fluorescence based on the fluorescent light from the observation object and an image of a background based on the part of the background light using an image processor.
5. A fluorescence observation device for observing a living organism into which a fluorescent dye is injected, the fluorescence observation device comprising: a light source configured to irradiate the living organism with excitation light including a wavelength for exciting the fluorescent dye; an image sensor configured to acquire a fluorescence image of the living organism generated by the irradiation with the excitation light; and an analyzer configured to specify an observation object in the living organism on the basis of the fluorescence image and specify a linear fluorescence pattern appearing in the fluorescence image of the observation object.
6. The fluorescence observation device according to claim 5, wherein the fluorescence image of the observation object is an image acquired when one minute or more has elapsed from the injection of the fluorescent dye into the living organism.
7. The fluorescence observation device according to claim 5, further comprising: a light filter configured to input fluorescent light from the observation object and a part of background light to the image sensor.
8. The fluorescence observation device according to claim 7, further comprising: an image processor configured to adjust luminance of an image of fluorescence based on the fluorescent light from the observation object and an image of a background based on the part of the background light.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0020]
[0021]
[0022]
[0023]
[0024]
DESCRIPTION OF EMBODIMENTS
[0025] Hereinafter, details of preferred embodiments of a fluorescence observation method and a fluorescence observation device according to the present invention will be described with reference to the drawings.
[0026]
[0027] The fluorescence observation device 1 is configured to include a light irradiation unit (a light irradiation means) 11, a light filter (a light control means) 12, an image acquisition unit (an image acquisition means) 13, and a controller 14. The light irradiation unit 11 includes a light source which outputs light (excitation light) including a wavelength for exciting the fluorescent dye. Also, the light irradiation unit 11 includes an optical system which irradiates the living organism S and the observation object K which is a part of the living organism S with light from the light source. An example of the light source includes a laser light source such as a laser diode, an LED, an SLD, and a lamp light source. The light irradiation unit 11 may include a single light source or a plurality of light sources.
[0028] The light filter 12 is an optical element which adjusts a wavelength of light incident on the image acquisition unit 13 and is arranged between the living organism S and the observation object K which is a part of the living organism S and the image acquisition unit 13.
[0029] If the indocyanine green is used as the fluorescent dye, a peak wavelength λ1 of the spectrum S1 of the excitation light is, for example, about 760 nm. Also, the wavelength band of the spectrum S2 of the fluorescent light is about 760 nm to 1000 nm and a peak wavelength λ2 is about 850 nm. Also, the spectrum S3 of the background light mainly has a peak in a visible band and is normally gradually reduced at an intensity which is less than that of the spectrum S2 of the fluorescent light at an infrared side.
[0030] If the long-pass filter is used as the light filter 12 with respect to the spectra S1 to S3, light of a wavelength greater than the wavelength λ3 between the peak wavelength λ1 and the peak wavelength λ2 is transmitted through the light filter 12. On the other hand, if the band-pass filter is used as the light filter 12, light of a wavelength band which is greater than a wavelength λ3 between the peak wavelength λ1 and the peak wavelength λ2 and is less than a wavelength λ4 of an edge on a long-wavelength side of the spectrum S2 of the fluorescent light is transmitted through the light filter 12. Therefore, regardless of whether the long-pass filter or the band-pass filter is used, the excitation light is shielded and the fluorescent light and a part of the background light are transmitted in the light filter 12.
[0031] The image acquisition unit 13 includes a light detector for acquiring a fluorescence image of the living organism S and the observation object K generated by the irradiation with the excitation light. For example, an area image sensor such as a CCD image sensor or a CMOS image sensor or a point sensor such as a photodiode or a photomultiplier tube is used as the light detector. The image acquisition unit 13 receives fluorescent light transmitted through the light filter 12 and acquires the fluorescence image of the living organism S and the observation object K. The image acquisition unit 13 outputs fluorescence image data including an image of fluorescence and an image of a background to the controller 14. The image acquisition unit 13 may acquire the fluorescence image of the living organism S or the observation object K as moving-image data or sill-image data.
[0032] The controller 14 is a computer system physically including a CPU, a memory, a communication interface, etc. or a hardware system constituted of a field-programmable gate array (FPGA) or a digital circuit. As illustrated in
[0033] The control unit 101 includes a control circuit which controls the light irradiation unit 11, the image acquisition unit 13, and the analysis unit 103. The control unit 101 receives an instruction of an output start of the excitation light by the light irradiation unit 11, an input of an image acquisition condition such as a frame rate or a contrast, or the like from the input unit 17 and controls operations of the light irradiation unit 11 and the image acquisition unit 13. Also, the control unit 101 receives start information indicating that the fluorescent dye is injected into the living organism S from the input unit 17 and instructs the analysis unit 103 to perform an operation when a predetermined time has elapsed from the input of the start information. The predetermined time is preset as any time of one minute or more.
[0034] The image processing unit 102 includes an image processing circuit for adjusting the luminance of the fluorescence image including the image of the background and the image of the fluorescence. More specifically, if fluorescence image data is received from the image acquisition unit 13, the image processing unit 102 acquires the fluorescence image by executing black level adjustment and gain adjustment on the fluorescence image data. The image processing unit 102 outputs the fluorescence image obtained by image processing to the analysis unit 103, the display unit 15, and the storage unit 16.
[0035]
[0036]
[0037] The analysis unit 130 includes an analysis processing circuit which specifies a linear fluorescence pattern appearing in the fluorescence image. When an instruction of execution of an operation is received from the control unit 101, the analysis unit 103 executes image analysis of the fluorescence image after image processing from the image processing unit 102. The timing at which the analysis unit 103 receives an instruction from the control unit 101 is when one minute or more has elapsed from the input of start information indicating that the fluorescent dye is injected into the observation object K to the control unit 101. Therefore, the fluorescent dye is introduced into the observation object K along with the passage of the time and, after a pattern corresponding to lymphedema first appears in the fluorescence image, the linear fluorescence pattern extending from the pattern appears.
[0038] The analysis unit 130 specifies a shape, a position, a direction, and the like of a lymphatic linear fluorescence pattern in the fluorescence image by the image analysis. The analysis unit 103 generates specification information indicating information thereof and adds the specification information to the fluorescence image to cause the fluorescence image to be displayed on the display unit 15 and cause the fluorescence image to be stored in the storage unit 16. The image analysis method used in the analysis unit 103 is not particularly limited, but it is possible to use, for example, a technique of recognizing a pattern of a time-variant luminance distribution, a technique of acquiring a difference image among a plurality of continuously acquired images, etc. Also, the control circuit of the control unit 101, the image processing circuit of the image processing unit 102, and the analysis processing circuit of the analysis unit 103 may be constituted of a single processor or a plurality of processors.
[0039] Next, a fluorescence observation method using the above-described fluorescence observation device 1 will be described.
[0040]
[0041] Also, the fluorescence observation method includes an excitation light irradiation step (step S9), an image acquisition step (step S10), and an image processing step (step S11) as the step of acquiring the fluorescence image in the step in which the lymphatic drainage path has appeared. Further, the fluorescence observation method includes a lymphatic drainage path specification step of specifying the lymphatic drainage path (step S12) and a drainage step of performing treatment based on the specified lymphatic drainage path (step S13).
[0042] In the fluorescent dye injection step (step S01), the fluorescent dye is injected into the living organism S. For example, a syringe is used in the injection of the fluorescent dye. In general, lymphedema occurs in limbs in many cases. In this case, an injection portion of the fluorescent dye is designated on the skin surface of a hand or a foot. When the injection of the fluorescent dye has been completed, the input unit 17 inputs the fact that the injection of the fluorescent dye has been completed to the fluorescence observation device 1. The injected fluorescent dye is introduced into a lymphatic vessel from the inside of the skin and gradually spreads to a portion in which lymphedema occurs according to a flow of lymph. Also, it is preferable to protect the injection portion using a tape, an adhesive plaster, or the like after the injection of the fluorescent dye. Thereby, it is possible to prevent an observation region from being contaminated due to the attachment of the fluorescent dye to another portion or an observer.
[0043] After the fluorescent dye is injected into the living organism S, the observation object K is first specified on the basis of the fluorescence image of the living organism S. In the excitation light irradiation step (step S02), the living organism S is irradiated with excitation light. The fluorescent dye injected into the living organism S is excited by the irradiation with the excitation light and fluorescent light is generated from the fluorescent dye introduced into the lymphatic vessel. In the image acquisition step (step S03), fluorescence image data is acquired by imaging the fluorescent light generated by the irradiation with the excitation light along with a part of the background light together.
[0044] In the image processing step (step S04), luminance adjustment of the fluorescence image data is performed and a fluorescence image (a first fluorescence image) including an image of a background of the living organism S and an image of fluorescence is acquired. In the luminance adjustment, a luminance level of the image of the fluorescence is increased while the luminance level of the image of the background is maintained at a low level by the black level adjustment and the gain adjustment (see
[0045] In the lymphedema portion specification step (step S05), the portion of the lymphedema in the living organism S is specified as the observation object K on the basis of the fluorescence image acquired in the image processing step (step S04). Here, the observer specifies the portion of the lymphedema on the basis of the fluorescence image displayed on the display unit 15. The observer may designate the portion of the lymphedema using the input unit 17 such as, for example, a mouse.
[0046] After the observation object K is specified, the fluorescence image of the observation object K is acquired in the step before the fluorescent dye is circulated in the lymphatic drainage path. In the excitation light irradiation step (step S6), the observation object K specified in the lymphedema portion specification step (step S05) is irradiated with the excitation light. According to the irradiation with the excitation light, the fluorescent dye in the observation object K is excited and fluorescent light is generated. Next, in the image acquisition step (step S07), a part of the background light from the observation object K and fluorescent light from the fluorescent dye in the observation object K are imaged together and fluorescence image data is acquired.
[0047] In the image processing step (step S08), the luminance adjustment of the fluorescence image data acquired in the image acquisition step (step S07) is performed and a fluorescence image (a third fluorescence image) including an image of a background of the observation object K and an image of fluorescence is acquired. In this luminance adjustment, as in the image processing step (step S04), the luminance level of the image of the fluorescence is increased while the luminance level of the image of the background is maintained low according to black level adjustment and gain adjustment (see
[0048] Further, the fluorescence image of the observation object K is acquired in the step in which the fluorescent dye is circulated in the lymphatic drainage path. In the excitation light irradiation step (step S09), the observation object K is irradiated with the excitation light. According to the irradiation with the excitation light, the fluorescent dye in the observation object K is excited and fluorescent fight is generated. In the image acquisition step (step S10), the background light from the observation object K and the fluorescent light from the fluorescent dye in the observation object K are imaged together and fluorescence image data is acquired.
[0049] In the image processing step (step S11), the luminance adjustment of the fluorescence image data acquired in the image acquisition step (step S10) is performed. In the luminance adjustment, as in the image processing step (step S04 and step S08), the luminance level of the image of the fluorescence is increased while the luminance level of the image of the background is maintained low according to black level adjustment and gain adjustment (see
[0050] The excitation light irradiation step (step S09) and the image acquisition step (step S10) are performed after a predetermined time of one minute or more has elapsed from the completion of injection of the fluorescent dye in the fluorescent dye injection step (step S01).
[0051] According to the passage of the predetermined time, the image acquisition step (step S10) is performed in a state in which the fluorescent dye is sufficiently introduced into a portion in which lymphedema occurs and the fluorescent dye is also sufficiently circulated in the lymphatic drainage path extending from the lymphedema to the normal lymphatic system. Therefore, the lymphatic drainage path appears as the fluorescence pattern linearly extending from the lymphedema in the obtained fluorescence image of the observation object K. Also, after the injection of the fluorescent dye in the fluorescent dye injection step, the massage or the like may be performed on the portion in which the lymphedema occurs to sufficiently introduce the fluorescent dye.
[0052] In the lymphatic drainage path specification step (step S12), a shape, a position, and a direction of the lymphatic drainage path are specified on the basis of the linear fluorescence pattern appearing in the fluorescence image. The specification of the lymphatic drainage path is performed by image analysis of the fluorescence image and the fluorescence image including specification information is stored in the fluorescence observation device 1. The fluorescence image after image processing is displayed on the display unit 15 in real time along with the specification information. At this time, because the image of the background is included in the fluorescence image, an indicator material such as a finger or a pen is close to the observation object K and a positional relationship between the actual lymphedema and the indicator material appears in the fluorescence image displayed on the display unit 15. Therefore, it is possible to easily visually recognize a shape, a position, and a direction of the lymphatic drainage path.
[0053] Also, in the lymphatic drainage path specification step (step S12), the observer may specify the linear fluorescence pattern appearing in the fluorescence image on the basis of the image of the observation object K displayed on the display unit 15. In this case, for example, each of the fluorescence image (the third fluorescence image) acquired in the image processing step (step S08) and the fluorescence image (the second fluorescence image) acquired in the image processing step (step S11) is displayed on the display unit 15 and the observer specifies the linear fluorescence pattern appearing in the fluorescence image by comparing the two images. Also, if the fluorescence image can be acquired by the image acquisition unit 13 in time series, the observer may specify the linear fluorescence pattern appearing in the fluorescence image on the basis of an extending direction of the fluorescence image by displaying a moving image thereof on the display unit 15.
[0054] In the drainage step, the vicinity of the lymphedema is massaged. In the drainage step, the living organism S is massaged from the lymphedema to the lymphatic drainage path on the basis of the shape, the position, and the direction of the lymphatic drainage path specified in the lymphatic drainage path specification step. Thereby, lymph in which a flow deteriorates in the vicinity of the lymphedema is drained to the normal lymphatic system via the lymphatic drainage path.
[0055] As described above, in the fluorescence observation device 1 and the fluorescence observation method, the observation object K which is lymphedema is specified on the basis of a fluorescence image of the living organism S obtained by irradiating the living organism S into which a fluorescent dye is injected with excitation light. Next, a linear fluorescence pattern appearing in the fluorescence image is specified on the basis of the fluorescence image of the observation object K obtained by irradiating the specified observation object K with the excitation light. Specifically, a linear fluorescence pattern appearing in the fluorescence image is specified by comparing a fluorescence image before the fluorescent dye is circulated in the lymphatic drainage path with a fluorescence image after the fluorescent dye is circulated in the lymphatic drainage path. The linear fluorescence pattern is a fluorescence pattern indicating the lymphatic drainage path along which lymph is drained from a portion in which lymphedema occurs to the normal lymphatic system. Therefore, it is possible to precisely recognize the lymphatic drainage path by specifying the linear fluorescence pattern.
[0056] Also, in the fluorescence observation device 1 and the fluorescence observation method, the acquisition of the fluorescence image of the observation object K is performed when at least one minutes has elapsed from the injection of the fluorescent dye into the living organism S. The analysis unit 103 specifies the linear fluorescence pattern when one minute or more has elapsed from the injection of the fluorescent dye into the living organism S. Thereby, it is possible to recognize the lymphatic drainage path more precisely because the linear fluorescence pattern in the fluorescence image appears clearly.
[0057] Also, in the fluorescence observation device 1 and the fluorescence observation method, fluorescent light from the living organism S and a part of background light are input to the image acquisition unit 13 by the light filter 12. Thereby, it is possible to capture an image of a background including an image of an indicator material such as a finger or a pen and an image of fluorescence together. The lymphatic drainage path is easily recognized on the basis of the specification of the linear fluorescence pattern when the indicator material is designated as a reference.
[0058] Further, in the fluorescence observation device 1 and the fluorescence observation method, the image processing unit 102 adjusts luminance of the image of the background and the image of the fluorescence in the fluorescence image. Thereby, the luminance of the linear fluorescence pattern in the fluorescence image is emphasized and the recognition of the lymphatic drainage path is further facilitated.
[0059]
[0060] The present invention is not limited to the above-described embodiment. For example, an example in which the light filter 12 which transmits fluorescent light from the living organism S and the observation object K and a part of background light is shown as a light control means in the above-described embodiment, but the light control means may be constituted of an optical element such as a dichroic mirror which reflects the fluorescent light from the living organism S and the observation object K and the part of background light and an optical system which guides the reflected light to the image acquisition unit 13. Also, an example in which light of a fluorescent lamp serves as the background light is shown in the above-described embodiment, but the background light may include reflected light or the like obtained by reflecting natural light or excitation light by the living organism S and the observation object K in addition to light of the fluorescent lamp.
[0061] Also, each of an image (a background image) of only an image of a background of the living organism S or the observation object K and a fluorescence image including the image of the background and the image of the fluorescence of the living organism S or the observation object K may be acquired by turning light irradiation ON/OFF by the light irradiation unit 11. In this case, the image processing unit 102 can acquire a difference image between the background image and the fluorescence image and acquire the fluorescence image including the image of the background and the image of the fluorescence by superimposing the difference image on the background image.
[0062] Also, in the fluorescence observation device 1, the light irradiation unit 11 and the image acquisition unit 13 may be configured integrally or separately.
REFERENCE SIGNS LIST
[0063] 1 Fluorescence observation device [0064] 11 Light irradiation unit (light irradiation means) [0065] 12 Light filter (light control means) [0066] 13 Image acquisition unit (image acquisition means) [0067] 102 Image processing unit (image processing means) [0068] 103 Analysis unit (analysis means) [0069] F4 Linear fluorescence pattern [0070] K Observation object