Rod Lens Relay System With Reduced Chromatic Aberration
20230236411 · 2023-07-27
Assignee
Inventors
Cpc classification
G02B27/005
PHYSICS
G02B27/0062
PHYSICS
H04N23/555
ELECTRICITY
International classification
G02B23/24
PHYSICS
A61B1/04
HUMAN NECESSITIES
G02B27/00
PHYSICS
Abstract
Improved fluoresced imaging (FI) endoscope devices and systems are provided to enhance use of endoscopes with FI and visible light capabilities. An endoscope device is provided for endoscopy imaging in a white light and a fluoresced light mode. A relay system includes an opposing pair of rod lens assemblies positioned symmetrically with respect to a central airspace. The rod lens assemblies include a meniscus lens positioned immediately adjacent to a central airspace and with the convex surface facing the airspace, a first lens having positive power with a convex face positioned adjacent to the inner face of the meniscus lens, a rod lens adjacent to the first lens having positive power and an outer optical manipulating structure selected from various designs providing chromatic aberration correction.
Claims
1. A relay system for an endoscope comprising: an opposing pair of rod lens assemblies positioned symmetrically with respect to a central airspace, wherein each rod lens assembly includes optical elements consisting essentially of: a meniscus lens positioned immediately adjacent to a central airspace and with the convex surface facing the airspace; a first lens having positive power with a convex face positioned adjacent to the inner face of the meniscus lens, the first lens formed of a material having anomalous partial dispersion; a rod lens, adjacent to the first lens having positive power, having a first face and a second face, both first and second faces being beam passing faces; and an outer optical manipulating structure selected from the group consisting of: (i) the second face of the rod lens, being plano, positioned adjacent to a plano-convex lens, the convex surface thereof being aspheric; (ii) the second face of the rod lens, being plano, positioned adjacent to a positive powered lens having a convex face facing the second plano face of the rod lens with a separation gap; and (iii) the second face of the rod lens, being plano, positioned adjacent to a second plano convex lens; wherein the meniscus lens, the first lens having positive power, the rod lens, and the outer optical manipulating structure together provide chromatic aberration correction by manipulating light from across an entire spectrum, from the blue region through the near infrared (NIR) region, to follow the same sequence of optical surfaces and come to a common focus in a common image plane.
2. The relay system of claim 1, wherein the first lens having positive power is plano-convex.
3. The relay system of claim 1, wherein the first lens having positive optical power is manufactured from a material having an Abbe number equal to or greater than 80.
4. The relay system of claim 1, wherein the outer optical manipulating structure is the second plano face of the rod lens positioned adjacent to a plano-convex aspherical lens.
5. The relay system of claim 4, wherein each rod lens assembly has no additional optical manipulating elements other than the those listed.
6. The relay system of claim 1, wherein the outer optical manipulating structure is the second plano face of the rod lens positioned adjacent to a second plano convex lens.
7. The relay system of claim 6, wherein each rod lens assembly has no additional optical manipulating elements other than the those listed.
8. The relay system of claim 1, wherein the relay system is also corrected for astigmatism.
9. The relay system of claim 1, wherein the meniscus lens is constructed of a crown glass having a refractive index less than 1.65 and an Abbe number between 55 and 75.
10. The relay system of claim 1, wherein the chromatic aberration correction is provided for the entire spectrum from approximately 400 nm to 900 nm.
11. The relay system of claim 1, wherein the pair of rod lens assemblies is arranged around an air space containing an aperture stop.
12. The relay system of claim 1, further comprising an endoscope containing the relay system.
13. The relay system of claim 1, wherein the first and second faces of the rod lens are plano.
14. A relay system for an endoscope comprising: an opposing pair of rod lens assemblies positioned symmetrically with respect a central air space, wherein each rod lens assembly comprises: a meniscus lens positioned adjacent to the opposing rod lens assembly; a first lens having positive optical power with a convex face positioned adjacent to an inner face of the meniscus lens; a rod lens positioned adjacent to the first plano-convex lens; and a single outer lens; wherein the meniscus lens, the first lens having positive optical power, the rod lens, and the single outer lens together are sufficient to manipulate light to provide chromatic aberration correction by manipulating light from across an entire spectrum from the blue region of the spectrum through the near infrared (NIR) region of the spectrum, to follow the same sequence of optical surfaces through the relay system and come to a common focus in a common image plane.
15. The relay system of claim 14, wherein each rod lens assembly has no additional optical manipulating elements other than the those listed.
16. The relay system of claim 14, wherein the meniscus lens is constructed of a crown glass having a refractive index less than 1.65 and an Abbe number between 55 and 75.
17. The relay system of claim 14, wherein the chromatic aberration correction is provided throughout a spectrum from approximately 400 nm to 900 nm.
18. The relay system of claim 14, further comprising an endoscope containing the relay system.
19. The relay system of claim 14, wherein first and second faces of the rod lens are plano.
20. The relay system of claim 14, wherein the relay system is also corrected for astigmatism.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0033] The present invention will become more fully understood from the detailed description given herein and the accompanying drawings which are given by way of illustration only, and thus are not limitative of the present invention, and wherein:
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS
[0052] As used herein, first elements (e.g., sensors and lenses) that are “optically arranged” in relation to other elements, refers to the first elements' position along a common optical path that includes first and other elements. For example, a lens group optically arranged between an image sensor and an objective, means that the lens group occupies a portion of the optical path that light travels (e.g., from the objective to the image sensor) for capturing images or video.
[0053] Because digital cameras and FI sensors and related circuitry for signal capture and processing are well-known, the present description will be directed in particular to elements forming part of, or cooperating more directly with, a method and apparatus in accordance with the invention. Elements not specifically shown or described herein are selected from those known in the art. Certain aspects of the embodiments to be described are provided in software. Given the system as shown and described according to the invention in the following materials, software not specifically shown, described or suggested herein that is useful for implementation of the invention is conventional and within the ordinary skill in such arts.
[0054]
[0055] Rod lens relay system 107 functions to compensate for the chromatic aberration of the endoscope's multiple lenses such that a first portion of light having a first wavelength spectrum and a second portion of light having a second wavelength spectrum different from the first are focused onto substantially the same image plane. Assembly 214 is positioned within a telecentric internal image space proximal to rod lens relay system 107. Second lens group 214 is preferably positioned within the proximal element 101 of device 100, but may partially span the volume of the shaft 102 and the proximal element 101 or may be an element of the camera head or eyepiece 216.
[0056] Typically, rod lens relay system 107 is integrated with endoscope device 100, and, in particular, the shaft 102, and is designed to correct for chromatic aberrations. As further described below, some embodiments also provide astigmatism correction. The eyepiece, or the image sensor assembly and its associated electronics (together constituting a camera) may be integrated with the device or may be separate and detachable, such as a detachable eyepiece or a detachable camera head. In various embodiments the invention may therefore constitute an endoscopic device or an imaging system including an endoscopic device 100.
[0057]
[0058] Each rod lens assembly 301, according to this embodiment, includes a meniscus lens 302 positioned adjacent to the opposing rod lens assembly. A first plano-convex lens 304 has a convex face positioned adjacent to an inner face of meniscus lens 302 and a planar face at the opposite side. Other lenses may be used instead of a plano-convex lens. A rod lens 306 has a first plano surface positioned adjacent to the plano face of first plano-convex lens 304.
[0059] At the opposing, outer end of rod lens 306 is an outer optical manipulating structure which in this embodiment includes a second concave face of rod lens 306 positioned adjacent to a second plano-convex lens 308 having a convex face facing the second concave face of rod lens 306.
[0060] A light ray diagram is shown showing the path taken by light 310 passing from an object plane depicted on the left to an image plane depicted on the right. Meniscus lens 302, first plano-convex lens 304, rod lens 306, and the outer optical manipulating structure together perform chromatic aberration correction by manipulating light 310 of a spectrum from the blue region through the near IR region to have substantially the same effective optical path length and thus come to a common focus at a common image plane, allowing for simultaneous imaging throughout the spectrum. Each rod lens assembly 301 has no additional optical manipulating elements other than the those listed which together provide a chromatic aberration correction sufficient to allow simultaneous imaging of visible and IR spectrum light at the depicted common imaging plane, or sequential or separate imaging without refocusing adjustments for the visible and IR spectra. The amount of chromatic aberration correction may vary depending on the materials, sizes, and curvatures of the various optical manipulating elements. Depending on the f-number of the system, the amount of correction in focal position due to chromatic aberration sufficient to allow simultaneous imaging across the IR and visible spectrum may be less than about 15 micrometers shift across the spectral range of 400 nm to 900 nm. Additionally, depending on the number of relays in a system, this correction in focal position may vary, as associated errors accumulate over multiple relays. More preferably, a correction to a total aberration of 10 micrometers of focal shift across that range is achievable with certain embodiments employing the relay system of
[0061] Meniscus lens 302 is preferably constructed with a crown glass having a refractive index less than 1.65 and an Abbe number between 55 and 75. Preferably, the first positive power lens 304, which is typically a plano-convex lens but may be another positive power lens, is constructed of a material having anomalous partial dispersion. The material of the first positive power lens 304 preferably has a lower refractive index and higher Abbe number than the material of the rod lens. For example, various types of crown glass may be used such as phosphate glasses or fluorophosphate glasses. A relatively high Abbe number is preferably used such as 55 or over. For example, various versions may employ crown glass with an Abbe number of 65, 70, 75, 80, or 85. For example, first positive power lens 304 has an Abbe number of 81.54 in some embodiments. Optical properties of the surface elements of one possible implementation of the embodiment shown in
TABLE-US-00001 TABLE 1 Surface Data Summary for one implementation of the embodiment FIG. 3 Surface Radius Thickness Index Abbe no. Clear Diam Obj Infinity 3.302 Air 4.20 1 Infinity 2.0 1.847 23.78 6.48 2 −7.2169 43.532 1.618 49.82 6.48 3 Infinity 2.5 1.497 81.55 6.48 4 −6.0591 1.4 1.522 59.48 6.48 5 −15.8891 0.25 Air 6.48 STO Infinity 0.25 Air 4.5857 7 15.8891 1.4 1.522 59.48 6.48 8 6.0591 2.5 1.497 81.55 6.48 9 Infinity 43.532 1.618 49.82 6.48 10 7.2169 2.0 1.847 23.78 6.48 11 Infinity 3.302 Air 6.48 IMA Infinity 4.2217
[0062] In this embodiment, as well as the embodiments described below with respect to
[0063]
[0064]
[0065] Each rod lens assembly 501 includes a meniscus lens 302 and a first plano-convex lens 304, or other positive power lens, similar to those described with respect to
[0066] Meniscus lens 302, first plano-convex lens 304, rod lens 506, and the outer optical manipulating structure together perform chromatic aberration correction by manipulating light 510 in the blue region of the spectrum through the near IR region of the spectrum to have the same effective optical path length so as to come to a common focus at a common image plane. Each rod lens assembly 501 has no additional optical manipulating elements other than the those listed which together provide a chromatic aberration correction sufficient to allow simultaneous imaging of visible and IR spectrum light at the depicted common imaging plane, or sequential or separate imaging without refocusing adjustments for the visible spectrum and IR. Optical properties of the surface elements of an implementation of the embodiment shown in
TABLE-US-00002 TABLE 2 Surface Data Summary for one implementation of the embodiment shown in FIG. 5 Surface Radius Thickness Index Abbe no. Clear Diam Obj Infinity 6.0 Air 4.2 1 13.2864 2.0 1.847 23.78 6.48 2 6.5539 44.835 1.618 49.82 6.48 3 Infinity 2.5 1.497 81.55 6.48 4 −5.8150 1.4 1.512 70.86 6.48 5 −17.8746 0.25 Air 6.48 STO Infinity 0.25 Air 5.3157 7 17.8746 1.4 1.512 70.86 6.48 8 5.8150 2.5 1.497 81.55 6.48 9 Infinity 44.835 1.618 49.82 6.48 10 −6.5539 2.0 1.847 23.78 6.48 11 −13.2864 6.0 Air 6.48 IMA Infinity 4.2209
[0067]
[0068]
[0069] A light ray diagram is overlaid on the diagram showing light passing from the object plane depicted on the left to an image plane depicted on the right. As with the other embodiments herein, additional pairs rod lens assemblies 701 may be placed end to end with the depicted pair of assemblies, with the image plane at which an image is measured with a sensor positioned after the final pair of rod lens assemblies.
[0070] Each rod lens assembly 701 includes a meniscus lens 302 and a first plano-convex lens 304, or other positive power lens, similar to those described with respect to
[0071] Meniscus lens 302, first plano-convex lens 304, rod lens 706, and the outer optical manipulating structure together perform chromatic aberration correction by manipulating light 710 in the blue region of the spectrum through the near IR region of the spectrum to have the same effective optical path length, and thus come to a common focus at a common image plane. Each rod lens assembly 701 has no additional optical manipulating elements other than the those listed which together provide a chromatic aberration correction sufficient to allow simultaneous imaging of visible and IR spectrum light at the depicted common imaging plane, or sequential or separate imaging without refocusing adjustments for the visible spectrum and IR. Optical properties of the surface elements of an implementation of the embodiment shown in
TABLE-US-00003 TABLE 3 Surface Data Summary for one implementation of the embodiment shown in FIG. 7 Clear Surface Radius Thickness Index Abbe no. Diam Conic Obj Infinity 6.995 Air 4.2 0 1 20.8646 2.0 1.717 29.52 6.48 −5.6347 2 Infinity 41.805 1.618 49.82 6.48 0 3 Infinity 2.5 1.529 76.98 6.48 0 4 −5.5174 1.4 1.540 59.71 6.48 0 5 −19.4448 0.3 Air 6.48 0 STO Infinity 0.3 Air 4.5372 0 7 19.4448 1.4 1.540 59.71 6.48 8 5.5174 2.5 1.529 76.98 6.48 0 9 Infinity 41.805 1.618 49.82 6.48 0 10 Infinity 2.0 1.717 29.52 6.48 0 11 −20.8646 6.995 Air 6.48 −5.6347 IMA Infinity 4.2247 0
[0072]
[0073]
[0074] A light ray diagram is overlaid on the diagram showing light passing from the object plane depicted on the left to an image plane depicted on the right. Additional pairs rod lens assemblies 901 may be placed end to end with the depicted pair of assemblies, with the image plane at which an image is measured with a sensor positioned after the final pair of rod lens assemblies.
[0075] Each rod lens assembly 901 includes a meniscus lens 302 and a first plano-convex lens 304, or other positive power lens, like those of
[0076] Meniscus lens 302, first plano-convex lens 304, rod lens 906, and the outer optical manipulating structure 908 together perform chromatic aberration correction by manipulating light 910 in the blue region of the spectrum through the near IR region of the spectrum to have the same effective optical path length, and thus and come to a common focus at a common image plane. Each rod lens assembly 901 has no additional optical manipulating elements other than the those listed which together provide a chromatic aberration correction sufficient to allow simultaneous imaging of visible and IR spectrum light at the depicted common imaging plane, or sequential or separate imaging without refocusing adjustments for the visible spectrum and IR. Optical properties of the surface elements of an implementation of the embodiment shown in
TABLE-US-00004 TABLE 4 Surface data summary for one implementation of the embodiment shown in FIG. 9 Surface Radius Thickness Index Abbe no. Clear Diam Obj Infinity 4.553 Air 4.2 1 Infinity 2.0 1.923 18.90 6.48 2 −27.8072 2.284 Air 6.48 3 Infinity 39.966 1.618 49.82 6.48 4 Infinity 2.5 1.497 81.55 6.48 5 −6.2398 1.4 1.523 59.48 6.48 6 −16.6953 0.25 Air 6.48 STO Infinity 0.25 Air 4.5853 8 16.6953 1.4 1.523 59.48 6.48 9 6.2398 2.5 1.497 81.55 6.48 10 Infinity 39.996 1.618 49.82 6.48 11 Infinity 2.284 Air 6.48 12 27.8073 2.0 1.923 18.90 6.48 13 Infinity 4.553 Air 6.48 IMA Infinity 4.2233
[0077]
[0078]
TABLE-US-00005 TABLE 5 Alternative surface data summary for one implementation of the embodiment shown in FIG. 9 Surface Radius Thickness Index Abbe no. Clear Diam Obj Infinity 6.3133 Air 4.2 1 102.5046 2.0 1.923 18.90 6.48 2 −34.8825 0.25 Air 6.48 3 Infinity 40.2717 1.620 36.37 6.48 4 Infinity 2.5 1.497 81.55 6.48 5 −6.2200 1.4 1.522 59.48 6.48 6 −17.0677 0.25 Air 6.48 STO Infinity 0.25 Air 4.3345 8 17.0677 1.4 1.522 59.48 6.48 9 6.2200 2.5 1.497 81.55 6.48 10 Infinity 40.2717 1.620 36.37 6.48 11 Infinity 0.25 Air 6.48 12 34.8825 2.0 1.923 18.90 6.48 13 −102.5046 6.3133 Air 6.48 IMA Infinity 4.2
[0079]
[0080] A light ray diagram is overlaid on the diagram showing light passing from the object plane depicted on the left to an image plane depicted on the right. Additional pairs rod lens assemblies 1201 may be placed end to end with the depicted pair of assemblies, with the image plane at which an image is measured with a sensor positioned after the final pair of rod lens assemblies.
[0081] Each rod lens assembly 1201 includes a meniscus lens 302 and a positive power lens such as first plano-convex lens 304 like that of
[0082] Meniscus lens 302, first plano-convex lens 304, rod lens 1206, and the outer optical manipulating structure together perform chromatic aberration correction by manipulating light 1210 in the blue region of the spectrum through the near IR region of the spectrum to have substantially the same effective optical path length, and therefore come to a common focus at a common image plane. Each rod lens assembly 1201 has no additional optical manipulating elements other than the those listed which together provide a chromatic aberration correction sufficient to allow simultaneous imaging of visible and IR spectrum light at the depicted common imaging plane, or separate or sequential imaging without refocusing adjustments for the visible spectrum and IR.
[0083]
TABLE-US-00006 TABLE 6 Surface Data Summary for one implementation of the embodiment shown in FIG. 12 Surface Radius Thickness Index Abbe no. Clear Diam Obj Infinity 7.257 Air 4.2 1 21.3368 2.0 1.717 29.52 6.48 2 Infinity 41.543 1.618 49.82 6.48 3 Infinity 2.5 1.529 76.98 6.48 4 −5.4641 1.4 1.540 59.71 6.48 5 −19.5366 0.3 Air 6.48 STO Infinity 0.3 Air 4.5429 7 19.5366 1.4 1.540 59.71 6.48 8 5.4641 2.5 1.529 76.98 6.48 9 Infinity 41.543 1.618 49.82 6.48 10 Infinity 2.0 1.718 29.52 6.48 11 −21.3368 7.257 Air 6.48 IMA Infinity 4.2695
TABLE-US-00007 TABLE 7 Surface Data Summary for an alternative implementation of the embodiment shown in FIG. 12 Surface Radius Thickness Index Abbe no. Clear Diam Obj Infinity 4.716 Air 4.2 1 25.0813 2.0 1.801 34.97 6.48 2 Infinity 44.083 1.618 49.82 6.48 3 Infinity 2.5 1.439 94.66 6.48 4 −7.6413 1.4 1.569 63.10 6.48 5 −13.1283 0.3 Air 6.48 STO Infinity 0.3 Air 4.8458 7 13.1283 1.4 1.569 63.10 6.48 8 7.6413 2.5 1.439 94.66 6.48 9 Infinity 44.083 1.618 49.82 6.48 10 Infinity 2.0 1.801 34.97 6.48 11 −25.0813 4.716 Air 6.48 IMA Infinity 4.2545
[0084]
[0085] A light ray diagram is overlaid on the diagram showing light passing from the object plane depicted on the left to an image plane depicted on the right. Additional pairs rod lens assemblies 1501 may be placed end to end with the depicted pair of assemblies, with the image plane at which an image is measured with a sensor positioned after the final pair of rod lens assemblies.
[0086] Each rod lens assembly 1501 includes a meniscus lens 302 and a positive power lens such as first plano-convex lens 304 like that of
[0087] Meniscus lens 302, first plano-convex lens 304, rod lens 1506, and the outer optical manipulating structure together perform chromatic aberration correction by manipulating light 1510 in the blue region of the spectrum through the near IR region of the spectrum to have the same effective optical path length, and thus come to a common focus at a common image plane. Each rod lens assembly 1501 has no additional optical manipulating elements other than the those listed which together provide a chromatic aberration correction sufficient to allow simultaneous imaging of visible and IR spectrum light at the depicted common imaging plane, or separate or sequential imaging without refocusing adjustments for the visible spectrum and IR.
[0088]
TABLE-US-00008 TABLE 8 Surface Data Summary for one implementation of the embodiment shown in FIG. 15 Surface Radius Thickness Index Abbe no. Clear Diam Obj Infinity 6.0 Air 4.2 1 23.0368 55.533 1.618 49.82 6.48 2 Infinity 2.5 1.497 81.55 6.48 3 −6.6931 1.4 1.512 64.98 6.48 4 −20.6228 0.25 Air 6.48 STO Infinity 0.25 Air 5.7193 6 20.6228 1.4 1.512 64.98 6.48 7 6.6931 2.5 1.497 81.55 6.48 8 Infinity 55.533 1.618 49.82 6.48 9 −23.0368 6.0 Air 6.48 IMA Infinity 4.2557
TABLE-US-00009 TABLE 9 Surface Data Summary for one implementation of the embodiment shown in FIG. 15 Surface Radius Thickness Index Abbe no. Clear Diam Obj Infinity 6.0 Air 4.2 1 18.2447 42.835 1.620 36.37 6.48 2 Infinity 2.5 1.497 81.55 6.48 3 −6.2847 1.4 1.525 64.67 6.48 4 −16.6115 0.25 Air 6.48 STO Infinity 0.25 Air 4.5273 6 16.6115 1.4 1.525 64.67 6.48 7 6.2847 2.5 1.497 81.55 6.48 8 Infinity 42.835 1.620 36.37 6.48 9 −18.2447 6.0 Air 6.48 IMA Infinity 4.2720
[0089] Referring to
[0090] As shown in the diagram of an endoscope device system, a light source 8 illuminates subject scene 9 with visible light and/or fluorescent excitation light, which may be outside the visible spectrum in the ultra-violet range or the infra-red/near infrared range, or both. Light source 8 may include a single light emitting element configured to provide light throughout the desired spectrum, or a visible light emitting element and a one or more fluorescent excitation light emitting elements. Further, light source 8 may include fiber optics passing through the body of the scope, or other light emitting arrangements such as LEDs or laser diodes positioned at or near the front of the scope.
[0091] As shown in the drawing, light 10 reflected from (or, alternatively, as in the case of fluorescence, excitation light 8 absorbed and subsequently emitted by) the subject scene is input to an optical assembly 11, where the light is focused to form an image at a solid-state image sensor(s) 222 and/or fluoresced light sensor(s) 223.
[0092] Optical assembly 11 includes an optical relay system constructed according to the techniques provided herein. For example, the embodiments of
[0093] Of course, alternate implementations of the present inventive relay lens systems are possible. For example, optical assembly 11 may include a dichroic beam splitting element and may direct one band of the spectra to one sensor for visual imaging and another band to another sensor for fluorescence imaging. As the present invention enables a scope side solution to the problems associated with chromatic aberration in relay systems, the camera head image sensor assembly 28 need not be adjusted to assure both visible and FI images are in focus.
[0094] The image sensor 222 and fluoresced light sensor 223 may be active pixel complementary metal oxide semiconductor sensor (CMOS APS) or a charge-coupled device (CCD).
[0095] The total amount of light 10 reaching the image sensor 222 and/or fluoresced light sensor 223 is regulated by the light source 8 intensity, the optical assembly 11 aperture, and the time for which the image sensor 222 and fluoresced light sensor 223 integrates charge. An exposure controller 40 responds to the amount of light available in the scene given the intensity and spatial distribution of digitized signals corresponding to the intensity and spatial distribution of the light focused on image sensor 222 and fluoresced light sensor 223.
[0096] Exposure controller 40 also controls the emission of fluorescent excitation light from light source 8, and may control the visible and fluorescent light emitting elements to be on at the same time, or to alternate to allow fluoresced light frames to be captured in the absence of visible light if such is required by the fluorescent imaging scheme employed. Exposure controller 40 may also control the optical assembly 11 aperture, and indirectly, the time for which the image sensor 222 and fluoresced light sensor 223 integrate charge. The control connection from exposure controller 40 to timing generator 26 is shown as a dotted line because the control is typically indirect.
[0097] Typically, exposure controller 40 has a different timing and exposure scheme for each of sensors 222 and 223. Due to the different types of sensed data, the exposure controller 40 may control the integration time of the sensors 222 and 223 by integrating sensor 222 up to the maximum allowed within a fixed 60 Hz or 50 Hz frame rate (standard frame rates for USA versus European video, respectively), while the fluoresced light sensor 223 may be controlled to vary its integration time from a small fraction of sensor 222 frame time to many multiples of sensor 222 frame time. The frame rate of sensor 222 will typically govern the synchronization process such that images frames based on sensor 223 are repeated or interpolated to synchronize in time with the 50 or 60 fps rate of sensor 222.
[0098] Analog signals from the image sensor 222 and fluoresced light sensor 223 are processed by analog signal processor 22 and applied to analog-to-digital (A/D) converter 24 for digitizing the analog sensor signals. The digitized signals each representing streams of images or image representations based on the data, are fed to image processor 30 as image signal 27, and first fluorescent light signal 29. For versions in which the image sensor 222 also functions to detect the fluoresced light, fluoresced light data is included in the image signal 27, typically in one or more of the three color channels.
[0099] Image processing circuitry 30 includes circuitry performing digital image processing functions to process and filter the received images as is known in the art. Image processing circuitry may include separate, parallel pipelines for processing the visible light image data and the FI image data separately. Such circuitry is known in the art and will not be further described here.
[0100] Image processing circuitry 30 may provide algorithms, known in the art, for combining visible light imagery with FI imagery in a combined image display, and further highlighting or emphasizing the FI imagery for easily distinguishing the presence of fluorescing features in the image.
[0101] Timing generator 26 produces various clocking signals to select rows and pixels and synchronizes the operation of image sensor 222 and fluorescent sensor 223, analog signal processor 22, and A/D converter 24. Image sensor assembly 28 includes the image sensor 222 and fluorescent sensor 223, adjustment control 20, the analog signal processor 22, the A/D converter 24, and the timing generator 26. The functional elements of the image sensor assembly 28 can be fabricated as a single integrated circuit as is commonly done with CMOS image sensors or they can be separately-fabricated integrated circuits.
[0102] The system controller 50 controls the overall operation of the image capture device based on a software program stored in program memory 54. This memory can also be used to store user setting selections and other data to be preserved when the camera is turned off.
[0103] System controller 50 controls the sequence of data capture by directing exposure controller 40 to set the light source 8 intensity, the optical assembly 11 aperture, and controlling various filters in optical assembly 11 and timing that may be necessary to obtain image streams based on the visible light and fluoresced light. In some versions, optical assembly 11 includes an optical filter configured to attenuate excitation light and transmit the fluoresced light. A data bus 52 includes a pathway for address, data, and control signals.
[0104] Processed image data are continuously sent to video encoder 80 to produce a video signal. This signal is processed by display controller 82 and presented on image display 88. This display is typically a liquid crystal display backlit with light-emitting diodes (LED LCD), although other types of displays are used as well. The processed image data can also be stored in system memory 56 or other internal or external memory device.
[0105] The user interface 60, including all or any combination of image display 88, user inputs 64, and status display 62, is controlled by a combination of software programs executed on system controller 50. User inputs typically include some combination of typing keyboards, computer pointing devices, buttons, rocker switches, joysticks, rotary dials, or touch screens. The system controller 50 manages the graphical user interface (GUI) presented on one or more of the displays (e.g. on image display 88). In particular, the system controller 50 will typically have a mode toggle user input (typically through a button on the endoscope or camera head itself, but possibly through a GUI interface), and in response transmit commands to adjust image processing circuitry 30 based on predetermined setting stored in system memory. Preferably a system employed with any of the device designs herein provides ability to toggle between at least two modes, visible light and FI modes, and more preferably a combined mode is included in which FI images are combined or overlaid with visible images in a suitable manner known in the art. Such settings may include different settings for different models of scopes that may be attached to a camera head or other imaging device containing image sensor assembly 28.
[0106] Image processing circuitry 30 is one of three programmable logic devices, processors, or controllers in this embodiment, in addition to a system controller 50 and the exposure controller 40. Image processing circuitry 30, controller 50, exposure controller 40, system and program memories 56 and 54, video encoder 80 and display controller 82 may be housed within camera control unit (CCU) 70.
[0107] CCU 70 may be responsible for powering and controlling light source 8, image sensor assembly 28, and/or optical assembly 11. In some versions, a separate front end camera module may perform some of the image processing functions of image processing circuitry 30.
[0108] Although this distribution of imaging device functional control among multiple programmable logic devices, processors, and controllers is typical, these programmable logic devices, processors, or controllers can be combinable in various ways without affecting the functional operation of the imaging device and the application of the invention. These programmable logic devices, processors, or controllers can comprise one or more programmable logic devices, digital signal processor devices, microcontrollers, or other digital logic circuits. Although a combination of such programmable logic devices, processors, or controllers has been described, it should be apparent that one programmable logic device, digital signal processor, microcontroller, or other digital logic circuit can be designated to perform all of the needed functions. All of these variations can perform the same function and fall within the scope of this invention.
[0109] As used herein the terms “comprising,” “including,” “carrying,” “having” “containing,” “involving,” and the like are to be understood to be open-ended, that is, to mean including but not limited to. Any use of ordinal terms such as “first,” “second,” “third,” etc., in the claims to modify a claim element does not by itself connote any priority, precedence, or order of one claim element over another, or the temporal order in which acts of a method are performed. Rather, unless specifically stated otherwise, such ordinal terms are used merely as labels to distinguish one claim element having a certain name from another element having a same name (but for use of the ordinal term).
[0110] The foregoing has outlined rather broadly the features and technical advantages of the invention in order that the detailed description of the invention that follows may be better understood. It should be appreciated by those skilled in the art that the conception and specific embodiments disclosed may be readily utilized as a basis for modifying or designing other structures for carrying out the same purposes of the invention. It should also be realized by those skilled in the art that such equivalent constructions do not depart from the scope of the invention as set forth in the appended claims.
[0111] Although the invention and its advantages have been described in detail, it should be understood that various changes, substitutions and alterations can be made herein without departing from the scope of the invention as defined by the appended claims. The combinations of features described herein should not be interpreted to be limiting, and the features herein may be used in any working combination or sub-combination according to the invention. This description should therefore be interpreted as providing written support, under U.S. patent law and any relevant foreign patent laws, for any working combination or some sub-combination of the features herein.
[0112] Moreover, the scope of the present application is not intended to be limited to the particular embodiments of the process, machine, manufacture, composition of matter, means, methods and steps described in the specification. As one of ordinary skill in the art will readily appreciate from the disclosure of the invention, processes, machines, manufacture, compositions of matter, means, methods, or steps, presently existing or later to be developed that perform substantially the same function or achieve substantially the same result as the corresponding embodiments described herein may be utilized according to the invention. Accordingly, the appended claims are intended to include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or steps.