Abstract
A handheld surgical endoscope has a disposable, single-use portion that includes a and a re-usable portion that includes a handle and display module. The distal tip includes LED illumination and an imaging module that feeds live video to the display module. The imaging module includes a lens system of no more than two lenses and provides the imaging module with a field of view greater than 120 degrees, preferably 130 degrees or more, and most preferably 140 degrees or more. LED illumination is provided by plural LED arranged symmetrically around an optical axis to provide a field of illumination that substantially coincides with the field of view of an imaging module. An image brightness balance arrangement selectively varies the illumination provided by different LEDs to reduce brightness differences between different areas of the displayed images.
Claims
1. A single-use, disposable portion of an endoscope that releasably attaches to a multiple-use, reusable portion that has a handle configured to be grasped by a user and carries a mechanically attached video screen to thereby form an assembled endoscope, said single-use portion comprising: a camera module at a distal part of said single-use portion, said camera module comprising: a digital image sensor array that is no more than 2.2 mm wide and is configured to send digital video toward said multiple-use portion for display at said video screen; a lens barrel housing a lens stack of no more than two lenses, each made of a plastic material, through which the sensor array receives an image, which lens stack presents the camera module with a diagonal field of view (FOV) of 140 degrees or more; two or more LED light sources arranged around the lens barrel and having a field of illumination (FOI) that matches the FOV of the camera module; wherein said single-use portion: has an outside dimension no greater than 4.2 mm in cross-section at said distal part thereof; and comprises at least one internal lumen configured to pass a guide wire with an outside diameter of 0.8 mm or to pass fluid.
2. The single-use, disposable portion of an endoscope of claim 1, wherein said lens stack has a front that is no more than 4 mm from a sensor plane of said sensor array.
3. The single-use, disposable portion of an endoscope of claim 1, wherein said lens barrel has a diameter of no more than 2 mm.
4. The single-use, disposable portion of an endoscope of claim 1, wherein said lens stack causes a spatial distortion of no more than 15% at a peripheral area of said FOV.
5. The single-use, disposable portion of an endoscope of claim 1, wherein each of said lenses is made of a polymer material.
6. The single-use, disposable portion of an endoscope of claim 1, wherein each of said lenses is molded.
7. The single-use, disposable portion of an endoscope of claim 1, wherein said lens stack has a total track length no greater than 4 mm and is no wider than 2 mm in cross-section.
8. The single-use, disposable portion of an endoscope of claim 1, wherein said lens barrel further houses an iris.
9. The single-use, disposable portion of an endoscope of claim 1, wherein said lens barrel further houses an infrared (IR) filter.
10. The single-use, disposable portion of an endoscope of claim 1, wherein said LED light sources are arranged symmetrically relative to the lens stack to match said FOI and FOV to avoid blind spots or unevenly illuminated FOV.
11. The single-use, disposable portion of an endoscope of claim 1, wherein said LED light sources have illumination fields that only partly overlap.
12. The single-use, disposable portion of an endoscope of claim 1, further including an C-clip or O-ring on which said LED light sources are mounted and which fits over a distal portion of said lens barrel.
13. The single-use, disposable portion of an endoscope of claim 1, further including a light-block sleeve that extends distally from the lens stack and said LED light sources to keep direct light from said light sources from entering the lens stack.
14. The single-use, disposable portion of an endoscope of claim 1, wherein said distal part thereof terminates in a flat central surface that covers the entire lens barrel, and a beveled or rounded periphery.
15. The single-use, disposable portion of an endoscope of claims 1, releasably attached to said multiple-use portion with mechanical and electrical connectors on each of said portions, to form an assembled endoscope.
16. A single-use, disposable portion of an endoscope that releasably attaches to a multiple-use, reusable portion carrying a mechanically attached video screen to thereby form an assembled endoscope, said single-use portion comprising: a camera module at a distal part of said single-use portion, said camera module comprising: a digital image sensor array configured to send digital video toward said multiple-use portion for display at said video screen; a lens barrel housing a lens stack through which the sensor array receives an image of a field of view (FOV) of said camera module; and two or more LED light sources symmetrically arranged around the lens barrel and configured to provide a field of illumination (FOI) that matches the FOV of the camera module.
17. The single-use, disposable portion of an endoscope of claim 16, in which said LED light sources are arranged in two or more sets, and further including a control circuit configured to vary the level of illumination provided by one set relative to the level of illumination provided by another set to make the light reaching the sensor array more uniform.
18. The single-use, disposable portion of an endoscope of claim 17, in which said multiple-use portion comprises a control coupled with said control circuit and operating therewith to vary the level of illumination provided by one set of said LED light sources relative to another set thereof.
19. The single-use, disposable portion of an endoscope of claim 18, in which said control comprises a three-position finger-operated or hand-operated switch coupled with said control circuit and having a first position in which the switch causes one of said sets of LEDs to provide more illumination than another one or said sets, a second position in which the switch causes the two sets to provide the same illumination, and a third position in which the switch causes the second set to provide more illumination than the first set.
20. The single-use, disposable portion of an endoscope of claim 18, in which said control comprises a finger-operated or hand-operated switch configured to vary the illumination provided by a first one or said sets from a setting in which the set provides more illumination than a second one of said sets and through a range ending with the second set providing more illumination that the first set.
21. The single-use, disposable portion of an endoscope of claim 18, in which said control and control circuit are configured to extract from said digital video a balance signal indicative of the light intensity received at one area of the sensor array relative to another area thereof and respond to said balance signal to control the relative levels of illumination provided by said LEDs to cause said balance signal to move toward an indication that the two areas of the sensor array receive comparable light intensity.
22. An endoscope with a single-use, disposable distal portion and a multiple-use, reusable proximal portion, comprising: a handle configured to be grasped by a user's hand and having at least one button controlling endoscope functions, a mechanical connector at a proximal portion of the handle, an electrical connector facing a direction different from that of the mechanical connector, and a video display screen mechanically attached to the handle, wherein the handle with said at least one button, connectors, and screen form a part of the multiple-use portion of the endoscope; a cannula forming a part of the single-use portion of the endoscope and configured with internal lumena; a mechanical connector and an electrical connector at a proximal part of the single-use portion of the endoscope, configured to releasably mate tool-free with the mechanical connector and the electrical connector, respectively, at the multiple-use portion of the endoscope to thereby releasably integrate the multiple-use and the single-use portions; a light source and an imaging module with a video camera at a distal portion of the cannula, coupled with the screen through said electrical connectors to illuminate a region in the patient and provide images of the region to the screen under the control of said at least one button at the handle; said imaging module comprising a lens system configured to provide imaging module with a field of view (FOV) of more than 120 degrees; wherein the video camera is a digital camera providing a digital signal representing one or more images, and transmits the digital signal from the cannula tip to the handle.
23. The endoscope of claim 22, in which said lens system is configured to provide the imaging module with a field of view (FOV) of more than 130 degrees.
24. The endoscope of claim 22, in which said lens system configured to provide the imaging module with a field of view (FOV) of 140 degrees or more.
25. The endoscope of claim 22, in which said light source comprises plural LEDs arranged symmetrically relative to a central axis of said distal portion of the cannula.
26. The endoscope of claim 22, in which said light source comprises plural LEDs and further including a control circuit selectively varying the relative illumination provided by different ones of the LEDs to improve a brightness balance between different areas of an image displayed at said display.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0029] To further clarify the above and other advantages and features of the subject matter of this patent specification, specific examples of embodiments thereof are illustrated in the appended drawings. It should be appreciated that these drawings depict only illustrative embodiments and are therefore not to be considered limiting of the scope of this patent specification or the appended claims. The subject matter hereof will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
[0030] FIGS. 1 and 2 are a right-side view and a top view, respectively, of a handheld surgical endoscope, according to some embodiments;
[0031] FIGS. 3A and 3B are perspective views, FIG. 3C is a side view, and FIG. 3D is a front view, showing aspects of attachment and detachment of single-use and multiple-use portions of a handheld surgical endoscope and of rotation of a single-use portion relative to a multiple-use portion of an endoscope, according to some embodiments;
[0032] FIG. 4 is an exploded view of a distal part of a single-use portion of an endoscope; FIG. 4A is a detail of FIG. 4; and FIGS. 4B, 4C, and 4D are, respectively, a front view, a side view, and a partial sectional view, of the distal tip of a single-use portion of an endoscope, according to some embodiments;
[0033] FIG. 5 is a sectional view showing a lens barrel housing a lens system that provides a wide field of view at a sensor plane of an imaging sensor in a single-use portion of an endoscope, according to some embodiments;
[0034] FIG. 6A is a schematic illustration of matching field of illumination (FOI) and field of view (FOV), according to some embodiments; FIG. 6B illustrates a mismatch between FOI and FOV in known prior art endoscope; and FIG. 6C is a schematic view of an image with imbalance in overall brightness between areas of the image due to mismatch of FOI and FOV and/or due to different distances of LEDs from the surface being imaged;
[0035] FIG. 7 illustrates an example of a control circuit for equalizing illumination and image brightness balance under manual control, according to some embodiments; and
[0036] FIG. 8 illustrates an example of a control circuit for automatically equalizing image brightness, according to some embodiments.
DETAILED DESCRIPTION
[0037] A detailed description of examples of preferred embodiments is provided below. While several embodiments are described, the new subject matter described in this patent specification is not limited to any one embodiment or combination of embodiments described herein, but instead encompasses numerous alternatives, modifications, and equivalents. In addition, while numerous specific details are set forth in the following description to provide a thorough understanding, some embodiments can be practiced without some or all these details. Moreover, for greater clarity certain technical material that is known in the related art has not been described in detail in order to avoid unnecessarily obscuring the new subject matter described herein. It should be clear that individual features of one or several of the specific embodiments described herein can be used in combination with features of other described embodiments or with other features. Further, like reference numbers and designations in the various drawings indicate like elements.
[0038] FIGS. 1 and 2 are a right-side view and a top view, respectively, of a handheld endoscope 100, according to some embodiments. Endoscope 100 includes an elongated cannula 120 with a distal tip 112 for inserting into a hollow organ or cavity of the body. According to some embodiments, a separate tip sub-assembly 110 is attached to the cannula 120 which can be made from an extruded material. Sub-assembly 110 includes an imaging module and one or more LED light sources for viewing the organ or cavity into which it is inserted. Tip 15 of assembly 110 also includes one or more fluid ports. The distal end of cannula 120 can also be slightly bent as shown in bent region 122.
[0039] According to some embodiments, cannula 120 includes a fluid channel that is fluidly connected to distal fluid port 132 at fluid hub and connection assembly 130. Port 132 includes a Luer fitting to facilitate leak-free connection of port 132 with various medical fluid components. The fluid channel or lumen in cannula 120 is also connected to a distal facing fluid port of tip assembly 110. According to some embodiments, wires running from the LED light sources and camera module in tip assembly 110 pass through a separate channel in cannula 120. Although no dedicated working channel is provided in this example, an endoscopic guide wire can be passed through the fluid channel in some applications.
[0040] Endoscope 100 includes a multiply-use, reusable portion comprising a handle portion 140 that is sized and shaped in a pistol-like fashion for easy grasping by the endoscope operator (e.g. a doctor or other medical professional). A display module 150 is rotatably mounted on handle 140 via bearing 154 which can be a plain bearing made of plastic, and a rubber coated hinge 152. As can be seen in the dotted outlines in FIGS. 1 and 2, the display module 150 can tilt relative to the handle 140 and can rotate about axis 156 relative to handle. 140. Also visible on handle 140 are image capture button 160 and power button 162. According to some embodiments handle 140 and display module 150 are configured to be re-usable and make up reusable, multiple-use portion 102. The fluid hub and connection assembly 130, cannula 120 and tip assembly 110 make up single-use, disposable portion 104 and are made at a relatively low-cost and are intended to be disposed of after a single-use. By making the tip, cannula, fluid hub all single-use, stringent decontamination and disinfection procedures as well as the risk of cross-contamination and hospital acquired diseases can be significantly lessened or avoided. According to some embodiments the disposable, single-use portion (portion 104 shown as a separate item in FIGS. 3A) is sterilized, for example, during production and is provided to the user in a sealed sterilized pouch, for ease of storage and handling. Shown in FIGS. 1 and 2 are various dimensions that have been found to be practical for use in some applications, although other dimensions may be used for various applications, and the endoscope is not limited to the illustrated dimensions. The camera module in the tip assembly can have a wide angle of view, such as 140 degrees or more in this example.
[0041] FIG. 3A is a perspective view and FIG. 3B is a side view showing aspects of attachment and detachment of single-use and multiple-use portions of a handheld endoscope, according to some embodiments. The single-use portion 104 and multiple-use, reusable portion 102 attach mechanically primarily via mating mechanical connectors 320 and 322. Electrical connection is made via separate mating electrical connectors 310 and 312. The two portions 102 and 104 are attached via translation vertically towards each other. Note that in this example, on assembly 130 the electrical connector 310 and mechanical connector 320 are both separated from the fluid hub 300 that provides fluid communication between fluid port 132 and the fluid channel/lumen of cannula 120. This separation allows for easy and adequate fluid sealing to prevent fluid from fluid hub 300 from penetrating internally towards connectors 310 and 320 and, in addition, provides some protection against any exterior fluid, for example from fluid port 132 from reaching and possibly compromising electrical connectors 310 and 312. Also, the separation between mechanical connector 320 and fluid hub 300 allows for a sleeve bearing 330 to allow for rotating of cannula 120 relative to the proximal portion of assembly 130. The physical separation of the fluid hub 300 and the mechanical and electrical connectors 320 and 310 also provide additional assurance against accidental contamination from fluid hub 300 to the re-usable portion 102. The difference between d1 and d2, or the separation between the electrical and mechanical connectors 310 and 320 allows for the insulated electrical cable to pass intact though the housing formed by fluid hub 300, the sleeve bearing 330 and the mechanical connector 320. Since the electrical connector 310 is positioned outside the fluid-containing housing, the electrical connections between the cable and the connector can be made outside the housing as well. According to some embodiments, the distances d1 and d2 are about 70 mm and 35 mm respectively. According to some embodiments, both distances d1 and d2 are at least 20 mm and according to some other embodiments both distances d1 and d2 are at least 15 mm. Other distances can be used so long as they provide adequate protection from cross-contamination as determined by the overall design of the endoscope and its intended use.
[0042] FIGS. 3C and 3D are side and front views illustrating further aspects of a rotatable cannula used on a handheld endoscope, according to some embodiments. Cannula 120 along with the distal tip 110 and fluid hub 300 are rotatable about the main axis 340. The portion of assembly 130 that rotates with cannula 120 includes the fluid port 132, fluid hub 300 and inner tube that forms the inner portion of sleeve bearing 330. Rotation of cannula 120 can be limited so that the internal electrical cable does not undergo undue stress from twisting. In one example starting from a neutral position shown in FIGS. 1 and 2, and in solid lines in FIGS. 3C and 3D, the cannula 120 can be rotated about 180 degrees in either direction (i.e. clockwise and counter clockwise). According to some other embodiments, an asymmetrical rotation pattern can be implemented in sleeve bearing 330 such as 270 degrees in one direction and 90 degrees in another direction. Many other combinations can be implemented, to improve ergonomics for various situations (i.e. various users, types of procedures, and patient anatomy variations). According to some embodiments, the rotation is limited so as not to put undue stress on the internal electrical cable.
[0043] FIG. 4 is an exploded diagram showing various components of a distal tip used on a handheld endoscope, according to some embodiments. Cannula 120 is shown with its upper lumen 430 used to carry cable 410 and lower lumen 420 used to convey fluid. Cable 410 emerges from upper lumen 430 and comprises outer insulation layer 430 surrounding a plurality of inner conductors 412. Each of the inner conductors 412 have their own insulation. Although 6 conductors 412 are depicted in this example, other numbers of conductors can be used depending on the needs to of cameral module and LEDs. The cannula 120 and tip housing 440 are held together using a sleeve 442 that is dimensioned to fit around both the outer surface of the distal end of cannula 120 and the proximal end 444 of tip housing 440. According to some embodiments, sleeve 442 is made of stainless steel, although other material can be used. The three pieces, cannula 120, sleeve 442 and tip housing 440 can be glued together using, for example, a U-V cured bonding glue. Some or all of the conductors 412 are bonded to a printed circuit board (PCB) 450. According to some embodiments, a relatively strong bonding technique, such as solder, is used to attach the conductors 412 to PCB 450. Such strong bonding has a benefit of further reducing risk that the portions of the tip assembly 110 become separated from the cannula during a procedure. Sensor 452 is mounted on PCB 450. A holder 454 sits around sensor 452 and a light shield or ferrule 456 further surrounds the lens system and dust cover 458.
[0044] According to some embodiments, plural LEDs 460 are mounted to a horseshoe-shaped (C-clip shaped) LED board 461 that surrounds the distal end of the lens system 458. According to some embodiments, light-guide lenses 462 and 464 are inserted and bonded to recesses in the distal end of tip housing 440. Although 4 LEDs 460 are shown in FIG. 4, other numbers of LEDs can be used around the periphery of lens system 458 such as 1, 2, 3, 4, 5, 6 or more LEDs. By using 4 LEDs, it has been found that a relatively uniform beam pattern can be produced.
[0045] By positioning the LEDs inside the housing 440 instead of flush with the distal surface, the LEDs are in a sense encapsulated in that they do not contact the patient tissue and are well sealed from fluid such as saline. It has also been found that the translucent shell provides some useful light dispersion for a widespread illumination either with or without the use of lenses 462 and 464. Also, recessing the LEDs as shown frees up some space on the distal surface. Finally, the assembly process is simplified when locating the LEDs inside the housing 440.
[0046] The components 480 within an upper cavity of tip housing 440 form a camera or imaging module 480. The tip housing 440 can be molded from a transparent material such as polycarbonate but other easy to mold materials could be used instead. When assembled, the front of lens system 458 sits flush with the distal end of tip housing 440 through lens orifice 441. A lower orifice 443 is provided to allow for fluid communication with lower lumen 420 of cannula 120. Note that port 132, lumen 420 and orifice 443 can be provide fluid in-flow (i.e. flowing fluid out of the endoscope and into the patient's organ or cavity and/or fluid out-flow (i.e. flowing fluid out of the patient's organ or cavity and into the endoscope).
[0047] FIG. 4A is a magnified perspective view of a portion of the components of camera module 480 illustrated in FIG. 4. LED board 461 is horseshoe-shaped, or shaped as a C-clip, and mounts by snapping over the proximal end of light shield 456, or can be a ring-shaped mount slipped over light-block ring 456. Light shield 456 extends distally from the LEDs and thus serves as a light shield or ferrule that keeps direct light from the LED from reaching the lens system inside holder 454 and sensor 452. Preferably, LEDs 460 are coplanar or nearly coplanar with the distal end of the lens assembly, and comprise a pair of LEDs 460a at one (left) side of light-block ring or sleeve 466 and a pair of LEDs 460b at the other (right) side.
[0048] FIG. 4B is a front view, FIG. 4C is a side view, and FIG. 4D is a sectional view of one example of the distal tip of cannula 120. Some dimensions are illustrated but alternative dimensions are possible and contemplated within the scope of this patent specification. FIG. 4B shows lens orifice 441, recesses 468 and 470 into which the lenses 462 and 464 are inserted, and a lower orifice 474 through which fluid can pass into or out of the patient or a guide wire can pass. As can be seen from FIG. 4D, the inner part of the tip 110 of cannula 120 has two cavities 472 and 474 that are separated by wall 476. FIGS. 4C and 4D show that according to some embodiments the distal outer edge 478 is rounded to facilitate insertion in/though tissue passages and alleviate tissue contact issues. When inserting the endoscope into and through passages such as the urethra, trachea or blood vessels, it is desirable that the outer distal edge 478 of the distal tip should be rounded since that region of the distal tip both contacts and dilates the tissue passage. In such cases, the central portion 481 of the distal tip can be made less rounded or flat. Making the central portion 481 less rounded or flat has been found to enhance imaging characteristics over a more spherical overall tip since the camera and illumination are not or significantly less impaired. In the case shown, orifice 472 can be covered with a flat glass dust cover that sits flush with the remainder of central portion 481. FIGS. 4C and 4D show that outer surface of housing 482 around fluid or guide wire opening 466 can be tapered. In the example shown an approximately 1-degree taper has been found to be useful for insertion in urological applications. The tip surface around the fluid or guide wire orifice is beveled, as best seen in FIGS. 4C and 4D.
[0049] FIG. 5 illustrates a section through a lens system 500 comprising a lens barrel 510 that fits in lens holder 454 seen in FIG. 4C and preferably is coaxial with light shield or ferrule 456. Lens barrel 510 holds two lenses 512 and 514, labeled as 1st (top) element 512 and 2.sup.nd element 514. The 2.sup.nd lens element 514 can be held in barrel 510 by a mounting ring or spacer 516. The 1.sup.st lens element 512 can be held in barrel 510 by a ring-shaped iris 518. An infrared (IR) filter 516 can be placed just proximally of the 2.sup.nd element 514. A single lens could be used in place of lenses 512 and 514 if it can provide a sufficiently wide FOV to the camera module.
[0050] An important property of the lens system 500 is that it provides sensor 452 with a field of view (FOV) that is uniquely wide for a single-use, disposable endoscope portion with a small outside diameter such as less than 5 mm and preferably is 4.2 mm or less. In some embodiments, the FOV is more than 120, preferably is 130 or more, and most preferably is 140 or more at a diagonal of a rectangular or square sensor 452, at a sensor plane thereof. In a specific example of a lens system 500 according to some embodiments, for a rectangular sensor 452 the FOV parameters are: diagonal FOV1403; horizontal FOV1063; and vertical FOV823. In this example, the total track length of lens assembly 500, which is the distance from the distal end of 1.sup.st lens element 512 to the sensor plane or sensor 452, is 4 mm; the distance from the proximal end of IR filter 516 to the sensor plane of sensor 452 is 1.56 mm; and the distance from the proximal end of lens barrel 510 to the sensor plane is 1.2 mm. The outside diameter of lens barrel 510 is 2 mm in this example. The resolution of the combination of lens system 500 and sensor 452 (in an example of sensor with 640480 pixels), in terms of MTF (modulation transfer function), is (1) on axis50% at 200 lp/mm (line pairs per mm), and 76% at 100 lp/mm; and (2) for 80%-39%(t) and 52%(s) at 100 lp/mm, and 66%(t) and 74%(s) at 60 lp/mm in the same example. The distortion is no more than 15% in the same example. Of course, these parameters are for a specific example of some embodiments, and different parameters can be used and are contemplated in this patent specification so long as they achieve the desired FOV greater than 120, preferably 130 or more, and most preferably 140 or more.
[0051] The wide field of view of lens system 510 allows a greater area of the organ being imaged to be seen in a single image than in known prior art disposable endoscopes. This can be particularly important when viewing organs such as the bladder, which has an internal area several times that of the uterus. If a known prior art disposable endoscope with an FOV of 120 is used for viewing the bladder, it would require considerably more repositioning than an endoscope with a wider FOV to examine the same internal area. In addition, the wider FOV allows a greater area of the organ to be seen in a single image, which can facilitate accurate assessment by allowing comparison of one area of the organ relative to other areas in the same image.
[0052] As illustrated in FIG. 4A and discussed above, according to some embodiments LEDs 460 are symmetrically arranged around light-block ring 456, in a way that allows the illumination from one side of ring 456 to overlap with that from the other side and thus provide a wide field of illumination (FOI) that substantially match the FOV of sensor 452. FIG. 6A illustrates this overlap, where the light from LEDs 460 that are at one lateral side of ring 458 provides a field of illumination labeled LED FOI 1, the light from LEDs 460 that are at the opposite lateral side of ring 458 provides a field of illumination labeled LED FOI 2, and the two FOIs overlap each other and in addition match the FOV of lens system 500. While as illustrated the outer edges of the FOI and the FOV may be slightly offset, they still match to make good use of the available light and avoid blind spots.
[0053] In contrast, in a known endoscope the LED light source is not symmetrically arranged relative to the lens system, and there is a substantial mismatch, as illustrated in FIG. 6B, where a substantial portion of the lens FOV is not illuminated and thus there a blind spot with insufficient light to show well in the image. When referring to a symmetric arrangement of LEDs, this patent specification means a substantially rather than perfectly symmetric arrangement, for example as illustrated in FIG. 4A, where the LEDs are symmetric relative to a vertical section through the central axis of light shield 456 and are nearly but not necessarily perfectly symmetric relative to a horizontal section through the central axis.
[0054] According to some embodiments, images are improved by providing the endoscope with facilities to make illumination of the camera FOV more uniform. This is particularly beneficial for examining organs such as the internal wall of the bladder, where cannula tip 110 may be in a position in which one pair of adjacent LED is significantly closer to the bladder wall that the other pair. In that situation, one side of sensor 452 may receive significantly more light than the other, and the image may be unbalanced in brightness. This can make image interpretation more difficult as some of the imaged portion of the bladder wall may appear darker than another portion or one portion may appear washed out. FIG. 6C illustrates an image where the field of view of the camera is not uniformly illuminated, and as a result an image region 622 is darker overall because it has received less light than image region 624. This can occur because of a significant mismatch between the FOI and the FOV due to an arrangement such as seen in FIG. 6B. It has been found that uneven overall brightness of areas within an image can occur to a lesser extent for a different reason as wellbecause some of the LEDs are significantly closer to the organ surface being imaged than other LEDs even when the LEDs are symmetrically arranged around the optical axis of the lens system.
[0055] FIG. 7 shows in block diagram form an example of a control circuit or system that can improve brightness balance in the image when different area of the organ being imaged receive different levels of illumination. This control circuit can be used in any of the endoscopes described in this patent specification. FIG. 7 is similar to FIG. 15 in application SN 15/651,526, incorporated by reference, except for additions and changes that deal with improving brightness balance. Specifically, LEDs 460a at one side of light-shield ring 456 of camera module 480 have their own LED driver 706a and LEDs 460b at the other side of the light-shield ring have their own LED driver 706b. Field programmable gate array 708 provides respective control signals ALCa and ALCb to LED drivers 706a and 706b that vary the intensity of light the LEDs put out. A 3-position, manually operated switch or button 712 provides input to processor ISP 710, which through FPGA 708 varies the control signals ALCa and ALCb and thus the light intensity from LEDs 460a and 460b. As one example, (i) in position 1 of switch 712, which can be the default position, LEDs 460a and 460b provide roughly equal light intensities, e.g., each operates at 100% of its rated brightness; (ii) in position 2, LEDs 460a operate at 50% of their rated brightness while LEDs 460b operate at 100% brightness, and (iii) in position 3, LEDs 460a operate at 100% brightness while LEDs 460b operate at 50% brightness. Of course, different brightness levels can be implemented for the dimmed LEDs, such as 40%, 60%, 70%, etc. And, there can be more than two individually controlled groups of LEDs, such as 3 or 4 groups, with a corresponding switch having more positions that vary the light outputs of the LEDs. A potentiometer rather than a 3-position switch can be used to make the steps in relative light output of the LEDs even finer. Switch or button 712 can be mounted at a convenient position on handle 140, for example as illustrated in FIG. 1, to be operated by the user. While display 150 shows an image and the user is manipulating handle 140 to point cannula 120 to different areas of the organ being examined, the user can operate switch 712 depending on the brightness balance seen on display 150.
[0056] In other respects, FIG. 7 is like FIG. 15 in said application SN 15/651,526, and will be similarly described below except for the use of different reference numerals. A main board 716 serves to interface, process the data, and control the components at the tip of cannula 120 and display module 150. In broad terms, main board 716 supplies power and control signals to camera module 480 and LEDs 460 as well as to display module 150, and converts the camera output to an image signal for display on display module 150. In main board 716, processor 710 (which can be a DSP or ISP) digital signal processor, controls the operation of the components at the tip of cannula 120 and in display module 150 and processes the captured image data. Communicating through field programmable gate array (FPGA1) 708, processor 710 sends control signals ALCa and ALCb to LED-DRIVERs 706a and 706b, respectively, to turn LEDs 460a and 460b ON and OFF and to adjust their outputs to the desired brightness levels as needed. Processor 710 receives the output of camera module 480 after it has been converted from serial to parallel by a STMIPI interface 718. Processor 710 exchanges information as needed with information storage devices such as DDR2 memory 720, SD-CARD memory 722, and SPI-FLASH memory 724. Processor 710 can provide an output to HDMI connector 714 and can receive key actuation or interrupt signals from touch keys 726, which can be buttons on handle 140 such as buttons 160 and 162. Processor 710 also receives touch or swipe information from touch panel 728 in display 150. Processor 710 provides control signals over I2C line 730 to cameral module 480, touch panel 728, and FPGA1 708. Processor 710 converts the parallel signal from FPAG1 708 to a serial RGB signal and supplies the serial RGB signal to display module 150.
[0057] Display module 150 displays images from camera module 480 and responds to touch to send control signals to processor 710. Display module 150 comprises a field programmable gate array (FPGA2) 732 that receives images from camera module 480 that are provided through processor 710 in serial RGB format. FPGA2 732 sends the images, in parallel RGB format, to LCD display screen 734, and can store selected images in memory SRAM 736 and recall them for display or for storage in SD-CARD 722 and/or SPI-FLASH 724, in response to commands from touch panel 728 or preprogrammed instructions from processor 710 or FPGA2 732 or other processor or memory components. Touch panel 728 communicates with processor 710 over signal bus I2C 730 and can send commands to processor 710 over a direct bus INT 738. Power supply facilities such as a connection to a rechargeable battery removably secured to handle 140, a connection to a manual OFF/ON switch on handle 140, and to a camera control button on handle 140 also can be on main board 716.
[0058] According to some embodiments, an automated system can be implemented in any of the described endoscopes to improve brightness balance in the image. FIG. 8 illustrates such an automated system, and is otherwise similar to FIG. 7 except that it omits switch 712 and includes an algorithm in processor 710 that responds to the level of overall brightness in selected areas of the image information from sensor 452 (or from LCD display 734) to change the light outputs of LEDs 460 toward equalizing the overall brightness over the entire image on LCD display 734. In this example, processor 710 is programmed with an algorithm 710a that responds to a difference in the overall brightness of two different areas of the current image frame from sensor 452, for example to a difference between the overall brightness of the left half of the image frame and the right half. The algorithm can be relatively simplee.g., when either of the left half or the right half of the image frame exceeds a selected threshold of overall brightness, processor 710 calculates a balance signal indicative or the difference and issues commands to LED driver 706a and/or 706b to reduce the intensity of the LEDs that correspond to the side of the image that had has overall brightness over the threshold. In a simple implementation, algorithm 710a can mimic the effect of switch 712 of FIG. 7, i.e., (i) when the left side of the image frame is more than a threshold brighter than the right side, reduce the light output of the left LEDs 460a by 50% (or some other selected % reduction), (ii) do the opposite if the right side of the image has overall brightness over a threshold, and (iii) do not change the relative outputs of the LEDs is the difference in overall brightness of the left and right sides of the image frame is within a selected threshold. Alternatively, algorithm 710a can provide control in finer steps, e.g., if the difference in overall brightness between the two halves of the image frame is more than a first threshold but less than a second threshold, decrease the light output of the relevant LEDs by a first amount; but if the difference is more than a second, greater threshold, decrease by a second, greater amount. There can be even more steps, i.e. three or more thresholds and three or more corresponding decreases in the light output of the relevant LEDs. The algorithm can be implemented by a person of ordinary skill in programming given the teachings of this patent specification. Instead of responding to overall brightness or each half of the image frame, algorithm 710a can be configured to respond to two or more smaller areas of the image, such as two strips of the image frame or two groups of pixels spread in each half of the image.
[0059] Although the foregoing has been described in some detail for purposes of clarity, it will be apparent that certain changes and modifications may be made without departing from the principles thereof. It should be noted that there are many alternative ways of implementing both the processes and apparatuses described herein. Accordingly, the present embodiments are to be considered as illustrative and not restrictive, and the body of work described herein is not to be limited to the details given herein, which may be modified within the scope and equivalents of the appended claims.
