Method and apparatus for controlling light output intensity and protection from high intensity light

Abstract

A method and apparatus where the output from a high intensity light source is controlled to produce well-exposed images/videos and to reduce automatically the intensity when an unsafe issue is detected in medical devices such as endoscopes and the like. The method and apparatus overcome problems to control light sources that have high-frequency noise, slow-response time, nonlinearity, and non-monotonic response time and to protect the patients' tissues from possible overheating/burning and the eyes of personnel and patients from possible direct exposure to high intensity light used in medical devices such as endoscopes and the like.

Claims

1. An apparatus for viewing a surface, the apparatus comprising: an examining instrument having an imaging path through which the surface is observed; a Xenon light source illuminating the surface; an imager detecting light reflected from the surface, and generating image signals representative of light reflected from the surface; a camera control unit (CCU) processing the image signals; and a controller associated with the imager and the CCU, the controller processing the image signals, the controller including software executing on the controller, the software executing on the controller decrementing or incrementing an output intensity of the Xenon light source via at least two steps, wherein the intensity of the at least two steps is incremented or decremented by a predetermined percentage of a maximum output intensity of the Xenon light source; wherein the controller is adapted to detect a potential safety issue and, if a potential safety issue is detected, to increment or decrement an output intensity of the Xenon light source via the software executing on the controller, the software executing on the controller incrementing the output intensity of the Xenon light source with a specified step ΔP.sub.scan, from P.sub.scan,min to P.sub.max, where P.sub.scan,min is less than P.sub.max, and P.sub.max is a maximum allowed output intensity of the Xenon light source; and wherein the controller is further adapted to compute, during the incrementing, a correlation metric indicative of a correlation between a measured achromatic image brightness (Luma.sub.meas), on Image Motion Metrics or Perimeter Black, and the output intensity of the Xenon light source, within a specified step, and to set the output intensity of the Xenon light source to a safe level, if a correlation between the measured achromatic image brightness and the incrementing output intensity of the Xenon light source is not detected.

2. The apparatus of claim 1, further comprising a communication bus coupled to a plurality of bus interfaces for communication between the Xenon light source and the CCU.

3. The apparatus of claim 1, wherein the Xenon light source has at least one of high-frequency noise, slow-response time, nonlinearity, and non-monotonic response time.

4. The apparatus of claim 1, wherein the examining instrument is selected from a group consisting of an endoscope, laryngoscope, bronchoscope, fiberscope, duodenoscope, gastroscope, flexible endoscope, arthroscope, cystoscope, laparoscope, anoscope, and sigmoidoscope.

5. The apparatus of claim 1, wherein the imager is either located distally inside the examining instrument, proximately inside the examining instrument, or externally from the examining instrument.

6. The apparatus of claim 1, wherein the imager is a CCD or CMOS imager.

7. A method for controlling a Xenon light source in an apparatus configured to view a surface, the method comprising: incrementing or decrementing an output intensity of the Xenon light via at least two steps by a predetermined percentage of a maximum output intensity of the Xenon light source; detecting a potential safety issue and, if a potential safety issue is detected, incrementing the output intensity of the Xenon light source with a specified step ΔP.sub.scan, from P.sub.scan,min to P.sub.max, where P.sub.scan,min is less than P.sub.max, and where P.sub.max is a maximum allowed output intensity of the Xenon light source; and computing, during the incrementing, a correlation-metric indicative of a correlation between a measured achromatic image brightness (Luma.sub.meas), on Image Motion Metrics or Perimeter Black, and the output intensity of the Xenon light source, within a specified step, and setting the output intensity to a safe level, if a correlation between the measured achromatic image brightness and the incrementing output intensity of the Xenon light source is not detected.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 is schematic block diagram view of an apparatus for controlling a light source in accordance with the invention;

(2) FIG. 1A is schematic block diagram view of the controller of FIG. 1;

(3) FIG. 1B is a schematic block diagram view of the methods for controlling the controller of FIG. 1;

(4) FIG. 2 is a graph comparing requested output intensity of light source against time that shows incrementing and decrementing the power in a stepwise manner;

(5) FIG. 3 is a schematic view of the steps of controlling the controller of FIG. 1;

(6) FIG. 3A is a schematic block diagram view of some of the steps of FIG. 3;

(7) FIG. 3B is a schematic block diagram view of some of the steps of FIG. 3; and

(8) FIG. 4 is a graph showing the high frequency noise, slow-response and nonlinearity of a Xenon or a Xenon-like light source and comparing the output intensity of a Xenon or a light source against time.

DETAILED DESCRIPTION OF THE INVENTION

(9) With reference to FIG. 1, an endoscope 10 is illustrated having a camera head 12 mounted thereto at the proximal end to produce video images in a manner for example as described in the aforementioned U.S. Pat. No. 5,162,913 to Chatenever, et al. The distal end of endoscope 10 is directed at tissue 14 to inspect the tissue with light from a high intensity light source 16 and passed to the distal end through a light guide cable 18. Typically, light guide cable 18 can be disconnected from endoscope 10 at connector 20, thus, posing a safety hazard as described above.

(10) The light from light guide cable 20 is directed to illuminate tissue 14 as suggested with path 22 and light reflected by tissue 14 is passed along optical path 24 to imager 26 within camera head 12. Imager 26 detects light reflected off tissue 14 by means of optical path 24. Imager 26 may be any type commonly used within the art, such as but not limited to CCD, CID or CMOS imagers. Camera head 12 produces image signals 28, which are received by auto exposure circuitry 30, within camera control unit (CCU) 32. Auto exposure circuitry 30 may consist of various types of methods for controlling the electronic shutter of imager 26, as well as adjusting amplification gain in response to illumination levels received by imager 26. Typically, within the field of video endoscopy, auto exposure circuitry has high-speed and wide dynamic range capabilities. Various methods may be utilized, that are well known within the art. Video display 36, receives signals from CCU 32, where an image of tissue 14 is presented.

(11) As shown in FIG. 1, light source 16 is controlled by CCU 32 and controller 234, by means of CCU bus interface 54, digital communication bus 50, and light source bus interface 52. Controller 234, may be any type of device designed to receive and execute software programs, or which is designed to be modified in functionality by software programs, and preferably is from the group consisting of digital signal processors, microcontrollers, and microprocessors, or the group consisting of field programmable gate arrays, and computer programmable logic devices.

(12) Typically, high intensity light sources utilize an incandescent bulb 38 (being a Xenon bulb, or other type), driven by an amplifier 40, which in turn is controlled by output control circuitry 42, to set the light output intensity level of the light source 16. Other types of light source intensity output control are known within the art; such as mechanical diaphragm or iris, liquid crystal shutter, rotary reed or slot devices, and the like. These various types of light source output intensity control may be utilized within the scope of the present invention. In the present embodiment, output control circuitry 42 varies the intensity of bulb 38 in accordance with controller 234.

(13) Controller 234 is a modified controller that is used to achieve the various objects of the invention. As shown in FIG. 1, controller 234 involves various steps A-F that allow the apparatus to control light sources that have slow-response, high-frequency noise, nonlinearity, non-monotonic response times. Controller 234 may have steps A) Adaptive Normalization of EV and Self Calibration 205, B) Detection of Hot Distal-End Method 210, C) Failure-Detection Method 215, D) Exposure Value Method 220, E) Power Scan and Correlation Methods 225 and F) Set Delays Method 226. Such steps are shown in FIG. 1A. FIG. 1B shows steps for the Scan Request 230, Power Scan 235, and Correlation 240. Scan Request 230, Power Scan 235, and Correlation 240 are part of the Power Scan and Correlation Method 225.

(14) FIG. 3 shows a global schematic view of the steps of the controller 234. FIG. 3A-3B show steps of FIG. 3.

(15) The step 210 is the Detection of Hot Distal-End Method. Here, the step 210 measures EV 402 and checks to see if EV.sub.meas is less than the threshold EV.sub.tr 404. If yes 408, then the tissue is too close to the hot distal end and the light source intensity is reduced by lowering the output intensity to avoid high temperature at the distal end. The output intensity is decreased to a safe value, as when EV.sub.meas is less than EV.sub.tr then the tissue is too close to the distal end of the endo cope and the output intensity is lowered to avoid high temperature at the distal end that may cause the tissue to burn.

(16) Next, Failure-Detection Method step 215 is provided. Here, the method checks to see if Luma.sub.meas is less than Luma.sub.tr 414. If yes 418, this indicates that low or no light is detected by the camera; therefore, the light guide/source is possibly either disconnected from the endoscope or endoscope/camera combination, the distal tip of the endoscope is not within close enough proximity to a subject being imaged to produce well exposed images (i.e., reflected light levels are below the Luma threshold, indicative of the endoscope being too far from the imaged subject to be “in use”), Thus, the output intensity is decreased to a safe level. If no 416, then the method checks whether PB.sub.meas is less than PB.sub.tr 424. Perimeter Black (PB) is typical in endoscope images. Endoscopes generally provide a circular image of the tissue being examined in the middle of the overall image, surrounded by a black perimeter extending to the square or rectangular edges of the overall image. The Perimeter Black (PB) being absent in the image (i.e., PB.sub.meas is less than PB.sub.tr) is indicative of the camera being disconnected from the endoscope. Therefore, if yes 428, then the camera is disconnected and the output intensity is decreased to a safe level. If no 426, then the system checks whether IMM.sub.meas is less than IMM.sub.tr 434. If yes 438, then motion is not detected within the video images and the output is decreased to a safe level. If no, then the Controller checks to see if an output level change is allowed. If no output change is allowed (no), then the light source output level is unchanged. If an output change is allowed (yes), then the Controller checks if Scanning of Power (light output intensity) is complete. If Power Scan is completed, the Exposure Method EV is allowed/enabled. If Power Scan is not completed, EV method is disabled while Power Scan and Correlation methods are enabled. The next step involves the Exposure Value Method 220 if EV method is enabled. The exposure value method involves having the optimal value of EV.sub.i, EV.sub.opt, be between EV.sub.opt,min and EV.sub.opt,max, wherein EV.sub.opt depends on the monotonic and linearity characteristics of the light source.

(17) The exposure value method 220 first checks to see if EV.sub.i is less than EV.sub.opt,min 444. If yes 448, then EV is below the optimal range and the output level of the light source is decremented. If no 446, next the method checks to see if EV.sub.i is greater than EV.sub.opt,max 454. If yes 458, then EV is above the optimal range and the output level of the light source is incremented. If no 456 then, EV is in the optimal range (EV.sub.i is between EV.sub.opt,min and EV.sub.opt,max) and the output level of the light source is unchanged. The criteria to form a well-exposed image typically requires that EV.sub.meas be between EV.sub.opt,min and EV.sub.opt,max. The EV.sub.meas is continuously measured exposure value EV. The EV.sub.opt depends on EV.sub.meas, the monotonic and linearity characteristics of the light source output.

(18) The absence of intensity is compensated by increasing of EV in the CCU/imager that is measured (EV.sub.meas) for the LSC. The larger the EV.sub.meas, the worse quality of the image because the image is under exposed. To improve quality of the image, the intensity is increased. Thus, when EV.sub.meas is greater than EV.sub.opt,max (where EV.sub.opt,max is the upper range of the optimal window for EV.sub.meas), LSC requests increasing the light intensity.

(19) When the end of the scope is touched by the patient tissue/surface, EV will be reduced by CCU to prevent from overexposure (when image is one bright spot). As shown in FIGS. 3, 3A and 3B, LSC helps the CCU/imager by decreasing light intensity when CCU reduces EV.

(20) In other words, the LSC helps the CCU/imager keep EV.sub.meas in the optimal range, i.e., EV shall not be too big (by incrementing the intensity) and EV shall not be too small (by decrementing the intensity).

(21) The goal of the exposure value step and/or method is to minimize the number of light source output level changes (increment or decrement) taking into account known issues with Xenon light sources.

(22) The goal of the exposure value method 220 is to minimize the number of output intensity level changes and avoid loops in output intensity requests (i.e., avoids instability of the output intensity control loop when the controller wrongfully requests periodical increment/decrement of output). Another goal of the exposure value method 220 is to increase the accuracy of computing correlation and minimize the number of such computations, and as a result, to minimize the number of changes of light source output intensity.

(23) The next step is power scan step 225, which involves scan request step 230, power scan step 235 and if requested, correlation step 240. These steps allow for the incrementing of the output intensity of the light source. Here, the output intensity of the light source may be incremented via the power scan step 225, power scan step 225 being able to increment the output intensity a few times with a specified step ΔP.sub.scan, from P.sub.scan,min to P.sub.max, where P.sub.scan is less than P.sub.max, and P.sub.max is the maximum allowed light source output intensity. The above mentioned step is typically not continuously enabled to minimize possible flickering of the video images. The next step is Set Delays method 226 to compensate for the slow response of Xenon or Xenon-like light sources by using optimal delays before and/or after controlling of light source.

(24) The correlation method may compute a correlation metric when EV.sub.meas is too small, i.e., when P.sub.i is requested to be around P.sub.max or higher (where P.sub.max is the maximum output level of the operating light source). While computing the correlation metric, instead of light-modulation, one or a few sets of incrementing intensity output levels are requested: each set producing a ramp of increasing light output intensity.

(25) FIG. 2 is a graph of the power scan step 225. Here, the graph shows regions where the correlation method is enabled or disabled and where there is a safe intensity output level.

(26) As shown in the graph, where the correlation method is enabled and the EV method is disabled, the output intensity can be incremented. The output intensity can be incremented via steps from P.sub.scan,min to P.sub.max, and vice-versa. Optionally, the output intensity may be decremented via steps from P.sub.max P.sub.scan,min. When a potentially unsafe condition is detected, the correlation method is enabled and the EV method is disabled. On the right hand side of the graph, upon completion of the correlation method one or more times, if the correlation between Luma.sub.meas and incrementing output level is not detected, the output intensity may be set to a safe level.

(27) The method may also involve adaptive normalization and self-calibration method steps. The adaptive normalization and self-calibration method steps take into account the type of the imager (i.e., video endoscope or camera head), connected to the CCU, and the type of light source.

(28) The adaptive normalization and self-calibration method steps may normalize EV to the imager being used in order to utilize a single LSC software implementation, to reuse the same control-equations, and to re-compute calibration curves based on the type of imager and light source. The adaptive normalization and self-calibration method steps may monitor the integration time of the imager, and the minimum and maximum values of EV.sub.i.

(29) The adaptive normalization and exposure value methods may take into account the type of imager (i.e., camera and camera head) connected to the CCU, including imager format (i.e. PAL, NTSC, SECAM, etc.) resolution, (i.e. frame size or field size for interlaced imagers), and type of light source. The method may adaptively normalize EV.sub.i to the imager being used, in order to re-use the same control equations, the same control-thresholds, and a single LSC software implementation and/or package for all imagers and re-computes calibration curves based on the type of imager and light source.

(30) The adaptive normalization and self-calibration methods may also include steps for the self-recovery method. The self-recovery method involves, such that when components of the system are changed, updating the previously used processing coefficients, equations, and/or calibration curves associated with the previous components. These processing coefficients, equations, and/or calibration curves associated with the previous components are no longer valid or accurate when components of the system are changed. Keeping these old values could lead to a wrong computation of a new safety level.

(31) When components in the system are changed, the self-recovery method automatically fixes the above issue by re-computing the coefficients, equations and calibration curves taking into account new correct equations and/or Look Up-Tables in order to compute the safe power-level correctly. In other words, the self-recovery method works as auto-adaptive method that allows for high-accuracy of computation of a safe power level or output intensity level during the change of components and/or equipment in a system.

(32) Components that are replaced and/or changed are the type of scope attached to the camera, the light source, the camera, any endoscopes, videoscopes and/or CCU.

(33) As an example using the self-recovery method, the LSC implemented from GI-CUU and Image-1 HD CCU can self-recover when a type of the scope/light source is changed (for example, when 10 mm scope is replaced with 5 mm scope; or when Xenon-300 is replaced with Power LED light source during the surgery).

(34) Furthermore, the self-recovery method may be incorporated into other operative methods of the system and/or method of the invention.

(35) The method and apparatus of the present invention has advantages over existing systems. As shown in FIG. 4, the method overcomes slow-response, high-frequency noise, nonlinearity, and non-monotonic response features of Xenon light sources and light sources similar to Xenon sources.

(36) FIG. 4 shows a time versus light source output graph illustrating high-frequency noise, as well as slow-response (more than a second to change light source output intensity from 5% to 100%). On the right, FIG. 4 shows an exposure value EV versus output intensity graph on a semi-log scale demonstrating the nonlinearlity and non-monotonic response of Xenon based light sources. These features (i.e., the slow-response, high-frequency noise, nonlinearity, and non-monotonic response features of Xenon light sources) do not allow control methods involving any type of modulation (such as described in U.S. Pat. No. 6,511,422 to Chatenever) to satisfactorily control Xenon light source outputs.

(37) The present invention may also operate to prevent fire hazard through light guide disconnection and to minimize light source intensity output in-vivo to minimize tissue burn. The present invention may also provide eye safety, and detection of camera and/or light guide disconnection. The invention achieves a single software package that does not impact existing hardware.

(38) The controller of the present apparatus takes into account the exposure value (i.e., the shutter speed in seconds). The invention may also provide a correlator that is a part of the controller.

(39) The invention may also involve providing software packages that do not impact existing algorithms for power control. The invention also supports various imager formats (i.e. NTSC, PAL, SECAM, etc.), as well as varying resolutions, frame and field sizes as in interlaced imagers. The hot distal end method step may involve checking if measured exposure value EV.sub.meas is below the threshold EV.sub.tr and if so the light source intensity is immediately reduced to prevent overheating/burning of tissue due to the small distance between the distal end of the scope and the observed tissue.

(40) The failure-detection method may include methods to detect the following failures to reduce the light source intensity to a safe level: light guide/source disconnect, camera disconnect, and detection of no movement within the video image. This may be based upon comparison of measured Luma, Perimeter Black (PB), and Image motion metrics (IMM) with corresponding thresholds, i.e., Luma.sub.tr, PB.sub.tr and IMM.sub.tr.

(41) The design style/workflow for the method for LSC may involve an effective and fast-to-market style, such as the style provided in http://www.mil-embedded.com/articles/id/?4881, an article by Joy Lin, entitled “Developing next-gen signal processing and communications systems: Engineering tools and design flow advancements”, which is herein incorporated by reference. As an example the Model-Based design workflow may involve various Matlab tools for design, test and verification of LSC, and for one-button push conversion of the proved Matlab LSC code into the corresponding C/C++/VHDL/Verilog-code for hard/firm-ware implementation. This allows fast-to-market of the reusable LSC design and prospective upgrades, changes, or modification of LSC.

(42) While the invention has been specifically described in connection with certain specific embodiments thereof, it is to be understood that this is by way of illustration and not of limitation and that various changes and modifications in form and details may be made thereto, and the scope of the appended claims should be construed as broadly as the prior art will permit.

(43) The description of the invention is merely exemplary in nature, and thus, variations that do not depart from the gist of the invention are intended to be within the scope of the invention. Such variations are not to be regarded as a departure from the spirit and scope of the invention.