Extended temperature range mapping process of a furnace enclosure using various device settings
09696210 ยท 2017-07-04
Assignee
Inventors
Cpc classification
G06T5/94
PHYSICS
G01J5/064
PHYSICS
International classification
Abstract
A process is provided for mapping temperatures in an enclosure during a combustion process. A device setting of an image-capturing device is provided. An intensity-temperature mapping is generated by performing an intensity-temperature calibration based on an intensity of an image pixel in a field of view (FOV) generated by the image-capturing device, a corresponding temperature measurement, and a selected device setting. Each emitted radiation of selected regions is detected based on a first image in the FOV. At least one region is determined whether the region is poor responsive, based on the intensity-temperature mapping associated with the device setting. The at least one poor responsive region is replaced with acceptable regions unaffected by the saturation from at least one other image captured at a different device setting for higher temperature resolution.
Claims
1. A process for mapping temperatures in an enclosure during a combustion process, comprising: providing a device setting for an image-capturing device; generating an intensity-temperature mapping by performing an intensity-temperature calibration based on an intensity of an image pixel in a field of view (FOV) generated by the image-capturing device, a corresponding temperature measurement, and the device setting of the image-capturing device; detecting an amount of emitted radiation of selected regions within the enclosure based on a first image in the FOV captured by the image-capturing device at the device setting; determining whether at least one region of said selected regions is poor responsive, which is underexposed or overexposed, such that an accurate temperature is unable to be estimated based on the intensity-temperature mapping associated with the device setting; and replacing, using a computer processor, temperatures of the at least one poor responsive region with temperatures from acceptable regions unaffected by a saturation from at least one other image in the FOV captured at a different device setting in order to provide an extended temperature mapping of the enclosure, wherein the extended temperature mapping has higher temperature resolution and range than that associated with the first image in the FOV.
2. The process according to claim 1, further comprising: providing a plurality of predetermined device settings; changing the device setting of the image-capturing device to a different predetermined device setting when the at least one portion of each selected region is poor responsive; and maintaining the device setting of the image-capturing device when the temperature is free of poor response.
3. The process according to claim 1, further comprising: providing a plurality of predetermined device settings; sequentially capturing a predetermined number of images at different predetermined device settings; and selecting a subset of acceptable images from the captured images at the different predetermined device settings for substituting the poor responsive regions of the first image with corresponding regions of the selected subset of acceptable images.
4. The process according to claim 1, further comprising: partitioning the first image captured by the image-capturing device based on the temperatures from the intensity-temperature mapping; and identifying the poor responsive regions of the first image for which an accurate temperature is unable to be estimated for replacement.
5. The process according to claim 1, further comprising: generating a plurality of images for the same FOV based on different device settings; and retrieving corresponding regions of the first image from the at least one other image that shares substantially the same FOV.
6. The process according to claim 5, further comprising: detecting a different temperature range of the selected regions of the first image based on the device settings; and creating sub-regions of the selected regions based on the corresponding intensity-temperature mapping.
7. The process according to claim 6, further comprising: searching for the at least one other image having regions unaffected by poor responsiveness for the higher temperature resolution; and selecting the acceptable portions unaffected by the poor responsiveness from the at least one other image based on the temperature values.
8. The process according to claim 7, further comprising: determining which portions of the acceptable regions have higher temperature resolutions based on the temperature values; and substituting at least one portion of the poor responsive regions with the portions of the acceptable regions for obtaining better temperature resolution in a predetermined temperature range.
9. An apparatus for mapping temperatures in an enclosure, the apparatus comprising: a mapping unit configured for: providing a device setting for an image-capturing device; generating an intensity-temperature mapping by performing an intensity-temperature calibration based on an intensity of an image pixel in a field of view (FOV) generated by the image-capturing device, a corresponding temperature measurement, and the device setting of the image-capturing device; detecting an amount of emitted radiation of selected regions within the enclosure based on a first image in the FOV captured by the image-capturing device at the device setting; determining whether at least one region of said selected regions is poor responsive, which is underexposed or overexposed, such that an accurate temperature is unable to be estimated based on the intensity-temperature mapping associated with the device setting; and replacing, using a computer processor, temperatures of the at least one poor responsive region with temperatures from acceptable regions unaffected by a saturation from at least one other image in the FOV captured at a different device setting in order to provide an extended temperature mapping of the enclosure, wherein the extended temperature mapping has higher temperature resolution and range than that associated with the first image in the FOV.
10. The apparatus according to claim 9, wherein the mapping unit is configured for: providing a plurality of predetermined device settings; changing the device setting of the image-capturing device to a different predetermined device setting when the at least one portion of each selected region is poor responsive; and maintaining the device setting of the image-capturing device when the temperature is free of poor response.
11. The apparatus according to claim 9, wherein the mapping unit is configured for: providing a plurality of predetermined device settings; sequentially capturing a predetermined number of images at different predetermined device settings; and selecting a subset of acceptable images from the captured images at the different predetermined device settings for substituting the poor responsive regions of the first image with corresponding regions of the selected subset of acceptable images.
12. The apparatus according to claim 9, wherein the mapping unit is configured for: partitioning the first image captured by the image-capturing device based on the temperatures from the intensity-temperature mapping; and identifying the poor responsive regions of the first image for which an accurate temperature is unable to be estimated for replacement.
13. The apparatus according to claim 9, wherein the mapping unit is configured for: generating a plurality of images for the same FOV based on different device settings; and retrieving corresponding regions of the first image from the at least one other image that shares substantially the same FOV.
14. The apparatus according to claim 9, wherein the mapping unit is configured for: detecting a different temperature range of the selected regions of the first image based on the device settings; and creating sub-regions of the selected regions based on the corresponding intensity-temperature mapping.
15. The apparatus according to claim 9, wherein the mapping unit is configured for: searching for the at least one other image having regions unaffected by poor responsiveness for the higher temperature resolution; selecting the acceptable portions unaffected by the poor responsiveness from the at least one other image based on the temperature values; determining which portions of the acceptable regions have higher temperature resolutions based on the temperature values; and substituting at least one portion of the poor responsive regions with the portions of the acceptable regions for obtaining better temperature resolution in a predetermined temperature range.
16. A non-transitory computer-readable medium storing instructions executable by a computer processor to map temperatures in an enclosure during a combustion process, comprising instructions to: provide a device setting for an image-capturing device; generate an intensity-temperature mapping by performing an intensity-temperature calibration based on an intensity of an image pixel in a field of view (FOV) generated by the image-capturing device, a corresponding temperature measurement, and the device setting of the image-capturing device; detect an amount of emitted radiation of selected regions within the enclosure based on a first image in the FOV captured by the image-capturing device at a particular device setting; determine whether at least one region of said selected regions is poor responsive, which is underexposed or overexposed, such that an accurate temperature is unable to be estimated based on the intensity-temperature mapping associated with the device setting; and replace, using a computer processor, temperatures of the at least one poor responsive region with temperatures from acceptable regions unaffected by the saturation from at least one other image captured at a different device setting in order to provide an extended temperature mapping of the enclosure, wherein the extended temperature mapping has higher temperature resolution and range than that associated with the first image in the FOV.
17. The medium according to claim 16, further comprising instructions to: provide a plurality of predetermined device settings; change the device setting of the image-capturing device to a different predetermined device setting when the at least one portion of each selected region is poor responsive; and maintain the device setting of the image-capturing device when the temperature is free of poor response.
18. The medium according to claim 16, further comprising instructions to: provide a plurality of predetermined device settings; sequentially capture a predetermined number of images at different predetermined device settings; and select a subset of acceptable images from the captured images at the different predetermined device settings for substituting the poor responsive regions of the first image with corresponding regions of the selected subset of acceptable images.
19. The medium according to claim 16, further comprising instructions to: partition the first image captured by the image-capturing device based on the temperatures from the intensity-temperature mapping; identify the poor responsive regions of the first image for which an accurate temperature is unable to be estimated for replacement; generate a plurality of images for the same FOV based on different device settings; and retrieve corresponding regions of the first image from the at least one other image that shares substantially the same FOV.
20. The medium according to claim 16, further comprising instructions to: detect a different temperature range of the selected regions of the first image based on the device settings; create sub-regions of the selected regions based on the corresponding intensity-temperature mapping; search for the at least one other image having regions unaffected by poor responsiveness for the higher temperature resolution; select the acceptable portions unaffected by the poor responsiveness from the at least one other image based on the temperature values; determine which portions of the acceptable regions have higher temperature resolutions based on the temperature values; and substitute at least one portion of the poor responsive regions with the portions of the acceptable regions for obtaining better temperature resolution in a predetermined temperature range.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
DETAILED DESCRIPTION OF THE INVENTION
(5) Referring now to
(6) The mapping unit 10 may reside in or be coupled to a server or computing device 14 (including, e.g., database and video servers), and is programmed to perform tasks and display relevant data for different functional units via a network 16. It is contemplated that other suitable networks can be used, such as a corporate Intranet, a local area network (LAN) or a wide area network (WAN), and the like, using dial-in connections, cable modems, high-speed ISDN lines, and other types of communication methods known in the art. All relevant information can be stored in the databases for retrieval by the mapping unit 10 or the computing device 14 (e.g., as a data storage device and/or a machine readable data storage medium carrying computer programs). Another exemplary mapping unit 10 is disclosed in commonly assigned U.S. patent application Ser. No. 14/306,047, which is incorporated by reference in its entirety.
(7) A plurality of image-capturing devices 18, 20 are mounted around the enclosure 12 (with two devices being shown in this example, but with additional devices being included, if desired). Each of the image-capturing devices 18, 20 captures image sequences covering a selected interior portion or region of the enclosure 12, for which temperature is to be measured. A plurality of temperature sensors 22, such as thermal couples or pyrometers, which are each observable by one or more image-capturing devices 18, 20 are placed inside the enclosure 12. Although only two image-capturing devices 18, 20 and two temperature sensors 22 are shown for illustration purposes, any number of devices and sensors can be used. Alternatively, even a single image-capturing device 18 can be used. Each image-capturing device 18, 20 can be liquid-cooled by directing the inflow of cold coolant C.sub.IN to the device, and delivering the outflow of warm coolant C.sub.OUT from device to an outlet.
(8) A cable 24 (or other signal transferring means, such as wireless communication) may be used to connect the sensors 22 and the image-capturing devices 18, 20 to the computing device 14, which may also have digitization, storage, and user interface capabilities. The computing device 14 receives temperature outputs or signals from the temperature sensors 22 and image sequences from the image-capturing devices 18, 20 to set proper parameters or settings of the image-capturing devices for performing subsequent intensity-temperature calibration and for estimating the temperature of the selected region of the enclosure 12.
(9) An exemplary calibration and temperature estimation method is disclosed in commonly assigned U.S. patent application Ser. No. 14/296,265, which is incorporated by reference in its entirety. As described in the above '932 application, an intensity of the corresponding image pixel is transformed to the temperature based on device settings of the image-capturing device 18, 20 and the image pixel. Then, this intensity to temperature transformation process performs computation or estimation of the temperatures of image pixels in a field of view (or FOV) of the corresponding image-capturing device 18, 20 by using the intensity-temperature calibration function.
(10) In one embodiment, the temperatures are computed and estimated from a set of intensity images, which are captured by the image-capturing devices 18, 20 that are optimally placed in or in association with the enclosure 12. As shown in
(11) When the amount of emitted radiation at a first predetermined device setting saturates the intensity of an image pixel, the amount of emitted radiation at a second predetermined device setting may not saturate the same image pixel in the corresponding image due to a different device setting. Conversely, if the amount of emitted radiation at the second predetermined device setting is too low or underexposed in the image, the amount of emitted radiation at the first predetermined device setting may provide better image intensities at the same pixel in the image. The mapping unit 10 performs a temperature mapping process or method that substitutes or replaces overexposed or underexposed portions of the image for providing an extended temperature mapping of the furnace enclosure 12.
(12) As explained in greater detail below, if the number of bits per pixel in the image devices 18, 20 is equal to 8, the device can measure 2.sup.8 (or 256) distinct temperature values (e.g., 0-255). Specifically, when the region is saturated or overexposed, the temperature value is read as 255, and when the region is underexposed, the temperature value is read as zero (0). Thus, the temperature value of each of the overexposed regions is equal to a maximum value (i.e., 255) that is detectable by the image-capturing device, and similarly, the temperature value of each of underexposed regions is equal to a minimum temperature value (i.e., 0) that is detectable by the image-capturing device, regardless of the fact that the regions may have different temperature values in reality. More detailed descriptions of certain features of the present mapping process are provided below.
(13) Referring now to
(14)
T=f{I,S}(1)
(15) In this example, considering an 8-bit image capturing device, when the first image-capturing device 18 is set to detect the emitted radiation at the first predetermined device setting S.sub.1, the measurable temperature range R.sub.1 may be between 500-1100 F. (or 260-600 C.), wherein the minimum temperature value MIN of 500 F. is read as zero (0) pixel intensity, and the maximum temperature value MAX of 1100 F. is read as 255. Thus, certain regions of the furnace enclosure 12 having temperatures lower than 500 F. are underexposed and still read as 0, and other regions having temperatures higher than 1100 F. are saturated or overexposed and also read as 255. A first graph designated S.sub.1 represents the intensity-temperature relationship associated with the first predetermined device setting S.sub.1.
(16) Similarly, when the same image-capturing device 18 is set to detect the emitted radiation at the second predetermined device setting S.sub.2, the measurable temperature range R.sub.2, for this example, may be between 1000-1600 F. (or 530-900 C.), wherein the minimum temperature value of 1000 F. is read as zero (0), and the maximum temperature value of 1600 F. is read as 255. Thus, certain regions of the furnace enclosure 12 having temperatures lower than 1000 F. are underexposed and read as 0, and other regions having temperatures higher than 1600 F. are saturated or overexposed and read as 255. A second graph designated S.sub.2 represents the intensity-temperature relationship associated with the second predetermined device setting S.sub.2. A shared area between two graphs S.sub.1, S.sub.2 represents a common temperature range (i.e., 1000-1100 F. or 530-600 C.) where either one of the graphs can be used to estimate identical temperature values. The temperature estimates in this common temperature range can also be used to improve the accuracy of the estimated temperature as part of the calibration process. Detailed explanation can be found in U.S. patent application Ser. No. 14/296,286.
(17) Likewise, when the same image-capturing device 18 is set to detect the emitted radiation at the third predetermined device setting S.sub.N, the measurable temperature range, for this example, may be between 1500-2500 F. (or 810-1400 C.), wherein the minimum temperature value of 1500 F. is read as zero (0), and the maximum temperature value of 2500 F. is read as 255. Thus, certain regions of the furnace enclosure 12 having temperatures lower than 1500 F. are underexposed and read as 0, and other regions having temperatures higher than 2500 F. are saturated or overexposed and read as 255. A third graph designated S.sub.N represents the intensity-temperature relationship associated with the third predetermined device setting S.sub.N.
(18) As a result, by merging or coalescing the these graphs S.sub.1, S.sub.2, and S.sub.N, an extended temperature profile covering the temperature range of 500-2500 F. (or 260-1400 C.) is achieved from the different images captured using different device setting. Of course, other temperature ranges than those provided in this example for each image-capturing device viewing other regions of the furnace enclosure 12 are also contemplated. Preferably, each temperature range overlaps at least one of the other temperature ranges such as where the upper endpoint of the first range and the lower endpoint of the second range overlap by 100 F., and the upper endpoint of the second range and the lower endpoint of the third range also overlap by 100 F. Other overlap amounts besides 100 F. are also contemplated, and it is also contemplated that different overlap amounts could be used between each of the various temperature ranges.
(19) Referring now to
(20) When the mapping unit 10 identifies one or more saturated (or alternatively, underexposed) regions in the first image IMAGE1 based on the corresponding temperature values of the regions, the saturated (or alternatively, underexposed) regions are substituted or replaced by additional acceptable regions from other images having a substantially identical FOV. The term acceptable regions refers to the regions that are neither overexposed nor underexposed, whereas the term poor responsive regions refers to the regions that are either overexposed or underexposed. For example, if one or more regions of IMAGE1 (indicated by the broken lines) having the same intensity-temperature value (255, 1000) are saturated and read as 255, then the mapping unit 10 will retrieve the corresponding regions in other images that share substantially the same FOV.
(21) A second image IMAGE2 captured by the same image-capturing device 18 using the setting S.sub.2 (e2, g2) shows various temperature regions based on the pair of the observed pixel intensity and the corresponding temperature (I, T) as in the first image IMAGE1 having substantially the same FOV. However, because the second image is captured with the second predetermined device setting S.sub.2 and thus is capable of detecting a different temperature range than that of the first image, the regions in IMAGE1 having the intensity-temperature value (255, 1000) are not saturated in the second image IMAGE2. The mapping unit 10 creates sub-regions having different intensity-temperature values of the unsaturated regions in the second image IMAGE2, designated (127, 920), (150, 1020), and (120, 880), and selects or flags the unsaturated regions as the additional acceptable regions.
(22) Similarly, the temperature mapping method can be performed for the underexposed regions by the mapping unit 10 to obtain better temperature resolution in the low temperature range (e.g., 100-500 F.). For example, the regions in IMAGE2 (indicated by the broken lines) having the intensity-temperature value (10, 150) can be replaced with the regions in the first image IMAGE1, designated (20, 100), (40, 200), and (60, 350) due to the regions not under-saturated in IMAGE1. As such, the temperature mapping method can be iteratively performed for the poor responsive regions by the mapping unit 10 to obtain better temperature resolution in the low (e.g., below 500 F. or 260 C.) and high (e.g., above 2500 F. or 1400 C.) temperature ranges.
(23) Accordingly, a combined image IMAGE.sub.FUSED is generated by combining acceptable or valid regions of the first and second images IMAGE1, IMAGE2, by complementarily replacing or substituting the overexposed or underexposed regions in IMAGE.sub.1 and IMAGE.sub.2. In a preferred embodiment, the temperature values are combined for the fused image IMAGE.sub.FUSED. The intensity of a particular pixel in the combined image IMAGE.sub.FUSED is derived from the corresponding intensity of image pixel in the first and second images IMAGE.sub.1, IMAGE.sub.2 captured at two different gain and exposure settings S.sub.1 (e1, g1), S.sub.2 (e2, g2) using the corresponding intensity to temperature mapping functions. The resulting IMAGE.sub.3 can be used for display purposes. Thus, the intensity values and the device settings associated with the first and second images IMAGE.sub.1, IMAGE.sub.2 are different and may not be combined directly in the fused image IMAGE.sub.FUSED.
(24) Original or initial images IMAGE.sub.1, IMAGE.sub.2 are selected such that the chosen pixels are neither oversaturated nor underexposed. When a multispectral imager is used, the pixels should be valid in all channels. An important aspect of the present process is that although the original images IMAGE.sub.1, IMAGE.sub.2 may have an 8 or 12 bit per pixel resolution, the resulting image IMAGE.sub.FUSED may be converted to a higher bit depth (e.g., 16 bits per pixel resolution) to retain the dynamic range captured from multiple images IMAGE1, IMAGE2. As a result, the present process increases the dynamic range of temperature measurement, and further increases the accuracy of the initial images IMAGE.sub.1, IMAGE.sub.2. The final temperature measurements shown in IMAGE.sub.FUSED have higher precision as they are derived from multiple images IMAGE.sub.1, IMAGE.sub.2 when compared to other conventional methods.
(25) During operation, a low-cost 8-bit camera may be used instead of cameras with high bits per pixel resolution. The accuracy of the detected temperature readings is substantially improved as the same FOV is captured at different exposure and gain settings, by merging the temperature estimates from valid regions from images IMAGE.sub.1, IMAGE.sub.2. More than two images including an N-th image IMAGE.sub.N can be used to complement offset errors. Transient errors caused by the dynamic nature of the flame are also reduced by averaging temperatures across valid regions of the images, IMAGE.sub.1, IMAGE.sub.2, . . . , IMAGE.sub.N, which are taken within a small time window.
(26) Referring now to
(27) The method begins at step 100. In step 102, as illustrated in
(28) A polynomial regression method is preferably performed to the intensity-temperature mapping functions of the selected regions in the FOV of the corresponding image-capturing device 18, 20. The polynomial regression method is done by performing a least square error or approximation. An exemplary polynomial regression method is disclosed in commonly assigned U.S. patent application Ser. No. 14/296,286, which is incorporated by reference in its entirety.
(29) Further the process of high dynamic range temperature estimation can follow either the path from step 104 to step 112 or the path from step 116 to step 112 as an alternate method.
(30) In step 104, the mapping unit 10 selects the first predetermined device setting S.sub.1, and sets the first image-capturing device 18 to the selected device setting S.sub.1 based on an image analysis. It is also contemplated that the mapping unit 10 may select any one of the predetermined device settings S.sub.1, S.sub.2, or S.sub.N as an initial device setting. Similarly, the mapping unit 10 may initially set any one of the available image-capturing devices 18, 20 to the selected device setting to suit different applications. An exemplary image analysis is performed by the mapping unit 10 based on a predetermined percentage of acceptable regions in the image captured by the image-capturing device 18, 20. For example, when a certain percentage (e.g., 20%) of the image is over-saturated or certain regions of interest are over-saturated (e.g., near the burner area), the image-capturing device 18 automatically switches to a different device setting (e.g., S.sub.2) such that the unacceptable regions are not over-saturated.
(31) More specifically, in step 106, when the mapping unit 10 determines that the image is over-saturated based on the image analysis, control proceeds to step 108. Otherwise, control proceeds to step 110.
(32) In step 108, the mapping unit 10 changes the current device setting S.sub.1 of the first image-capturing device 18 to the next available device setting S.sub.2. During this acquisition time, the mapping unit 10 receives the new device setting S.sub.2 (e2, g2) from the data storage device, which was previously saved during the calibration process.
(33) In step 110, when the new device setting S.sub.2 is determined to be acceptable (i.e., the image taken using the new setting S.sub.2 is not saturated), the image-capturing device 18 maintains and uses the currently selected device setting S.sub.2 for capturing subsequent images.
(34) In step 112, as illustrated in
(35) Control may end at step 114. However, in step 102, control may simultaneously or alternatively, proceed to step 116 to suit a different application. In step 116, the mapping unit 10 sequentially captures a predetermined number of images at different device settings (e.g., IMAGE.sub.1 at S.sub.1, IMAGE.sub.2 at S.sub.2, and IMAGE.sub.N at S.sub.N, where N is an integer). These images are usually obtained in quick succession to minimize the change in the furnace and/or heat distribution. For example, the mapping unit 10 selects a set of device settings for different aperture, gain and exposure values from the preset settings that were saved from the calibration process, and captures a sequence of images of the furnace enclosure 12 with each available device setting S.sub.1, S.sub.2, and S.sub.N. If mean temperature in the furnace enclosure 12 is known based on prior estimates and/or thermal couple readings in the current field of view, the mapping unit 10 may select a subset of preset device settings [S.sub.K . . . S.sub.K+n]. These preset settings are based on the minimum and maximum recorded temperatures of the furnace, so that the images captured at these settings capture the full range of temperatures (i.e. from a minimum temperature to a maximum temperature). In step 118, as illustrated in
(36) In step 120, when the subset of images IMAGE.sub.1-M are determined to be acceptable (i.e., not saturated), the image-capturing device 18 maintains and uses the current subset of images for estimating the temperature values. Control proceeds to step 112 and ends at step 114.
(37) While a particular embodiment of the present mapping process has been described herein, it will be appreciated by those skilled in the art that changes and modifications may be made thereto without departing from the invention in its broader aspects and as set forth in the following claims.