Image recording method and image recording device
11297250 · 2022-04-05
Assignee
Inventors
- Ingo Doser (Villingen-Schwenningen, DE)
- Nicole Giessler (Triberg, DE)
- Alexander Raiola (Furtwangen, DE)
- Sebastien Weitbruch (Niedereschach, DE)
- Andreas Hanselmann (Freiburg, DE)
- Clemens Meier (Seelbach, DE)
- MATEUSZ CICHOSZ (FREIBURG, DE)
- JOCHEN DIETRICH (ELZACH, DE)
- Massimo Kubon (Emmendingen, DE)
- Patrick Spring (Freiburg, DE)
Cpc classification
G03B7/16
PHYSICS
H04N23/555
ELECTRICITY
International classification
Abstract
An image recording method (100) and an image recording device (1) for recording a sequence of single images of a scene (3) are provided, wherein the scene (3) is illuminated using an illumination unit (4), a light intensity generated by the illumination unit (4) is characterized by an illumination variable (47), a setting of the illumination variable (47) is performed as long as a regulating reserve (19) of an optimum regulating range (39) of the exposure parameter (46) is present, and a setting of the illumination variable (47) is performed or repeated until the illumination variable (47) is within an optimum regulating range (30) of the illumination variable (47).
Claims
1. An image recording method (100) for recording a sequence of single images of a scene (3) using an image recording device (1), the method comprising: illuminating the scene (3) using an illumination unit (4), setting an exposure parameter (46) in dependence on a respective brightness value of a single image in a first control loop, wherein a light intensity generated by the illumination unit (4) is characterized by an illumination variable (47), setting the illumination variable (47) in a second control loop as long as a regulating reserve (19) of the exposure parameter (46) is present, wherein the regulating reserve (19) of the exposure parameter (46) corresponds to a respective distance of a current value of the exposure parameter (46) to a lower limiting value (40) or an upper limiting value (41) of an optimum regulating range, in order to avoid excessive heat generation, and performing a check (18) as to whether the regulating reserve (19) of the exposure parameter (46) is present before the setting of the illumination variable (47) is performed.
2. The image recording method (100) as claimed in claim 1, further comprising: defining or predefining an optimum regulating range (30) of the illumination variable (47), which is within an overall regulating range (28) of the illumination variable (47), in the second control loop, performing a check (20) as to whether a current value of the illumination variable (47) is within the optimum regulating range (30) of the illumination variable (47), changing the illumination variable (47) if the current value of the illumination variable (47) is outside the optimum regulating range (30) of the illumination variable (47), until the current value of the illumination variable (47) is within the optimum regulating range (30) of the illumination variable (47).
3. The image recording method (100) as claimed in claim 2, wherein the limits of the regulating reserve (19) are defined or predefined by limiting values (37, 38, 40, 41) of an optimum regulating range (39) of the exposure parameter (46), wherein the optimum regulating range (39) is within an overall regulating range (29) of the exposure parameter (46), and the method further comprising changing the illumination variable (47) until a current value of the exposure parameter (46) is within the optimum regulating range (39) of the exposure parameter (46) and as long as a current value of the illumination variable (47) is within the optimum regulating range (30) of the illumination variable (47).
4. The image recording method (100) as claimed in claim 2, wherein regulation of the illumination variable (47) is not performed if a current value of the illumination variable (47) is within the optimum regulating range (30) of the illumination variable (47).
5. The image recording method (100) as claimed in claim 1, wherein the exposure parameter (46) is at least one of an amplification factor (33), an exposure time (34), or an aperture setting.
6. The image recording method (100) as claimed in claim 5, wherein the exposure parameter (46) is comprised of a regulating range (45) of an exposure time (34) and a regulating range (44) of an amplification factor (33), and the regulating range (44) of the amplification factor (33) begins after reaching a maximum exposure time (36).
7. The image recording method (100) as claimed in claim 1, wherein the illumination variable (47) is a parameter or a combination of two or more parameters from the group including a light intensity (48) of the illumination unit (4), a power consumption of the illumination unit (4), a temperature of the illumination unit (4), an ambient temperature, or a control signal of the illumination unit (4).
8. The image recording method (100) as claimed in claim 1, wherein setting of the illumination variable (47) is not performed if the exposure parameter (46) is outside the optimum regulating range (39) of the exposure parameter (46) and a current value of the illumination variable (47) corresponds to an upper limiting value (32) or a lower limiting value (31) of the optimum regulating range (30) of the illumination variable (47).
9. The image recording method (100) as claimed in claim 1, wherein the setting of the illumination variable (47) is performed iteratively.
10. The image recording method (100) as claimed in claim 1, wherein in the event of a change of the illumination variable (47), an opposing change of the exposure parameter (46) takes place.
11. The image recording method (100) as claimed in claim 1, further comprising: performing a measurement of at least one of a temperature of the illumination unit (4) or an ambient temperature, and if the measured temperature value reaches or exceeds a temperature limiting value, reducing at least one of the current value of the illumination variable (47) or an upper limiting value (32) of the optimum regulating range (30) of the illumination variable (47) to a lower value, or increasing an upper limiting value (41) of the optimum regulating range (39) of the exposure parameter (46).
12. The image recording method (100) as claimed in claim 11, wherein the upper limiting value (41) of the optimum regulating range (39) of the exposure parameter (46) is only increased if a current value of the exposure parameter (46), at the point in time of reaching or exceeding the temperature limiting value, corresponds to the original upper limiting value (41) of the optimum regulating range (39) of the exposure parameter (46).
13. The image recording method (100) as claimed in claim 11, wherein if one of the measured temperature value of the illumination unit (4) or the ambient temperature falls below one or the temperature limiting value, automatically checking whether an increase of at least one of the current value of the illumination variable (47) or an increase of the upper limiting value (32) of the optimum regulating range (30) of the illumination variable (47) or a reduction of the upper limiting value (41) of the optimum regulating range (39) of the exposure parameter (46).
14. The image recording method (100) as claimed in claim 1, wherein the image recording method (100) is executed using an image recording device (1) comprising as an endoscope (2), and at least one of an image sensor (8) or the illumination unit (4) are arranged in an endoscope tip (9).
15. The image recording method (100) as claimed in claim 1, wherein the illumination unit (4) comprises a pulsed light source, at a flash frequency of 60 Hz, and a change of the illumination variable (47) is performed at an interval of at most 25 ms.
16. An image recording device (1) for recording a sequence of single images of a scene (3), the image recording device (1) comprising: an illumination unit (4) for illuminating the scene (3), the illumination unit being configured to generate light having a light intensity (48) characterized by an illumination variable (47), an exposure controller (5) configured to control an exposure parameter (46) in dependence on a respective brightness value of a single image in a first control loop, an illumination controller (6) configured to control the illumination variable (47) in a second control loop as long as a regulating reserve (19) of the exposure parameter (46) is present, wherein the regulating reserve (19) of the exposure parameter (46) corresponds to a respective distance of a current value of the exposure parameter (46) to a lower limiting value (40) or an upper limiting value (41) of an optimum regulating range, in order to avoid excessive heat generation, a control connection (7) between the exposure controller (5) and the illumination controller (6), and the image recording device is configured to perform a check (18) as to whether the regulating reserve (19) of the exposure parameter (46) is present before setting the illumination variable (47).
17. The image recording device (1) as claimed in claim 16, wherein the illumination controller (6) is configured to set the illumination variable (47) in dependence on a current value of the exposure parameter (46).
18. The image recording device (1) as claimed in claim 16, wherein the image recording device (1) comprises an endoscope (2).
19. The image recording method (100) as claimed in claim 1, wherein the setting of the illumination variable (47) is performed with priority over the setting of the exposure parameter (46), such that a heat development which results due to the illumination unit (4) on the tissue to be examined is minimized.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The invention will now be described in greater detail on the basis of an exemplary embodiment, but is not restricted to this exemplary embodiment. Further exemplary embodiments result by way of the combination of the features of individual or multiple claims with one another and/or with individual or multiple features of the exemplary embodiments.
(2) In the figures:
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
DETAILED DESCRIPTION
(13)
(14) A detail view of a controller unit 11 is shown in a simplified schematic manner in
(15) The image recording device 1 is capable of recording a sequence of single images of a scene 3. Thus, for example, a video sequence of the scene 3 can be recorded.
(16) The image recording device 1 comprises an illumination unit 4, the emission region of which is oriented in the usage position onto the scene 3 to be recorded, while a field of view of an image sensor 8 of the image recording device 1 is also oriented on the scene 3. The illumination unit 4 is thus suitable for illuminating the scene 3 during the recording of the sequence of single images. A settable light intensity 48 of the illumination unit 4 can be characterized in this case by an illumination variable 47. The illumination variable 47 thus relates at least to a parameter by which a current value of the light intensity 48 emitted by the illumination unit 4 is determinable or determined directly or indirectly. The illumination variable 47 can also correspond in this case to a light intensity 48 emitted by the illumination unit 4.
(17) The image recording device 1 furthermore comprises an exposure controller 5, which is configured for controlling an exposure parameter 46. The setting of the exposure parameter 46 is preferably performed automatically by the exposure controller 5 in a first control loop. The exposure controller 5 is connected via a control line 13 to the image sensor 8. For example, the control line 13 can be a bidirectional control line. This has the advantage that only one control line is required for emission and reception, which reduces the overall space requirement.
(18) To be able to perform a setting of the above-mentioned illumination variables 47, in particular automatically, the image recording device 1 additionally comprises an illumination controller 6, which is configured to set the illumination variable 47 in a second control loop.
(19) Exposure controller 5 and illumination controller 6 can be combined to form the controller unit 11.
(20) A single image is thus acquired by the image sensor 8 and transmitted via an image data transmission line 12, in particular a video line, from the image sensor 8 to the camera controller unit (abbreviated CCU) 11. Processing of the single images takes place in the controller unit 11, for example, video processing (in particular by method steps such as video sensor processing, video signal processing, and/or video output processing). A processed sequence, for example, as a video, is transmitted from the controller unit 11 via a signal line 15 to a display unit 10. The display unit 10 can be designed, for example, as a display screen and is configured for displaying the recorded single images.
(21) During the processing of the image data by the controller unit 11, the image signal of the recorded single image is transmitted to the exposure controller 5. A computation of the exposure parameter 46 (in particular of the amplification factor 33 and the exposure time 34) is then performed by the exposure controller 5.
(22) The ascertained value of the exposure parameter 46 is subsequently transmitted to the illumination controller 6 and/or to the image sensor 8. A transmission from the exposure controller 5 to the illumination controller 6 occurs in this case via a control connection 7.
(23) The illumination controller 6 is connected via a control line 14 to the illumination unit 4. The control line 14 can be designed in particular as a bidirectional control line. This has the advantage that only one control line is required for transmission and reception, which reduces the overall space requirement. In this design, the illumination unit 4 can thus be arranged spatially separated from the illumination controller 6. For example, in this case the illumination unit 4 can be arranged in an endoscope tip 9 and/or the illumination controller 6 can be arranged on the controller unit 11.
(24) According to an alternative design, the illumination unit 4 can also be arranged and/or designed farther away from the endoscope tip 9, for example, as a combined unit with the illumination controller 6 (not shown in the figures). In this case, for example, a transmission of the light emitted by the illumination unit 4 can take place via a light guide 17 up to the endoscope tip 9 to be able to illuminate the scene 3.
(25) To be able to avoid “pumping of the brightness” as much as possible or at least reduce it to a minimum, the illumination unit 4 and/or the illumination controller 6 can be configured to perform a change of the brightness level step-by-step. A step-by-step change is dependent in this case on the illumination unit 4 and/or on a distance of a current value of the illumination variable 47 from a target value and/or an optimum regulating range 30 of the illumination variable 47. If, for example, a recorded single image is excessively dark, the illumination unit 4 has to be adjusted brighter rapidly to have a less noisy image, so that large change steps are used.
(26) It can be provided in this case that the illumination unit 4 is designed as a pulsed light source. The illumination unit 4 and/or the illumination controller 6 can be configured in this case in such a way that at a flash frequency of 60 Hz of the illumination unit 4, a change of the illumination variable 47 is possible at an interval of at most 25 ms, in particular at an interval of at most 20 ms, in particular at an interval of at most 16.6 ms. Alternatively or additionally, it can be configured in such a way that at a flash frequency of 50 Hz of the illumination unit 4, a change of the illumination variable 47 is possible at an interval of at most 30 ms, in particular at an interval of at most 25 ms, in particular at an interval of at most 20 ms.
(27) An automatic setting of the illumination variable 47 by the illumination controller 6 is thus performed in dependence on a current value of the exposure parameter 46, since because of the control connection 7, a transmission of a current value of the exposure parameter 46 to the illumination controller 6 is possible. The exact regulation can be performed in this case, for example, by the image recording method 100 described hereafter (see
(28) The image recording method 100 is thus used for recording a sequence of single images of a scene 3, as was already described above with reference to the image recording device 1.
(29) The image recording method 100 comprises a first control loop, by which a setting of an exposure parameter 46 is performed in dependence on a respective brightness value of a single image already recorded by the image recording device 1.
(30) In particular in medical applications of the image recording device 1 and/or the image recording method 100, it is to be ensured that a heat development which results due to the illumination unit 4 on examined tissue is kept as low as possible.
(31) In previous image recording devices and image recording methods, the setting of an illumination variable 47 was generally performed manually by a user. However, this had the disadvantage that either an optimum exposure situation did not prevail, or the heat development was in a critical range since, for example, the light intensity 48 of the illumination unit 4 is set excessively high.
(32) The invention wishes to provide aid here to enable a more appropriate setting of the light intensity 48. This therefore takes place according to the invention in dependence on the exposure parameter 46.
(33) A check 18 is performed by the image recording method 100 as to whether a regulating reserve 19 of the exposure parameter 46 is present before a setting of the illumination variable 47 is performed.
(34) To be able to avoid excessively strong heat development, firstly an optimum regulating range 30 of the illumination variable 47 can be defined or a predefined optimum regulating range 30 can be selected. The optimum regulating range 30 is within an overall regulating range 28 of the illumination variable 47 in this case.
(35) An automated change of the illumination variable 47 can be performed in dependence on multiple situations, which are described in detail hereafter.
(36) The limits of the regulating reserve 19 can correspond in this case, for example, to the limiting values 40, 41 of an optimum regulating range 39 of exposure parameter 46. The optimum regulating range 39 can be predefined in this case or set by the users. The optimum regulating range 39 is within an overall regulating range 29 of the exposure parameter 46 here. As shown in
(37) A desired result of the image recording method 100 is always a setting of the illumination variable 47 within the optimum regulating range 30 and, if the illumination variable 47 enables it, a setting of the exposure parameter 46 within the optimum regulating range 39. The setting of the illumination variable 47 is thus performed with priority over the setting of the exposure parameter 46.
(38) After checking a current value of the exposure parameter 46, it is compared how far away this is from a lower limiting value 40 or an upper limiting value 41 of the optimum regulating range 39 of the exposure parameter 46. The respective distance to the limiting values 40, 41 represents the regulating reserve 19.
(39) In dependence on whether a regulating reserve 19 is present (+) or is not present (−), a different method sequence takes place, as shown in
(40) In principle, the regulation of the illumination variable 47 and the regulation of the exposure parameter 46 take place in opposition. In the case of an increase of the illumination variable 47, a reduction of the exposure parameter 46 takes place. In the case of a reduction of the illumination variable 47, an increase of the exposure parameter 46 takes place.
(41) If a regulating reserve 19 is present, a check 20 of the illumination variable 47 thus takes place. If a current value of the illumination variable 47 is within the optimum regulating range 30, no further action thus takes place.
(42) If a current value is less than or equal to 21 the lower limiting value 31 of the illumination variable 47, the illumination variable 47 is thus adjusted upward until a new current value is within the optimum regulating range 30. The exposure parameter 46 can be reduced at the same time.
(43) If a current value is greater than or equal to 22 the upper limiting value 32 of the illumination variable 47, the illumination variable is thus adjusted downward until a new current value is within the optimum regulating range 30. The exposure parameter 46 can be increased at the same time.
(44) If no regulating reserve is present, a check 25 takes place as to whether a current value of the exposure parameter 46 is less than or equal to 26 the lower limiting value 40 of the exposure parameter 46 or is greater than or equal to 27 the upper limiting value 41 of the exposure parameter 46.
(45) In the case of situation 26 (current value is less than or equal to the lower limiting value 40), an unnecessarily high temperature development can exist. A check 20 takes place of the illumination variable 47. If a situation 49 exists, that a current value of the illumination variable 47 is greater than the lower limiting value 31 of the illumination variable 47, a reduction 24 of the illumination variable 47 thus takes place, wherein a newly set value of the illumination variable 47 is greater than or equal to the lower limiting value 31.
(46) In the case of situation 27 (current value is greater than or equal to the upper limiting value 41), a poor image quality can exist, for example, because of noise, since in particular the amplification factor 33 can be set excessively high. A check 20 of the illumination variable 47 takes place. If a situation 50 exists, that a current value of the illumination variable 47 is less than the upper limiting value 32 of the illumination variable 47, an increase of the illumination variable 47 thus takes place, wherein a newly set value of the illumination variable 47 is less than or equal to the upper limiting value 31. In other cases, it can be provided that no action occurs.
(47) The exposure parameter 46 can be a single parameter or multiple parameters, for example an amplification factor 33 and/or an exposure time 34 and/or an aperture setting.
(48) The exemplary embodiment illustrated in the figures involves an exposure parameter 46 composed of a regulating range 45 of the exposure time 34 and a regulating range 44 of the amplification factor 33.
(49) The illumination variable 47 can be a parameter or a combination of two or more parameters selected from the group of a light intensity 48 of the illumination unit 4, a power consumption of the illumination unit 4, a temperature of the illumination unit 4, an ambient temperature, in particular of an endoscope tip 9, and/or a control signal of the illumination unit 4.
(50)
(51) The exemplary embodiment according to
(52) This temperature sensor 51 ascertains a temperature of the endoscope tip 9 and/or the surroundings and conducts the measured temperature as information 52 to a temperature analysis 53, for example, via the control line 13. The temperature analysis 53 is completed in a correspondingly configured unit according to the explanations of
(53)
(54) In the method according to
(55) If this is the case, the method is thus continued in the alternative “y”. If this is not the case, the method is thus continued in the alternative “n”.
(56) In the alternative “y”, the illumination variable 47 is reduced in step 56. This can be achieved either directly by engagement in the value of the illumination variable 47 or—as explained on the basis of
(57) In the alternative “n”, it is ascertained in step 57 whether regulating reserves exist which can be enabled. This can be the case, for example, if an upper limiting value 32 of the optimum regulating range of the illumination variable 47 can be increased or if an upper limiting value 41 of the optimum regulating range of the exposure parameter 46 can be reduced.
(58) If a regulating reserve is present, the method is thus continued with the alternative “y”. If a regulating reserve is not present, the method is thus left with the alternative “n” and possibly executed again cyclically.
(59) In the alternative “y”, the corresponding measure is now taken in step 58 to utilize the regulating reserve. Thus, for example, the illumination variable 47 or the associated upper limiting value 32 can be increased to effectuate or at least enable an increase of the light intensity. Alternatively or additionally, the upper limiting value 41 can be reduced to force an increase of the illumination variable 47.
(60)
(61) It is apparent that the technically accessible range does not extend from 0% to 100%, but rather ends at limits 60, 61. In the extreme case, the limits 60, 61 can also be at 0% and 100%, respectively. The regulating system is configured so that the illumination variable is to remain in the optimum operating range 59, wherein deviations within the limits 60, 61 are temporarily tolerated.
(62) The upper image region of
(63) In step 56, the upper limiting value 32 or the upper limit 61 is reduced. The upper limiting value 32 can be moved with the upper limit 61 in this case. In this way, the optimum operating range 59 is reduced in size. In the example shown, the current value 62 of the illumination variable 47 moves out of the optimum operating range 59 due to this reduction. It is readjusted and has the result that the illumination variable 47 decreases. The illumination unit 4 thus becomes less bright and therefore develops less heat. In this variant, only an indirect engagement is made in the illumination variable 47. In further variants, the illumination variable 47 is directly reduced to achieve a direct reduction of the heat development.
(64) In contrast, the lower limiting value 31 and the lower limit 60 remain unchanged in this method.
(65) In the exemplary embodiments illustrated in the figures, the illumination variable 47 is a light intensity 48 of the illumination unit 4. The illumination variable 47 can in this case be, for example, a numeric ratio between a switched-on time and cycle time, between a switched-off time and cycle time, or between a switched-on-time and a switched-off time in the case of a light source operated in a cyclic or pulsed manner. In further exemplary embodiments, the light intensity 48 can be characterized by a power consumption of a light source.
(66) The invention thus relates in particular to an image recording method 100 and an image recording device 1 for recording a sequence of single images of a scene 3, wherein the scene 3 is illuminated using an illumination unit 4, wherein a light intensity generated by the illumination unit 4 is characterized by an illumination variable 47, wherein a setting of the illumination variable 47 is performed as long as a regulating reserve 19 of an optimum regulating range 39 of the exposure parameter 46 is present, and wherein a setting of the illumination variable 47 is performed or repeated until the illumination variable 47 is within an optimum regulating range 30 of the illumination variable 47.
LIST OF REFERENCE SIGNS
(67) 1 image recording device 2 endoscope 3 scene 4 illumination unit 5 exposure controller 6 illumination controller 7 control connection 8 image sensor 9 endoscope tip 10 display unit 11 controller unit/CCU 12 image data transmission line/video line 13 control line to the image sensor 14 control line to the illumination unit 15 signal line to the display unit 16 general video processing path 17 light guide 18 check as to whether regulating reserve is present 19 regulating reserve 20 check of the value of the illumination variable 21 current value less than or equal to lower limiting value 22 current value greater than or equal to upper limiting value 23 increase of the illumination variable 24 reduction of the illumination variable 25 check of the value of the exposure parameter 26 exposure parameter less than or equal to lower limiting value 27 exposure parameter greater than or equal to upper limiting value 28 overall regulating range of the illumination variable 29 overall regulating range of the exposure parameter 30 optimum regulating range of the illumination variable 31 lower limiting value of the optimum regulating range of the illumination variable 32 upper limiting value of the optimum regulating range of the illumination variable 33 amplification factor 34 exposure time 35 minimal exposure time 36 maximal exposure time 37 minimal amplification factor 38 maximal amplification factor 39 optimum regulating range of the exposure parameter 40 lower limiting value of the optimum regulating range of the exposure parameter 41 upper limiting value of the optimum regulating range of the exposure parameter 42 0% light intensity/minimal illumination variable 43 100% light intensity/maximal illumination variable 44 overall regulating range of the amplification factor 45 overall regulating range of the exposure time 46 exposure parameter 47 illumination variable 48 light intensity 49 current value greater than or equal to lower limiting value 50 current value less than or equal to upper limiting value 51 temperature sensor 52 result of a temperature measurement 53 temperature analysis 54 temperature measurement 55 threshold value comparison 56 decrease illumination variable 57 ascertain regulating reserve 58 increase illumination variable 59 optimum operating range 60 lower limit of 28 61 upper limit of 28 62 current value of 47 100 image recording method