ESTABLISHING A DEGREE OF BROWNING OF FOOD TO BE COOKED

Abstract

In a method for establishing a degree of browning of food to be cooked in a cooking chamber of a household cooking appliance, a reference image is captured by a camera of the household cooking appliance, which camera is directed into the cooking chamber. A first measurement image is captured at a first brightness of a light source of the household cooking appliance, and a second measurement image is captured at a second brightness of the light source. A difference image is generated from the first measurement image and the second measurement image, and the difference image is compared with the reference image.

Claims

1-14. (canceled)

15. A method for establishing a degree of browning of food to be cooked in a cooking chamber of a household cooking appliance, comprising: capturing a reference image by a camera of the household cooking appliance, which camera is directed into the cooking chamber; capturing a first measurement image at a first brightness of a light source of the household cooking appliance; capturing a second measurement image at a second brightness of the light source; generating a difference image from the first measurement image and the second measurement image; and comparing the difference image with the reference image.

16. The method of claim 15, wherein comparing the difference image with the reference image includes subtracting the reference image from the difference image.

17. The method of claim 15, wherein the reference image is a difference image which is generated from a first image captured at the first brightness and a second image captured at the second brightness.

18. The method of claim 15, wherein the first brightness is zero and the second brightness corresponds to a brightness when the light source is switched on.

19. The method of claim 15, further comprising operating the light source by pulse-width modulation at an eye inertia frequency.

20. The method of claim 19, wherein the first measurement image is captured during at least one off-phase of a pulse-width modulation and the second measurement image is captured during at least one on-phase of the pulse-width modulation.

21. The method of claim 15, wherein the light source has an LED.

22. The method of claim 15, wherein the difference image is compared in at least one area with the reference image.

23. The method of claim 15, wherein the difference image is compared with the reference image in an area with the proviso that the area has become darker as a cooking process progresses over time, or that the area is free of a predetermined pattern or that the area has been predetermined by a user.

24. The method of claim 15, further comprising triggering an action by the household cooking appliance based on the comparison of the difference image with the reference image.

25. The method of claim 15, wherein comparing he difference image with the reference image comprises a determination of whether a result of the comparison fulfills a predetermined criterion.

26. The method of claim 25, wherein the result of the comparison comprises reaching a predetermined proportion of pixels with a minimum coloration.

27. The method of claim 15, further comprising compensating a reduction in a brightness of the light source due to ageing.

28. A household cooking appliance, comprising: a camera directed into a cooking chamber; a light source configured to illuminate the cooking chamber; and a control device coupled to the camera and the light source, said household cooking appliance being configured to: capture a reference image by the camera, capture a first measurement image at a first brightness of the light source, capture a second measurement image at a second brightness of the light source, generate a difference image from the first measurement image and the second measurement image, and compare the difference image with the reference image.

Description

[0060] The above-described properties, features and advantages of this invention and the manner in which they are achieved become clearer and more clearly comprehensible in combination with the following schematic description of an exemplary embodiment, which is described in more detail in combination with the drawings.

[0061] FIG. 1 shows a sectional representation of a side view of a household cooking appliance with a cooking chamber, a camera and a light source;

[0062] FIG. 2 shows a temporal progression of an operating current applied to the light source;

[0063] FIG. 3 shows a temporal progression of a radiation intensity measured for a specific pixel of the camera;

[0064] FIG. 4 shows a measurement difference image at a first time;

[0065] FIG. 5 shows a measurement difference image at a subsequent second time;

[0066] FIG. 6 shows a browning image; and

[0067] FIG. 7 shows a gray-scale histogram of the pixels of the browning image.

[0068] FIG. 1 shows a sectional representation of a side view of a household cooking appliance 1 with a heatable cooking chamber 2. The cooking chamber 2 may be an oven chamber and the household cooking appliance 1 may be an oven or a cooker.

[0069] The cooking chamber 2 has on the front side a feed opening 3 which is able to be closed by means of a door 4. The door 4 has a viewing window 5 through which a user obtains a view into the cooking chamber 2 and through which ambient light UL may be incident from the outside into the cooking chamber 2. A camera 7 is arranged on a top wall 6 of a cooking chamber wall, said camera thus being directed from above into the cooking chamber 2. A light source in the form of an LED 8 radiating white useful light NL into the cooking chamber 2 is also arranged on the top wall 6. The camera 7 and the LED 8 are connected to a control device 9 which is also connected to a touch-sensitive screen 10 which is able to be used as a control panel and to a radio module 11 for the wireless data transmission. In the cooking chamber 2, a plurality of foods G1 to G3 which are located in the field of view of the camera 7 are located on a carrier for food to be cooked, in the form of a baking sheet B.

[0070] The control device 9 is designed to operate the LED 8 with the brightness modulated, for example with a rectangular signal at a frequency of at least 50 Hz. The LED 8 is switched on and off by means of the control device 9 at least 50 times a second. If the LED 8 is switched off, the cooking chamber 2 and thus the foods G1 to G3 are only illuminated by means of the ambient light UL, however when the LED 8 is switched on, the foods are illuminated by the useful light NL thereof and the ambient light UL together. The control device 9 may also control the image capturing by the camera 7, and namely in particular synchronously with the on-phases to and/or off-phases to of the LED 8. The control device 9 may also be designed for image processing.

[0071] In particular, the control device 9 is designed to activate the camera 7 and the LED 8 such that initially at the start of a cooking process (where t=t0) a reference bright image is captured during an on-phase te of the LED 8 and, during an off-phase ta of the LED 8 subsequent thereto, a reference dark image is captured by means of the camera 9 as indicated in FIG. 2. To this end, during an off-phase ta the LED 8 is not supplied with current and during an on-phase te the LED is supplied with a maximum electrical current Imax (in Amperes).

[0072] In principle, the reference dark image may also be captured before the reference bright image. There is advantageously a short time period between the reference bright image and the reference dark image, so that the ambient light UL acting as stray light remains the same. Particularly advantageous is a capturing of the reference bright image and the reference dark image immediately one after the other. By subtracting the two images from one another pixel-by-pixel, a reference difference image (not illustrated) may be generated, for example by a corresponding image processing in the control device 9.

[0073] As a result, during an on-phase te of the LED 8 a (first) measurement bright image may be captured by means of the camera 7 and during an immediately preceding or following off-phase ta of the LED 8 a (second) measurement dark image may be captured. Then, for example, by means of the control device 9 the measurement dark image may be subtracted from the measurement bright image pixel-by-pixel or vice-versa in order to generate a measurement difference image. Advantageously, the reference difference image and the measurement difference image are generated in the same manner.

[0074] This may also be denoted as: difference image (t)=bright image (t)dark image (t), optionally in absolute variables.

[0075] FIG. 3 shows a radiation intensity ILED measured by the camera 7 (in Watts per spatial angle sr) of any selected pixel which is assigned to a surface of a food G1 to G3 over time t (in s). The radiation intensity ILED represents a measurement of the brightness of the pixel. The measured radiation intensity ILED is greater generally in a bright image than in a dark image since the ambient light UL illuminates the cooking chamber in addition to the useful light NL and thus the food G1 to G3 reflects more light in the direction of the camera 7. In the course of a cooking process, the intensity of the ambient light UL may alter so that a difference in the radiation intensity ILED of the pixel between the bright image and the dark image also alters, for example as shown here it reduces. Moreover, by the browning of the food G1 to G3, the value of the radiation intensity ILED of the pixel measured by the camera 7 may be reduced for the bright image and for the dark image.

[0076] FIG. 4 shows as a gray-scale photograph a measurement difference image MD1 of two foods, namely of a piece of dough G1 and a garnished pizza G2, at a time t1>t0 of the cooking process. FIG. 5 shows as a gray-scale photograph a measurement difference image MD2 of the two foods G1 and G2 shown in FIG. 4, at a time t2>t1 of the cooking process progressed further. In both images, for example, the baking sheet B is covered with baking paper P which also appears as dark. Baking paper is typically brown. Thus without further measures the baking paper would be taken into consideration when determining the degree of browning, which could considerably falsify the determination.

[0077] For determining the degree of browning, in order to consider only pixels which show a browning progression, the measurement difference image MD1, MD2 is compared with the reference difference image and initially the reference difference image is subtracted from the measurement difference image Md1, MD2 or vice-versa. The resulting twice-differentiated image (hereinafter also denoted as the browning image BB) is shown in FIG. 6. The baking paper P has practically no more dark pixels, whilst the foods G1 and G2 are also clearly visible.

[0078] The browning image BB at a time t>t0 may also be expressed as: browning image (t)=measurement difference image (t)reference difference image (t0), optionally in absolute variables.

[0079] Hereinafter the pixels of the browning image assigned to a specific radiation intensity ILED or brightness are plotted on a histogram H as shown in FIG. 7. The histogram H in this case shows on the x-axis a gray-scale value GW assigned to the radiation intensity ILED and on the y-axis a number n of pixels assigned in each case to the gray-scale values GW. The gray-scales may extend from black (=value 0) to white (=value 255). In this case white pixels and optionally also virtually white pixels may be hidden or masked.

[0080] In order to determine whether a desired degree of browning has been reached, it is determined whether the contents of the histogram H fulfills a predetermined criterion, namely in this case whether a predetermined proportion and/or a predetermined number of pixels has reached a minimum coloration (expressed by exceeding a gray-scale value). This may be determined by this proportion of pixels reaching or exceeding a gray-scale threshold value S. The threshold value S may, for example, be altered by a user.

[0081] If this is the case, at least one action may be triggered by the control device. Thusin addition to triggering a visual and/or acoustic signalvia the radio module 11 a message (for example including an image captured by the camera 7) may be emitted to a mobile phone or the like of the user. The user may remotely control the household cooking appliance 1 via the mobile phone, or the like, for example lengthen the cooking process, if after viewing the image the user is of the opinion that the browning is not yet sufficient. The household cooking appliance 1 may also automatically switch off the heating of the cooking chamber 1.

[0082] Naturally the present invention is not limited to the exemplary embodiments shown.

Thus the baking paper may have a predetermined pattern, the baking paper remaining masked and/or unconsidered by means of said pattern when creating the histogram. In addition, for determining the degree of browning, areas of the images to be considered may be predetermined by respective bounding boxes. The bounding boxes may be predetermined by the control device 9 and/or by a user. The user may set these bounding boxes, for example, by means of the touch-sensitive screen 10 and/or via the radio module 11 by means of a mobile phone/smartphone/tablet, etc.

[0083] The household cooking appliance 1 may also have a wired interface to a network, for example an Ethernet connection.

[0084] Generally by a, an, etc. is understood a single number or a plurality thereof, in particular in the sense of at least one or one or more etc. provided this is not explicitly excluded, for example by the expression just one, etc.

[0085] A number may also encompass exactly the specified number and also a conventional tolerance range as long as this is not explicitly excluded.

LIST OF REFERENCE CHARACTERS

[0086] 1 Household cooking appliance [0087] 2 Cooking chamber [0088] 3 Feed opening [0089] 4 Door [0090] 5 Viewing window [0091] 6 Top wall of a cooking chamber wall [0092] 7 Camera [0093] 8 LED [0094] 9 Control device [0095] 10 Touch-sensitive screen [0096] 11 Radio module [0097] B Baking sheet [0098] BB Browning image [0099] G1-G3 Foods [0100] GW Gray-scale value [0101] H Histogram [0102] Imax Maximum electrical current [0103] ILED Radiation intensity [0104] MD1 Measurement difference image at the time t1 [0105] MD2 Measurement difference image at the time t2 [0106] NL Useful light [0107] n Number of pixels [0108] P Baking paper [0109] S Threshold value [0110] t Time [0111] ta Off-phase [0112] te On-phase [0113] t0 Start of a cooking process [0114] t1 Subsequent time [0115] t2 Further subsequent time [0116] UL Ambient light