SYSTEM COMPRISING A DISHWASHER AND METHOD FOR OPERATING A DISHWASHER

Abstract

A system includes a dishwasher, an image capturing device designed to capture an image of washware arranged in the washing chamber, with the image including a plurality of sub-images, each of which having different spectral information of the washware. An illumination unit illuminates the washware in the washing chamber, and an image analysis unit receives the captured image from the image capturing device and to carry out a chemical analysis of soiling on the washware based on the plurality of sub-images of the received image and to ascertain a dirt characteristic of soiling as a result of the chemical analysis. A control device carries out a washing program for washing the washware in the washing chamber. The control device receives the dirt characteristic from the image analysis unit and adapts the washing program for washing the washware as a function of the received dirt characteristic.

Claims

1-15. (canceled)

16. A system, comprising: a dishwasher including a washing chamber; an image capturing device designed to capture an image of washware arranged in the washing chamber, with the image comprising a plurality of sub-images, each of which having different spectral information of the washware; an illumination unit designed to illuminate the washware in the washing chamber; an image analysis unit designed to receive the captured image from the image capturing device and to carry out a chemical analysis of soiling on the washware based on the plurality of sub-images of the received image and to ascertain a dirt characteristic of soiling as a result of the chemical analysis; and a control device designed to carry out a washing program for washing the washware in the washing chamber, said control device receiving the dirt characteristic from the image analysis unit and adapting the washing program for washing the washware as a function of the received dirt characteristic.

17. The system of claim 16, wherein the dishwasher is embodied as a household dishwasher.

18. The system of claim 16, wherein the image capturing device comprises a digital image sensor with a spectral sensitivity ranging from 360 nm - 980 nm.

19. The system of claim 16, wherein the image capturing device comprises a digital image sensor with a spectral sensitivity ranging from 300 nm - 1200 nm.

20. The system of claim 16, wherein the illumination unit is designed to emit selectively an emission spectrum from a plurality of different emission spectra.

21. The system of claim 16, wherein the illumination unit comprises a number of light-emitting diodes of different emission spectra.

22. The system of claim 16, wherein at least one of the illumination unit and the image capturing device includes at least one filter which is permeable only to a specific spectral range.

23. The system of claim 16, wherein at least one of the illumination unit and the image capturing device comprises a plurality of different filters which are permeable only to a specific spectral range.

24. The system of claim 16, wherein the illumination unit is designed to emit at least five, preferably seven, preferably eight, further preferably nine, different emission spectra, with each of the emission spectra comprising a single maximum.

25. The system of claim 16, wherein the image capturing device comprises an optical device.

26. The system of claim 25, wherein the optical device is a wide angle lens.

27. The system of claim 16, further comprising an optical element designed to distribute light emitted by the illumination unit spatially in the washing chamber.

28. The system of claim 27, wherein the optical element comprises a lens, a light guide and/or a mirror.

29. The system of claim 16, further comprising a modulation device designed to control the illumination unit with an amplitude-modulated control signal, said image capturing device comprising a carrier frequency amplifier for capturing a respective one of the plurality of sub-images as a function of the control signal.

30. The system of claim 16, further comprising a reference device designed to provide a reference surface and arranged in the washing chamber, with a respective one of the plurality of sub-images being calibrated as a function of an intensity of the light reflected by the reference surface.

31. The system of claim 16, further comprising an external device designed to comprise the image analysis unit, the dishwasher and the external device each comprising a communication unit for bidirectional communication.

32. The system of claim 16, wherein the dirt characteristic comprises information about fats, proteins, carbohydrates, pigments, moisture and/or surface-active substances contained in the soiling.

33. The system of claim 16, wherein the control device is designed to ascertain an optimized detergent mixture as a function of the received dirt characteristic, and further comprising an automatic metering system designed to provide the optimized detergent mixture and to meter the optimized detergent mixture into a washing liquor used for washing the washware, wherein the detergent mixture comprises liquid and/or solid components, wherein the detergent mixture comprises an enzyme component, a surfactant component, a bleach component, a soap component and/or a rinse aid component.

34. A method for operating a dishwasher which comprises a control device for carrying out a washing program for washing washware in a washing chamber, the method comprising: illuminating the washware in the washing chamber; capturing an image of the washware in the washing chamber as the washware is illuminated, with the image comprising a plurality of sub-images of different spectral information of the washware; analyzing at least one of the plurality of sub-images of the captured image by carrying out at least a chemical analysis of a soiling of the washware; ascertaining a dirt characteristic of the soiling based on the chemical analysis, and adapting the washing program for washing the washware as a function of the ascertained dirt characteristic.

35. The method of claim 34 for operating a household dishwasher as the dishwasher.

Description

[0068] Further advantageous embodiments and aspects of the invention form the subject matter of the subclaims and the exemplary embodiments of the invention described below. The invention is described in more detail hereinafter by way of preferred embodiments with reference to the accompanying figures.

[0069] FIG. 1 shows a schematic perspective view of an embodiment of a system comprising a dishwasher;

[0070] FIG. 2 shows a schematic block diagram;

[0071] FIG. 3 shows a diagram of an exemplary sequence for capturing an image comprising a plurality of sub-images;

[0072] FIG. 4 shows an exemplary diagram of a plurality of emission spectra;

[0073] FIG. 5 shows a schematic perspective view of a further embodiment of a system comprising a dishwasher;

[0074] FIG. 6 shows a schematic view of a further embodiment of a system comprising a dishwasher; and

[0075] FIG. 7 shows schematic block diagram of an exemplary method for operating a dishwasher.

[0076] Elements which are the same or functionally the same have been provided in the figures with the same reference characters unless specified otherwise.

[0077] FIG. 1 shows a schematic perspective view of an embodiment of a system 20 comprising a dishwasher 1 which is configured here as a household dishwasher. The household dishwasher 1 comprises a washing container 2 which can be closed by a door 3, in particular in a water-tight manner. To this end, a sealing device can be provided between the door 3 and the washing container 2. The washing container 2 is preferably cuboidal. The washing container 2 can be arranged in a housing of the household dishwasher 1. The washing container 2 and the door 3 can form a washing chamber 4 for washing washware.

[0078] The door 3 is shown in FIG. 1 in the open position thereof. The door 3 can be closed or opened by pivoting about a pivot axis 5 provided at a lower end of the door 3. A loading opening 6 of the washing container 2 can be closed or opened by means of the door 3. The washing container 2 has a bottom 7, a ceiling 8 arranged opposite the bottom 7, a rear wall 9 arranged opposite the closed door 3 and two side walls 10, 11 arranged opposite one another. The bottom 7, the ceiling 8, the rear wall 9 and the side walls 10, 11 can be produced, for example, from a stainless steel sheet. The bottom 7 can be produced alternatively from a plastic material, for example.

[0079] The household dishwasher 1 also has at least one washware receptacle 12 to 14. Preferably, a plurality of washware receptacles 12 to 14, for example three thereof, can be provided, wherein the washware receptacle 12 can be a lower washware receptacle or a lower basket, the washware receptacle 13 can be an upper washware receptacle or an upper basket, and the washware receptacle 14 can be a cutlery drawer. As FIG. 1 also shows, the washware receptacles 12 to 14 are arranged one above the other in the washing container 2. Each washware receptacle 12 to 14 can be displaced selectively into or out of the washing container 2. In particular, each washware receptacle 12 to 14 can be pushed into or moved into the washing container 2 in a push-in direction E and pulled out or moved out of the washing container 2 in a pull-out direction A counter to the push-in direction E.

[0080] A control device 100, an image capturing device 110, an illumination unit 120 and an image analysis unit 130 are shown on the door 3 of the household dishwasher 1. The control device 100 is designed to carry out a washing program for washing washware which can be arranged in the washing chamber 4. The image capturing device 110 is designed to capture an image IMG of washware which is arranged in the washing chamber 4. The image IMG comprises a plurality of sub-images IMG1 - IMG6 (see FIG. 3), each thereof having different spectral information on the washware. The illumination unit 120 is designed to illuminate the washware, whilst the image capturing device 110 captures the image IMG. The image analysis unit 130 is designed to receive the captured image IMG from the image capturing device 110 and on the basis of the plurality of sub-images IMG1 - IMG6 of the received image IMG to carry out a chemical analysis of a soiling of the washware and as a result of the chemical analysis to ascertain a dirt characteristic SC. The control device 100 is designed to receive the dirt characteristic SC and to adapt the washing program for washing the washware as a function of the received dirt characteristic SC.

[0081] FIG. 2 shows a schematic block diagram with a control device 100, an image capturing device 110, an illumination unit 120 and an image analysis unit 130. The arrangement of FIG. 2 can be used, for example, in the system of FIG. 1. In this example, the control device 100 controls the image capturing device 110 and the illumination unit 120 by means of corresponding control signals CTR.

[0082] The image capturing device 110 comprises in this case a digital image sensor with a spectral sensitivity ranging from 300 - 1050 nm. The illumination unit 120 in this case has three different light-emitting diodes 121, 122, 123 which are designed in each case to emit different emission spectra. To this end, the illumination unit 120 can also have one or more filters (not shown). For capturing the image IMG, the control device 100 controls the illumination unit 120, for example, such that it emits a first emission spectrum by means of the light-emitting diode 121 and controls the digital image sensor in a chronologically synchronized manner such that it captures a sub-image IMG1 (see FIG. 3) which is temporarily stored, for example, in a buffer memory. “Chronologically synchronized” means, for example, that the image sensor 110 records the sub-image IMG1, whilst the illumination unit 120 emits the emission spectrum. After the first sub-image IMG1 is recorded, the same process is carried out by controlling the further light-emitting diodes 122, 123 so that at least two further sub-images IMG2, IMG3 are captured. It is also possible that a plurality of light-emitting diodes 121, 122, 123 are controlled at the same time, in order to obtain mixed illumination which can contribute to the spectral information as a further sub-image.

[0083] The captured sub-images IMG1, IMG2, IMG3 are output as one image IMG to the image analysis unit 130. This leads to a chemical analysis of the soiling of the washware on the basis of the image IMG. The image analysis unit 130 preferably ascertains in advance the image regions which are relevant for the chemical analysis. For example, the image analysis unit 130 identifies which of the image pixels show the washware and which do not. In this case, the image analysis unit 130 carries out, for example, an edge detection of the image and detects specific shapes such as round edges which can originate from plates. The chemical analysis can then be limited to the relevant pixels which permits an improved analysis result.

[0084] For example, proteins are particularly easy to identify on the first sub-image IMG1, since this sub-image IMG1 has been recorded with an emission spectrum which is highly absorbed by proteins. Thus dark regions in the sub-image IMG1 correspond to a high protein concentration. For example, it is possible to ascertain an average brightness of the first sub-image IMG1 which represents an indicator of the quantity of proteins in the soiling on the washware. Apart from the average brightness, various other metrics can also be used, which can also permit a more accurate determination.

[0085] Accordingly, the further sub-images IMG1 - IMG6 are analyzed and the analysis result is output to the control device 100 as the dirt characteristic SC. The dirt characteristic SC contains, for example, relative and/or quantitative information on a chemical composition of the soiling of the washware and/or a quantity of soiling. The dirt characteristic SC is ascertained, for example, in the from of a table and preferably also comprises ascertained uncertainties for individual numerical values.

[0086] The control device 100 then ascertains an optimized washing program on the basis of the received dirt characteristic SC.

[0087] This method is preferably carried out repeatedly during a washing program cycle, for example after the prewash, after the main wash, after the rinsing with rinse aid and after the drying. As a function of the respectively ascertained dirt characteristic SC, it is then possible to extend the respective step or to pass to the next step. Additionally, individual parameter settings can be further adapted for the following steps and the washing program optimized in this manner.

[0088] The image capture or even the chemical analysis can be selectively limited in this case to specific spectral ranges or chemical compositions. For example, only those spectral ranges which can provide an indication of moisture are captured as sub-images and/or analyzed during the drying.

[0089] FIG. 3 shows a diagram of an exemplary sequence for capturing an image IMG comprising a plurality of sub-images IMG1 - IMG6, which is also denoted hereinafter as the capturing routine. At a point in time t0, the image capturing routine starts. At the points in time t1 - t6, in each case a sub-image IMG1 - IMG6 is captured, as described for example with reference to FIG. 2. Each of the sub-images IMG1 - IMG6 contains different spectral information. After all of the sub-images IMG1 - IMG6 have been captured, these sub-images are combined to form one image IMG without the respective spectral information being lost. The different sub-images IMG1 - IMG6 are output as one image IMG. At the point in time t7, the routine is terminated. This routine can be carried out any number of times during a washing program cycle.

[0090] It should be mentioned that the image IMG does not necessarily always comprise the same number of sub-images IMG1 - IMG6. Thus when the described capturing routine is carried out subsequently, only some of the sub-images IMG1 - IMG6 can be captured and output as the image IMG.

[0091] FIG. 4 shows an exemplary diagram of a plurality of emission spectra which are emitted, for example, from an illumination unit 120 (see FIGS. 1, 2, 5 or 6) which has a total of nine different light-emitting diodes. The vertical axis shows the intensity I, wherein a respective spectrum is shown standardized to the maximum at 100%. By way of example, the wavelengths in nm of the maximum of the emission spectrum of one respective light-emitting diode are specified on the horizontal axis. For example, at 365 nm several surface-active substances, as are contained in detergents, can be identified. For example, at 455 nm glucose (sugar) can be identified. For example, at 530 nm, 590 nm, 656 nm, 740 nm and 810 nm several dyes or pigments can be identified. For example, at 850 nm proteins can be identified. For example, at 940 nm fats can be identified.

[0092] On the spectrum, the maximum thereof being at 530 nm, the full width at half maximum FWHM is shown by way of example, which is the width of the curve at 50% intensity. The emission spectra shown in this example represent examples of narrow-band spectra. It should be mentioned that the spectra shown are merely to be understood by way of example and that the exact shape of one respective spectrum depends on the light source and on the filters used.

[0093] The illumination unit 120 comprises, for example, a multi-color light-emitting diode which is designed to emit at least three different emission spectra, preferably one in the blue spectral range (400 - 500 nm), one in the green spectral range (500 - 600 nm) and one in the red spectral range (600 - 700 nm). The illumination unit 120 preferably comprises in addition to the multi-color light-emitting diode at least one further light-emitting diode which emits an emission spectrum ranging between 800 - 1000 nm and/or ranging between 300 - 400 nm. Instead of the multi-color light-emitting diode, individual diodes can also be provided, as described above.

[0094] FIG. 5 shows a schematic perspective view of a further embodiment of a system 20 comprising a dishwasher 1. In this example, the illumination unit 120 is arranged in a machine housing (not shown) of the dishwasher 1. A plurality of light guides LL conduct the light generated by the illumination unit 120 to windows or lenses 125, the light being emitted therefrom into the washing chamber 4 and illuminating said washing chamber. The light guides LL and the lenses 125 are examples of optical elements. In this manner it is possible to achieve a very good illumination of the entire washing chamber 4, even if large items of washware, such as for example large pots or pans, cover some of the irradiation windows 125. Alternatively or additionally to such a distribution of the light by means of light guides LL, a plurality of illumination units 120 which are arranged at different points of the washing chamber 4 can be provided. The image capturing device 110 which in this example has an optical element 111, for example a wide angle lens, is arranged on the left-hand side of the washing chamber 4, so that the entire washing chamber 4 can be captured by the image capturing device 110. A control device 100 (see FIGS. 1, 2 or 6) and an image analysis unit 130 (see FIGS. 1, 2 or 6) are also present but, for reasons of clarity, are not shown in this FIG. 5.

[0095] A reference device 140 is arranged on the opposing side of the washing chamber 4. This reference device has a reference surface which entirely or almost entirely reflects the light emitted from the illumination unit 120 over the entire spectral range. Thus the brightness of the reference device 140 which is captured in the respective sub-images IMG1 - IMG6 (see FIG. 3) can serve as a standardizing measure of the respective sub-image IMG1 - IMG6.

[0096] As an alternative to such a reference device 140, the image analysis unit 130 (see FIGS. 1, 2 or 6) can also be designed to undertake a self-consistent calibration by means of corresponding image processing algorithms. For example, clean surfaces of washware can be used as a reference surface. To this end, for example, it is ascertained that a specific image region which shows the surface of a plate (which has been ascertained, for example, by an object recognition) does not have any dark regions in the sub-images IMG1 - IMG6 but has a uniform brightness. It can be concluded therefrom that this region is clean and thus is suitable as a reference surface.

[0097] FIG. 6 shows a schematic view of a further embodiment of a system 20 comprising a dishwasher 1. In this example, the image analysis unit 130 is arranged in an external device 200 which is configured here as a server. The dishwasher 1 and the server 200 have in each case a communication unit 101, 201 which are designed for establishing a communication connection COM for bidirectional communication. The communication unit 101 transmits the captured image IMG to the server 200 via this communication connection COM. The image analysis unit 130 in the server 200 carries out the chemical analysis using the received image IMG and on the basis of the encompassed sub-images IMG1 - IMG6 (see FIG. 3) and transmits the ascertained dirt characteristic SC back to the dishwasher 1. Since the image analysis unit 130 is arranged in the server 200, a relatively high computing power is available for the image analysis and the chemical analysis, which is why more complex and/or more accurate analysis methods can be used, which can result in a more accurate dirt characteristic SC.

[0098] The dishwasher 1 also has in this example an automatic metering system 15 which has a plurality of chambers for separately receiving individual detergent components K1, K2, K3. The components K1, K2, K3 are, for example, an enzyme component K1, a bleach component K2, and a surfactant component K3, and the automatic metering system 15 is designed to mix a detergent mixture on the basis of the individual components K1, K2, K3 in any composition. The control device 100 ascertains, for example, an optimized detergent mixture as a function of the dirt characteristic SC and causes the automatic metering system 15 to provide this detergent mixture and to meter it into the washing chamber 4 at a predetermined metering time when carrying out the washing program.

[0099] FIG. 7 shows a schematic block diagram of an exemplary method for operating a dishwasher 1, for example shown in FIGS. 1, 5 or 6. The dishwasher has a control device 100 for carrying out a washing program for washing washware which can be arranged in a washing chamber 4 (see FIGS. 1, 5 or 6). In a first step S1, the washware which is arranged in the washing chamber 4 is illuminated. In a second step S2, an image IMG (see FIGS. 1, 2, 3 or 6) is captured of the washware which is arranged in the washing chamber 4 and which is illuminated, wherein the image IMG comprises a plurality of sub-images IMG1 - IMG6 (see FIG. 3), each thereof having different spectral information on the washware. In a third step S3, each sub-image IMG1 - IMG6 of the captured image IMG is analyzed, wherein a chemical analysis of a soiling of the washware is carried out. In a fourth step S4, a dirt characteristic of the soiling is ascertained on the basis of the chemical analysis. In a fifth step S5, the washing program for washing the washware is adapted as a function of the ascertained dirt characteristic SC.

[0100] This method or at least individual steps of the method can be repeated multiple times when carrying out the washing program in order to keep the dirt characteristic SC up to date.

[0101] For example, the method is carried out a first time at the start of the washing program. The image analysis unit 130 ascertains that the washware is heavily soiled, wherein the soiling consists of 20% fats, 50% carbohydrates and 30% proteins, wherein no moisture or detergent residues have been ascertained, which is output as a dirt characteristic SC. The control device 100 plans the washing program as a function of the dirt characteristic SC, wherein the washing program starts with a prewash with cold water. After ten minutes prewash, the method is carried out again in order to ascertain a current dirt characteristic SC. For example, it is ascertained that half of the carbohydrates and a third of the proteins have been washed off, so that it passes to the main wash. For the main wash, an optimized detergent mixture which has been ascertained on the basis of the current dirt characteristic SC by the control device 100 is added to the washing liquor. After 30 minutes main wash, the method is carried out again in order to ascertain a current dirt characteristic SC. It is ascertained that fats and proteins still adhere to the washware. The control device 100 ascertains a new optimized detergent mixture in order to release in a targeted manner the fats and proteins still present. After a further 20 minutes main wash, the method is carried out again and ascertains that soiling is no longer present on the washware, thus the washware is clean. However, detergent residues on the washware are captured, which is why rinsing with rinse aid takes place. After ten minutes rinsing with rinse aid, the method is carried out again, wherein it is ascertained that detergent residues are no longer present on the washware so that it passes to drying. After 30 minutes drying, the method is carried out again, wherein it is ascertained that residual moisture still adheres to the washware which is why the drying is continued. The method is carried out regularly, for example, until it is ascertained that the washware is dry, whereby the washing program is terminated.

[0102] Whilst the present invention has been described with reference to exemplary embodiments, it can be modified in many different ways.

TABLE-US-00001 Reference characters used: 1 Dishwasher 2 Washing container 3 Door 4 Washing chamber 5 Pivot axis 6 Loading opening 7 Bottom 8 Ceiling 9 Rear wall 10 Side wall 11 Side wall 12 Washware receptacle 13 Washware receptacle 14 Washware receptacle 15 Automatic metering system 20 System 100 Control device 101 Communication unit 110 Image capturing device 111 Optical element 120 Illumination unit 121 Light-emitting diode 122 Light-emitting diode 123 Light-emitting diode 125 Optical element 130 Image analysis unit 140 Reference device 200 External device 201 Communication unit A Pull-out direction CTR Control signal COM Communication connection E Push-in direction FWHM Full width at half maximum IMG Image IMG1 Sub-image IMG2 Sub-image IMG3 Sub-image IMG4 Sub-image IMG5 Sub-image IMG6 Sub-image K1 Component K2 Component K3 Component LL Optical element S1 Method step S2 Method step S3 Method step S4 Method step S5 Method step SC Dirt characteristic