Abstract
A system includes a dishwasher including a receptacle for an item to be washed, and a control device for carrying out a washing program, which can be parameterized by a number of different washing program parameters. An image-capturing device captures an image of the receptacle and an image analysis unit classifies the item to be washed in the receptacle in dependence on the captured image of the receptacle and to output a classification result to the control device. The control device is designed to parameterize the washing program depending on the classification result.
Claims
1-15. (canceled)
16. A system, comprising: a dishwasher including a receptacle for an item to be washed; a control device for carrying out a washing program, which is parameterizable by a number of different washing program parameters; an image-capturing device designed to capturing an image of the receptacle; and an image analysis unit designed to classify the item to be washed in the receptacle in dependence on the captured image of the receptacle and to output a classification result to the control device, wherein the control device is designed to parameterize the washing program depending on the classification result.
17. The system of claim 16, wherein the dishwasher is a household dishwasher.
18. The system of claim 16, wherein the dishwasher comprises a position sensor unit designed to capture a position of the receptacle and to output a position signal to the image-capturing device, said image-capturing device designed to capture the image in dependence on the position signal.
19. The system of claim 18, wherein the position sensor unit outputs the position signal when the receptacle is visible in a field of view of the image-capturing device.
20. The system of claim 18, wherein the position sensor unit outputs the position signal when the receptacle is completely visible in a field of view of the image-capturing device.
21. The system of claim 16, wherein the image-capturing device is designed to capture an extended spectral range which comprises at least a visual spectral range and a near infrared range.
22. The system of claim 16, wherein the dishwasher comprises a washing container with a peripheral washing container flange around a loading opening of the washing container, said image-capturing device being arranged in or on an upper flange portion of the washing container flange which upper flange portion is assigned to a ceiling of the washing container, with the image-capturing device facing away from the washing container and obliquely in a direction of a plane spanned by a bottom of the washing container.
23. The system of claim 22, wherein the washing container flange comprises a cavity in which at least one section of the image-capturing device is received.
24. The system of claim 16, wherein the image-capturing device has a vertical image angle of at least 90° and a horizontal image angle of at least 120°.
25. The system of claim 16, wherein the classification result comprises information regarding a quantity, type and/or position of the item to be washed in the receptacle.
26. The system of claim 16, wherein the image analysis unit is designed to classify the item to be washed in the receptacle in dependence on the captured image of the receptacle via a neural network.
27. The system of claim 16, further comprising a memory unit configured to store a number of captured images, said image analysis unit classifying the item to be washed in the receptacle in dependence on at least one of the stored captured images of the number of captured images.
28. The system of claim 16, wherein the image analysis unit is integrated in the dishwasher.
29. The system of claim 16, wherein the image-capturing device and the image analysis unit are arranged together on a substrate in an integrated circuit.
30. The system of claim 16, wherein the image analysis unit is integrated in a device arranged externally relative to the dishwasher, said dishwasher being designed as a communication unit for transmitting the captured image to the image analysis unit, for receiving the classification result from the image analysis unit and for outputting the received classification result to the control device.
31. The system of claim 16, wherein the dishwasher includes a plurality of said receptacle, said image-capturing device capturing at least one image of each of the receptacles.
32. A method for operating a dishwasher, said method comprising: capturing an image of a receptacle for an item to be washed of the dishwasher; classifying the item to be washed in the receptacle in dependence on the captured image; outputting a classification result; and parameterizing a washing program for washing the item to be washed in dependence on the classification result.
33. The method of claim 32 for operating a household dishwasher.
Description
[0061] FIG. 1 shows a schematic perspective view of an embodiment of a system with a dishwasher;
[0062] FIG. 2 shows a schematic sectional view of a detail of a dishwasher;
[0063] FIG. 3 shows a schematic side view of a dishwasher;
[0064] FIG. 4 shows a further schematic side view of a dishwasher;
[0065] FIG. 5 shows a further schematic side view of a dishwasher;
[0066] FIG. 6 shows a schematic example of a captured image and a classification result;
[0067] FIG. 7 shows a schematic block diagram of an arrangement with a dishwasher; and
[0068] FIG. 8 shows a schematic block diagram of an exemplary method for operating a dishwasher.
[0069] Elements which are the same or functionally the same have been provided in the figures with the same reference characters, unless specified otherwise.
[0070] FIG. 1 shows a schematic perspective view of a system with a dishwasher 1 which is configured here as a household dishwasher. The household dishwasher 1 comprises a washing container 2 which is able to be closed by a door 3, in particular in a water-tight manner. To this end, a sealing device 17 (see FIG. 2) may be provided between the door 3 and the washing container 2. The washing container 2 is preferably cuboidal. The washing container 2 may be arranged in a housing of the household dishwasher 1. The washing container 2 and the door 3 may form a washing chamber 4 for washing items to be washed 51, 52, 53, 54 (see FIG. 6).
[0071] The door 3 is shown in FIG. 1 in its open position. The door 3 may be closed or opened by pivoting about a pivot axis 5 provided at a lower end of the door 3. A loading opening 6 of the washing container 2 may be closed or opened by means of the door 3. A peripheral container flange 16, which for example frames the loading opening 6, is provided on a front face of the washing container 2. The washing container 2 has a bottom 7, a ceiling 8 arranged opposite the bottom 7, a rear wall 9 arranged opposite the closed door 3, and two side walls 10, 11 arranged opposite one another. The bottom 7, the ceiling 8, the rear wall 9 and the side walls 10, 11 may be produced, for example, from a stainless steel sheet. Alternatively, for example, the bottom 7 may be produced from a plastic material.
[0072] The household dishwasher 1 also has at least one receptacle for items to be washed 12 to 14. Preferably, a plurality of receptacles for items to be washed 12 to 14, for example three thereof, may be provided, wherein the receptacle for items to be washed 12 may be a lower receptacle for items to be washed or a lower basket, the receptacle for items to be washed 13 may be an upper receptacle for items to be washed or an upper basket, and the receptacle for items to be washed 14 may be a cutlery drawer. As FIG. 1 further shows, the receptacles for items to be washed 12 to 14 are arranged one on top of the other in the washing container 2. Each receptacle for items to be washed 12 to 14 is able to be selectively moved into and out of the washing container 2. In particular, each receptacle for items to be washed 12 to 14 is able to be pushed or moved into the washing container 2 in a push-in direction E and is able to be pulled or moved out of the washing container 2 in a pull-out direction A counter to the push-in direction E.
[0073] Moreover, a control device 15 and an image analysis unit 25 are arranged in the door 3 of the household dishwasher 1. The control device 15 is designed to carry out a washing program. An image-capturing device 20 is arranged in or on the washing container flange 16, which is designed to capture an image IMG (see FIG. 6) of the receptacles for items to be washed 12, 13, 14. The captured image IMG is output by the image-capturing device 20 to the image analysis unit 25. The image analysis unit 25 is designed to classify the image IMG and to output a classification result KR (see FIG. 6) to the control device 15. The control device 15 is designed to parameterize the washing program depending on the classification result KR.
[0074] FIG. 2 shows a schematic sectional view of a detail of a dishwasher 1, for example the household dishwasher of FIG. 1. In FIG. 2 a section is shown through an upper flange portion of the washing container flange 16 assigned to the ceiling 8 of the washing container 2 (see FIG. 1). The door 3 is shown in the closed position, wherein a sealing device 17 is arranged between the door 3 and the washing container 2, and closes the washing chamber 4 in a fluid-tight manner. A cavity 18 which is defined in the direction of the door 3 by a transparent element 19, which is configured here as a glass pane, is arranged in the washing container flange 16. The cavity 18 is preferably sealed in a fluid-tight manner, relative to its surroundings. In this example, an image-capturing device 20 and an image analysis unit 25 are arranged in the cavity 18. The image-capturing device 20 and the image analysis unit 25 in this case are integrated on a common substrate. In the arrangement shown, the image-capturing device 20 is advantageously designed to capture an image IMG (see FIG. 6) of the receptacles for items to be washed 12, 13, 14 (see FIG. 1) through the transparent element 19. The cavity 18 is arranged as close as possible to a central point of the upper flange portion, preferably exactly in the center thereof, so that the image-capturing device 20 may take an image of the receptacle for items to be washed 12, 13, 14 as symmetrically as possible.
[0075] FIG. 3 shows a schematic side view of a dishwasher 1, for example the household dishwasher 1 of FIG. 1 or 2. The door 3 is shown in the open position. The image-capturing device 20 is preferably arranged as described with reference to FIG. 2 in a cavity 18 (see FIG. 2) of the washing container flange 16. The dishwasher 1 of FIG. 3 has two receptacles for items to be washed 12, 13 which may be moved into and out of the washing container 2. In this case, the lower receptacle for items to be washed 12 is in a moved-out position, where it may be loaded in a simple manner with items to be washed 51, 52, 53, 54 (see FIG. 6). Additionally, the dishwasher 1 has two position sensor units 21A, 22A, which are arranged on a front edge of the washing container 2 where the washing container flange 16 is also attached. The position sensor units 21A, 22A are configured as magnetic sensors. Each of the receptacles for items to be washed 12, 13 has a magnet 21B, 22B which is arranged in a rear region of the respective receptacle for items to be washed 12, 13.
[0076] If the respective receptacle for items to be washed is pulled out of the washing container 2, the magnet 21A, 22B is guided past the respective magnetic sensor 21A, 22A, which the respective magnetic sensor 21A, 22B captures. In this case, the magnetic sensor 21A, 22A may also capture, for example, a direction of movement of the magnet 21B, 22B. If the lower magnetic sensor 22A detects that the magnet 22B is guided past the lower receptacle for items to be washed 12, for example, it outputs a position signal to the image-capturing device 20, whereupon this image-capturing device captures an image IMG (see FIG. 6). The image IMG is preferably captured when the respective receptacle for items to be washed 12, 13 is moved into the washing container 2, since then it may be assumed that the current loading process is completed. By the use of a position sensor unit 21A, 22A which is assigned in each case to a receptacle for items to be washed 12, 13, 14, an assignment of a captured image IMG to the respective receptacle for items to be washed 12, 13, 14 is possible.
[0077] FIG. 4 shows a further schematic side view of a dishwasher 1, for example the household dishwasher of FIG. 1, 2 or 3. The door 3 is shown here in its open position. In FIG. 4 the vertical image angle V, which the image-capturing device 20 comprises, is shown schematically. The vertical image angle V is preferably 90° but may also be greater. The image-capturing device 20 is preferably oriented such that an angle between an optical axis and a horizontal direction is 120°-135° (the acute alternate angle therefor is accordingly in the range of 45°-60°). Thus it is ensured that the image-capturing device 20 detects each of the receptacles for items to be washed 12, 13, 14 (see FIG. 1 or 3) in the respective overall length thereof.
[0078] FIG. 5 shows a schematic front view of a dishwasher 1, for example the household dishwasher of FIG. 1, 2 or 3. The door 3 is shown here in its open position. In FIG. 4 the horizontal image angle H, which the image-capturing device 20 comprises, is shown schematically. The horizontal image angle H is preferably at least 120° but may also be greater. Thus it is ensured that the image-capturing device 20 detects each of the receptacles for items to be washed 12, 13, 14 (see FIG. 1 or 3) in the respective overall width thereof.
[0079] FIG. 6 shows a schematic example of a captured (digital) image IMG and a classification result KR. The image IMG has been captured, for example, by the image-capturing device 20 (see FIG. 1-5 or 7) of one of the dishwashers 1 of FIG. 1-5 or 7 and the classification result KR has been determined, for example, by the image analysis unit 25 (see FIG. 1, 2 or 6) of FIG. 1, 2 or 6. The captured image IMG in this case shows, for example, the lower receptacle for items to be washed 12 with the items to be washed 51, 52, 53, 54 arranged therein. In this case, it is a plate 51 made of ceramic or porcelain, a pan 52 made of metal with a plastic handle, a pot 53 made of metal and a beer mug 54 made of glass. The image-capturing device 20 in this case captures a color image with an extended spectral range of 360 nm-2500 nm.
[0080] The image analysis unit 25 (see FIG. 1, 2 or 6) is designed to classify the items to be washed 51, 52, 53, 54 on the basis of the image IMG captured by the image-capturing device 20. Preferably, the image analysis unit 25 selects from the entire spectral range two sub-regions (color channels) which do not overlap. The selection is made, in particular, such that contrasts between the different materials of the items to be washed, which are respectively assigned to a class, are particularly high. Preferably, the color channels to be used for a dishwasher 1 are predetermined and then remain fixed. However, different color channels may also be selected for different dishwashers 1. It may also be provided that the color channels are reselected again each time depending on specific parameters, such as for example an ambient brightness, a color temperature of the ambient light or the like. In this case, it may also be provided that a color channel is widened or narrowed. In this manner, it is ensured that the image analysis unit 25 carries out a reliable classification on the basis of the high contrasts.
[0081] In this example, the items to be washed 51, 52, 53, 54 are classified in the classes: empty K0, ceramic K1, metal K2, glass K3 and plastic K4. Moreover, a class for wood may be provided. This takes place, for example, by means of a neural network which carries out an object recognition. The classification preferably takes place in a pixel-precise manner. The classification result KR may, as shown in FIG. 6, be output as a two-dimensional matrix, which has as many rows and columns as the digital image IMG. Each input of the matrix in this case is assigned to one of the classes K0-K4. The classification result KR thus comprises a quantitative classification including a respective position of the items to be washed 51, 52, 53, 54 arranged in the receptacle for items to be washed 12.
[0082] FIG. 7 shows a schematic block diagram of an arrangement comprising a dishwasher 1 and an external device 100. The dishwasher 1 has, for example, all of the features of the dishwashers shown in FIGS. 1-5. Additionally, the dishwasher 1 comprises a communication unit 30 for producing a communication connection KOMM with the external device 100, which for example is a server which is operated by a manufacturer of the dishwasher 1 and which may be accessed via the internet. In this case, the server 100 comprises an image analysis unit 25 which is designed to classify items to be washed 51, 52, 53, 54 (see FIG. 6) arranged in the receptacle for items to be washed 12, 13, 14, (see FIG. 1 or 3) of the dishwasher 1, depending on the captured image IMG (see FIG. 6) of the receptacle for items to be washed 12, 13, 14, and for the output of a classification result KR (see FIG. 6) to the communication unit 30 of the dishwasher 1. The communication unit 30 receives the captured image IMG from the image-capturing device 20 and transmits the image via the communication connection KOMM to the image analysis unit 25. Then the communication unit 30 receives the classification result KR from the image analysis unit 25 via the communication connection KOMM and outputs this classification result to the control device 15 of the dishwasher 1. The control device 15 is designed to parameterize the washing program depending on the classification result KR.
[0083] FIG. 8 shows a schematic block diagram of an exemplary method for operating a dishwasher 1, for example the dishwasher of FIG. 1-5 or 7. In a first step S1, an image IMG (see FIG. 6) of a receptacle for items to be washed 12, 13, 14 (see FIG. 1, 3 or 6) of the dishwasher 1 is captured. This is carried out, for example, by an image-capturing device 20 arranged on the dishwasher 1 (see FIG. 1-5 or 7). In a second step S2, the items to be washed 51, 52, 53, 54 (see FIG. 6) arranged in the receptacle for items to be washed 12, 13, 14 are classified depending on the captured image IMG. This is carried out, for example, by an image analysis unit 25 (see FIG. 1, 3, or 7). In a third step S3, a classification result KR (see FIG. 6) is output, preferably to a control device 15 (see FIG. 1 or 6). In a fourth step S4, a washing program is parameterized for washing the items to be washed 51, 52, 53, 54 depending on the classification result KR.
[0084] Whilst the present invention has been described with reference to exemplary embodiments, it may be modified in many different ways. In particular, elements which are not shown in a figure may be present in the same manner as described with reference to a further figure. Thus, for example, each dishwasher has a control device even if this may be configured differently in different dishwashers.
REFERENCE CHARACTERS USED
[0085] 1 Dishwasher [0086] 2 Washing container [0087] 3 Door [0088] 4 Washing chamber [0089] 5 Pivot axis [0090] 6 Loading opening [0091] 7 Bottom [0092] 8 Ceiling [0093] 9 Rear wall [0094] 10 Side wall [0095] 11 Side wall [0096] 12 Receptacle for items to be washed [0097] 13 Receptacle for items to be washed [0098] 14 Receptacle for items to be washed [0099] 15 Control device [0100] 16 Washing container flange [0101] 17 Sealing device [0102] 18 Cavity [0103] 19 Transparent side [0104] 20 Image-capturing device [0105] 21A Position sensor [0106] 21B Position sensor [0107] 22A Position sensor [0108] 22B Position sensor [0109] 25 Image analysis device [0110] 30 Communication unit [0111] 51 Items to be washed [0112] 52 Items to be washed [0113] 53 Items to be washed [0114] 54 Items to be washed [0115] 100 External device [0116] A Pull-out direction [0117] E Push-in direction [0118] H Horizontal image angle [0119] IMG Image [0120] K0 Class [0121] K1 Class [0122] K2 Class [0123] K3 Class [0124] K4 Class [0125] KOMM Communication connection [0126] KR Classification result [0127] S1 Method step [0128] S2 Method step [0129] S4 Method step [0130] S1 Method step [0131] V Vertical image angle
