SAFE VOICE-BASED REMOTE CONTROL OF A DOMESTIC APPLIANCE

Abstract

A method controls a domestic appliance by a user. The method includes the steps of detecting a voice command of the user; determining whether the user is in a predefined first region around the control device; determining whether the control device is located in a predefined second region around the domestic appliance; and controlling the domestic appliance as a function of the voice command.

Claims

1-15. (canceled)

16. A method for a safe control of a household appliance by a user, wherein the method comprises the following steps of: detecting a voice command of the user via a controller; determining that the user is in a predetermined first region around the controller; determining that the controller is in a predetermined second region around the household appliance; and controlling the household appliance in dependence on the voice command.

17. The method according to claim 16, wherein the household appliance has a kitchen appliance.

18. The method according to claim 16, which further comprises determining if a line of sight is present in the predetermined first region between the user and the controller.

19. The method according to claim 18, which further comprises optically detecting the user via the controller.

20. The method according to claim 19, which further comprises identifying the user.

21. The method according to claim 16, which further comprises determining if a line of sight is present between the user and the household appliance.

22. The method according to claim 16, which further comprises detecting a gesture of the user in the predetermined first region via the controller.

23. The method according to claim 16, which further comprises determining a position of the user in the predetermined first region.

24. The method according to claim 23, which further comprises determining the position on a basis of acoustic information of the voice command.

25. The method according to claim 16, which further comprises identifying the user on a basis of the voice command.

26. The method according to claim 16, which further comprises determining whether a line of sight is present in the predetermined second region between the controller and the household appliance.

27. The method according to claim 16, which further comprises determining if a spacing between the controller and the household appliance is below a predetermined distance.

28. The method according to claim 26, which further comprises carrying out the determining step on a basis of a wireless communication signal transmitted between the controller and the household appliance.

29. A controller for a safe control of a household appliance by a user, the controller comprising: a detector for detecting a voice command of the user; and a determination facility configured to determine that the user is in a predetermined first region around the controller, wherein the controller is configured to control the household appliance in dependence on the voice command if the controller is in a predetermined second region around the household appliance.

30. A system, comprising: said controller according to claim 29; and a household appliance.

Description

[0025] Embodiments of the invention are now described in more detail with reference to the accompanying figures, in which:

[0026] FIG. 1 shows a system;

[0027] FIG. 2 shows a control apparatus for a household appliance; and

[0028] FIG. 3 shows a flow chart of a method.

[0029] FIG. 1 shows a system 100 which comprises a household appliance 105 and a control apparatus 110. The household appliance 105 can be remotely controlled by a user 115. In this case, the user 115 is generally located outside a physical range of a control element which acts directly on the household appliance 105. In the present case, the household appliance 105 is shown as a cooktop; in other embodiments a different household appliance can also be encompassed, in particular a household appliance which is regarded as safety-relevant. For example, the household appliance 105 can come under the regulations of EC 60335-2-6 2014 or DIN EN 30-1-1:2013-06. The household appliance 105, the control apparatus 110 and the user 115 are generally located in the same household, further preferably in the same space, in particular a kitchen.

[0030] The control apparatus 110 can comprise a mobile device such as a smartphone or a tablet computer or even a smart speaker or a smart display. The control apparatus 110 can be carried or, for example, held in the hands by the user 115. In a further embodiment, the control apparatus 110 is designed to be positioned, attached or deposited. For example, the control apparatus 110 can be deposited in the region of a shelf which is located in the vicinity of the household appliance 105. The control apparatus 110 can also comprise a dedicated technical facility which is designed, for example, for controlling a plurality of household appliances 105. The control apparatus 110 can carry out further functions, for example managing cooking recipes or displaying contents from the Internet.

[0031] The user 115 can include any person. In some embodiments, it can be checked whether the user 115 is authorized as a specified person and thus for controlling the household appliance 105. In a further embodiment, the control of the household appliance 105, for example, can be accessible to all persons 115 who are not determined as a child.

[0032] The user 115 is in a first predetermined region 120 around the control apparatus 110. At the same time, the control apparatus 110 is in a second predetermined region 125 around the household appliance 105. If the regions 120 and 125 are determined sufficiently accurately, then it can also be determined that the person 115 is in a third region 130 around the household appliance 105. In particular, it can be determined whether the user 115 has a line of sight to the household appliance 105. Thus it can be indirectly determined whether the user 115 is able to supervise the household appliance 105. In this case, the user can be permitted to control the household appliance 105 remotely. To this end, in particular, the user can give a voice command which is identified on the part of the control apparatus 110 or on the part of the household appliance 105 and can form the basis of the control of the household appliance 105.

[0033] FIG. 2 shows an exemplary schematic view of a control apparatus 110. The control apparatus 110 comprises a processing facility 205 which can be connected to different sensors. An exemplary first sensor 210 comprises a camera which, for example, can operate in the optical or in the infrared range. The camera 210 can be designed to record individual images or a video data stream. A second exemplary sensor comprises a microphone 215. The microphone 215 is designed to scan an acoustic expression of the person 115. A plurality of microphones 215 can also be provided. A microphone 215 can be attached directly to the control apparatus 110, to the household appliance 105, or to the user 115. Moreover, a microphone 215 can be positioned freely in a space which can include the regions 125 to 130. A microphone 215 can also be attached wirelessly to the control apparatus 110 and, for example, implemented as a headset or lavalier microphone of the user 115.

[0034] A third exemplary sensor 220 comprises a capacitive sensor which can comprise one or more electrodes. The capacitive sensor 220 can be designed, in particular, to identify gestures of the user 115. The sensor 220 can be activated by means of a direct voltage signal or an alternating voltage signal.

[0035] A fourth exemplary sensor 225 comprises a radar sensor or lidar sensor. Both sensors can be designed to emit a high-frequency electromagnetic signal and to determine the reflections thereof. In the case of the lidar sensor, generally a laser light beam is used therefor. The sensor 225 is preferably an imaging sensor and can provide, in particular, differentiated information about the distance from a detected object.

[0036] A fifth exemplary sensor 230 comprises an ultrasonic sensor which can be designed to determine a distance or a movement of an object. To this end, generally sound signals can be emitted in the non-audible range and the reflections thereof received.

[0037] A sixth exemplary sensor 235 comprises an infrared sensor which is preferably designed to detect a gesture of the user 115. The sensor 235 can have a limited range of, for example, ca. 1.5 m, ca. 1 m, ca. 0.8 m or ca. 0.5 m. If the user 115 is located further from the sensor 235 than has been predetermined, then the user cannot be identified.

[0038] In addition to the sensors 210 to 235, the control apparatus 110 can comprise a communication facility 250 which is designed for wireless communication with the household appliance 105. The communication facility 250 can operate, in particular, on the basis of Bluetooth, further preferably Bluetooth Low Energy (BLE). A distance between the control apparatus 110 and the household appliance 105 can be determined on the basis of signals which can be exchanged therebetween via the communication facility 250. A corresponding determination can also be carried out on the part of the household appliance 105.

[0039] Optionally a map memory 255 which is designed to record map information, which relates to a space which can comprise the regions 125 to 130, is provided. Information for the map memory 255 can come from an external source or from one or more of the sensors 215-235. If the household appliance 105, the control apparatus 110 and the user 115, for example, are located in a room of a household, the map information can relate to the room. Thus, for example, furniture and other obstacles, walls, doors or windows can be stored in the map information. On the basis of the map information it can be determined whether a line of sight can be established or not between two predetermined positions. Moreover, a geometric spacing between the positions can be determined and the length of a path that the user 115 has to cover from their current position in order to reach the household appliance 105 can be determinable. This path can be significantly longer than a line of sight to the household appliance 105.

[0040] FIG. 3 shows a flow chart of a method 300 for controlling a household appliance 105. The method 300 can be carried out, in particular, in combination with a system 100.

[0041] In a step 305 a voice command can be detected. The voice command can be output by the user 115 and, in particular, relate to a control of household appliance 105. In the case of a stove, for example, the voice command can relate to a selection of a hotplate and an absolute or relative setting of the heating of a pot on this hotplate.

[0042] In a step 310 it can be determined whether the user 115 is in a predetermined first region 120 around the control apparatus 110. To this end, the user 115 can be scanned and detected by means of one or more of the sensors 210 to 235. Sensor signals of the sensors 210 to 235 can be compared or combined with one another. If the signals of one of the sensors 210 to 235 indicate different circumstances from the others, the measurement can be discarded as inconclusive. In this step, the positions of the control apparatus 110 and/or the person 115 can also be determined. A spacing between the control apparatus 110 and the user 115 can also be determined on the basis of the positions, or directly.

[0043] In a step 315, which is preferably carried out at the same time or further preferably only after completing step 310, it can be determined whether the control apparatus 110 is within a second region 125 around the household appliance 105. This determination is preferably carried out on the basis of a communication connection between the control apparatus 110 and the household appliance 105. Positions of the control apparatus 110 and/or the household appliance 105 can also be determined in this step. A spacing between the appliances 105 and 110 can also be determined on the basis of the positions, or directly.

[0044] A step 320 is preferably carried out only when the steps 310 and 315 have been positively determined, i.e. the user 115 is in the first region 120 and the control apparatus 110 is in the second region 125. In this step it can be determined whether the user 115 is in the third region 130 around the household appliance 105. In particular, it can be determined whether a line of sight is present between the user 115 and the household appliance 105. Moreover, it can be determined how great a spacing is from the user 115 to the household appliance 105. Different spacings can relate to the length of a line of sight and the length of a path for the user 115 to the household appliance 105. These determinations can be carried out on the basis of previously determined positions of the household appliance 105 and the person 115, optionally with reference to a position of the control apparatus 110. For these determinations, it is possible to consider map information which can relate to physical obstacles or visible obstacles in the region of a space which can comprise the regions 120 to 130.

[0045] In an optional step 325 the user 115 can be identified. The identification can be carried out, in particular, on the basis of scans which have been carried out in step 310. The user 115 can also be identified on the basis of the voice command in step 305. In one embodiment, the user 115 can be identified by means of the voice command, for example on the basis of their voice pattern or on the basis of the spoken text. If it were to be determined that the user 115 is not permitted to control the household appliance 105, the method 300 can be interrupted at this point. In one embodiment, any person can be permitted to control the adoption of a safe state by the household appliance 105. The safe state can relate, in particular, to switching off the household appliance 105. In particular, in the case of a cooking appliance, a lower energy state can also be activated. In this case, no more than a predetermined quantity of heat can be provided or a food to be cooked can be heated only to a predetermined temperature.

[0046] In a step 330 the household appliance 105 can be controlled as a function of the voice command of the user 115.

[0047] It should be mentioned that the steps 305 to 330 do not necessarily have to be carried out in the sequence shown. In other embodiments, for example, an identification of the user 115 can be carried out before it is determined whether the user 115 is in the first region 120 around the control apparatus 110.

REFERENCE SIGNS

[0048] 100 System [0049] 105 Household appliance [0050] 110 Control apparatus [0051] 115 User [0052] 120 First region [0053] 125 Second region [0054] 130 Third region [0055] 205 Processing facility [0056] 210 Camera [0057] 215 Microphone [0058] 220 Capacitive sensor [0059] 225 Radar sensor/lidar sensor [0060] 230 Ultrasonic sensor [0061] 235 Infrared sensor [0062] 250 Communication facility [0063] 255 Map memory [0064] 300 Method [0065] 305 Detect voice command [0066] 310 User in first region around control apparatus? [0067] 315 Control apparatus in second region around household appliance? [0068] 320 Line of sight between user and household appliance? [0069] 325 Identify user [0070] 330 Control household appliance