Food processor with a face recognition software

Abstract

An electrically operated food processor with a mixing bowl and a mixer in the mixing bowl, wherein the mixing bowl can be heated, is provided with a camera, in particular an electronic camera, which is potentially directed towards the user of the food processor, and with stored face recognition software, as well as a face data bank, it being possible to use face recognition to cause the food processor to carry out a routine task.

Claims

1. An electrically operated food processor with: a mixing bowl; a mixer in the mixing bowl; a camera configured to be directed towards a user of the food processor; an acoustic transducer; and a computer comprising a computer processor, having a face recognition software and a face data bank both stored on the computer, and configured to receive images captured by the camera and an audio signal from a spoken word captured by the acoustic transducer; and wherein at least one of a speech control software and a gesture control software is further stored on the computer; wherein the face recognition software is programmed to use an image captured by the camera and the face data bank to perform face recognition; wherein the computer processor is programmed to activate at least one of the speech control software and the gesture control software when a positive face recognition is achieved via the face recognition, the speech control software performing speech recognition using the audio signal and/or the gesture control software performing gesture recognition using a plurality of images captured by the camera; and wherein the computer processor is programmed to cause the food processor to operate when a positive speech recognition is achieved via the speech recognition or when a positive gesture recognition is achieved via the gesture recognition.

2. The food processor according to claim 1, wherein the computer processor is programmed to activate the food processor when the positive speech recognition is achieved via the speech control software or when the positive gesture recognition is achieved via the gesture control software.

3. The food processor according to claim 1, wherein the food processor is configured so that turning on the food processor activates the computer, the camera, and the face recognition software.

4. The food processor according to claim 1, wherein the face recognition software can be deactivated only by turning off the food processor.

5. The food processor according to claim 1, further comprising a display configured to display a suggestion from the food processor; wherein a heating and/or a running of the mixer is carried out only when speed, temperature and duration of the suggestion are accepted by the user via a voice command captured by the acoustic transducer and processed via the speech control software.

6. The food processor according to claim 1, further comprising a display configured to display a suggestion from the food processor; wherein a heating and/or a running of the mixer is carried out only when speed, temperature and duration of the suggestion are accepted by the user via a gesture captured by the camera in the plurality of images and processed via the gesture control software.

7. The food processor according to claim 1, further comprising: a display configured to display a suggestion from the food processor; and an input device selected from the group consisting of a button and a switch; wherein a heating and/or a running of the mixer is carried out only when speed, temperature and duration of the suggestion are accepted by the user via an input into the input device.

8. A food processing system comprising: an electrically operated food processor with: a mixing bowl; a mixer in the mixing bowl; a camera configured to be directed towards a user of the food processor; an acoustic transducer; and a first computer comprising a first computer processor and configured to receive images captured by the camera and to receive an audio signal from a spoken word captured by the acoustic transducer; and a second computer comprising a second computer processor, the second computer being located externally to the electrically operated food processor, wherein a face recognition software, a face data bank, and at least one of a speech control software and a gesture control software are stored on the second computer; wherein the first computer is configured to transmit a first image captured by the camera and the audio signal to the second computer; wherein the second computer processor is configured to use the face recognition software, the first image, and the face data bank to perform face recognition; wherein the second computer is configured to transmit a positive face recognition signal to the first computer when the face recognition achieves a positive face recognition; wherein the first computer is programmed so that when a positive face recognition signal is received by the first computer, the first computer causes the acoustic transducer to capture the spoken word or causes the camera to capture a plurality of images, and the first computer transmits the audio signal or the plurality of images to the second computer; wherein the second computer is programmed to activate the speech control software or the gesture control software when the second computer receives the audio signal or the plurality of images from the first computer, respectively, and the speech control software performs speech recognition using the audio signal or the gesture control software performs gesture recognition using the plurality of images; and wherein when the speech recognition at the second computer achieves a positive speech recognition or when the gesture recognition at the second computer achieves a positive gesture recognition, the second computer sends an activation signal to the first computer, and the first computer processor is programmed to cause the food processor to operate when the first computer receives the activation signal.

9. The food processing system according to claim 8, wherein the first computer processor is programmed to activate the food processor when the first computer receives the activation signal.

10. The food processing system according to claim 8, wherein the food processor is configured so that turning on the food processor activates the first computer, the camera, and the second computer.

11. The food processing system according to claim 8, wherein the face recognition software can be deactivated only by turning off the food processor.

12. The food processing system according to claim 8, further comprising a display configured to display a suggestion from the food processor; wherein a heating and/or a running of the mixer is carried out only when speed, temperature and duration of the suggestion are accepted by the user via a voice command captured by the acoustic transducer and processed via the speech control software.

13. The food processing system according to claim 8, further comprising a display configured to display a suggestion from the food processor; wherein a heating and/or a running of the mixer is carried out only when speed, temperature and duration of the suggestion are accepted by the user via a gesture captured by the camera and processed via the gesture control software.

14. The food processing system according to claim 8, further comprising: a display configured to display a suggestion from the food processor; and an input device selected from the group consisting of a button and a switch; wherein a heating and/or a running of the mixer is carried out only when speed, temperature and duration of the suggestion are accepted by the user via an input into the input device.

15. A food processing system comprising: an electrically operated food processor with: a mixing bowl; a mixer in the mixing bowl; a camera configured to be directed towards a user of the food processor; an acoustic transducer; and a computer comprising a computer processor and a memory input receiving device, wherein the computer is configured to receive an image captured by the camera and to receive an audio signal from a spoken word captured by the acoustic transducer; and a memory storage device configured to be inserted into the memory input receiving device, wherein a face recognition software and a face data bank and at least one of a speech control software and a gesture control software are stored on the memory storage device; wherein the face recognition software is programmed to use the image captured by the camera and the face data bank to perform face recognition, and the computer processor is configured to execute the face recognition software when the memory storage device is inserted into the memory input receiving device of the computer; wherein the computer processor is programmed to execute at least one of the speech control software and the gesture control software when a positive face recognition is achieved via the face recognition software, the speech control software performing speech recognition using the audio signal and/or the gesture control software performing gesture recognition using a plurality of images captured by the camera; and wherein the computer processor is programmed to cause the food processor to operate when a positive speech recognition is achieved via the speech recognition or when a positive gesture recognition is achieved via the gesture recognition.

16. The food processing system according to claim 15, wherein the memory storage device is a USB flash drive.

Description

(1) The invention will be explained below by means of the enclosed drawing, which, however, represents only an exemplary embodiment.

(2) FIG. 1 shows a view of a food processor of the type in question with a mixing bowl accommodated in a mixing bowl accommodation, mechanical switches for setting variables as well as a display;

(3) FIG. 2 shows a schematic illustration of the recognition software and data banks stored in the food processor 1 to control the latter;

(4) FIG. 3 shows a flowchart for illustrating an exemplary operation of the food processor.

(5) A food processor 1 with a mixing bowl accommodation 2 and a control panel 3 is illustrated and described initially with regard to FIG. 1.

(6) A mixing bowl 4 can be assigned to the food processor 1, in that said mixing bowl is inserted into the mixing bowl accommodation 2, in particular in the base area of the mixing bowl 4, preferably with positive locking. Assigned to the mixing bowl bottom, provision is made in the mixing bowl 4 for a mixer 5, which is operated via an electric motor 6, which is arranged in the food processor 1 below the mixing bowl accommodation 2 and which is only illustrated schematically in the drawing. The mixer 5 remains in the mixing bowl 4 even if the latter is removed from the mixing bowl accommodation 2, for the purpose of which, in a more preferable manner, the mixer 5 is connected to the electric motor 6 via a torque proof plug-in coupling in the assigned position.

(7) The bottom of the mixing bowl 4 can preferably be heated to heat a food to be cooked, which is located in the mixing bowl 4. Preferably, an electrical resistance heating 7, which is integrated in the bottom of the mixing bowl 4, is used here.

(8) The mixing bowl 4 is preferably embodied in a pot-like manner comprising a substantially circular cross section, with a cross section, which widens conically to the pot opening, that is, towards the top. The pot wall preferably consists of a metal material.

(9) The mixing bowl 4 furthermore encompasses a grab handle 8, which is preferably oriented vertically and which is fixed to the mixing bowl 4, for example on the base side as well as on the side of the pot edge.

(10) The mixing bowl 4 is preferably assigned to the food processor 1 such that the grab handle 8 extends in a free-standing manner between device housing brackets, facing the control panel 3, wherein the base area of the mixing bowl 4 is supported on an integral bottom of the food processor 1 in the area of the accommodation 2, by coupling mixer drive and mixer 5 and preferably by electrically contacting the heater on the side of the mixing bowl bottom.

(11) A bowl lid 9 can be attached to the mixing bowl 4. During operation of the food processor 1, further in particular during operation of the mixer 5 and/or of the resistance heating 7 on the bottom side, said bowl lid is locked in an attached position, more preferably to the housing of the food processor 1. Centrally, the bowl lid 9 has a non-illustrated filler opening.

(12) The electric supply of the electric motor 6 as well as of the heater 7, which is more preferably provided on the side of the mixing bowl bottom, and furthermore also of the electrical control of the entire food processor 1 is attained via a power cord 10.

(13) Initially, provision is preferably made in the control panel 3 for a display 11. More preferably, the control panel 3 supports one or a plurality of mechanical switches and controllers for setting different variables for the operation of the food processor 1. Initially, provision is thus preferably made for a rotary switch 12 for setting the speed of the mixer 5, whereby mixer speed stages are preferably selected via the rotary switch 12, and a provided mixer speed is assigned to each mixer speed stage.

(14) Provision is made in the illustrated exemplary embodiment for two further mechanical switches in the form of push buttons 13, preferably below the display 11. With this, a duration can be input as variable, via which duration preferably the mixer 5 and/or the heater 7 of the mixing bowl 4 on the bottom side is activated.

(15) In addition, provision can be made for a number of mechanical switches in the form of push buttons 14, via which different, provided temperatures can be selected. Preferably, these are temperatures in the range of from 37 C. to 100 C. By means of the chosen temperature and the mixer speed, which is chosen via the rotary switch 12, if applicable, heat is applied to the food to be cooked, which is located in the mixing bowl 4, for a period, which is provided by means of the push buttons 13.

(16) In addition, provision can furthermore be made in the control panel 3 for further push buttons for recalling stored special functions, thus in particular a push button 15 for activating a turbo function, in response to which the mixer 5 is operated at a maximum speed for a short time, that is, preferably for a period of between 1 and 3 seconds, more preferably for a period, which corresponds to the period during which the push button is acted upon. More preferably, the turbo function thus leads to a temporary speed of the mixer 5 of more than 10.000 rpm, more preferably more than 12.000 rpm, up to 15.000 rpm, for example.

(17) A further push button 16 preferably serves to activate a direction reversal function for the mixer 5. If, during normal operation, the mixer 5 preferably rotates clockwise, the push button 16 provides for the switchover to counter-clockwise. The new direction of rotation can be maintained until the period specified via the push buttons 13 has expired. More preferably, the electronics of the food processor 1 (then) switches back into the standard direction of rotation independently. It is also possible to reverse the direction of rotation again by operating the push button 16 during the mixer operation again.

(18) Provision is preferably furthermore made for a push button 17 for activating a dough mixing function, which is used in particular when making heavy yeast and bread doughs.

(19) The variables, which are to be set via the rotary switch 12 as well as via the push buttons 13 to 17 or the functions, which are to be accessed, respectively, can preferably be displayed in the display 11.

(20) A recipe data bank 18 is more preferably stored in the food processor 1. This recipe data bank includes a plurality of recipes for preparation in the food processor 1, preferably in a categorized manner. Preferably the parameters or variables, respectively, relating to the speed of the mixer 5, temperature of the resistance heating 7 and duration are assigned to each recipe. Preferably, the food processor 1 sets these variables independently or provides them to the user for confirmation with the activation of the recipe process.

(21) In addition, users or user groups, for example, can be assigned to each recipe, so that every user of the food processor 1 can access his preferred recipes at the touch of a button, so to speak, without moving through the menu in a time-consuming manner. The latter is preferably displayed on the display 11 in the conventional manner. In one embodiment, said display 11 can be embodied as touchscreen.

(22) In addition and parallel to an operation via an acoustic signal, the food processor 1 can preferably also be operated manually in the conventional manner, thus in particular as a result of operating rotary switch 12 and push buttons 13 to 17.

(23) Preferably, the food processor 1 is activated initially for operation, more preferably solely by one or a plurality of authorized persons.

(24) The authorization proof for activating the food processor and for activating the operating functions of the food processor is preferably attained by means of a speech control and/or a gesture control and/or a face recognition.

(25) For this purpose, the food processor 1 more preferably encompasses a speech recognition software E and/or a face recognition software F and/or a gesture recognition software G. An acoustic transducer 19 in the form of a microphone is furthermore arranged in particular in the area of the control panel 3 in interaction with the speech recognition software E. The microphone as well as an electronic camera 20, which is provided more preferably, is potentially directed towards the user of the food processor 1 in the control panel 3. The camera 20 serves to capture images, which can be evaluated, in combination with the face recognition software F and/or the gesture recognition software G.

(26) In response to the speech recognition, preferably the spoken word, in particular the command word or the acoustic pressure resulting therefrom, respectively, is converted into electrical signals and is processed and analyzed by a digital signal processor. After the continuous analysis of the received words and the comparison with a previously defined word list within a control data bank E.sub.1, the signal processor returns the word having the highest probability, which corresponds to the spoken word. In a further step, a microcontroller analyzes the word, which is present in text form, and translates it into a machine command or into a recipe or converts it, respectively, such that a recipe is accessed specifically from the recipe data bank 18 and is displayed at least on the display 11. In a preferred further development, the transmission of the machine command to the recipe data bank 18 has the result that the parameters, such as speed, temperature and time, which belong to the accessed recipe or recipe section, are preset automatically.

(27) As an alternative to or also in combination with the speech recognition, an image is captured continuously by using the camera 20, which is provided in the control panel 3, in particular for face recognition, furthermore as an alternative thereto or in combination therewith for gesture recognition. If a user is located in a defined image section and at a defined distance in front of the food processor 1, the image is examined, the face is extracted in the event of a face recognition, and is compared to a previously generated face data bank F.sub.1. The comparison with the face data bank F.sub.1 is attained by means of a processor, which is integrated in the food processor, wherein the face data bank F.sub.1 as well as the further data banks are preferably stored in a non-volatile memory.

(28) If a face, which has been stored in the face data bank F.sub.1 as reference value, is recognized via the face recognition F, this recognition can lead to the translation into a machine command or into a recipe for selection from the recipe data bank 18, as in the case of speech recognition.

(29) If a gesture of the user is recognized via the camera 20, for example an up and down movement of a hand, wiping with the hand, etc., this can preferably lead to the same operating commands as described above with regard to the face recognition or speech recognition.

(30) If a user is located in a defined image section and at a distance, the captured image is examined and the body of the user or body parts, respectively, such as face or hands, is extracted. If the body of the recognized person is in a stable position, the gesture recognition G it initiated. The movement of a hand, for example, is hereby observed and analyzed continuously. For recognition, the movement of a hand is determined by calculating movement vectors. The differential image calculation, in which an extracted feature (for example the hand) is determined initially in consecutive images, and the position of which is searched in the analyzed images, is suitable for this. If a movement corresponds to a previously defined gesture from the gesture data bank G.sub.1, the function of the food processor 1, which is stored for this, is executed, for example the setting of one or a plurality of parameters, such as speed, temperature or time, in addition the selection of a certain recipe from the recipe data bank 18.

(31) In a preferred embodiment, the respective recognition for controlling the food processor 1 preferably in a contact-free mannerwhich is preferably possible in addition to the common manual control of the food processor 1initially requires the food processor 1 to be turned on, in particular the activation thereof, for example via a main switch. In the alternative, the activation of the food processor can be attained by means of a certain voice command and/or gesture command and/or by recognizing a certain face, if applicable. The food processor 1 can thus preferably only be activated as a whole by recognizing a provided signal word or a provided gesture, whereby signal word or gesture preferably differ greatly from common words of gestures.

(32) The activation of the food processor 1 can be limited to certain persons by means of a face recognition.

(33) Based on this activation in point A in FIG. 3, the food processor 1 can be operated optionally under point B, it can thus be operated manually in the conventional manner on the one hand, on the other hand in a contact-free manner as a result of gesture and/or face and/or speech recognition.

(34) Due to a certain command word and/or a certain gesture and/or due to a facial image in the face data bank, which is associated with corresponding parameters, the parameters can be set manually (point C) after activation, thus in particular the speed C.sub.1, the temperature C.sub.2 and the duration C.sub.3, and/or the recipe data bank can be accessed under point D. Depending on the command word, face or gesture, all functions are activated or are available only to a limited extent.

(35) As can furthermore be seen from the flowchart in FIG. 3, the recipes D are divided in a wide variety of submenus, for instance initially under the generic terms sauces D1, meat D2 and baked goods D3 in the illustrated exemplary embodiment, wherein the latter term, in turn, is divided into cakes D3.1 and bread D3.2.

(36) The menu item bread offers a submenu rolls D3.2.1, among others, which, in turn, is divided into wheat rolls D3.2.1.1 and rye rolls D3.2.1.2, for example.

(37) The recipe data bank can be maneuvered, for example via the speech recognition E, thus in particular as a result of command words, which correspond to the individual menu items (for example recipes, baked goods, bread, etc.).

(38) In the alternative, a submenu can also be accessed directly via the speech recognition E, for example by means of the word rolls, in response to which the submenu is then displayed directly in the display 11.

(39) As a further alternative, the possible submenu items are specified acoustically as a result of a speech output, in response to which the user can react with the corresponding command word. If the command word corresponds directly to a submenu, which is not subdivided further, for example rye rolls in the illustrated exemplary embodiment, the corresponding recipe is accessed directly and the parameters for speed, temperature and time are set, if applicable.

(40) The gesture recognition and the routine task of the food processor 1 resulting therefrom is equivalent to the above-described speech recognition. Different gestures, in particular with the hand, lead to routine tasks of the food processor 1, which correspond to the respective gesture, thus for example, to accessing a certain recipe or to setting possible special functions of the food processor, such as the cake batter setting, for example.

(41) When a certain face is recognized, a selection of recipes culminating in one recipe can be provided as a function of the parameters, which belong to the reference face stored in the data bank.

(42) Regardless of whether a gesture recognition, a face recognition or a speech recognition can be used or is used or also a combination thereof, it is more preferable for the registered command, which is to be converted, to initially be queried optically, for example, in the display 11 or acoustically by means of speech output. In the case of a speech recognition, the user can react to this with yes or no, for example.

(43) In a preferred embodiment, the setting of speed C.sub.1 and/or temperature C.sub.2 by means of a gesture and/or a word command is only converted into a corresponding action, if the duration C.sub.3 has furthermore also been set. This can take place manually. In addition, a query can also be made so as to ask the user to also input the duration.

(44) In the case of a gesture recognition, speed, temperature and/or time can be set, for example by continuously moving the hand upwards or moving it downwards.

(45) The above descriptions serve to explain the inventions, which are covered as a whole by the application, which further develop the state of the art at least by means of the following feature combinations, in each case independently, namely:

(46) A food processor, which is characterized in that the food processor 1 encompasses a camera 20, in particular an electronic camera, which is potentially directed towards the user of the food processor 1, and that a face recognition software as well as a face data bank F.sub.1 are stored and that face recognition F can be used to cause the food processor 1 to carry out a routine task.

(47) A food processor, which is characterized in that the face recognition F activates the food processor 1.

(48) A food processor, which is characterized in that the face recognition F activates a speech control E and/or gesture control G of the food processor 1.

(49) A food processor, which is characterized in that the face recognition F is activated by turning on the food processor 1.

(50) A food processor, which is characterized in that the face recognition F can be deactivated only by turning off the food processor 1.

(51) A food processor, which is characterized in that a heating and/or a running of the mixer 5 is carried out only when speed C.sub.1, temperature C.sub.2 and duration C.sub.3 are provided or are accepted in response to a corresponding suggestion from the food processor 1.

(52) TABLE-US-00001 LIST OF REFERENCE NUMERALS: 1 food processor A activation 2 mixing bowl accommodation B selection 3 operating panel C parameter setting 4 mixing bowl C.sub.1 speed 5 mixer C.sub.2 temperature 6 electric motor C.sub.3 duration 7 resistance heating D recipes 8 grab handle D1 sauces 9 bowl lid D2 meat 10 power cord D3 baked goods 11 display D3.1 cake 12 rotary switch D3.2 bread 13 push button D3.2.1 rolls 14 push button D3.2.1.1 wheat rolls 15 push button D3.2.1.2 rye rolls 16 push button E speech 17 push button recognition 18 recipe data bank E.sub.1 command data bank 19 acoustic transducer F face recognition 20 camera F.sub.1 face data bank G gesture recognition G.sub.1 gesture data bank