HOUSEHOLD REFRIGERATION APPLIANCE WITH A POWER-SAVING MODE, AND METHOD FOR INITIALIZING A HOUSEHOLD REFRIGERATION APPLIANCE

Abstract

A household refrigeration appliance has a cooling chamber that can be closed off by at least one door. At least one door image recording module with at least one camera sensor and a gyro sensor is arranged on the at least one door. The gyro sensor is permanently active in an operationally ready state of the household refrigeration appliance and is configured to determine that the door is closed, and thereupon to deactivate at least one other component of the door image recording module, and/or to detect an opening movement of the previously closed door and, on this basis, to activate at least one deactivated other component of the door image recording module. The invention is particularly advantageously in the context of refrigerators, specifically refrigerators with double doors in a French-door arrangement.

Claims

1. A household refrigeration appliance, comprising: a body having a cooling chamber and at least one door for closing off said cooling chamber; at least one door image recording module arranged on said at least one door, said door image recording module having at least one camera sensor and one gyro sensor, said gyro sensor being permanently active in an operationally ready state of the household refrigeration appliance and said gyro sensor being configured: to determine that said at least one door is closed and thereupon to deactivate at least one other component of said door image recording module; and/or to detect an opening movement of a previously closed said door and, based thereon, to activate at least one deactivated other component of said door image recording module.

2. The household refrigeration appliance according to claim 1, wherein said at least one other component of said door image recording module, to be deactivated by said gyro sensor, is a component which is required for communication with a control unit of the household refrigeration appliance.

3. The household refrigeration appliance according to claim 2, wherein said door image recording module is connected to the control unit via a serial digital video interface, and said component to be deactivated by said gyro sensor is a serializer.

4. The household refrigeration appliance according to claim 3, wherein said door image recording module is connected to the control unit via a Flat Panel Display Flat Panel Display (FPD) Link II or a Gigabit Multimedia Serial Link (GMSL) connection.

5. The household refrigeration appliance according to claim 1, wherein said gyro sensor is configured to determine that said door is closed when said gyro sensor receives a message indicating that a door opening sensor assigned to said door has detected a closed state of said door, and when a current angular velocity of said door determined by said gyro sensor reaches or undershoots a predetermined first threshold value.

6. The household refrigeration appliance according to claim 1, wherein said gyro sensor is configured to detect an opening movement of the previously closed said door when a current angular velocity of said door determined by said gyro sensor following the closed state of said door reaches or exceeds a predetermined second threshold value.

7. The household refrigeration appliance according to claim 1, wherein said image recording module further includes at least one body image recording module with at least one camera sensor arranged on said body and wherein a control unit of the household refrigeration appliance connected to said at least one body image recording module is configured: to receive information from a door opening switch assigned to a respective said door indicating whether said door is open or closed; upon receiving the information indicating that the at least one door has been closed, to deactivate said at least one body image recording module; and upon receiving the information indicating that said at least one door has been opened, to activate said at least one body image recording module.

8. The household refrigeration appliance according to claim 1, further comprising: a control unit connected to said at least one image recording module via a serial digital video interface; a deserializer for communication with said at least one image recording module; said control unit having a system master configured: to receive information from a door opening switch indicating whether said at least one door is open or closed; upon receiving the information indicating that said at least one door has been closed, to deactivate said deserializer; and upon receiving the information indicating that said at least one door has been opened, to activate said deserializer.

9. The household refrigeration appliance according to claim 8, wherein said serial digital video interface is a Flat Panel Display (FPD) Link II or a Gigabit Multimedia Serial Link (GMSL) connection.

10. The household refrigeration appliance according to claim 8, wherein said system master is configured to place itself in a power-saving mode once said deserializer has been deactivated.

11. The household refrigeration appliance according to claim 8, wherein said system master is configured to place itself in a power-saving mode once said deserializer has been deactivated and if, in addition, no data transmission is taking place from said system master to a further device.

12. The household refrigeration appliance according to claim 8, wherein said system master is configured: to receive information from a door opening switch indicating whether said at least one door is open or closed; and to wake itself up out of the power-saving mode if said system master receives information while in the power-saving mode that said door has been opened.

13. A method for initializing a household refrigeration appliance after an activation thereof, wherein the refrigeration appliance includes: a cooling chamber and at least one door for closing off the cooling chamber; a control unit; at least one door image recording module arranged on the at least one door and having at least one camera sensor and a gyro sensor; and at least one body image recording module arranged on a body of the refrigeration appliance and having at least one camera sensor; and wherein: each of the image recording modules is connected to the control unit via a serial digital video interface and each has a serializer which is connected for data communication to a deserializer of the control unit; and the control unit, in addition to the deserializer, has a system master which is configured to receive information from at least one door opening switch indicating whether the at least one door is closed; and the method comprising, after the activation of the household refrigeration appliance: activating the control unit and the image recording modules; initializing the gyro sensor of the at least one door image recording module by the activated system master; if subsequently the system master receives information from the at least one door opening switch, indicating that the at least one door is open or has been closed: transmitting the information from the system master to the gyro sensor of the at least one door image recording module, and thereupon deactivating the associated serializer; and following a transmission of the information, deactivating with the system master the at least one body image recording module and the deserializer and then transitioning into a power-saving mode.

14. A method for waking up a household refrigeration appliance for recording an image, wherein the household refrigeration appliance has a cooling chamber and at least one door for closing off the cooling chamber; a control unit, at least one door image recording module arranged on the at least one door and having at least one camera sensor and a gyro sensor; and at least one body image recording module arranged on a body of the refrigeration appliance and having at least one camera sensor; and wherein: each of the image recording modules is connected to the control unit via a serial digital video interface and each has a serializer which is connected for data communication to a deserializer of the control unit; and the control unit, in addition to the deserializer, has a system master which is configured to receive information from at least one door opening switch indicating whether the at least one door is closed; and the method comprises: with the at least one door being closed, the system master being in a power-saving mode, the at least one body image recording module and the deserializer being deactivated, and the serializer of the at least one door image recording module being deactivated, waking up the system master upon receiving information from at least one door opening switch indicating that the at least one door is open; upon having been woken up, activating with the system master the at least one body image recording module and the deserializer; and activating with a gyro sensor of a door image recording module an associated serializer if the gyro sensor detects that the associated door is being opened.

15. The method according to claim 14, further comprising, subsequent to performing the method of claim 14, placing the household refrigeration appliance in a power-saving mode: upon receiving information from at least one door opening switch indicating that the at least one door has been closed, deactivating with the system master the at least one body image recording module and the deserializer and subsequently placing itself in the power-saving mode; and upon detecting that the associated door is closed, deactivating with the gyro sensor of a door image recording module the associated serializer.

16. The method according to claim 15, wherein the serializer of the at least one body image recording module is connected to the control unit and an associated coaxial cable is energized or deenergized for a selective activation and deactivation of the at least one body image recording module.

Description

BRIEF DESCRIPTION OF THE FIGURES

[0120] FIG. 1 shows a diagrammatic outline, viewed obliquely from the front, of a household refrigeration appliance in the form of a double-door refrigerator;

[0121] FIG. 2 shows a schematic block diagram of the data technology connections of several functional units of the double-door refrigerator from FIG. 1;

[0122] FIG. 3 shows a schematic block diagram of a functional unit of the double-door refrigerator from FIG. 1 in the form of an image recording module;

[0123] FIG. 4 shows a schematic block diagram of a functional unit of the double-door refrigerator from FIG. 1 in the form of a central master module;

[0124] FIG. 5 shows a possible flowchart for initializing image recording modules;

[0125] FIG. 6 shows a possible flowchart for recording images by means of the image recording modules;

[0126] FIG. 7 shows an outline, viewed from above, of a section of the refrigerator from FIG. 1 in the region of a right door, which is shown at two different pivot angles;

[0127] FIG. 8 shows a more detailed representation of an initialization step S1-3, described in FIG. 5;

[0128] FIG. 9 shows a more detailed representation of some of the method steps described in FIG. 5;

[0129] FIG. 10 shows an oblique view of a door image recording module according to a possible design configuration.

[0130] FIG. 11 shows a sectional view, viewed from the side, of the door image recording module from FIG. 10;

[0131] FIG. 12 shows a sectional view, viewed from the back from a cooling chamber, with both doors partially open;

[0132] FIG. 13 shows a sectional representation, viewed from the side, of the refrigerator; and

[0133] FIG. 14 shows a sectional representation, viewed from above, of the refrigerator with fields of view of the door image recording modules.

DETAILED DESCRIPTION OF THE INVENTION

[0134] Referring now to the figures of the drawing in detail and first, in particular, to FIG. 1 thereof, there is shown an outline, viewed obliquely from the front, of a household refrigeration appliance in the form of a double-door refrigerator 1 with two doors 2A and 2B attached to the outside of a body 25, or carcass 25, which doors—viewed from the front—cover a left and a right side respectively of a common cooling chamber 3. This is also known as a “French-door” arrangement. The doors 2A and 2B are shown open here.

[0135] The cooling chamber 3 contains several, in particular transparent, shelves 4 as well as retractable drawers 5A and 5B on the bottom of the cooling chamber 3 on the left and right in each case. The drawers provide for a special climate zone, for example for fruit and vegetables (VitaFresh®—a registered trademark of BSH Hausgeräte GmbH), meat and fish, etc. At least one sensor mR-1 or mR-2 is assigned to each of the two drawers 5A and 5B, by means of which it is possible to detect when a drawer 5A, 5B is being or has been pulled out and when it is pushed back in. The sensors mR-1 and mR-2 can be proximity sensors such as for example magnet sensors, which detect an approaching sensing element, for example a magnet, attached to the respective drawer 5A, 5B. The sensors mR-1 and mR-2 are connected via data technology to a further module (referred to in the following without limiting the generality as the “central module” CMM), which can be accommodated for example in a switch space of the refrigerator 1 arranged for example above the cooling chamber 3.

[0136] The central module CMM is also connected via data technology to four image recording modules CCM-0, CCM-1, CCM-2, CCM-3, namely, [0137] to a first image recording module CCM-0, which is arranged on a ceiling of the cooling chamber 3 and is provided (in other words configured and arranged) to record at least one image of refrigerated goods placed in door compartments 17 on the inner sides of the doors 2A and 2B; [0138] to a second image recording module CCM-1, which is arranged on an inner side of the left door 2A and is provided to record at least one image of refrigerated goods placed on the shelves 4, namely at least from a “left” spatial region of the cooling chamber 3 which is located behind the left door 2A when this door is closed; [0139] to a third image recording module CCM-2, which is arranged on an inner side of the right door 2B and is provided to record at least one image of refrigerated goods placed on the shelves 4, namely at least from a “right” spatial region of the cooling chamber 3 which is located behind the right door 2B when this door is closed; [0140] to a fourth image recording module CCM-3, which is arranged on the ceiling of the cooling chamber 3 and is provided to record at least one image, from above, of refrigerated goods accommodated in the pulled-out regions of the drawers 5A, 5B.

[0141] The first and the fourth image recording modules CCM-0 and CCM-3 are also referred to in the following without limiting the generality as “body image recording modules.” They may also be referred to as “carcass image recording modules.” The second and the third image recording module CCM-1 and CCM-2 are also referred to in the following without limiting the generality as “door image recording modules.”

[0142] The central module CMM can be connected via data technology, for example via a D-bus, an Ethernet connection, or the like, to further modules (not shown) of the refrigerator 1, for example to a user interface etc., and can actuate the same. The refrigerator 1 is configured in particular to enable a wireless and/or wired data communication between the central module CMM and an external unit such as a network server, cloud computer etc. To this end, the refrigerator 1, in particular the central module CMM, can be equipped with a communication facility (not shown) such as a WLAN module, Bluetooth module, Ethernet module etc.

[0143] FIG. 2 shows an outline of the data technology connections of several functional units of the refrigerator 1 from FIG. 1.

[0144] The image recording modules CCM-0 to CCM-3 are connected to the central module CMM in each case via an FPD (“flat panel display”) link, in particular via an FPD-Link III.

[0145] Here, the FPD terminals FPD of the image recording modules CCM-0 to CCM-3 are advantageously connected to the FPD terminals FPD of the central module CMM in each case via coaxial cables COAX, wherein in each case an FPD-Link III is provided. The control channel thereof uses the I2C bus protocol here by way of example. In addition, video signals can be transmitted from the associated image recording module CCM-0 to CCM-3 to the central module CMM and on the other hand the associated image recording module CCM-0 to CCM-3 supplied with electrical energy via the coaxial cable COAX in accordance with what is known as the “Power over Coaxial”/“PoC” standard.

[0146] In addition, an interface between a camera sensor 6 (see FIG. 3) of the associated image recording module CCM-0 to CCM-3 and the central module CMM (expressed more precisely: the system master module SMM thereof) is provided via the respective coaxial cable COAX in accordance with the MIPI-CSI specification, in other words in accordance with CSI-2 v3.0, CSI-3 v1.1, etc.

[0147] The central module CMM is connected via respective signal lines to the sensors mR-1 and MR-2 and to respective door opening sensors TOS for the doors 2A, 2B. The door opening sensors TOS can be for example microswitches, magnet switches etc. and detect whether the associated door 2A, 2B is open or closed.

[0148] FIG. 3 shows a block diagram of an image recording module CCM-n where n={0, . . . , 3}. The image recording module CCM-n has a (“camera”) module CAM and a (“connection”) module COB (“connection board”).

[0149] The camera module CAM has a digital camera sensor 6, in particular digital color camera sensor, which can be actuated for recording images via a trigger input TRIGGER and which can output image data via an MIPI-CSI terminal MIPI-CSI. A I2C terminal I2C is also present for a control channel which uses the I2C bus protocol. These terminals are connected via an FPC (flexible printed circuit) connector to corresponding terminals GPIO_0, MIPI-CSI or I2C of a serializer SER of the connection module COB. The camera sensor 6 can comprise driver software etc. in addition to the actual sensor element 6A (e.g. a CMOS sensor element).

[0150] A terminal FLASH of the camera module CAM is optionally connected to a flash 7, for example an LED. This can be used to transmit a signal to the flash 7 so that said flash triggers together with an image recording by the camera sensor 6.

[0151] The connection module COB can also have a gyro sensor 8, for example depending on the application purpose. The gyro sensor 8 can be switched to active or inactive, for example depending on the application purpose. In the present exemplary embodiment, the gyro sensors 8 of the stationary body image recording modules CCM-0 and CCM-3 are permanently inactive (for example permanently deenergized), while the gyro sensors 8 of the door image recording modules CCM-1 and CCM-2 which are moved with the doors are active.

[0152] In particular, the gyro sensors 8 of the door image recording modules CCM-1 and CCM-2 are oriented parallel to the axes of rotation of the doors 2A, 2B and thus along a z axis, so that by means of the gyro sensors 8 a rotational movement or change of angle of the associated door 2A, 2B in each case can be determined particularly easy without taking the z components into consideration.

[0153] The gyro sensor 8 can have a I2C terminal I2C for connecting a control channel, which is connected to the I2C terminal I2C of the serializer SER.

[0154] A terminal GPIO_0 of the gyro sensor 8 is connected to the terminal GPIO_0 of the serializer SER and to the trigger input TRIGGER of the camera module CAM. A first trigger signal can for example be output via the terminal GPIO_0 of the gyro sensor 8 when the opening of the monitored door 2A or 2B fulfills a certain first condition, for example the door 2A or 2B reaches a certain first pivot angle, possibly linked to the further sub-condition that a door opening process or a door closing process is present (which can be established by the direction of rotation). Such a pivot angle can also be referred to as the “trigger angle,” the first trigger signal also as the “self-trigger”. The first trigger signal then triggers an image recording by the camera module CAM of the same door image recording module CCM-1, CCM-2 and is also output via the serializer SER to the central module CCM.

[0155] Here, the camera module CAM is advantageously embodied for low energy consumption such that the camera sensor 6 is in a power-saving mode if no trigger signal is applied to it. If a trigger signal is applied, the camera sensor 6 wakes up from the power-saving mode and records at least one image. If the trigger signal is deactivated again, the camera sensor 6 automatically returns to the power-saving mode.

[0156] In addition, a terminal GPIO_1 of the gyro sensor 8 is connected to a terminal GPIO_1 of the serializer SER. A second trigger signal can for example be output via the terminal GPIO_1 of the gyro sensor 8 when the opening of the monitored door 2A or 2B fulfills a certain second condition, for example the door 2A or 2B reaches a certain second pivot angle, possibly linked to the sub-condition that a door opening process or a door closing process is present. The second trigger signal can be output during an opening and closing of a door 2A, 2B, with or after the first trigger signal.

[0157] Furthermore, a terminal GPIO_4 of the gyro sensor 8 is configured such that a supply voltage SerVDD of the serializer SER and thus of the serializer SER itself can be activated or deactivated via said terminal. This is advantageous for reducing power consumption, as a serializer SER consumes a comparatively large amount of current.

[0158] The serializer SER has a signal transmission terminal DOUT, for example a data transmission terminal FPD in accordance with FPD-Link III, and is configured to serialize image data supplied from the camera module CAM and then output it via the signal transmission terminal DOUT. Further signals such as the trigger signals etc. can also be output via the signal transmission terminal DOUT. The serializer SER is further configured to receive incoming control signals and, if required, output them to the camera module CAM and/or to the gyro sensor 8.

[0159] Because the gyro sensor 8 is inactive or possibly not even present in the body image recording modules CCM-0 and CCM-3, the trigger signal which triggers an image recording is received there exclusively via the signal transmission terminal DOUT and forwarded to the terminal TRIGGER. In the body image recording modules CCM-0 and CCM-3, there is therefore also no possibility to specifically deactivate the supply voltage SerVDD of the serializer SER. Instead, the body image recording modules CCM-0 and CCM-3 can be deactivated in their entirety by switching off the current supply via the coaxial cable COAX.

[0160] FIG. 4 shows a block diagram of the central module CMM. The central module CMM has four interfaces FPD_0 to FPD_3 for FPD Link III connections to the image recording modules CCM-0 to CCM-3. The interfaces FPD_0 to FPD_3 are routed to terminals RIN_0 to RIN_3 of a deserializer DESER of the central module CMM, which deserializes the incoming serialized data again and forwards it to the (“system master”) module SMM, for example image data via MIPI-CSI and bus data via I2C.

[0161] The terminals GPIO_0 to GPIO_4, via which the first and second trigger signals of the image recording modules CCM-1 and CCM-2 are routed, are also available to the system master module SMM for data exchange with the deserializer DESER.

[0162] Furthermore, the system master module SMM has the terminals GPIO_5 and GPIO_6, via which the sensors mR-1 and mR-2 are connected. By means of the signals applied to the terminals GPIO_5 and GPIO_6, the system master module SMM can determine whether the drawer 5A or 5B has once again reached a certain pushed-in position after previously being pulled out.

[0163] The door opening sensors TOS are connected via the terminal GPIO_7 of the system master module SMM, so that information indicating that at least one of the doors 2A and/or 2B are open is provided via this route.

[0164] The supply voltage DesVDD of the deserializer DESER can be activated and deactivated via the terminal GPIO_8 of the system master module SMM. Furthermore, the electrical power to the stationary body image recording modules CCM-0 and CCM-3 can be interrupted via the terminal GPIO_8, so that said modules are deactivated in their entirety. The door image recording modules CCM-1 and CCM-2, on the other hand, are not deactivated via the terminal GPIO_8.

[0165] The system master module SMM can be for example a microprocessor, ASIC, FPGA, etc. In one development, the system master module SMM can actuate yet further functional components of the refrigeration appliance 1.

[0166] FIG. 5 shows a flow chart illustrating the initialization of the image recording system shown in FIG. 2, following an operational startup/activation of the refrigeration appliance 1.

[0167] Here, in a step S1-1, the operational startup initially activates the system master module SMM.

[0168] In a second step S1-2, an activation signal is output by the system master module SMM via the terminal GPIO_8, by means of which (a) the supply voltage DesVDD for the deserializer DESER is activated such that the latter is placed in its normal operational state, and (b) the power supply, PoC, for the body image recording modules CCM-0 and CCM-3 is established. The door image recording modules CCM-1 and CCM-2 are activated automatically with the operational startup of the refrigeration appliance 1.

[0169] In a step S1-3, the gyro sensors 8 of the door image recording modules CCM-1 and CCM-2 are initialized with the aid of the system master module SMM, at the end of which they are in an operational state/awake state.

[0170] In a subsequent step S1-4, monitoring is carried out to determine whether the doors 2A and 2B are closed. If this is not the case (“N”), the verification is continued.

[0171] If on the other hand this is the case (“Y”), in step S1-5 a signal is issued to the terminal GPIO_8 of the system master module SMM, on the basis of which the deserializer DESER and the body image recording modules CCM-0 and CCM-3 are deactivated.

[0172] Upon completion of this initialization routine, the individual modules can have the following operational state when both doors 2A and 2B are closed: [0173] The system master module SMM is activated and operationally ready or is in the normal operational state/awake mode; [0174] The deserializer DESER is deactivated; [0175] The body image recording modules CCM-0 and CCM-3 are deactivated or deenergized; [0176] The door image recording modules CCM-1 and CCM-2 are supplied with current, but their serializer SER is deactivated and their camera sensors 6 are in their power-saving mode, while the gyro sensors 8 are in their normal operational state or awake mode.

[0177] In a variant thereof—possibly after expiration of a predetermined duration during which both doors 2A and 2B have been kept closed, for example 15 to 30 s—the system master module SMM can also be placed in a power-saving mode, from which it can be woken up for example by receiving a signal via terminal GPIO_7 indicating that at least one of the door opening sensors TOS has detected an opening of at least one of the doors 2A and/or 2B.

[0178] FIG. 6 shows a possible flowchart for the recording of images by means of the image recording modules CCM-0 to CCM-3 following the opening of at least one of the doors 2A and/or 2B. Here, it is assumed that the individual modules are in the operational state as described above after completion of the initialization routine and the system master module SMM is in a power-saving mode.

[0179] In a step S2-1, a door opening signal from at least one door opening sensor TOS is received at GPIO_7 of the system master module SMM when at least one of the two doors 2A, 2B is opened.

[0180] In a step S2-2, the system master module SMM is woken up by the door opening signal.

[0181] In a step S2-3, the system master module SMM which is now awake activates the deserializer DESER and the body image recording modules CCM-0 and CCM-3 via GPIO_8.

[0182] In a step S2-4 following step S2-3, the system master module SMM verifies on the basis of the signals received at the terminals GPIO_5 and GPIO_6 from the sensors mR-1 or mR-2 whether (a) at least one of the drawers 5A, 5B has been pulled out by a predetermined pull-out distance, which can be established when the sensing element passes the associated sensor mR-1 or mR-2 in each case for the first time, and whether (b) this drawer 5A, 5B is being pushed in again, which can be established when the sensing element passes the associated sensor mR-1 or mR-2 in each case once again (this time in the opposite direction).

[0183] An additional verification condition can consist in firstly verifying whether the drawer 5A, 5B has been or is being pulled out at all, in other words even by a short distance. This can be queried by means of an independent sensor, the measurement output of which can likewise be connected to the system master module SMM (not shown).

[0184] If this is not the case, the verification is continued. If on the other hand this is the case (“Y”), in step S2-5 the system master module SMM outputs a trigger signal to the body image recording module CCM-3, namely here by way of example from its terminal GPIO_4 to the terminal GPIO_5 of the deserializer DESER, which transmits the signal or a corresponding item of information via RIN_3 and further via FPD_3 and a coaxial cable COAX used with FPD-Link III to the signal transmission terminal DOUT of the serializer SER, from where it reaches the trigger input TRIGGER of the camera module CAM of the drawer image recording module CCM-3, as a result of which at least one image is recorded by means of the associated camera sensor 6, possibly with the flash. The image shows a top view of a content of the drawer 5A and/or 5B, which is being retracted but is still partially pulled out.

[0185] The gyro sensors 8 of the door image recording modules CCM-1 and CCM-2 are permanently awake. In a step S2-6, they verify, based on the assumption that the respective door 2A, 2B was previously closed, whether the door 2A or 2B is moving. If this is the case (“Y”), the serializer SER is activated in step S2-7. In addition, it is assumed that in this case also the steps S1-1 to S1-3 are being or have been carried out, so that the deserializer DESER and the body image recording modules CCM-0 and CCM-3 are activated.

[0186] In step S2-3, verification is carried out to determine whether the condition(s) for outputting the first trigger signal (which can also be referred to as the “self-trigger”) is or are present.

[0187] If the conditions for triggering the self-trigger are present (“Y”), for example if the associated door 2A or 2B is moved for closing and in the process reaches a predetermined trigger or pivot angle, in a step S2-9 the self-trigger is output at the terminal GPIO_0 of the gyro sensor 8, namely both to the trigger input TRIGGER of the camera module CAM, which thereupon triggers an image recording by the camera sensor 6 of the camera module CAM, and also via the serializer SER to the deserializer DESER and further to the system master module SMM. With the image recording, the flash 7 is also triggered via the terminals FLASH. The associated image shows the cooling chamber 3.

[0188] Expressed more precisely, the self-trigger is transmitted from the door image recording module CCM-1 to the terminal RIN_1 of the deserializer DESER and from the terminal GPIO_0 thereof to the terminal GPIO_0 of the system master module SMM. The self-trigger of the door image recording module CCM-2 is transmitted to the terminal RIN_2 of the deserializer DESER and from the terminal GPIO_3 thereof to the terminal GPIO_2 of the system master module SMM. The first trigger signal is used by the system master module SMM inter alia to assign the image data received as a result of the image recording to the correct door image recording module CCM-1 or CCM-2.

[0189] In a step S2-10, verification is carried out in parallel with step S2-6 to determine whether the condition(s) for outputting the second trigger signal (which can also be referred to as the “CCM-0 trigger”) is or are present.

[0190] If this is the case (“Y”), in a step S2-11 the CCM-0 trigger is output at the terminal GPIO_1 of the gyro sensor 8, namely via the serializer SER to the deserializer DESER and further to the system master module SMM. Expressed more precisely, the CCM-0 trigger is transmitted from the door image recording module CCM-1 to the terminal RIN_1 of the deserializer DESER and from the terminal GPIO_1 thereof to the terminal GPIO_1 of the system master module SMM. The CCM-0 trigger of the door image recording module CCM-2 is transmitted to the terminal RIN_2 of the deserializer DESER and from the terminal GPIO_4 thereof to the terminal GPIO_3 of the system master module SMM.

[0191] In a step S2-12, the second trigger signal is output from the system master module SMM via the same terminal at which it was received (GPIO_1 or GPIO_3), via the terminal GPIO_2 of the deserializer DESER via RIN_0 to the body image recording module CCM-0. Alternatively, the output terminal of the deserializer DESER outputting the second trigger signal (GPIO_1 or GPIO_4) can branch to the terminal GPIO_2 of the deserializer DESER, so that no action is required from the system master module SMM for the forwarding to the body image recording module CCM-0 in step S2-12.

[0192] In step S2-13, the CCM-0 trigger is received by the serializer SER of the body image recording module CCM-0 and forwarded to the trigger input TRIGGER of the associated camera module CAM, as a result of which an image recording of the inner sides of the doors 2A and 2B is triggered. The second trigger signal is used by the system master module SMM inter alia to assign the image data received as a result of the image recording of the body image recording module CCM-0 to the body image recording module CCM-0.

[0193] The image data generated in the steps S2-5, S2-9 and/or S2-13 by the respective camera modules CAM of the image recording modules CCM-3, CCM1-1/CCM-2 or CCM-0 is transmitted via the MIPI-CSI terminals to the system master module SMM and, in a step S2-14, received by the system master module SMM, possibly together with further information such as a time of the image recording etc. To prevent a transmission of image data of different camera sensors 6 from overlapping, it is advantageous if the trigger signals arriving at the camera sensors 6 are spaced apart from each other by a time interval of at least 15 ms.

[0194] Once the image data etc. together with any further information has been received by the system master module SMM, in a step S2-15 an image is composed therefrom, for example in JPG or PNG format etc. In one development, the image may have been cropped to a region of interest (RoI) of the image. Metadata can be attached to the image, for example an identifier of the image recording module CCM-0 to CCM-4 carrying out the recording, a time stamp, a resolution, compression information, etc.

[0195] In a step S2-16, an external instance/backend (not shown) such as a network server etc. is informed that an image is available.

[0196] In a step S2-17, the image can then be transmitted to the external instance/backend.

[0197] The steps S2-18 to S2-20 are carried out in parallel with the steps S2-15 to S2-17.

[0198] In step S2-18, verification is carried out to determine whether all doors 2A, 2B are closed, possibly for a predetermined duration. This is advantageously measured such that the steps S2-15 to S2-17 are completed before step S2-18 is carried out.

[0199] If all doors 2A, 2B are closed, possibly for a predetermined period (“Y”), the serializers SER of the door image recording modules CCM-1 and CCM-2 are deactivated in a step S2-19. Subsequently, in a step S2-20, the body image recording modules CCM-0 and CCM-3 are deenergized and the deserializer DESER deactivated.

[0200] In a step S2-21 following the steps S2-17 and S2-20, the system master module SMM is placed in a power-saving mode. The same initial situation is thus present as in step S2-1, to which the method then branches.

[0201] If during the steps S2-15 to S2-20 a new image is recorded by the same camera sensor 6 as the image currently being generated, the steps S2-15 to S2-20 currently being carried out are aborted, and the method returns to step S2-1.

[0202] In the following FIG. 7 and FIG. 8, the initialization of the gyro sensors 8 from step S1-3 is explained in more detail: to this end, FIG. 7 shows an outline of the right door 2B at a pivot angle α=0°, at which the door 2B rests on the body 25 (possibly via a seal) and closes off the cooling chamber 3, and a door 2B which is rotated relative thereto by 90° about the vertically disposed axis of rotation z, which corresponds to a pivot angle α=90°. Here, the axis of rotation z projects vertically from the image plane. If the door 2B is closed, this can be detected at least approximately by means of the associated door opening sensor TOS.

[0203] The angular velocity Ω.sub.z of the door 2B about its axis of rotation z can be detected by the gyro sensor 8, from which angular velocity the pivot angle α is calculated by means of temporal integration. In one development, the maximum detectable value of the angular velocity Ω.sub.z amounts to 90°/s. In one development, a direction of rotation of the door 2B can also be determined by the gyro sensor 8.

[0204] FIG. 8 shows a more detailed representation of the step S1-3 described in FIG. 5 for initializing the gyro sensors 8, here by way of example on the basis of the door 2B. When the refrigerator 1 is commissioned, in a step S3-1 the data memory of the gyro sensor 8 of the third image recording module CCM-2 is flashed from the system master module SMM via the I2C bus if the driver software is present in a volatile memory. A prerequisite here is that the serializer SER is initially in operation/awake when the refrigerator 1 is commissioned.

[0205] In a subsequent step S3-2, the system master module SMM receives data required for triggering at the gyro sensor 8 via the I2C bus of the serializer SER, for example the trigger angle xα1 for the first trigger signal (for example) 1.5°), the trigger angle xα2 for the second trigger signal (for example 0.5°), etc. Several trigger angles xα1 and/or trigger angles xα2 can optionally be transmitted and used by the gyro sensor 8. An item of time information in relation to the trigger signals, for example that the first trigger signal and the second trigger signal must be output offset by at least a predetermined duration, can also be transmitted. This can be expedient in order to ensure that the system master module SMM only ever receives image data of just one image at any one time.

[0206] In a subsequent step S3-3, verification is carried out to determine whether information detected by the door opening sensor TOS indicating whether the door 2B is closed or is in its closed state has been received by the gyro sensor 8 from the system master module SMM via the I2C bus. If this is not the case (“N”), the occurrence of this case is awaited.

[0207] If this is the case (“Y”), in step S3-4 verification is carried out by means of the gyro sensor 8 to determine whether the angular velocity Ω.sub.z of the door 2B lies below a predetermined first threshold value Ω.sub.z;thr1, in particular is less than 0.3°/s. If this is not the case (“N”), the method branches back to step S3-3, alternatively step S3-4 is repeated (not shown).

[0208] If on the other hand this is the case (“Y”), in step S3-45 the value for the pivot angle α is set to 0°, a time value t is set to zero and subsequently the serializer SER is deactivated via GPIO_4.

[0209] The initialization of the gyro sensor 8 is thus completed, and the method can proceed for example to step S1-6.

[0210] A step S3-6 can optionally be carried out between step S3-4 and step S3-5, in which verification is carried out by means of the gyro sensor 8 to determine whether the door 2B is at rest or is carrying out a closing movement. If this is not the case (“N”), the method branches back to step S3-3, otherwise (“Y”) proceeds to step S3-5.

[0211] FIG. 9 shows a more detailed representation of the steps S2-6 to S1-11 described in FIG. 5 for the doors 2A, 2B, here by way of example on the basis of the door 2B.

[0212] Here, it is assumed that initially, in a step 4-1 analogous to step S3-5, the value for the pivot angle α has been set to 0°, a time value t has been set to zero, and the serializer SER has been deactivated.

[0213] In a step S4-2 analogous to step S2-6, verification is carried out to determine whether a door movement is being started. This can be determined for example by means of the gyro sensor 8 of the image recording module CCM-2 by verification being carried out to determine whether the angular velocity Ω.sub.z of the door 2B is equal to or greater than a predetermined second threshold value Ω.sub.z;thr2, for example whether Ω.sub.z>1°/s applies. At the same time, the time value t is incremented, for example in steps of seconds or minutes.

[0214] If it has not been established in step S4-2 that a door movement is being or has been started (“N”), in step S4-3 verification is carried out to determine whether the time value t is greater than a predetermined—comparatively high—value, for example whether t≥15 min applies. If this is not the case (“N”), the method branches back to step S4-2, otherwise (“Y”) returns to step S4-1, wherein the time value t is then reset to zero, the pivot angle α is set to 0° and the serializer SER is deactivated.

[0215] If on the other hand the gyro sensor 8 establishes in step S4-2 that a door movement is being or has been started (“Y”), in a step S4-4 analogous to step S2-7 the associated serializer SER is firstly ramped up into its operating state, for example activated, by the gyro sensor 8.

[0216] Subsequently, in step S4-5 the gyro sensor 8 verifies whether information indicating whether the door 2B is open is received from the system master module SMM, for example via the I2C bus.

[0217] If this is the case (“Y”), in a step S4-6 the gyro sensor 8 verifies or monitors whether the pivot angle α is greater than the first trigger angle xα1 plus a predetermined angle value, for example whether α>xα1+y° applies, for example whether α>xα1+3° applies. This is used to verify whether or not the door 2B has been opened perceptibly beyond the first trigger angle xα1. If this is not the case, the verification is continued in step S4-6. The verification can then be repeated for example at intervals of milliseconds.

[0218] If on the other hand the verification in step S4-6 has determined that the verified condition has occurred (“Y”), the method branches to step S4-7 in which the gyro sensor 8 verifies whether the pivot angle α corresponds to the first trigger angle xα1. This corresponds to the situation that the door 2B is being closed again and in the process has reached the first trigger angle xα1. If this is not the case, the verification is continued in step S4-7. The verification can then be repeated for example at intervals of milliseconds.

[0219] The steps S4-6 and S4-7 correspond to step S2-8.

[0220] If on the other hand the verification in step S4-7 has determined that the condition α=xα1 has occurred (“Y”), the method branches to a step S4-8 analogous to step S2-9. In step S4-8 the gyro sensor 8 outputs the first trigger signal/self-trigger via the terminal GPIO_0, inter alia in order to record an image by means of the camera module CAM of the image recording module CCM-2.

[0221] Where there are several different first trigger angles xα1, the steps S4-6 to S4-8 are carried out for each of these trigger angles xα1.

[0222] Subsequently, in step S4-5 the gyro sensor 8 verifies whether information indicating whether the door 2B is open is received from the system master module SMM, for example via the I2C bus.

[0223] If this is the case (“Y”), in step S4-6 the gyro sensor 8 verifies or monitors whether the pivot angle α is greater than the first trigger angle xα1 plus a predetermined angle value, for example whether α>xα1+y° applies, for example whether α>xα1+3° applies. This is used to verify whether or not the door 2B has been opened perceptibly beyond the first trigger angle xα1. If this is not the case, the verification is continued in step S4-6. The verification can then be repeated for example at intervals of milliseconds.

[0224] If on the other hand the verification in step S4-6 has determined that the verified condition has occurred (“Y”), the method branches to step S4-7 in which the gyro sensor 8 verifies whether the pivot angle α corresponds to the first trigger angle xα1. This corresponds to the situation that the door 2B is being closed again and in the process has reached the first trigger angle xα1. If this is not the case, the verification is continued in step S4-7. The verification can then be repeated for example at intervals of milliseconds.

[0225] If on the other hand the verification in step S4-7 has determined that the condition α=xα1 has occurred (“Y”), the method branches to step S4-8. In step S4-8 the gyro sensor 8 outputs the first trigger signal/self-trigger via the terminal GPIO_0, inter alia in order to record an image by means of the camera module CAM of the image recording module CCM-2.

[0226] Where there are several different first trigger angles xα1, the steps S4-6 to S4-8 are carried out for each of these trigger angles xα1.

[0227] The steps S4-9 to S4-11 are carried out in parallel with and analogously to the steps S4-6 to S4-8.

[0228] In step S4-9 the gyro sensor 8 therefore verifies or monitors whether the pivot angle α is greater than the second trigger angle xα2 plus a predetermined angle value, for example whether α>xα2+y° applies, for example whether α>xα2+3° applies. The predetermined angle value y can in principle differ for the two trigger values xα1, xα2. Step S4-9 is used to verify whether or not the door 2B has been opened perceptibly beyond the second trigger angle xα2. If this is not the case, the verification is continued in step S4-9. The verification can then be repeated for example at intervals of milliseconds.

[0229] If on the other hand the verification in step S4-9 has determined that the verified condition has occurred (“Y”), the method branches to step S4-10, in which the gyro sensor 8 verifies whether the pivot angle α corresponds to the second trigger angle xα2. This corresponds to the situation that the door 2B is being closed again and in the process has reached the second trigger angle xα2. If this is not the case, the verification is continued or repeated in step S4-10. The verification can then be repeated for example at intervals of milliseconds.

[0230] The steps S4-9 and S4-10 are analogous to step S2-10.

[0231] If on the other hand the verification in step S4-10 has determined that the condition α=xα2 has occurred (“Y”), the method branches to the step S4-11, which is analogous to step S2-11. In step S4-11, the gyro sensor 8 transmits the second trigger signal/CCM-0 trigger via the terminal GPIO_1 to the system master module SMM, which in turn triggers an image recording by the image recording module CCM-0.

[0232] Where there are several different second trigger angles xα2, the steps S4-9 to S4-11 are carried out for each of these trigger angles xα2.

[0233] Starting from the steps S4-8 and S4-11, the method can for example branch back to step S4-5.

[0234] If on the other hand it is established in step S4-5 that the system master module SMM has received information for example via the I2C bus indicating that the door 2B is closed (“N”), in a step S4-12 verification is carried out by means of the gyro sensor 8 to determine whether the angular velocity Ω.sub.z of the door 2B is at most as great as or less than a predetermined—comparatively low—first threshold value Ω.sub.z,thr1, for example whether Ω.sub.z<0.3°/s applies. This is used to verify whether the closed door 2B is or is not yet at rest. If this is not yet the case, the verification is continued or repeated in step S4-12. The verification can then be repeated for example at intervals of milliseconds. If on the other hand this is the case (“Y”), the method returns to step S4-1.

[0235] In a variant of the sequence shown in FIG. 9, the steps S4-6 and S4-9 are automatically carried out after step 4-4 when the system master module SMM transmits the information indicating that the door 2B is open. Step S4-12 is automatically carried out when the system master module SMM transmits the information indicating that the door 2B is closed. An explicit query in step S4-5 is not required to this end.

[0236] FIG. 10 shows an oblique view of a door image recording module CCM-1, CCM-2 according to a possible design configuration. FIG. 11 shows a sectional representation, viewed from the side, of the door image recording module CCM-1, CCM-2.

[0237] The door image recording module CCM-1, CCM-2 has a middle part 9 with a tubular housing 10. A reinforcement part 11 having a laterally tapering, plate-shaped base 26 is inserted into the rear end opening of the housing 10. The reinforcement part 11 is pushed through a simple opening 27 in a door inner wall 18 into the cooling chamber 3 until the base 26 is fully supported on a side of the door inner wall 18 (which can also be referred to as the “door inner liner,” see FIG. 12) facing away from the cooling chamber 3. In the installed state of the door image recording module CCM-1, CCM-2, the door inner wall 18 is clamped between the base 26 and the rear edge of the tubular housing 10 and, on account of the surface contact between the base and the door inner wall 18, is aligned precisely with the door inner wall 18. Here, the middle part 9 protrudes for example on the inner or cooling chamber side vertically in front of the door inner wall 18. The arrangement shown is advantageously particularly easy to implement and install, and can also be used on a cross-platform basis. Specifically, the reinforcement part 11 can also be used in a standardized manner across different platforms.

[0238] A cap 12 with an end face 13 is placed on the front end of the housing 10, wherein the end face 13 is angled obliquely to the longitudinal orientation of the tubular housing 10 and has a window 14 for the camera sensor 6 and a window 15 for the flash 7. The window 14 can be embodied as an optical element, for example as a lens. The window 14 can be heatable in order to prevent misting. The camera module CAM is accommodated in the cap 12 and connected to the connection module COB via an FPC connector FPC laid through the tubular housing 10. The signal transmission terminal DOUT is present at the rear opening of the housing 10.

[0239] A further advantage of the door image recording module CCM-1, CCM-2 consists in that it can be installed without screws.

[0240] FIG. 12 shows a sectional representation of the refrigerator 1 with the two doors 2A and 2B partially open, viewed from the back from the cooling chamber 3 through the front loading opening 16. Door compartments 17 are arranged in each case on the inner side of the doors 2A, 2B. An ice dispenser 19 is also located in the left door 2A in front of the door inner wall 18.

[0241] The door image recording modules CCM-1, CCM-2 project from an edge region adjacent to the hinges (not shown) out of the door inner wall 18 of the respective door 2A or 2B, namely at different heights, in each case just below a base of a door compartment 17 arranged thereabove. Because the end face 13 is positioned obliquely in the direction of the cooling chamber 3, a larger region of the cooling chamber 3 lies in the field of view of the camera sensors 6 than without the oblique position.

[0242] FIG. 13 shows a sectional representation, viewed from the side, of the refrigerator 1, which is embodied here as a combination appliance with a freezer compartment 20 arranged therebelow. With the right door 2B opened at the first trigger angle/self-trigger xα1, the field of view SFB of the associated door image recording module CCM-2 is such that at least those spatial regions which are located behind the (closed) door 2B are located 4 within the field of view SF above the shelves 4. Analogously, with the left door 2A opened at the first trigger angle/self-trigger xα1, the field of view SF of the associated door image recording module CCM-1 is such that at least those spatial regions which are located behind the (closed) door 2A are located within the field of view SFA above the shelves 4.

[0243] FIG. 14 shows a sectional representation, viewed from above, of the refrigerator 1 with the fields of view SFA and SFB of the door image recording modules CCM-1 or CCM-2 of the doors 2A or 2B. The fields of view SFA and SFB overlap one another.

[0244] Naturally, the present invention is not restricted to the exemplary embodiment shown.

[0245] In general, “a,” “an,” etc. can be understood as singular or plural, in particular in the sense of “at least one” or “one or several,” etc., provided this is not explicitly excluded, for example by the expression “exactly one,” etc.

[0246] A numerical value can also include the given value as well as a typical tolerance range, provided this is not explicitly excluded.

[0247] The following is a summary list of reference numerals and the corresponding structure used in the above description of the invention: [0248] 1 Double-door refrigerator [0249] 2A Left door [0250] 2B Right door [0251] 3 Cooling chamber [0252] 4 Shelf [0253] 5A Left drawer [0254] 5B Right drawer [0255] 6 Camera sensor [0256] 6A Sensor element of the camera sensor [0257] 7 Flash [0258] 8 Gyro sensor [0259] 9 Middle part [0260] 10 Tubular housing [0261] 11 Reinforcement part [0262] 12 Cap [0263] 13 End face [0264] 14 Window for the camera sensor [0265] 15 Window for the flash [0266] 16 Loading opening [0267] 17 Door compartment [0268] 18 Door inner wall [0269] 19 Ice dispenser [0270] 20 Freezer compartment [0271] 21 Ceiling of the cooling chamber [0272] 22 Top [0273] 23 Insert [0274] 24 Insert [0275] 25 Body [0276] 26 Base [0277] 27 Opening [0278] CAM Camera module [0279] CCM-0 First image recording module [0280] CCM-1 Second image recording module [0281] CCM-2 Third image recording module [0282] CCM-3 Fourth image recording module [0283] CCM-n (n+1)th image recording module [0284] CMM Central module [0285] COAX Coaxial cable [0286] COB Connection module [0287] DESER Deserializer [0288] DesVDD Supply voltage of the deserializer [0289] DOUT Signal transmission terminal [0290] FLASH Terminal for flash [0291] FPC FPC connector [0292] FPD FPD terminal [0293] FPD_x Interface for FPD Link III connection to image recording module CCM_x [0294] GPIO Generally usable terminal (“General Purpose I/O”) [0295] I2C I2C terminal [0296] MIPI-CSI MIPI-CSI terminal [0297] mR-1 Proximity sensor assigned to the left drawer [0298] mR-2 Proximity sensor assigned to the right drawer [0299] RIN_x (x+1)th terminal of the deserializer to FPD_x [0300] SER Serializer [0301] SerVDD Supply voltage of the serializer [0302] PoC Power supply/“Power over Coaxial” [0303] SFA Field of view of door image recording module CCM-1 of left door [0304] SFB Field of view of door image recording module CCM-2 of right door [0305] SMM System master module [0306] S1-1-S4-12 Method steps [0307] TOS Door opening sensor [0308] TRIGGER Trigger input [0309] z Axis of rotation [0310] α Pivot angle [0311] Ω.sub.z Angular velocity