A MONITORING DEVICE FOR DETECTING PRESENCE IN A SPACE AND A METHOD THEREOF

Abstract

A method (300) of detecting presence in a space is disclosed. The method comprises entering (302) a monitoring state, receiving (304) one or more first signals from one or more radio frequency sensors, analyzing (306) the one or more first signals to determine that a being is present in the space, controlling (308), when the presence of the being has been determined, a device configured to provide a stimulus perceivable by the being in the space to provide the stimulus, receiving (310) one or more second signals from the one or more radio frequency sensors when the stimulus has been provided, analyzing (312) the one or more second signals, detecting (314) a physical response to the stimulus of the being based on the analyzed one or more second signals, generating (316) a notification command and/or a control command based on the physical response, and communicating (318) a signal indicative of the notification command and/or the control command to a controllable device or an application.

Claims

1. A method of detecting presence in a space, the method comprising: entering a monitoring state, receiving one or more first signals from one or more radio frequency sensors, analyzing the one or more first signals to determine that a being is present in the space, controlling, when the presence of the being has been determined, a device configured to provide a stimulus perceivable by the being in the space to provide the stimulus, receiving one or more second signals from the one or more radio frequency sensors when the stimulus has been provided, analyzing the one or more second signals, detecting a physical response to the stimulus of the being based on the analyzed one or more second signals, generating a notification command and/or a control command based on the physical response, and communicating a signal indicative of the notification command and/or the control command to a controllable device or an application.

2. The method of claim 1, further comprising: determining if the detected physical response corresponds to an authorized or an unauthorized physical response, and when the detected physical response corresponds to an unauthorized physical response, the signal is communicated to the controllable device or the application.

3. The method of claim 2, wherein, if the detected physical response corresponds to an authorized physical response, a second signal is communicated to the controllable device or the application.

4. The method of claim 2, wherein, if the detected physical response corresponds to an authorized physical response, a second signal is communicated to a second controllable device or a second application.

5. The method of claim 1, further comprising the steps of: activating a learning state, learning, over time, physical responses to provided stimuli of one or more authorized beings, and storing the physical responses of the authorized being in a database.

6. The method of claim 1, wherein the physical response is a movement of the being, and wherein the signal is communicated if the movement corresponds to a predefined movement.

7. The method of claim 1, wherein the physical response is a change in breathing or a change in heart rate of the being, and wherein the signal is communicated if the change in breathing or a change in heart rate corresponds to a predefined change.

8. The method of claim 1, the stimulus is provided by providing a sound in the space, by changing the light output of a lighting unit in the space, by generating an air movement in space, by movement of a robot or by opening or closing of an automatic door or window.

9. The method of claim 1, further comprising the step of: identifying the being based on the physical response, and generating the notification and/or the control command based on the identified being.

10. The method of claim 1, wherein the controllable device is located in the space.

11. The method of claim 1, wherein the controllable device is located remotely from the space, or wherein the application is running on a remote device located remotely from the space.

12. The method of claim 1, wherein the one or more first signals are received from one or more first radio frequency sensors located at a first position with respect to the being, and wherein the one or more second signals are received from one or more second radio frequency sensors located at a second position with respect to the being.

13. The method of claim 1, wherein the one or more first signals are communicated via a first communication technology, and wherein the one or more second signals are communicated via a second communication technology.

14. A non-transitory computer program product for a computing device, the computer program product comprising computer program code to perform the method of claim 1, when the computer program product is run on a processing unit of the computing device.

15. A monitoring device for detecting presence in a space, the monitoring device comprising: a communication unit configured to receive one or more first signals from one or more radio frequency sensors, a processor configured to: enter a monitoring state, analyze the one or more first signals to determine that a being is present in the space, control, when the presence of the being has been determined, a device configured to provide a stimulus perceivable by the being in the space to provide the stimulus, receive, via the communication unit, one or more second signals from the one or more radio frequency sensors when the stimulus has been provided, analyze the one or more second signals, identify a physical response to the stimulus of the being based on the analyzed one or more second signals, generate a notification command and/or a control command based on the physical response, and communicate a signal indicative of the notification command and/or the control command to a controllable device or an application.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The above, as well as additional objects, features and advantages of the disclosed systems, devices and methods will be better understood through the following illustrative and non-limiting detailed description of embodiments of devices and methods, with reference to the appended drawings, in which:

[0039] FIG. 1 shows schematically an embodiment of a system comprising a monitoring device for detecting presence in a space;

[0040] FIGS. 2a, 2b and 2c show schematically systems for detecting presence of a person in a space;

[0041] FIG. 3 shows schematically a method of detecting presence in a space; and

[0042] FIG. 4 shows schematically a method of detecting and differentiating between beings present in a space.

[0043] All the figures are schematic, not necessarily to scale, and generally only show parts which are necessary in order to elucidate the invention, wherein other parts may be omitted or merely suggested.

DETAILED DESCRIPTION OF EMBODIMENTS

[0044] Home and building control systems enable users to control devices in an environment, such as the user's home. Such smart control systems may comprise multiple control devices (such as light switches, sensors, smart hubs, smartphones, etc.) and controllable devices (such as lighting units, audio devices, cameras, etc.) that are connected via a network. FIG. 1 illustrates an example of such a system 100. The system 100 comprises a monitoring device 102 for monitoring presence of beings in a space (e.g. an indoor space such as a room, an outdoor space such as a garden, an alleyway, a front door space, etc.), one or more radio frequency sensors 110 located in the space, a device for providing a stimulus 120 in the space and one or more controllable devices 130 or software applications 140.

[0045] The monitoring device 102 is configured to detect presence of beings (persons or animals). The monitoring device 102 may for example be located at or nearby the space. The monitoring device may, for example, be comprised in a central (home) control system, a personal device such as a smartphone, a smart speaker, a hub, a bridge, etc. Alternatively, the monitoring device 102 may be located remotely from the space, and be for example be comprised in a remote (cloud) server or in a monitoring system located remotely from the space.

[0046] The monitoring device 102 comprises a communication unit 104 configured to receive one or more first signals from the one or more radio frequency sensors 110. The communication unit 104 may further comprise a transmitter for communicating signals (indicative of notification commands and/or the control commands) to the device 120 for providing the stimulus or the controllable device 130 or application 140. Various wired and wireless communication protocols may be used, for example Ethernet, DMX, DALI, USB, Bluetooth, Wi-Fi, Li-Fi, 3G, 4G, 5G or Zigbee. A specific communication technology may be selected based on the communication capabilities of the monitoring device 102 and/or the controllable device or application, the power consumption of the communication driver for the (wireless) communication technology and/or the desired communication range of the signals. The monitoring device 102 may be comprised in a remote server, the monitoring device 102 may be configured to control the controllable device 130 via an intermediary device such as a bridge, a hub, a central (lighting) control system, a smartphone, etc. This may depend on the system architecture of the system 100.

[0047] The monitoring device 102 further comprises a processor 106 (e.g. a microchip, circuitry, a microprocess, etc.) configured to analyze the one or more first signals from the one or more radio frequency sensors 110 to determine that a being 150 (e.g. a person or an animal) is present in the space based on changes in the one or more first signals. Detecting presence based on changes in the RF signals (e.g. changes in received signal strength indicators (RSSI) of RF signals, changes in signal-to-noise ratio (SNR) of RF signals, changes in time-of-flight (ToF) of RF signals, etc.) are known in the art and will not be discussed in detail.

[0048] The processor 106 is further configured to control, when the presence of the being 150 has been determined, the device 120 to provide the stimulus in the space. Examples of stimuli include but are not limited to auditory stimuli (sounds), tactile stimuli (e.g. vibrations, air movement, etc.), visual stimuli (e.g. changing the light output of a lighting unit, switching on a display device, etc.), olfactory stimuli (e.g. a smell), etc. The device 120 may, for example, be a lighting unit configured to receive lighting control instructions form the processor 106, and change its light output accordingly to provide the stimulus. The lighting control instructions may, for example, be indicative of a light setting such as a bright light, a flashing light for a stroboscopic effect, etc. The device 120 may, for example, be an audio rendering device (e.g. a home audio system, an alarm system, etc.) configured to receive audio control instructions from the processor 106, and generate audio accordingly. The audio control instructions may, for example, comprise instructions to render an alarm sound or a prerecorded message letting an intruder know that the neighbors have been notified of the alarm. The device 120 may, for example, be a video rendering device (e.g. a display) configured to receive control instructions from the processor 106, and render video images accordingly. The control instructions may, for example, comprise instructions to display a camera feed on the display (for example to indicate to an intruder that he is captured by a camera). It should be understood that these examples of devices 120 and stimuli are mere examples, and that the skilled person is able to design alternatives without departing from the scope of the appended claims.

[0049] The processor 106 is further configured to receive one or more second signals from the one or more radio frequency sensors 110 after the stimulus has been provided. The processor 106 may then analyze the one or more second signals to detect (and optionally classify) a physical response to the stimulus of the being 150. The processor 106 may analyze the one or more second signals to detect, for example, a movement or quiver of the being 150 in response to the stimulus. The one or more second signals may analyzed over time, and the processor 106 may detect a change in the signals indicative of an increased amount of movement (e.g. a high SNR of RF signals communicated between two RF nodes, a change in ToF of RF signals communicated between two RF nodes, a Doppler shift of a reflected signal emitted by an RF transceiver, changes in CSI wireless multipath etc.). No change in the one or more second signals may also be an indication of a physical response. This may occur when the being is used to the stimulus and therefore does not respond physically to the stimulus. Additionally or alternatively, the processor 106 may analyze the one or more second signals to detect a change in breathing or a change in heart rate of the being of the being 150 in response to the stimulus. RF signals from 60 GHz WiFi nodes may, for example, be used for detecting the breathing rate or the heart rate of the being. Techniques for detecting movement of the entire body or body parts and physiological parameters such as breathing rates and heart rates are known in the art, and are for example disclosed in US 2017/0074980 A1.

[0050] The processor 106 is further configured to generating a notification command and/or a control command based on the physical response, and to communicate a signal indicative of the notification command and/or the control command to a controllable device or an application. The processor 106 may, for example, be configured to classify the physical response. The classification may, for example, be based on the amount of change in the one or more second signals, or based on the type of change in the one or more second signals. The processor 106 may, for example, classify the response as a startle response if the amount of change in the one or more second signals exceeds a threshold value, and classify the response as a calm response if the amount of change in the one or more second signals does not exceed the threshold value. The processor 106 may further generate the notification command and/or the control command based on the classified physical response, and communicate the signal indicative of the notification command and/or the control command to the controllable device 130 or application 140.

[0051] The monitoring device 102 may be configured to distinguish between authorized and unauthorized beings. The processor 106 may be configured to determine if the detected physical response corresponds to an authorized or an unauthorized physical response, and when the detected physical response corresponds to an unauthorized physical response, the signal may be communicated to the controllable device or the application. The processor 106 may, for example, be configured to compare the detected physical response to a set of predefined physical responses stored in a database. The database may be stored in a memory, which may be comprised in the monitoring device or be located on a remote server accessible via a network such as the internet. A first subset of the set of predefined physical responses may represent authorized physical responses (e.g. known physical responses of authorized users of the system 100) and a second subset of the set of predefined physical responses may represent unauthorized physical responses (e.g. other physical responses of unauthorized people, such as intruders). The second subset of the set of predefined physical responses may comprise responses indicative of a level of movement (or change in physiological parameter) that exceeds a threshold value. Additionally or alternatively, the processor 106 may be configured to compare the detected physical response to a set of predefined physical responses stored in a database, and if the physical response does not correspond to a response stored in the database the processor 106 may determine that the physical response corresponds to an unauthorized physical response. Additionally or alternatively, the processor 106 may analyze characteristics of the one or more second signals (RSSI, SNR, ToF) to determine if the characteristics exceed a threshold. If the threshold is exceeded, the processor 106 may determine that the detected physical response corresponds to an unauthorized physical response.

[0052] If the detected physical response corresponds to an unauthorized physical response (e.g. heart rate change associated to the stimulus indicating a younger person than the owner), the processor 106 may communicate the (alarm) signal to the controllable device or the application (e.g. an alarm system and/or a security or monitoring application running on a personal device of an authorized user). In another example, the processor 106 may control a controllable device located in the space based on the identification of the unauthorized being, for instance a local alarm system, an intruder deterrent system (e.g. switching on a lighting unit and/or a display showing a video feed of the intruder), etc. If the detected physical response corresponds to an authorized physical response, a different signal may be communicated to the controllable device or the application, or to another controllable device or application. The authorized being may, for example, be a resident, a cleaning person, a nanny, etc. who frequently visits the space, and their physical response(s) to one or more stimuli may be stored in the database. If the authorized being (e.g. the cleaning person) has been detected, the processor 106 may for example communicate a signal indicative thereof to a personal device of the owner of the monitoring system 100 to inform the owner of the authorized person's presence. In another example, the processor 106 may control a controllable device located in the space based on the identification of the authorized being, for instance an HVAC system, a lighting unit, an audio system, etc.

[0053] The processor 106 may be further configured to activate a learning state to learn physical responses of authorized beings. In the learning state, the processor 106 may provide the stimulus via the device 120 when a being is present, and store the physical response of the authorized being in the database. The processor 106 may repeat this process to learn, over time, physical responses to provided stimuli of one or more authorized beings, and store these physical responses of the authorized being in a database.

[0054] The processor 106 may be further configured to distinguish classes of beings based on their physical responses (when the monitoring state and/or to the learning state is active). The processor 106 may, for example, distinguish between different types of people (e.g. children, grown-ups, different body-masses, etc.) and/or distinguish between people and animals (e.g. pets). Additionally or alternatively, the processor 106 may be further configured to identify the being based on the physical response. Different beings may have different physical responses to the provided stimulus. The responses of these beings may be learned when the processor 106 has been set to the learning state. This enables the processor 106 to, when set to the monitoring state, identify beings. While in the learning state, the processor 106 may detect the physical responses of the beings, and receive an input indicative of the identity or the class of being. The input may be received from a user via a user interface. Additionally or alternatively, the input may be received from a further device, e.g. a camera system configured to identify classes of beings present in the space.

[0055] The processor 106 may be further configured to generate the notification and/or the control command based on the identified being or based on the class of the detected being. In a first example, the processor 106 may generate, when a first class of being has been detected (e.g. a child), a first notification (e.g. a notification to inform a parent that the child is home) and transmit the signal indicative of the first notification (e.g. to a software application 140 running on a personal device of the parent). When a second class of being has been detected (e.g. an adult), the processor 106 may generate a second notification (e.g. to send a welcome home message to the adult) and transmit the signal indicative of the second notification (e.g. to a software application 140 running on a personal device of the adult). In another example, the processor 106 may generate and transmit a first control command for a first device (e.g. an instruction to display the news on a tv) when a first user has been identified, and generate and transmit a second control command for a second device (e.g. an instruction to play certain music on an audio system) when a second user has been identified. The processor 106 may be configured to access a database to determine which notification command or control command to generate. The database may store associations between beings (that are to be identified) and notification commands or control commands, and/or associations classes of beings and notification commands or control commands, enabling the processor 106 to select/generate a notification command or control command for the identified being or class.

[0056] The system 100 may comprise one or more radio frequency sensors 110. The system 100 may, for example, comprise a single RF sensor configured to transmit an RF signal and receive its reflection. The single sensor may communicate the reflected first signals to the monitoring device 102, which may be analyzed to determine that a being is present in the space. Based on changes in reflection (e.g. due to Doppler shift or changes in time of flight), presence of a being can be detected. This has been illustrated in FIG. 2a. The sensor 210 may be configured to transmit a first RF signal and receive a reflection thereof to detect that a being 150 is present. If so, the stimulus is provided by the device 120 (not shown) and the processor 106 may detect changes in reflected second signal transmitted by the sensor 210, indicative of the physical response.

[0057] FIG. 2b illustrates a system 100 comprising two RF nodes 220, 222. These nodes may each comprise an RF transceiver for transmitting and receiving RF signals. The two RF nodes 220, 222 may be configured to detect RF signals transmitted through the body. When a being 150 is present between the nodes 220, 222, the RSSI, CSI or the SNR of the communicated first signals changes, which indicates the presence of the being. The stimulus may then be provided by the device 120, and the processor 106 may detect changes in one or more second signals communicated between the nodes 220, 222 indicative of the physical response.

[0058] FIG. 2c illustrates a system 100 comprising three RF nodes 230, 232, 234. The one or more first signals may be received from one or more first radio frequency sensors (node 230) located at a first position with respect to the being 150, and the one or more second signals may be received from one or more second radio frequency sensors (nodes 232, 234) located at a second position with respect to the being 150. The first position may, for example, be a position higher (e.g. on ceiling level) than the second position (e.g. at head or torso level of a person). The one or more first RF sensors 230 may be configured to provide the first signals to the processor 106 indicative of ‘general’ presence with less details, whereas the one or more second RF sensors may be configured to provide the second signals indicative of detailed physical changes such as (minor) movements, changes breathing or changes in heart rate.

[0059] The one or more first signals may be communicated via a first communication technology, and the one or more second signals may be communicated via a second communication technology. The first communication technology may for example be a communication technology that has a lower power consumption, and the second communication technology may be a communication technology that has a higher power consumption. Additionally or alternatively, the first communication technology may for example be a communication technology that has a lower bandwidth, and the second communication technology may be a communication technology that has a higher power bandwidth. The first (wireless) communication technology may be a multi-hop communication technology (such as Zigbee, Thread, WirelessHART, SmartRF, Bluetooth Mesh, WiFi Mesh, or any other mesh or tree-based technology), and the second (wireless) communication technology may be a point-to-point communication technology (such as Bluetooth, Bluetooth Low Energy (BLE), Infrared (IR), near field communication (NFC), wireless local area communication (Wi-Fi), etc.). Typically, RF signals of point-to-point communication technologies are stronger compared to RF signals of multi-hop communication technologies. Hence, low-signal strength (first) signals of a multi-hop communication technology (e.g. Zigbee) may be analyzed to detect presence, and higher-signal strength (second) signals of a point-to-point communication technology (e.g. Bluetooth, Wi-Fi) may be analyzed to detect the physical response.

[0060] When the first one or more RF signals and the second one or more RF signals are received from the same (set of) RF sensors (which may be comprised in lighting units), these sensors may comprise one or more communication modules for communicating via different communication technologies. These communication modules may be separate units (e.g. separate radio chips) comprised in the sensors, or both be comprised on a single radio chip, allowing a low-cost device to operate as part of both a first network and a second network at the same time, leveraging a single wireless radio module. This may be achieved by fast switching the first and second communication technology (e.g. Zigbee and Bluetooth) operations over time such that the sensor (or device comprising the sensor, such as a lighting unit) remains connected and operates in both networks simultaneously. The possibility of having a constrained device operating simultaneously on two networks opens up new solutions to improve the limitations of these existing technologies.

[0061] The one or more radio frequency sensors may be comprised in respective lighting units. Current smart homes typically contain a plurality of connected lighting devices that communicate via a (mesh) network. The RF signals communicated between these lighting units may be analyzed for determining presence and for determining the physical response of the being 150. The RF signals communicated between the lighting devices may comprise lighting control instructions and/or configuration instructions, and these RF signals may additionally be analyzed for determining presence and for determining the physical response of the being 150. Hence, there is no need for dedicated (RF) sensors for detecting presence. The one or more lighting units may be any type of lighting units. The lighting units may comprise one or more light sources (e.g. LED/OLED light sources). The lighting units may be arranged for providing general lighting, task lighting, ambient lighting, atmosphere lighting, accent lighting, indoor lighting, outdoor lighting, etc.

[0062] FIG. 3 shows schematically a method 300 of detecting presence in a space, the method 300 comprising: entering 302 a monitoring state, receiving 304 one or more first signals from one or more radio frequency sensors, analyzing 306 the one or more first signals to determine that a being is present in the space, controlling 308, when the presence of the being has been determined, a device configured to provide a stimulus perceivable by a being in the space to provide the stimulus, receiving 310 one or more second signals from the one or more radio frequency sensors when the stimulus has been provided, analyzing 312 the one or more second signals, detecting 314 a physical response to the stimulus of the being based on the analyzed one or more second signals, generating 316 a notification command and/or a control command based on the physical response, and communicating 318 a signal indicative of the notification command and/or the control command to a controllable device or an application.

[0063] FIG. 4 shows schematically a method 400 of detecting and differentiating between beings present in a space. The method 400 comprises the steps of the method 300 of FIG. 3, and further comprising the steps of: comparing 315 the detected physical response to a set of predefined physical responses stored in a database, wherein a first subset of the set of predefined physical responses represent authorized physical responses, and wherein a second subset of the set of predefined physical responses represent unauthorized physical responses. The method 400 comprises generating 316a, when the detected physical response corresponds to an unauthorized physical response of the second subset, a first notification command and/or a first control command based on the physical response, and communicating 318a a first signal indicative of the first notification command and/or the first control command to a controllable device or an application. The method 400 comprises generating 316b, when the detected physical response corresponds to an authorized physical response of the second subset, a second notification command and/or a second control command based on the physical response, and communicating 318a a second signal indicative of the second notification command and/or the second control command to a controllable device or an application (the controllable device/application may be the same or a different controllable device/application).

[0064] The methods 300, 400 may be executed by computer program code of a computer program product when the computer program product is run on a processing unit of a computing device, such as the processor 106 of the monitoring device 102.

[0065] It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims.

[0066] In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb “comprise” and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. The article “a” or “an” preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer or processing unit. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

[0067] Aspects of the invention may be implemented in a computer program product, which may be a collection of computer program instructions stored on a computer readable storage device which may be executed by a computer. The instructions of the present invention may be in any interpretable or executable code mechanism, including but not limited to scripts, interpretable programs, dynamic link libraries (DLLs) or Java classes. The instructions can be provided as complete executable programs, partial executable programs, as modifications to existing programs (e.g. updates) or extensions for existing programs (e.g. plugins). Moreover, parts of the processing of the present invention may be distributed over multiple computers or processors or even the ‘cloud’.

[0068] Storage media suitable for storing computer program instructions include all forms of nonvolatile memory, including but not limited to EPROM, EEPROM and flash memory devices, magnetic disks such as the internal and external hard disk drives, removable disks and CD-ROM disks. The computer program product may be distributed on such a storage medium, or may be offered for download through HTTP, FTP, email or through a server connected to a network such as the Internet.