Electronic switch for controlling a device in dependency on a sleep stage
09754471 ยท 2017-09-05
Assignee
Inventors
- IGOR BEREZHNYY (EINDHOVEN, NL)
- Pedro Miguel Fonseca (Antwerp, BE)
- Adrienne HEINRICH (DEN BOSCH, NL)
- Reinder HAAKMA (Eindhoven, NL)
Cpc classification
A61M21/00
HUMAN NECESSITIES
A61B5/7264
HUMAN NECESSITIES
A61B5/0816
HUMAN NECESSITIES
A61B5/4809
HUMAN NECESSITIES
International classification
A61M21/00
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
A61B5/08
HUMAN NECESSITIES
A61B5/11
HUMAN NECESSITIES
Abstract
An electronic switch for controlling a device 170 by switching a function of the device at least in dependence on a sleep stage of a human. The switch includes an EEG data interface configured to receive brain activity data from an EEG sensor 120 configured to monitor electrical activity of the brain of the human during a training phase, an EEG sleep classifier 125 configured to classify sleep stages of the human from the received brain activity data, and a body data interface configured to receive body activity data from an alternative sensor 130 configured to monitor a bodily function of the human both during the training phase and during a subsequent usage phase. The alternative sensor is different from the EEG sensor, and the electronic switch further includes an alternative sleep classifier 135 and a machine learning system 140, the machine learning system being configured to train the alternative sleep classifier 135 to classify a sleep stage of the human from the received body activity data, the learning system using sleep stages classified by the EEG sleep classifier 125 and concurrent body activity data received from the alternative sensor as training data, wherein in the usage phase, the device 170 is controlled in dependency on sleep stages of the human classified by the alternative sleep classifier 135. A control logic 150 is configured to at least determine that the classified sleep stage is one of a set of particular sleep stages and to switch a function of the device at least in dependency on said determination.
Claims
1. A burglar alarm comprising: an intrusion sensor for detecting an intrusion of a burglar; a device configured to raise an alarm in response to the intrusion sensor detecting an intrusion; and an electronic switch for controlling the device by switching a function of the device at least in dependency on a sleep stage of a human, wherein the electronic switch comprises: an electroencephalogram (EEG) sensor configured to monitor electrical activity of a brain of the human; an EEG data interface configured to receive brain activity data from the EEG sensor during a training phase; an EEG sleep classifier configured to classify sleep stages of the human from the received brain activity data; an alternative sensor configured to monitor a bodily function of the human, the alternative sensor being different from the EEG sensor; a body data interface configured to receive body activity data from the alternative sensor both during the training phase and during a subsequent usage phase; an alternative sleep classifier and a machine learning system, the machine learning system being configured to train the alternative sleep classifier to classify a sleep stage of the human from the received body activity data, the machine learning system using sleep stages classified by the EEG sleep classifier and concurrent body activity data received from the alternative sensor as training data, wherein, in the usage phase, the device is controlled in dependency on sleep stages of the human classified by the alternative sleep classifier; control logic configured to at least determine that the classified sleep stage is one of a set of particular sleep stages and to switch a function of the device at least in dependency on said determination; a statistical unit configured to determine a statistical measure of the received body activity data during the training phase and store it as a reference measure, and to determine the statistical measure of the received body activity data during the usage phase; and a drift detection unit configured to detect a drift of the statistical measure determined during the usage phase and the reference measure, and upon detecting the drift signaling a user for recalibration of the alternative sleep classifier, wherein the control logic is configured to switch-on the device configured to raise an alarm.
2. The burglar alarm as claimed in claim 1, wherein said electronic switch further comprises a clock configured to indicate a current time, the switch being configurable with a first switching time-period, the control logic being configured to switch the function when both: a current time indicated by the clock is in the first switching period, and the classified sleep stage is one of the set of particular sleep stages.
3. The burglar alarm as claimed in claim 2, wherein the control logic is configured to switch the function when a current time indicated by the clock is at the end of the first switching period regardless of the classified sleep stage.
4. The burglar alarm as claimed in claim 1, wherein the control logic is configured to defer switching until the classified sleep stage has remained in the set of particular sleep stages for a particular time period.
5. The burglar alarm as claimed in claim 1, wherein the EEG sensor is configured to monitor when placed in close proximity or direct contact to the head of the human, and the alternative sensor is configured to monitor without direct contact with the human.
6. The burglar alarm as claimed in claim 1, wherein the alternative sensor is configured to monitor at least one of respiration, heart and actigraph.
7. The burglar alarm as claimed in claim 1, wherein the alternative sensor comprises a pressure sensor for positioning in or under a mattress.
8. An alarm clock comprising: the burglar alarm as claimed in claim 1; and a device configured to wake the human using audio and/or visual stimuli, wherein the electronic switch is configurable with a first switching time period, and the control logic is configured to switch-on the device to generate audio and/or video stimuli thereby waking the human.
9. The alarm clock as in claim 8, wherein at least the device configured to wake the human is arranged for wearing in a human ear.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) These and other aspects of the invention are apparent from and will be elucidated with reference to the embodiments described hereinafter. In the drawings:
(2)
(3)
(4)
(5)
(6) It should be noted that items which have the same reference numbers in different Figures, have the same structural features and the same functions, or are the same signals. Where the function and/or structure of such an item has been explained, there is no necessity for repeated explanation thereof in the detailed description.
LIST OF REFERENCE NUMERALS
(7) 100 a sleep stage controlled system 110 an electronic switch 120 an EEG sensor configured to monitor electrical activity of the brain of the human 125 an EEG sleep classifier configured to classify sleep stages of the human from the received brain activity data 130 an alternative sensor configured to monitor a bodily function of the human 135 an alternative sleep classifier for classifying a sleep stage of the human from the monitored bodily function 140 a machine learning system configured to train the alternative sleep classifier to classify a sleep stage of the human from the received body activity data 150 control logic 160 a clock 170 a device controlled by switch 110 210 sleep classification data 220 wrist actigraphy 230 EEG data 240 a time period showing deep sleep 310 a bed 312 a floor 314 a mattress 320 an EEG sensor 322 an EEG sensor cable 330 a pressure mat 332 a pressure mat cable 350 a buzzer 340 a switch 342 a processor 344 a memory 346 a clock
DETAILED EMBODIMENTS
(8) While this invention is susceptible of embodiment in many different forms, there is shown in the drawings and will herein be described in detail one or more specific embodiments, with the understanding that the present disclosure is to be considered as exemplary of the principles of the invention and not intended to limit the invention to the specific embodiments shown and described.
(9)
(10) Sleep controlled system 100 further comprises an EEG sensor 120 configured to monitor electrical activity of the brain of the human and an alternative sensor 130 configured to monitor a bodily function of the human. The EEG sensor 120 and the alternative sensor 130 are two different sensors.
(11) The EEG sensor may be a sensor configured for placing at a scalp of a human and may comprise a number of electrodes. The alternative sensor 130 is preferably more comfortable, e.g., being a non-contact sensor, i.e., not in direct contact to the human, and/or a wireless sensor, i.e., not connected to switch 110 through a wire. A good choice for alternative sensor 130 is a pressure sensor placed in or under the mattress. Such a pressure sensor is a non-contact sensor. Such a pressure sensor may be connected to switch 110 through a wire if that is convenient, as it is unobtrusive to the human. Alternative sensor 130 may be an actiograph sensor, for sensing movement of the human. For example, an actiograph sensor may be worn around a wrist or ankle and the like; it is considered more comfortable than an EEG sensor. The alternative sensor 130 may also comprise more advanced system, e.g., a camera, possibly including an infrared filter. From the camera features such as movement, temperature, etc. may be derived.
(12) More in general, it may be desirable to derive features from the raw body data before processing it with a sleep classifier. For example, from a heart sensor, which records the heart activity, features such as heart rate and heart variability, may be derived. Heart rate and heart variability change differently in response to a change in sleep stage. Using heart rate and heart rate variability as two features instead of the raw data allows the machine learning system to learn faster, e.g., the alternative sleep classifier will converge faster towards the performance of the EEG sleep classifier.
(13) Alternative sensor 130 and EEG sensor 120 are shown as connected to switch 110. Switch 110 may be configured so that alternative sensor 130 and/or EEG sensor 120 are detachable. Especially, EEG sensor 120 is preferably detachable from switch 110 since EEG sensor 120 is not used in the usage phase (see below). Alternative sensor 130 and EEG sensor 120 are connected at an interface (not separately shown). In an embodiment, alternative sensor 130 is not an EEG sensor. In an embodiment alternative sensor 130 does not comprise electrodes configured to measure electric brain activity. The bodily function measured by alternative sensor 130 is correlated to sleep and/or sleep stages.
(14) Switch 110 comprises an EEG sleep classifier 125 configured to classify sleep stages of the human from the received brain activity data. EEG sleep classifier 125 is configured before switch 110 is first used. For example, EEG sleep classifier 125 is configured at manufacture, or a user installs a configuration file for EEG sleep classifier 125. The latter has the advantage that EEG sleep classifier 125 may be updated. A combination is possible.
(15) To make EEG sleep classifier 125, one may obtain EEG data from multiple sleeping humans, preferably from multiple backgrounds and across multiple nights and have sleep experts label the EEG data according to a sleep classification system; Next a machine learning system, similar to machine learning system 140 but for EEG data may be used to train EEG sleep classifier 125. Alternatively, EEG sleep classifier 125 may be a rule based expert system using hand-crafted features indicated by the sleep expert.
(16) Switch 110 comprises an alternative sleep classifier 135 for classifying a sleep stage of the human from the monitored bodily function. Alternative sleep classifier 135 may be pre-trained like EEG sleep classifier 125, however its performance is expected to be quite poor. Whereas interpersonal differences are small in so far as sleep classification from EEG data is concerned, the interpersonal differences are much larger when classifying sleep from non-EEG data.
(17) Switch 110 comprises a machine learning system 140 configured to train the alternative sleep classifier 135 to classify a sleep stage of the human from the received body activity data. Machine learning system 140 may be any of a variety of automated machine learning systems similar in construction to machine learning systems used to train a system to classify sleep from EEG data. Note, even though the machine learning system is in principle capable for unsupervised learning, the data may be preprocessed to advantage. For example, frequency analysis may be done, e.g., converting the data to a frequency domain, e.g., a power spectrum. For example, the data may be split using low-, mid- and high-pass filters. For example, the data may be averaged over sequential time intervals, say every 30 seconds, e.g., to reduce noise.
(18) Switch 110 further comprises control logic 150. The control logic receives a sleep classification from alternative sleep classifier 135. Control logic 150 decides if the switching is to be performed or not. Optionally, switch 110 comprises a clock 160, which provides a current time as input to switch 110.
(19) Switch 110 may be configured in many different ways. Switch 110 may be configurable or be configured in a more fixed manner. Switch 110 may simply turn a device off as soon as sleep is detected (any stages), for example, a radiator may be turned off regardless of time, regardless of sleep stage, as long as sleep is detected, or as soon as a specific sleep stage has been detected, e.g., deep or REM sleep. However, using clock 160, more precise configurations are possible.
(20) For example control logic 150, may control controlled device 170 in a sleep dependent manner in a defined time period, i.e., the first switching period; For example, only between 19:00 and 23:00, or 06:30 and 07:00 etc.
(21) In operation, e.g., out of the box, switch 110 is started in a training phase. The training phase is at least one night, or at the very least a complete sleep cycle in a night, but more preferably a few days, say a week, or 10 days. Generally, a longer training phase will lead to better training. During the training phase, the user sleeps with both EEG sensor 120 and alternative sensor 130. The EEG data received from EEG sensor 120 is labeled with the appropriate sleep classification. During the training phase, body data from alternative sensor 130 is obtained together with corresponding sleep classification. There may be multiple sets of body data from multiple sensors 130. Also multiple features may be extracted from a single sensor, e.g., RHA data may be extracted from a single pressure sensor.
(22) The training data is used by machine learning system 140 to train alternative sleep classifier 135. This may be done in batch, say at the end of the training phase, or during the accumulation of training data. The end of the training phase may be a fixed moment, say at the end of a week, but machine learning system 140 may also be configured to indicate the quality of training, and may indicate if the quality has reached a minimum quality level, possibly with a minimum duration of the training phase, say of 3 days. For example, when the sleep classification of alternative sleep classifier 135 on data from alternative sensor 130 matches the sleep classification of EEG sleep classifier 125 at least a minimum percentage, say 95%. Preferably, the statistical measure Cohen's Kappa is computed between sleep classification of EEG sleep classifier 125 and alternative sleep classifier 135 and quality is high if it is above a minimum, say above 0.85. At some point, whether at the indication of machine learning system 140 or after a fixed time period, etc., the training phase ends. At that point the usage phase start. The user will then sleep without EEG sensor 120 and only use alternative sensor 130. Alternative sensor 130 may be significantly more comfortable and/or unobtrusive. Alternative sensor 130 may be non-contact and/or wireless and/or not attached to the head but other body parts. Even though the alternative sensor 130 does not sense the EEG data, but other data which has much larger interpersonal variation, the alternative sleep classifier 135 has been trained for this particular individual which boosts performance considerably.
(23) Training in batch may be slightly more accurate; however, training during the training phase furthermore allows termination of the training phase when training is sufficient, this is a considerable advantage.
(24) In the usage phase, control logic 150 uses sleep classification to make decisions about switching functions of controlled device 170 on or off. For example, control logic 150 may be configured with
(25) a first switching period, e.g., comprising a start time and an end time;
(26) a set of particular sleep stages, e.g., {N1, N2, N3, N4} to indicate any sleep, e.g., {N3, N4} to indicate deep or REM sleep, e.g., {N1, N2} to indicate light sleep etc.;
(27) a function of controlled device 170; and
(28) an indication whether the function is to be turned on or off.
(29) If such a degree of configurability is not desired, some may be removed, say the set of sleep stages may be fixed to an indication of any sleep, etc. In the usage phase, EEG sensor 120 may be unplugged from switch 110 if this is supported by switch 110. In the training phase, control logic 150 may use classification of EEG sleep classifier 125 instead of alternative sleep classifier 135.
(30) Typically, the switch 110 and optionally device 170 each comprise a microprocessor (not shown) which executes appropriate software stored at switch 110 and optionally device 170, e.g., that the software may have been downloaded and stored in a corresponding memory, e.g., RAM or Flash (not shown), and/or placed in ROM code. Note that part or all of switch 110 may be implemented in hardware, e.g., using integrated circuits.
(31) Alternative sensor 130 may be a sensor to obtain a measure of gross body movements, although this is not a cardio/respiratory feature, it is a modality that may be recorded together with ECG. It is very useful to distinguish between sleep (any of the sleep stages) and wake but much less useful to distinguish between different sleep stages, for example, between N3 (deep sleep) and REM sleep. Alternative sensor 130 may measure variations in the (heart) beat-to-beat intervals (or heart rate variability). The latter are highly dependent on the activity of the sympathetic and parasympathetic nervous systems. For example, when sympathetic activity increases and/or parasympathetic activity decreases, these variations will be reduced. On the other hand, it is known that during REM sleep, there is an increase in the sympathetic activity to a level compared to (or sometimes higher than) wakefulness, and especially when compared with non-REM sleep. So certain properties of the heart rate variability, such as the high frequency power components (e.g., 0.15 to 0.40 Hz), are very discriminating between REM and non-REM sleep but much less discriminating between REM and wake states. Combining different sensors, e.g., a sensor for gross body movements and a sensor for heart rate variability, together increases the accuracy to detect sleep stages without EEG data.
(32) The inventors found that the discriminating power of certain features is subject dependent. This is a consequence of the differences in physiology (including the possible existence of a certain medical condition) and behavior. For example:
(33) Consider a person that while lying in bed, awake, does not move his/her body very much. In that case, gross body movements might be less discriminating than for a person who moves more when awake.
(34) Heart rate variability heavily depends on age. A younger person will have higher heart rate variability than an older person. So it is only natural that for the younger person, features based on heart rate variability will discriminate better between REM (or wake) and non-REM sleep states than for an older person.
(35) The machine learning system may compute the values of these features and/or other features for a given subject, on the one hand, and on the other hand, having access to (estimated) sleep stages for that person. Statistical methods (e.g., standardized mean difference, Mahalanobis distance, etc.) may be used to determine the degree to which a certain feature (or combination of features) discriminates well (or not) between these stages.
(36)
(37)
(38) The signals in
(39) From the image, we can see that the deep sleep region marked in
(40) Thus, an obtrusive contact-based brain activity measuring device (e.g., based on electrodes which could be easily placed on the user's face) based on which, after one or multiple nights recording an automatic classifier would perform sleep stage classification. Simultaneously, more convenient and unobtrusive contactless sensors would record RHA signals from that user during those same nights. These sleep stages would then be associated with characteristics of the RHA signals measured for that user and a new classifier could be built based on those characteristics. In subsequent nights, the user would no longer require the contact-based measurements of brain activity but only the monitoring of the RHA signals: the new classifier would use these signals only to automatically classify the sleep stages.
(41) In an embodiment, the control logic is not only configured to control the device, e.g., by sending technical control data to the device instructing the device to switch functionality, e.g., from one function to another, on or off, etc; but also to record information relating to the sleep, e.g., the sleep stages classified based on the alternative or EEG sleep classifier. In this way, said sleep information may be shown to the user in the morning or archive for further follow-up or diagnosis.
(42)
(43) Shown is a bed 310 with a mattress 314 standing on a floor 312. On the bed lies a human. Attached to the scalp of the human is an EEG sensor 320, in this cased attached with a head band, alternatives include a skull cap, glue, and the like. Note that this human is in the privacy of his own home, there is no need for him/her to go to a sleep lab. EEG sensor 320 is attached to a switch 340, in this case with an EEG sensor cable 322, the connection could also be wireless. Switch 340 is of the same basic design as switch 110. Also attached to switch 340 is a pressure mat 330 with a pressure mat cable 332, also this connection could be wireless. Pressure mat 330 is placed underneath mattress 314. It is also possible to integrate the pressure sensor in the mattress. This will increase the sensitivity of the pressure signal, which is especially advantageous to derive a cardiogram from the pressure data. Other pressure sensors than pressure mats may be used, e.g., pressure sensors incorporated in the mattress, e.g., optical sensors.
(44) This switch 340 has been implemented using a processor 342 and a memory 344. The memory is preferably non-volatile, and may be used to store software for execution on processor 342 to implement the functions of switch 340. Switch 340 controls a device, namely, a buzzer 350. Buzzer 350 is configured to wake the human, when this function is turned on by switch 340. Note that buzzer 350 and switch 340 may well be integrated in a single device. For the alarm clock embodiment, switch 340 comprises a clock 346. For some other applications than waking at a particular time, a clock is not needed.
(45) Switch 340 as shown is in the training phase. Switch 340 records pressure information from body sensor 330 and EEG data from EEG sensor 320. The EEG data is classified into sleep classification stages by EEG classification software placed in memory 344. When the training phase is finished, EEG sensor 320 is no longer used by the human, and may even be disconnected from switch 340. Machine learning software uses the data received from pressure mat 330 and the sleep classification to train an alternative sleep classifier to classify the body data according to the same sleep classification system used by the EEG sleep classifier.
(46) Control software of switch 340 may be programmed to wake the human in an appropriate manner, for example: between 6:00 and 6:30 turn on buzzer 350 if the body data is classified by the alternative sleep classifier as light sleep, say N1 or (N1 and N2), between 6:30 and 6:35 turn on the buzzer regardless of classification of the alternative sleep classifier. Switch 340 may conveniently be configured with a button to turn off the function, say turn off buzzer 350.
(47) In an especially convenient embodiment, buzzer 350 is configured for placement in the ear. For example, switch 340 may be configured with two or more switches, the two switches may share some components, e.g., the clock, the EEG sleep classifier itself, optionally only a single EEG sensor may be used. Sensor 320 would then be connectable to the two or more switches in turn. This means, e.g., that switch 340 could classify the sleep stage of each of the two people in a couple, for each one of them an ideal waking moment based on sleep classification may be detected. Because the buzzer is worn in the ear, only the correct person is woken. Preferably, the buzzer is then connected wirelessly to switch 340. An ear-worn buzzer may even be integrated with a switch and body sensor, in that case there is no need for a wireless connection, each person would have his own switch. For example such sensors for such bodily functions as heartbeat, body temperature, and actiography may be configured for placement in the ear as an ear piece.
(48) A sleep stage dependent alarm clock may combine a sensor for heart, movement, and/or respiratory measurement device. Out of the box the system is trained to classify sleep stages based on the measured brain wave data. During a training phase, the system is trained with the classified sleep stages to classify sleep stages using only the data obtained from the heart/movement/respiratory measurement device or devices. In a usage phase, the system does not use a head electrode, only the simpler system, i.e., the heart/movement/respiratory measurement device or devices. The alarm clock uses the classified sleep stage to wake you up in the right sleep stage moment so that you feel refreshed.
(49) Other applications of switch 110 than sleep stage dependent alarm clock 340 include sleep dependent switching off of equipment, such as home entertainment systems, and sleep dependent switching on of a house alarm system.
(50)
(51) The usage phase 490 comprises step 440, classifying sleep stages of the human from the monitored body activity data by the alternative sleep classifier. In step 450, it is determined that the sleep stage classified by the alternative sleep classifier is one of a set of particular sleep stages. If so then in step 460 a function of a device is switched on or off at least in dependency on said determination. There may be other types of input considered, e.g., time information from a clock, or information obtained from an external information providing system.
(52) Many different ways of executing the method are possible, as will be apparent to a person skilled in the art. For example, the order of the steps can be varied or some steps may be executed in parallel. Moreover, in between steps other method steps may be inserted. The inserted steps may represent refinements of the method such as described herein, or may be unrelated to the method. For example, steps 412 and 414 are executed, at least partially, in parallel. Moreover, a given step may not have finished completely before a next step is started.
(53) A method according to the invention may be executed using software, which comprises instructions for causing a processor system to perform method 400. Software may only include those steps taken by a particular sub-entity of the system. The software may be stored in a suitable storage medium, such as a hard disk, a floppy, a memory etc. The software may be sent as a signal along a wire, or wireless, or using a data network, e.g., the Internet. The software may be made available for download and/or for remote usage on a server.
(54) It will be appreciated that the invention also extends to computer programs, particularly computer programs on or in a carrier, adapted for putting the invention into practice. The program may be in the form of source code, object code, a code intermediate source and object code such as partially compiled form, or in any other form suitable for use in the implementation of the method according to the invention. An embodiment relating to a computer program product comprises computer executable instructions corresponding to each of the processing steps of at least one of the methods set forth. These instructions may be subdivided into subroutines and/or be stored in one or more files that may be linked statically or dynamically. Another embodiment relating to a computer program product comprises computer executable instructions corresponding to each of the means of at least one of the systems and/or products set forth.
(55) It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments.
(56) In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb comprise and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. The article a or an preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.