ALERT SYSTEM
20210295668 · 2021-09-23
Inventors
- Elizabeth BLANCHARD (Sydney, AU)
- Laurent PARSY (Sydney, AU)
- Bruce BREW (Sydney, AU)
- Helene BLANCHARD (Sydney, AU)
- Andreanne BLANCHARD (Sydney, AU)
- Serge LAURIOU (Sydney, AU)
Cpc classification
G08B29/185
PHYSICS
G08B21/0446
PHYSICS
A61B5/4094
HUMAN NECESSITIES
G06N3/042
PHYSICS
International classification
A61B5/00
HUMAN NECESSITIES
A61B5/11
HUMAN NECESSITIES
Abstract
A system is provided which, in at least some embodiments, can read the vital signs of the body of a user utilizing a sensing device such as a smartwatch or smart phone (for example utilizing the iOS, Android or Pebble operating systems) and apply algorithms to interpret the vital signs and then send a notification with an escalation process to nominated carriers if the patient interpreted as having a fall or fit or seizure. In at least some embodiments doctors or other parties can log in to a secured dashboard and check a patient data in real time. Doctors or other parties can analyze the history of the patient. In at least some embodiments, users/patients can also use data to keep track of fall or fit or seizure episodes and monitor their progress.
Claims
1. A fall detection apparatus comprising: an accelerometer which communicates an acceleration signal to a processor, the acceleration signal quantifying acceleration on a substantially continuous basis relative to a reference frame; and a timer which communicates a time reference signal to the processor, the processor monitoring the acceleration signal and the time reference signal on a substantially continuous basis, wherein the processor waits for the acceleration signal to indicate low acceleration within a first low acceleration range, wherein when the acceleration signal is within the first low acceleration range for a predetermined first period of time comprising a waiting for low acceleration step and is followed by a second high acceleration signal in a second high acceleration range in a second predetermined period of time comprising a waiting for high acceleration step a fall condition is determined by the processor, wherein the processor monitors the time reference signal and the acceleration signal during a third predetermined period of time subsequent to the second predetermined period of time whereby if the acceleration signal remains in a predetermined very low acceleration range during the third predetermined period of time comprising a calculating if the user stays immobile on the surface step, wherein the predetermined very low acceleration range, comprises the acceleration signal being lower than an On The Ground acceleration Sensitivity setting during Time To Detect On The Floor time setting and wherein the sum of the Time On The Floor periods is greater than the Time On The Floor setting then it is determined that a user is immobile on the surface and a fall detection event is confirmed, and wherein a plurality of parameters of each of the first low acceleration range, the second high acceleration signal and the predetermined very low acceleration range are customised for each user with reference to personal profile settings unique to each said user and can be updated by the user.
2. The fall detection apparatus of claim 1, wherein when the fall detection event is confirmed by the processor a fall signal is transmitted by a transmitter to a remote location.
3. The fall detection apparatus of claim 1, wherein when the fall detection event is confirmed by the processor then a fall signal is communicated locally.
4. The fall detection apparatus of claim 1, wherein the acceleration signal is referenced against the reference frame.
5. The fall detection apparatus of claim 1, wherein the reference frame is a surface upon which the user of the fall detection apparatus is supported.
6. The fall detection apparatus of claim 1, wherein the fall detection apparatus is a wrist mounted fall detection apparatus.
7. The fall detection apparatus of claim 1, wherein a weighting system receives input from a threshold-based algorithm and input from a machine learning model; the weighting system varying the weight applied to the respective inputs over time thereby to increase reliability of fall detection decisions.
8. The fall detection apparatus of claim 1, wherein said Time To Detect On The Floor excludes time when the acceleration signal is greater than the On The Ground acceleration Sensitivity setting.
9. A method of detecting a fall event comprising: providing an accelerometer which communicates an acceleration signal to a processor, the acceleration signal quantifying acceleration on a substantially continuous basis relative to a reference frame; providing a timer which communicates a time reference signal to the processor, the processor monitoring the acceleration signal and the time reference signal on a substantially continuous basis; and waiting for the acceleration signal to indicate low acceleration within a first low acceleration range, wherein when the acceleration signal is within the first low acceleration range for a predetermined first period of time comprising a waiting for low acceleration step and is followed by a second high acceleration signal in a second high acceleration range in a second predetermined period of time comprising a waiting for high acceleration step a fall condition is determined by the processor, wherein the processor monitors the time reference signal and the acceleration signal during a third predetermined period of time subsequent to the second predetermined period of time whereby if the acceleration signal remains in a predetermined very low acceleration range during the third predetermined period of time comprising a calculating if the user 12 stays immobile on the surface 13 step; wherein the predetermined very low acceleration range comprises the acceleration signal being lower than an On The Ground acceleration Sensitivity setting during a Time To Detect On The Floor time setting, wherein the sum of the Time On The Floor periods is greater than the Time On The Floor setting then it is determined that a user is immobile on the surface and a fall detection event is confirmed, and wherein a plurality of parameters of each of the first low acceleration range, the second high acceleration signal and the predetermined very low acceleration range are customised for each user with reference to personal profile settings unique to each said user and can be updated by the user.
10. The method of claim 9, wherein a weighting system receives input from a threshold-based algorithm and input from a machine learning model, the weighting system varying the weight applied to the respective inputs over time thereby to increase reliability of fall detection decisions.
11. A detection and communication system which utilizes the method of claim 9 to detect a fall condition and confirm a fall detection event; said system utilizes a method of detecting the fall event comprising: providing an accelerometer which communicates an acceleration signal to a processor; the acceleration signal quantifying acceleration on a substantially continuous basis relative to a reference frame; providing a timer which communicates a time reference signal to the processor; the processor monitoring the acceleration signal on a substantially continuous basis; the processor monitoring the time reference signal on a substantially continuous basis; the method comprising waiting for the acceleration signal to indicate low acceleration within a first low acceleration range; and when the acceleration signal is within the first low acceleration range for a predetermined first period of time and is followed by a second high acceleration signal in a second predetermined period of time a fall condition is determined by the processor; and wherein the processor monitors the time reference signal and the acceleration signal during a third predetermined period of time subsequent to the second predetermined period of time whereby if the acceleration signal remains in a predetermined very low acceleration range during the third predetermined period of time comprising a calculating if the user 12 stays immobile on the surface 13 step; wherein the predetermined very low acceleration range comprises the acceleration signal being lower than an On The Ground acceleration Sensitivity setting during a Time To Detect On The Floor time setting and wherein the sum of the Time On The Floor periods is greater than the Time On The Floor setting then it is determined that a user is immobile on the surface and a fall detection event is confirmed; said system reading a plurality of vital signs of a body of the user utilising a sensing device in a form of a body worn sensor and applies algorithms to interpret whether the fall detection event has occurred and then send a notification of the fall detection event with an escalation process to nominated carriers by way of a server incorporating a separate processor if the user is interpreted as having a fall; said system implemented by means of the processor associated with the body worn sensor and the separate processor associated with the server.
12. The system of claim 11, wherein the sensing device is a smartwatch or smartphone.
13. The system of claim 11, wherein the system includes a secured dashboard, said secured dashboard displaying user data in real time, said secured dashboard accessible to doctors or other parties via a log in sequence.
14. The system of claim 11, wherein the system incorporates a memory, said memory storing user data and historical user data, said user data and said historical user data accessible to doctors or other parties for analysis via a log in sequence.
15. The system of claim 11, wherein the system includes a memory which retains user data relating to fall or fit or seizure episodes of each user, said memory accessible to users or patients via a login sequence thereby allowing the users or patients to keep track of fall, fit or seizure episodes and monitor their progress.
16. The fall detection apparatus of claim 2, wherein transmitter has Bluetooth or other short-range radio or electromagnetic transmission capability.
17. A decision system wherein reliability of decision making is improved by combining threshold-based decision making with a Machine Learning Model in order to provide an automated improvement of fall detection accuracy, said system providing acceleration data to a threshold-based algorithm, wherein the threshold-based algorithm includes personal profile settings customizable to a user, said system further including a machine learning model which receives acceleration data and learns from feedback input by the user, said system further including a weighting system which receives input from said machine learning model and from said threshold-based algorithm, said weighting system weighting input from said threshold-based algorithm more heavily than from input from machine learning model during a first phase of use by a user of the detection system, said weighting system weighting input from said machine learning model more heavily as the model learns.
18. The system of claim 17, applied to determining whether a user has had a fall.
19. The system of claim 17, applied to determining whether a user has had a seizure.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0081] Embodiments of the present disclosure will now be described with reference to the accompanying drawings, wherein:
[0082]
[0083]
[0084]
[0085]
[0086]
[0087]
[0088]
[0089]
[0090]
[0091]
[0092]
[0093]
[0094]
DETAILED DESCRIPTION OF EMBODIMENTS
[0095] Broadly what is disclosed is a device, method and system which, in at least some embodiments, can read the vital signs of the body of a user utilizing a sensing device such as a smartwatch or smartphone (for example, utilizing the IOS, ANDROID, PEBBLE or TIZEN operating systems) and apply algorithms to interpret the vital signs and then send a notification with an escalation process to nominated carriers if the patient is interpreted as having a fall or fit or seizure. In at least some embodiments, doctors or other parties can log in to a secured dashboard and check a patient data in real time. In some embodiments, doctors or other parties can analyze the history of the patient.
[0096] In some embodiments, a plurality of parameters of each of the first low acceleration range, the second high acceleration signal and the predetermined very low acceleration range are customized for each user with reference to personal profile settings unique to each said user. In some instances, the personal profile settings unique to each said user can be updated by the user.
[0097] In at least some embodiments, users/patients can also use data to keep track of fall or fit or seizure episodes and monitor their progress.
[0098] Embodiments of the present disclosure can be applied, for example, in situations where the patient/user suffers from a medical condition, such as epilepsy, which may predispose the patient/user to falls and related events.
[0099] With reference to
[0100] In this instance the alert system 10 monitors and analyzes data derived from a sensor 11. In some instances, the sensor 11 may be a body-worn sensor. In some instances, the sensor 11 may be strapped to the wrist of a user 12. In some instances, the sensor 11 may be chest-mounted, ankle-mounted or otherwise, but such that there is a mechanical association as between the sensor 11 and the body of the user 12 sufficient for the sensor to detect parameters associated with the body of the user 12.
[0101] Such parameters may include movement of the body relative to a reference frame. In some instances, the reference frame will be the surface 13 which supports the user 12.
[0102] Other parameters may include physiological parameters such as heart rate, ECG waveforms, EEG waveforms, blood pressure, blood glucose, sweat, body temperature and the like.
[0103] Yet other parameters may include geographic location information and data such as is derived from a GPS module. An embodiment of the device incorporating GPS capability is shown in
[0114] In some embodiments and with reference to
[0115] In this and other instances, the apparatus 310 may include an accelerometer 320 which communicates an acceleration signal to a processor 311. The flow chart of
[0116] With reference to
[0117] In some embodiments, having the acceleration signal is within the first low acceleration signal range 350 for a predetermined first period of time 352 is defined as a waiting for low acceleration step time 352. In some embodiments, this may be followed by a second high acceleration signal 353 in a second high acceleration range 354 which may be greater than setting HA 354A. In some embodiments, HA 354A may be an acceleration magnitude which lies in the range from 5 G to 30 G. If the signal 353 is greater than setting HA 354A, the second High Acceleration may be confirmed.
[0118] If in a second predetermined period of time comprising a waiting for high acceleration step, a fall condition is determined by the processor. The processor may monitor the time reference signal 19 and the acceleration signal 370 during a third predetermined period of time subsequent to the second predetermined period of time. If the acceleration signal 370 remains between OTGS value 355A in a predetermined very low acceleration range 355 shown in
[0119] The decision as to whether a fall has occurred may comprise additional observation of the acceleration signal 370 during a Time to Detect On The Floor (TTDOTF) period 356.
[0120] The additional observation may comprise monitoring the acceleration signal during the TTDOTF period 356 such that any consecutive time periods during this period made up of shorter TOTF periods which total a predetermined amount SUM of all TOTF periods (which will be less than or equal to TTDOTF) will be interpreted that a fall has occurred.
[0121] The periods TOTF 357 may comprise time periods when the acceleration signal remains continuously within the OTGS 355 very low acceleration range. They are ended if the acceleration signal moves out of the very low acceleration range OTGS 355 at any time during the TTDOTF time period.
[0122] In the example of
[0123] In some embodiments, TTDOTF may be in the range 10 to 20 seconds. The sum of TOTF periods within this range may be set at, for example, 6 seconds. In some embodiments, a plurality of parameters of each of the first low acceleration range, the second high acceleration signal and the predetermined very low acceleration range are customized for each user with reference to personal profile settings 372 unique to each said user 312 and may be updated by the user (see
[0124] With reference to
[0125] A real confirmed data recorded fall is shown in the graph of
[0126] With reference to
[0127] Broadly, the system 10 may comprise components which are networked together and which, in some instances, will be geographically separated from each other.
[0128] In some embodiments, the system 10 may include a sensor 11 mechanically associated with user 12 which is in communication with a server 14. The sensor 11 may send an acceleration signal 70 to the server 14. In some instances, the sensor and/or the server 14 may also be in communication with carrier digital communications devices 15 and also, separately, in communication with call center digital communication devices 16.
[0129] In some embodiments, the sensor 11 may be in the form of a wearable device attached to the wrist of user 12.
[0130] The sensor 11 may incorporate or may be in communication locally with a processor 17, a memory 18, a timer module 19, acceleration sensing module 20 and a communications module 21. In some embodiments, the components 17, 18, 19, 20, 21 communicate with each other over bus 22.
[0131] In a further embodiment, at least the acceleration detection module and communications module may communicate via Bluetooth or other short range radio or electromagnetic transmission capability with the other components forming the sensor 11.
[0132] In some embodiments, the acceleration sensing module 20 may be implemented as at least a three-axis accelerometer which permits acceleration to be resolved in three orthogonal axes.
[0133] The communications module 21 may communicate with the Internet 23 or other wide area network either by way of a Wi-Fi router 24 or via cellular telephone network 25, whereby the sensor 11 may be placed in data communication with server 14, carrier digital communications device 15 and call center digital communications device 16.
[0134] The system 10 may further include a scheduler 36 in some instances executed as an application on the server 14. A function of the scheduler 36 may be to start and stop monitoring effected by the sensor 11.
[0135] In some embodiments, the functionality may be to automatically start the monitoring of the application on sensor 11 in the morning and close it at night, for fall and seizure event detection. For sleepwalking event detection, it may be started at bed time and closed in the morning.
In Use
Fall or Seizure Condition Monitoring
[0136] As seen initially in
[0137] The event may then be communicated to one or more of the server 14, the carrier digital communications device 15 and the call center digital communications device 16 in accordance with the flowchart of
[0138] In some embodiments, the event may also be communicated locally to the user 12. In some embodiments, the event may be communicated locally by way of a display 26 associated with the sensor 11.
[0139] In some embodiments, the display 26 may be a touch sensitive display (or voice activation, e.g., Apple Siri or Ok Google assistance) whereby the user may communicate with one or more of the server 14, the carrier digital communications device 15 or the call center digital communications device 16.
Integrated Sensor and Communications Device
[0140] In some embodiments, the sensor 11, 111, 211 may be implemented as a smartwatch app running on an independent smartwatch which has an integrated sim or esim card, such as the Apple Watch Series 3™ or the LG Urbane LTE Smartwatches™.
Machine Learning Adaptation
[0141] In some embodiments, an artificial intelligence AI capability may be programmed into memory 18 for execution by processor 17. In some embodiments, an AI program may be executed on the processor 17 associated with server 14. One particular application of the AI capability may be to learn from false positive event determination and false negative event determination in order to statistically improve reliability of detection of an event over time and with particular reference to learned attributes of the data associated with any given user 12. In some embodiments, the AI program uses Machine Learning methods works on activity recognition and analysis of the falls, such as true positive, true negative, false negative and false positive, as well as analyzing sensor data from the sensing device (smartwatch), to embed functional software changes of the parameters used by the algorithm to improve the reliability of the automatic detection personalized for each patient (user).
[0142] With reference to
[0143] The system relies on a threshold-based algorithm 401 which makes decisions as to whether a fall event has occurred based on an algorithm described in the flowchart of
[0144] The decision system 410 may receive feedback from a user as to its decisions by way of a simple question and answer prompt menu 403 which may be displayed on the smartwatch or the smartphone. When the weighting system 404 outputs that a fall has been detected, a window period may be opened to receive feedback from the user.
[0145] In the instance that the machine learning model 402 communicates that it assesses the use as having had a fall the user may respond with feedback 403 of either:
[0146] 1. I need help;
[0147] 2. I fell but I am okay; or
[0148] 3. I did not fall,
thereby allowing one way for the machine learning model to learn more regarding this user in order to increase reliability of fall detection decisions.
[0149] The decisions of the machine learning model 402 in
[0150] At the time of first use by a user 12, the majority of weighting may be given to decisions of the threshold-based algorithm 401 in
[0151] For example, after a few months of learning experience, the weighting given to MLM 402 may be 0.8 and to the TBA 401 it may be 0.2.—wherein the weighting may be affected by time.
[0152] If TBA 401 gives a “hard fall” decision compared to MLM 402, the system 410 may give more weight to TBA 401 based on experience stored in the database—weighting affected by probability.
[0153] In both cases, the weighted determination 405 may be fed to database 414 so as to enrich the user profile 472 and automatically update threshold user settings if necessary and for final communication to carriers, as per the system illustrated in
[0154] With reference to
[0155] With reference to
[0156] With reference to
[0157] In this instance, the threshold-based algorithm 401 may provide input to weighting system 410. Machine learning model 402 may also provide input to weighting system 410. Decision Logic box 410A may set out decision logic and procedure by which a “final fall probability” 410B is determined. If this value is above a PPT threshold value 410C then a fall is determined to have occurred.
[0158] Exceptions 410D may overwrite the TB weightings.
[0159] In this instance, it will be seen in graph 410E that, over time, a higher weight is attributed to the machine learning model 402 than to the output of the threshold-based algorithm 401.
Sleep Walking Detection
[0160] With reference to
Heart Rate Monitoring Event Detection
[0161] In some embodiments, the sensor 11 may include ECG monitoring capability, whereby heart rate monitoring may provide an alert to patient and carrier when an unusual heart rate/beat is recorded.
Audio Functionality
[0162] Audio may be provided when an event such as a fall, seizure or sleepwalk is detected to alert people around and emergency services. In some embodiments, this may be affected by the sensor emitting an audible sound. In some embodiments, the sound may be loud enough for surrounding people to hear.
Sensor Condition Monitoring and Communication
[0163] The App may send notification to carriers about the App monitoring status (making sure the app is monitoring) as well as the battery level of the watch, so the carrier can contact the patient if there is any issue of the App monitoring. As reference to
Integration with Other Systems-Telehealth
[0164] In some embodiments and with reference to
[0177] The additional monitoring or sensor device 27 may include functionality and communications capability similar to that of sensor 11, but may include at least microphone 28 and, in some embodiments, speaker 29 in communication with a bus 30 which may also be in communication with processor 31 and memory 32, and therefore in communication with Wi-Fi router 224, Internet 223 and subsequently Web-enabled database 33.
[0178] In some embodiment, the additional monitoring or sensor device 27 may take the form of a smart microphone and speaker device of the form currently marketed as the Amazon Echo™, or Google™ home device or the HomePod™ from Apple.
[0179] These devices permit audio pickup typically from an entire room and also audio playback to an entire room. Third-party applications may be run on web-enabled database 33 to provide specific functionality to complement the basic functionality which can include voice recognition and giving effect to voice commands by way of communication with other devices located in the vicinity.
[0180] In some instances, this arrangement may facilitate a telehealth functionality enabling the user at home to talk to carriers and emergency workers using at least the voice recognition system built into the additional monitoring or sensing device 27. In some embodiments, an application may be loaded onto Web-enabled database 33 which, when executed, may integrate functionality of the additional monitoring or sensor device 27 with the functionality of the sensor 211.
[0181] In some instances, this combining of functionality provides a powerful, integrated body-worn sensor with a local room sensor which has at least audio pickup and audio playback capability.
INDUSTRIAL APPLICABILITY
[0182] Embodiments of the present disclosure have application wherever it is desired to monitor and communicate conditions or events associated with a user.
In some embodiments, the system may have application to fall detection and communication of the same to remote locations for the purpose of obtaining assistance or at least monitoring of the same.
[0183] In some embodiments, the system may be applied with advantage to read the vital signs of the body of a user utilizing a sensing device such as a smartwatch or smartphone (for example utilizing the IOS™, ANDROID™ or PEBBLE™ operating systems) and apply algorithms to interpret the vital signs and then send a notification with an escalation process to nominated carriers if the patient is interpreted as having a fall or fit or seizure. In some embodiments, doctors or other parties may log in to a secured dashboard and check patient data in real time. in some embodiments, doctors or other parties may analyze the history of the patient.
[0184] In some embodiments, users/patients may also use data to keep track of fall or fit or seizure episodes and monitor their progress.
[0185] Embodiments of the may be applied, for example, in situations where the patient/user suffers from a medical condition such as epilepsy and which may predispose the patient/user to falls and related events.
[0186] The above describes only some embodiments of the present disclosure and modifications, obvious to those skilled in the art, can be made thereto without departing from the scope of the present invention.