SYSTEM AND METHOD FOR WEARABLE MONITOR WITH ACTIVITY MONITORING, FALL DETECTION AND DELEGATE NOTIFICATION
20200105115 ยท 2020-04-02
Inventors
Cpc classification
G08B21/0446
PHYSICS
G08B21/182
PHYSICS
International classification
Abstract
The present system is directed in various methods, devices and systems relating to wearable devices for personal safety and emergency notification. More specifically, a wearable watch with a band that provides fall detection processing only after detecting a significant movement, emergency notification of an emergency service, a call to an emergency center and SMS message to designated delegates upon determining that a fall is detected. Fall detection processing only begins after a significant motion is detected. Once a significant motion is detected, then the device monitors motion for predetermined windows of time, develops waveforms for the monitored motion and compares the monitored waveform with a reference fall waveform. If the monitored waveform compares with the reference fall waveform at or above a predetermined comparison threshold, a fall is detected and declared.
Claims
1. A fall detection method for a wearable device comprising a 3-axis accelerometer and a processor in communication with the accelerometer, wherein the fall detection method is not initiated unless a significant movement threshold is exceeded.
2. The method of claim 1, wherein the fall detection method further comprises: establishing an upper movement threshold; establishing a lower movement threshold; obtaining acceleration data from a 3-axis accelerometer over a predetermined time; comparing the obtained acceleration data with the upper and lower movement thresholds; and detecting a fall only if at least one acceleration data point exceeds the upper movement threshold and if the acceleration data remains below the lower movement threshold.
3. The method of claim 2, wherein the upper movement threshold is 30 m/s.sup.2 and the lower movement threshold is 20 m/s.sup.2.
4. The method of claim 2, further comprising: establishing a window for the obtained acceleration data; and detecting a fall only at least one acceleration data point exceeds the upper movement threshold within the established window and if the acceleration data remains below the lower movement threshold after exceeding the upper movement threshold within the established window.
5. The method of claim 5, wherein the established window moves step-wise along the obtained acceleration data.
6. The method of claim 1, further comprising: establishing a reference fall waveform indicative of fall movements; and obtaining acceleration data over a predetermined time; transforming the obtained acceleration data into a waveform; comparing the waveform with the reference wavelet; and detecting a fall only if the waveform matches the reference wavelet above a predetermined level of matching.
7. The method of claim 6, further comprising establishing a window for the obtained acceleration data; and detecting a fall only at least one acceleration data point exceeds the upper movement threshold within the established window and if the acceleration data ends remains below the lower movement threshold after the upper movement threshold is exceeded within the established window.
8. The method of claim 7, wherein the established window moves step-wise along the obtained acceleration data.
9. The method of claim 1, wherein the wearable device remains in a low-power mode until a fall is detected.
10. The method of claim 9, further comprising initiating an emergency event process when a fall is detected.
11. The method of claim 10, further comprising actuating a countdown timer when the emergency event process is initiated and a cancellation option displayed on the wearable device that may be actuated to interrupt the emergency process.
12. The method of claim 11, further comprising storing the initiating of the emergency event process.
13. The method of claim 10, further comprising sending an emergency event message to a cloud-based emergency service, initiating a phone call to an emergency center, and sending SMS messages to identified delegates.
14. The method of claim 9, wherein remotely located users may access a web-based dashboard comprising data from the wearable device and request a current telemetry inquiry for the device.
15. The method of claim 14, wherein the device partially wakes up in order to get its location, battery life information and heart rate.
16. A fall detection method for a wearable device comprising: establishing a reference fall waveform indicative of fall movements; obtaining acceleration data over a predetermined time; transforming the obtained acceleration data into a waveform; comparing the waveform with the reference wavelet; and detecting a fall only if the waveform matches the reference wavelet above a predetermined level of matching.
17. The method of claim 16, further comprising establishing a window for the obtained acceleration data; and confirming the detected fall only if at least one acceleration data point exceeds the upper movement threshold within the established window and the acceleration data remains below the lower movement threshold after exceeding the upper movement threshold within the established window.
18. A wearable device comprising: a processor configured to execute programmed instructions; an internal memory configured to store the programed instructions and in operative communication with the processor; a sensor hub configured to sense movements of the wearable device and in operative communication with the processor and the internal memory; a cellular module in operative communication with the processor; and wherein the programmed instructions adapted to execute the method of claim 7.
19. The wearable device of claim 18, wherein if a fall is detected after execution of the programmed instructions, a emergency process is initiated by the wearable device.
20. The wearable device of claim 19, wherein the emergency process comprises initiating a phone call to a designated phone number and sending at least one SMS message to a communication device of least one predesignated delegate.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0009]
[0010]
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
DETAILED DESCRIPTION
[0026] While the invention is amenable to various modifications and alternative forms, specifics thereof are shown by way of example in the drawings and described in detail herein. It should be understood, however, that the intention is not to limit the invention to the particular embodiments described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.
[0027] Various embodiments of the present invention comprise a wearable device comprising motion detection, fall detection, emergency assistance request, location detection, cellular and Wifi communication modules, a heart rate sensor, a display and power management module including a rechargeable battery.
[0028]
[0029]
[0030] The wearable device 100 communicates with remote services and/or individuals using the internet and cloud-based system 200 of
[0031]
[0032]
[0033] Initiation of startup configuration at 404 further results in displaying a set of terms and conditions screen on the wearable device's display at 416 which may be accepted at 418.
[0034] The device 100 then queries whether it has been activated at 420. If activated, the standard device screen of, e.g.,
[0035] If the device has not been activated, the user is required to activate the device by moving through the startup configuration steps as illustrated. First, the activation code screen is displayed on the wearable device screen as seen in
[0036] We turn now to the handling of a manually actuated emergency process 500 illustrated in
[0037] If the countdown reaches 0 as in step 516, then the device initiates an emergency process 518 which comprises two major elements. First, the location of the device, using a GPS locating sensor integrated into the device, and the battery status are queried, obtained and sent to the remote or cloud-based server or service where these data are stored at 510, 512 and 514. Second, a notification chain is initiated. A phone call is started to the designated emergency center to allow voice interaction between the emergency center and/or the designated health care provider and the wearer of the device or other person assisting the wearer of the drive at step 520. Initiation of phone call at 520 results in displaying the call screen at 522 and ultimately an end to the call at 524. In addition, SMS messages are sent to the designated delegates alerting them of the manually actuated emergency at 526.
[0038] The wearable device further comprises an optical sensor for monitoring the heart rate of the wearer. However, unlike known devices, this feature is only initiated upon remote inquiry by a designated delegate and/or healthcare provider or other person with access to the website and the user's unique information as shown in dashboard interaction process 600 in
[0039] If desired, the device's telemetry, e.g., device location, battery status and/or heart rate of the designated wearer of the device 100 may be requested from the website dashboard via the remote or cloud-based server or service as shown. In response to a device telemetry inquiry or update, the remote or cloud-based server or service generates a message via firebase cloud messaging (FCM) as is well-known to the skilled artisan as in 614. The generated FCM message is communicated to the wearer's device at 616 which, when received, partially wakes the device which is otherwise normally in a low activity or sleep state 618. At this point, the device gets its location, gets its battery status and now and only now gets a heart rate from the patient at an exemplary optical sensor at 618. This information is provided to the remote and cloud-based server and service upon initiating of a retrieve device details function 620 and the data is further stored at the remote and cloud-based server and service at 622. Next, the dashboard at the website may update on its own, or may be refreshed by the user, to show the obtained information, including the patient's heart rate as discussed above. Confirmation of the heart rate in this manner also confirms that the device is being worn and therefore, in combination with the GPS locating sensor data also accessible at the website dashboard, also further confirms the location of the person wearing the device.
[0040] Only getting the telemetry data, i.e., location and heart rate, in the above process, and then only initiated by a user of the website, operates to save battery life. The device waits for the FCM message and then only partially wakes up to obtain the requested telemetry data, thus saving battery life.
[0041] It is another feature of the present system and method that designated delegate(s) receive an SMS message if the battery reaches a predetermined low point, for example, the low battery charge point may be set anywhere between 5% and 25%. This allows the designated delegate(s) to contact the wearer of the device and/or a local assistant who can then ensure the device is charged.
[0042] We now turn to the motion monitoring and fall detection processes 700 of the inventive system and method as described in relevant part in
[0043] A motion sensor hub 700 comprising a gyroscope and an accelerometer, preferably a 3-axis accelerometer is provided in operative communication with the device's processor and memory as shown in
[0044] With reference now to
[0045] If a fall is detected, i.e., confirmed, at 704, then a cancel screen appears on the device and a countdown initiates which lasts a predetermined time, e.g., 10 seconds at 706. If the cancel feature is actuated, e.g., a button is pressed, at 708, then the related emergency process is cancelled at 710, the battery status and location of the device are obtained at 712 and a fall cancellation message is sent to the remote or cloud-based server and service at 714 where it is stored for future reference and analysis if needed at 716.
[0046] If, however, the cancellation countdown reaches 0 as at 718, then the fall emergency process is initiated 720 by getting the device's location and battery status 712. When this is completed, a fall event message is sent to the remote or cloud-based server and service 714 where it is stored 716. Initiation of the fall emergency process also comprises starting a phone call to the designated emergency center or health care provider 722 and an SMS message is sent to the designated delegate(s) 724 as those processes are described in connection with the emergency processing 500 of
[0047] As discussed above in connection with
[0048] Once the plurality of post-significant x,y,z acceleration vectors has been captured by the motion sensor's accelerometer, the data is processed and analyzed on the processor using programmed instructions or code according to the following steps and as shown in
[0049] 1. Two force vector thresholds are established and stored in the device's internal memory. Thus, a pre-event threshold value and a post-event threshold value are established.
[0050] If the pre-event threshold value is exceeded, then an initial free fall is detected. If the pre-event threshold is not exceeded, then a free fall is not detected.
[0051] An exemplary pre-event threshold value (or upper threshold value) may comprise approximately 30 m/s.sup.2 or approximately 3 G's of force. An exemplary post-event threshold may comprise approximately 20 m/s.sup.2 or approximately 2 G's of force.
[0052] If the post-event threshold value is not met, i.e., the force vector data is below the post-event threshold, then it is determined that the device (and the wearer) are at rest, potentially after having fallen. If the post-event threshold value is not exceeded, then the device's processor sets a global indicator, indicating that a potential fall is detected and that the accelerometer data must be analyzed to determine and validate if a real fall event has occurred.
[0053] 2. The force vector is calculated for each of the plurality of post-significant x,yxz acceleration vectors using the following equation:
Vtot=(x.sup.2+y.sup.2+z.sup.2).sup.5. See step 806.
[0054] 3. A two-part moving window is established at 804 using a subset of the plurality of post-significant movement acceleration data. The first part of the moving window may consist of 8 data points and established as the pre-event data set of the moving window. The second part of the moving window may comprise the next set of data points in the plurality of post-significant movement acceleration data and established as the post-event data set of the moving window. The skilled artisan will recognize that 8 data points for each window component is merely exemplary and that the window components may comprise more or less data points. It is preferable that the pre-event and post-event data sets consist of an equivalent number of data points, though this is not a requirement. Thus either the pre-event or post-event data set may comprise a larger number of acceleration data points than the other data set.
[0055] 4. Once the two-part moving window is established, the pre-event data set is analyzed on the device's processor 10 using programmed instructions stored in the memory to detect if the data set has a value that is greater than the established pre-event threshold value to potentially identify an initial free fall of the device at 806. If the pre-event threshold of, e.g., 3 G's of force is not met in pre-event comparison step 808, then it is concluded that this window of data is not consistent with a fall at 810. If, however, the pre-event threshold is met or exceeded, then the analysis continues to step 812.
[0056] 5. Thus, at 812, the post-event data set portion of the moving window is analyzed at to detect if it has a value that is less than the established post-event threshold value to potentially detect the device at rest which may occur in some cases after a fall. Thus, as shown in post-event comparison step 814, if the post-event threshold of, e.g., 2 G's of force, is exceeded, then it is concluded at 816 that the data in this portion of the window is inconsistent with a fall.
[0057] If, however, the post-event data indicates that the exemplary 2 G's of force is not met within the window of data, then a fall may be detected and may be handled as in
[0058] 6. If the threshold values in step 4, or steps 4 and 5, is/are met, then the angle between the first point (U) and the last point (V) in the pre-event data set may in some embodiments be calculated, where
U=[x.sub.1, y.sub.1, z.sub.1] and V=[x.sub.8, y.sub.8, z.sub.8], as follows:
Cos Theta=dot(U, V)/Norm(U)Norm(V)); and
Theta InDegrees=a cos d(Cos Theta).
[0059] If the Theta InDegrees value is determined to be greater than an established threshold angle (Tfall), then the algorithm determines that a fall has potentially occurred and may be handled as in
[0060] 7. In other embodiments, concluding that a fall has been detected in both the pre-event and post-event data windows, may result in waveform validation, discussed in detail infra, is subsequently performed to confirm whether a fall has occurred. See step 818 and step 820 where the conformance of the test waveform within the designated data window to a reference known-fall waveform is tested. If the percent of conformance is greater than a predetermined threshold, e.g., 90%, then the detected fall is confirmed and handled as in
[0061]
[0062] The moving window may, as discussed above, comprise 16 data points (8 pre-event and 8 post-event) for each analysis. The window moves down the plurality of acceleration data points, searching for values that exceed the preset pre-event threshold and/or that are below the preset post-event threshold. Thus, analysis 1 may comprise events 1-16, analysis 2 may comprise events 2-17, analysis 3 may comprises events 3-18, etc., wherein each analysis determines whether or not a fall may have occurred.
[0063] The waveform validation process comprises the following steps:
[0064] 1. A series of data from a pre-event data set and the related post-event data set of the moving window discussed above is selected.
[0065] 2. A continuous wavelet transform is applied to the selected data set. In this connection, a base wavelet is provided that is representative of a fall. The base wavelet may be created based on analysis of previously obtained fall data.
[0066] 3. The wavelet transform then analyzes whether a waveform of the selected data set is similar to, or different from, the base waveform.
[0067] 4. The results of this analysis and comparison against the base waveform enables classification of the analyzed waveform as a fall or not a fall. If the analyzed waveform is determined to be similar to the base waveform (fall), then the event is classified as a fall.
[0068] Generally, a moving analysis window as discussed and described herein may comprise a size in x-axis units of an exemplary 8 steps before the center and 8 steps after the center of the waveform or wavelet. Thus, a total of 16 steps along the x-axis may be employed for the moving window approach which equates to 16 steps640 ms (0.640 of a second).
[0069] In the embodiments using the reference fall waveform or wavelet to detect a fall or confirm a fall detection, a continuous wavelet transform is calculated between the reference fall waveform or wavelet to get the best translation and rotation that will fit the reference fall waveform or wavelet to the data's waveform or wavelet analyzed within the analysis window. Then, the reference fall waveform or wavelet and the waveform within the analysis window are integrated to obtain the space underneath the two waveforms, then a comparison of the size of the space is done. If the size of the common space is greater than a predetermined matching threshold, e.g., 90%, then a fall is detected.
[0070] These analysis tools and techniques are illustrated below in a series of Fall Detection Working Examples.
FALL DETECTION WORKING EXAMPLES
[0071] Working Example 1, illustrated in
[0072]
[0073] Similarly, Working Example 2 shown in
[0074] Working Examples 1 and 2 provide a fall detection embodiment comprising only the upper and lower predetermined thresholds, whereby if the threshold requirements are met, a fall is detected and if the threshold requirements are not met, no fall is detected.
[0075] Working Example 3 illustrated in
[0076] However, a further refining and/or confirmatory step may be taken to determine if the waveform of
[0077] Thus, generally as the moving window progresses along the y-axis according to the fall detection algorithm discussed above, if the waveform data peaks above the upper threshold then stays below the lower threshold, a fall may be detected.
[0078] Working Examples 5 (
[0079] Turning now to Working Example 6 in
[0080] The degree of matching between the reference wavelet and the movement waveform needed to indicate a fall may be fixed at a greater than an exemplary 90% match, though other match thresholds may be used effectively.
[0081] Working Example 7 is shown in
[0082] Working Example 8 in
[0083] The skilled artisan will now recognize that it is possible to detect a fall with the system described herein by (1) upper and lower thresholds alone; (2) upper and lower thresholds within an established window; (3) upper and lower thresholds within a window that moves across the data; (4) upper and lower thresholds within a window in combination with waveform comparison with a reference wavelet; and (5) waveform comparison with a reference wavelet.
[0084] The present invention should not be considered limited to the particular examples described above, but rather should be understood to cover all aspects of the invention. Various modifications, equivalent processes, as well as numerous structures to which the present invention may be applicable will be readily apparent to those of skill in the art to which the present invention is directed upon review of the present specification.