A SYSTEM FOR MONITORING, EVALUATING AND PROVIDING FEEDBACK OF PHYSICAL MOVEMENTS OF A USER
20220411355 · 2022-12-29
Inventors
- Søren WÜRTZ (Allinge, DK)
- Andersen FINN BECH (Allinge, DK)
- Jønne MARCHER (Allinge, DK)
- Carsten SCHEIBYE (Allinge, DK)
Cpc classification
A61B5/1036
HUMAN NECESSITIES
A61B5/7264
HUMAN NECESSITIES
A61B5/02416
HUMAN NECESSITIES
A61B5/721
HUMAN NECESSITIES
A61B5/7275
HUMAN NECESSITIES
A61B5/7278
HUMAN NECESSITIES
A61B2562/0219
HUMAN NECESSITIES
International classification
Abstract
The present invention relates to a system for monitoring a physical movements of a user, the system comprising: a detection unit configured for receiving a signal obtained by a sensor device representative of a sensed bodily activity, calculating a load index value and communicate, e.g. to the user wearing the sensor device, the value of the load index value. The invention also relates to a method for monitoring and evaluating physical movement of a user and providing feedback to the user.
Claims
1. A system for monitoring the movements of a user, the system comprising: a detection unit (3) configured for receiving a signal obtained by a sensor device (1) representative of a sensed bodily activity, said bodily activity optionally comprising a position or movement of muscles, bone(s) and/or joint(s), calculate based on the signal obtained by the sensor device (1) over a period of time, optionally a 1 hour signal period, a load index (LI-) value based on the received signal obtained by the sensor device (1).
2. The system according to claim 1, the system being configured for communicating the value of the load index, the communicating optionally being to the user wearing the said sensor device (1).
3. The system according to claim 1, said sensor device (1) being configured for being attached to a part of a user for sensing one or more bodily activities in that part of a user during movement of said part and for providing a signal representative of the sensed bodily activity.
4. The system according to claim 1, further comprising a communication device (2) in signal communication (4) with said sensor device (1), said communication device (2) comprising said detection unit (3), optionally such that said detection unit (3) physically forms part of said communication device (2).
5. The system according to claim 1, wherein the sensor is characterized as a SEMG sensor, accelerator meter, gyro meter, near infra-red optical sensor, stretch sensor, or force sensor.
6. The system according to claim 1, wherein the signal from the sensor device (1) is processed to remove signal noise, optionally by using RMS signal processing.
7. The system according to claim 1, wherein the load index value is calculated using one or more pre-defined research-based rules, based on extracted information concerning the strain-load characteristics leading to injuries, wherein the extracted information optionally includes heavy load strain, high median strain, static strain, lack of rest, or any combination thereof.
8. The system according to claim 7, wherein the research-based rules are based on a relative bodily activity level that is defined as the ratio between the processed signal and the maximum voluntary amplitude being above a threshold, with/or without a signal length requirement, the threshold optionally being a 30% threshold.
9. A system according to claim 7, wherein a research-based rule is set to be broken when a predefined percentage of the signal time length is over the research-based rule giving the maximum LI-value, optionally wherein 10% of the signal length is over a 30% threshold.
10. A system according to claim 8 wherein in a research-based rule is step-wise time and/or strain level aggregated, wherein the strain level is the relative bodily activity level, so that an LI-value is assigned to each time and/or strain level step in the research-based rule.
11. A system according to claim 7 wherein if two or more research-based rules yield different LI-values, the highest LI-value is chosen.
12. The system according to claim 1, the system being configured to calculate the LI-value using a signal originating from the sensor device (1) and wherein the calculation of the LI-value comprises the steps of: processing of the signal into a filtered signal, preferably into an RMS signal, calculation of a relative bodily activity level, defined as the ratio between the processed signal, preferable an RMS signal, and the maximum voluntary amplitude, and calculation of the relative time spent above a condition of a research-based rule, use of the research-based rules to determine the LI-value.
13. The system according to claim 1, wherein the LI-value is calculated using statistical variables and/or functions related to the signal obtained by the sensor device.
14. The system according to claim 13, where the statistical variables are one or more of the mean of the sensor signal and/or the RMS, the standard deviation (STD) of the sensor signal and/or RMS signal, the power of the sensor signal and/or RMS, the time spent in a frequency category of a the frequency categorized signal, the relative difference in the maximum amplitude of the signal compared to the baseline level, the relative power in different frequency bands and/or the peak amplitude in a given frequency interval.
15. The system according to claim 7, wherein the LI-value is calculated based on a trained machine learning algorithm, wherein the input parameters for the learning are the pre-defined research-based rules, the user demographical data, strain patterns, the statistical function and variables and characteristic originating from pain reports from the user.
16. The system according to claim 1, wherein the load index-value is updated on a regular basis, optionally every 5 minutes, based on the signal period from the update.
17. The system according to claim 1, wherein the load index-values are stored in a database.
18. The system according to claim 1, wherein the system is configured to provide a list of recommendations based on a LI-value history and/or a pain report and/or the user's demographical data, the list of recommendations optionally comprising training and guidance for the user.
19. The system according to claim 1, further comprising a communication device (2) spatially apart from said detection unit (3), the communication device (2) being in signal communication (4) with said sensor device (1) and the communication device (2) being configured to relay a signal received from said sensor device (1) representative of a senses bodily activity to the detection unit (3), and receive from the detection unit (3) a signal signaling the value of load index.
20. The system according to claim 1, wherein the detection unit (3) is configured for: receiving signals from a plurality of sensor devices (1) each signal being representative of a sensed bodily activity; calculating, in each of said received signals, a load index value, and storing said load index values in a database.
21. The system according to claim 1, wherein the sensor device (1) is configured for wirelessly transmitting said signal representative of sensed bodily activity.
22. The system according to claim 1, wherein the detection unit (3) is configured for wireless receiving said signal representative of the sensed bodily activity and for wireless communicating the load index value.
23. The system according to claim 4, wherein the communication device (2) is configured for wireless communication with said sensor device (1) and said detection unit (3).
24. The system according to claim 1, wherein the detection unit (3) is embodied comprised in a user's smart device, said smart device optionally comprising a smartphone, tablet, computer, or smart watch.
25. The system according to claim 2, wherein the system is configured to communicate to the user wearing the sensor device (1) that the load index value has exceeded a predefined threshold, and the communicating is in the form of visual, auditory or tactile perceptive information.
26. The system according to claim 1, wherein the sensor device (1) comprises a sleeve (6) made from an elastic material, and/or another device configured for obtaining a signal representative of position or movement of muscles, bone(s) and/or joint(s); a device holding electronics (8) a socket (7) attached to the sleeve (6) or device, and configured for receiving the device holding electronics (8), the socket comprises electrical conductive connections (9) for the connecting with device holding electronics (8), one or more sensor strips (10) arranged at the inside of the sleeve (6), the one or more sensor strips (10) being connected to the connections (9) provided in the socket (7) so as to provide a connection between the one or more sensor strips (10) and the device holding electronics (8).
27. A method for monitoring and optionally evaluating physical movements of a user, the method comprising: receiving a signal obtained by a sensor device (1) representative of a position or movement of muscles, bone(s) and/or joint(s), calculating, in said received signal, a load index value, optionally communicating to a user wearing the said sensor device (1), the load index value.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0068] The different embodiments according to the invention will now be described in more detail with regard to the accompanying figures. The figures show one way of implementing the present invention and is not to be construed as being limiting to other possible embodiments falling within the scope of the attached claim set.
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
[0075]
[0076]
[0077]
[0078]
DETAILED DESCRIPTION OF AN EMBODIMENT
[0079] Reference is made to
[0080] The system as illustrated comprises a detection unit 3 configured for receiving a signal obtained by a sensor device 1 representative of a sensed bodily activity.
[0081] Hereafter the embodiments referred to illustrates embodiments, wherein the sensor device senses a muscular activity. In other embodiments, the sensor might sense other bodily activities, such as joint position and/or bones. Furthermore, in the following embodiments muscular injuries are mentioned, but the invention also includes injuries due to strain of bodily activities, and the invention is not limited to only concern muscular injuries, but also includes strain injuries etc.
[0082] Such a detection unit may be a computer, smart phone or the like and the signal may be received via wireless communication, such as a WIFI or Bluetooth connection. The signal received is typically a time wise stream of data, where each data point represents muscular strain and/or load at a certain point in time.
[0083] The detection unit 3 is configured for calculating based on the signal obtained by the sensor device 1 over a defined time period, such as a 1 hour period, a load index (LI) value. The LI-value is based on the received signal obtained by the sensor device.
[0084] It has been shown that in the prevention of muscular injuries, an important factor to be considered is the total strain level of a muscular group. A muscular strain could be contributed by a muscular activity or a muscular load, such as flexing of the back or movement and use of the elbow. In the following muscular load, activity and strain are used interchangeable.
[0085] The defining feature of the LI-value is therefore that it is representative of the total muscular strain experience by the user. The LI-value can in one embodiment encompass a pain level factor from the user. The LI-value is based upon a measured period of the sensor signal and this period is typically around 1 hour, but can be any amount of time, such as 10 min or 3 hours, as long as the period is sufficiently long for extracting strain characteristics.
[0086] The LI-value is calculated by the detection device 1 as an identification of the muscular strain experience by the sensed muscle groups. The LI-value can go from 0 to 10, where 0 represent the lowest possibility of strain and/or short and/or long-term injury to the body and 10 the highest. The LI-value is calculated as one value over a sensed period, which will be detailed below. The sensor signal, such as an EMG signal, allows for the extraction of strain characteristics, such as sustained periods of high-level strain in the muscle based on the sensor signal.
[0087] As outlined, the detection unit 3 processes information received from a sensor device 1, and accordingly, the system may further comprise such sensor device 1. The sensor device 1 is typically configured for being attached to a part of a user for sensing muscular activity(s) in that part of the user during movement of said part and for providing a signal representative of the sensed muscular activity. Such sensor device may be a sensor measuring a mechanical response of muscle activity but other sensor types may be used in connection with the present invention, such as accelerator meter, gyro meter, near infra-red optical sensor, stretch sensor. The sensor device 1 further comprising—or is connected to—a transmitter, transmitting the sensed signal.
[0088] The signal from the sensor device 2 is to be received by the detection unit 3 and in some preferred embodiments, this data communication is handled by a communication device 2 forming part of the system. The communication device 2 is in signal communication 4 with said sensor device 1 for receiving data from the sensor device. Further, the communication device 2 may comprise detection unit 3, such as the detection unit 3 physically forms part of said communication device 2.
[0089] In another configuration of the system—see
[0090] In such embodiments, the communication device 2 is in signal communication 4 with the sensor device 1 and is configured to relay a signal received from sensor device 1 representative of a senses muscular activity to the detection unit 3, and receive from the detection unit 3, a signal signaling the value of the load index calculation.
[0091] As illustrated in
[0092] Referring to
[0093] The arrows in the flow diagram represents the direction of steps taken in the process.
[0094] In a preferred embodiment the statistical variables are chosen from the mean of the sensor signal and/or the RMS, the standard deviation (STD) of the sensor signal and/or RMS signal, the power of the sensor signal and/or RMS, the time spent in a frequency category of a the frequency categorized signal, the relative difference in the maximum amplitude of the signal compared to the baseline level, the relative power in different frequency bands and/or the peak amplitude in a given frequency interval.
[0095] If the sensor type is changed, the processing will in some circumstances change. For example, in a gyroscope sensor an orientation-processing step might be required.
[0096] In a second step the relative bodily activity level is calculated, which in this embodiment is a relative muscular activity, RMA, level. The relative muscle activity level being the ratio between the muscular strain level and the maximum voluntarily strain level, wherein the maximum voluntarily strain level represents an individual's maximum strain level under normal circumstances, where under normal circumstances is meant a user's ability to strain the muscle without outside exerted force In some embodiments, the maximum strain level is replaced by a different individual-based control variable. The important factor in the RMA-level is that it a relative value for the strain level for a specific user.
[0097] The maximum voluntary strain level is individually determined and is advantageous determined during a calibration step, undertaken during the set-up of the system. The relative muscle activity level can be expressed a percentage value.
[0098] The specific calculation of the RMA-value differs from sensor type to sensor type. In an EMG signal, which might be a sensor type used to sense muscular activity in the elbow, it is the ratio between the RMS and maximum RMS of the EMG-signal, wherein the maximum RMS-value represent the maximum voluntary strain level as described above. This normally produces a value between 0 and 100%, but can in some situations exceed 100%, such as when a muscle is torn or a bone is broken. In such a case, the value of 100% is used. The RMA can be expressed as
[0099] In a third step, the RMA-value is used to calculate the LI-value. In one embodiment, the LI is based on scientific research-based rules, which utilizes the signal obtained by the sensor device. A research-based rule is a rule based on research concerning factors leading to strain injuries. These rules are in the majority of cases independent of subjective factors, such as age, occupation etc., only being based upon strain levels.
[0100] Such research-based rules can be based on threshold rules, and can be expression for heavy load strain, high median strain, static strain and lack of rest (restitution), which is scientifically proven to lead to an injury if not corrected or treated. These research-based rules changes for the specific muscular groups and/or sensor types. The research-based rules are normally characterized in that they encompasses both a strain level requirement and a time requirement.
[0101] An example of a research-based rule could be that the RMA-value is over a specified RMA-value, such as 30% percent, for a specified amount of time, such as 10% of the signal length. A research-based rule is said to be broken when both conditions are satisfied, such that the above rule is broken if the RMA-value is over 30% for 12% of the time. A broken research-based rule is associated with an LI-value of 10 or the highest value on the scale.
[0102] Referring to
[0103] The table shown in
[0104] For example, as seen in
where T is the signal period. In
[0105] The different research-based rules are in one embodiment independent from each other, such that the highest LI-value across the different research-based rules is chosen as the final value. It is anticipated that a hierarchical system could be developed.
[0106] The research-based rules can also be further segmented into rules for healthy, previous injured and injured individuals.
[0107] Furthermore, the LI can advantageous be calculated using a trained machine-learning algorithm with/or without the research-based rules. Such a machine learning system would be trained to detect characteristics leading up to a pain report, which is not anticipated by the research-based rule, such characteristics could be repetition of movements, energy content in the time and/or frequency domain and identification of patterns leading up to a pain report. The machine-learning algorithm could be trained using user-feedback and initial data obtained by using the research-based rules, as well as the pain and strain level indications predicted by the research-based rule.
[0108] The training of the machine-learning algorithm could in an embodiment be accomplish by utilizing the research-based parameters to obtain a first indication of the relevant parameters for the training and to narrow in the training area of the machine learning algorithm. The training material can be accomplish by inter-correlating extract features from the sensor, e.g. from a Gyro Accelerometer or EMG signal, as well as user related parameters, such as e.g. age, gender, injury status etc. and pain reports reported by the users, as well as parameters in the signal representing muscular strain.
[0109] The machine learning could in an embodiment be trained using the research-based rules as a foundation for the algorithm and as the repository of pain report and associated history is expanded, the machine will shift to relying on this instead of the research-based rules. Such a transitions can be said to be going from an objective research-based training to a subjective empirically based training of the algorithm.
[0110] The strain parameters representing muscular strain comprises both parameters from the research-based rules, as well as additional parameters such as parameters identifying the energy content both in time and frequency domain and patterns leading up to a pain report—e.g. correlation with a pre-identified signal pattern.
[0111] The machine-learning would therefore be able, by using the user related parameters, strain parameters and pain report, to add new analysis dimensions to the LI-value, and in greater detail specifically tailor the LI-value to the individual user. As such, the main advantage of the machine-learning version is that the load index is more nuance and would eventually be able to take over from the research-based rules.
[0112] The machine-learning algorithm has in addition the advantage that it can intercorrelate patterns that leads to pain, by analysing the pain report submitted by the user and comparing the pain level with the sensor data in the analysis period. The machine-learning algorithm can also adjust the scale of the LI for the specific user.
[0113] The statistical variables used as parameters for the machine learning and/or research-based rules, if the sensor signal is an EMG measurement, could be chosen from the mean of the SEMG and/or the RMS, the standard deviation (STD) of the EMG and/or RMS signal, the power of the EMG and/or RMS, the time spent in a frequency category of a the frequency categorized signal, the relative difference in the maximum amplitude of the signal compared to the baseline level, the relative power in different frequency bands and/or the peak amplitude in a given frequency interval.
[0114] The LI-value can in an embodiment be continuously updated every time a specific time interval has occurred, such as every 5 min, but the time interval can be larger or smaller than this. The LI value can in an embodiment be used to give recommendations to the user. Such recommendations can be based on a single LI-value or a history of LI-values. The recommendations could be general guidelines or modified to the specific user based upon the users characteristics as provided by the user.
[0115] The invention may be characterised by being independent of professionals instructing the user, and can be used by the user without instruction, which will save time and expensive consultation. The invention is intuitive in use and does not require extra equipment as previous solutions, making it more accessible to the user, so it can be integrated into the user's everyday life. The user is therefore expected to use the invention more frequently and the use will have a more lasting effect. The invention is based on measurements of several parameters that are collected from the sensors, which are sent wirelessly to the user's smart device, where the signal is processed through algorithms to ultimately give the user feedback on, for example, a potential overload of a muscle, or feedback to corrective measure.
[0116] The invention can be implemented by means of hardware, software, firmware or any combination of these. The invention or some of the features thereof can also be implemented as software running on one or more data processors and/or digital signal processors.
[0117] Reference is now made to
[0118] Although the sensor device 1 is illustrated as being used on an arm and elbow, the same principle may and in some instances, the same device 1, may be used on different body parts. Such body parts wherein the device 1, can advantageous be used could be on the back, the neck, the knee including the kneecaps, the thigh, etc.
[0119] With reference to
[0120] By use of a socket 7, such a socket may be applied to different shaped sleeves 6, whereby different sleeves 6 may be used to accommodate the same device holding electronics 8.
[0121] In
[0122] Reverting now to
[0123] In other embodiments, the sensor is fastened to other parts of the body and measure different aspect to calculate the LI-value. As the LI-value is representative of relative load on a specific muscle group, multiple sensors and measurements techniques can be utilized. For example, if the sensor is placed on a person's back, the sensor could be of the type of a near-infrared optical sensor measuring blood oxygen saturation values and/or acidification. In such a situation the measured force used, such as when the spine is bent, can be indirectly measured by looking at the blood oxygen saturation values and/or acidification.
[0124] The position and rotation are also important in the prevention of injuries, and these can be measured by the use of accelerator meter and gyro meter sensors, and can be utilized at different positions on the body. The bending of the spine can be measured by use of a stretch sensor, measuring the arching of the back.
[0125] These parameters is also relevant for other parts of the body. The sensors might need to be adapted to the specific body part, as requirements such as position, sweat, body curvature etc. needs to be overcome. The general principle is described for the case of the elbow but the specific sleeve or sensor-holding object will change accordingly.
[0126] Now referring to
[0127] The sensor device 1 will measure the activity of the user for a defined period of time, and send the signal data to an application, which will processed the data. This data processing could be, as detailed above a RMS signal processing, restructuring of the data, compression of the signal, etc. This data can, in an embodiment, be sent to a cloud, where the LI-value will be calculated.
[0128] The calculation of the LI-value has been detailed in previous in the application but may be based on research-based rules or a machine-learning algorithm. The cloud will, in an embodiment, calculate the LI-value and transfer the LI-value back to the application. The application will, based on the LI-value or history of LI-values, produce an insight to the LI-value. This insight may include recommendations, feedback warnings and general information relating to bodily activity. The application may also collect pain reports from the user in order to produce the insight and use the pain report in the analysis of the LI-values and/or the training of the machine-learning algorithm.
[0129] The application will, based on the analysis done in the previous step, give the user specific training and guidance in order to lower the chance of strain injuries. The user will therefore have optimal information to make ergonomically behaviour modifications, thereby lowering the chance of sustaining strain injuries.
[0130] The application will therefore nudge the user away from unhealthy situations by providing suggestions on training and guidance, as well as warnings when the LI-value becomes too high and an unhealthy activity might be performed or is being performed. A user will be able to analyse their daily activity and compared these activities to the LI-values, and make appropriate adjustments so as to keep the LI-value as low as possible. This may help prevent or alleviate strain injuries.
[0131] The invention can be implemented by means of hardware, software, firmware or any combination of these. The invention or some of the features thereof can also be implemented as software running on one or more data processors and/or digital signal processors.
[0132] The individual elements of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way such as in a single unit, in a plurality of units or as part of separate functional units. The invention may be implemented in a single unit, or be both physically and functionally distributed between different units and processors.
[0133] Although the present invention has been described in connection with the specified embodiments, it should not be construed as being in any way limited to the presented examples. The scope of the present invention is to be interpreted in the light of the accompanying claim set. In the context of the claims, the terms “comprising” or “comprises” do not exclude other possible elements or steps. Also, the mentioning of references such as “a” or “an” etc. should not be construed as excluding a plurality. The use of reference signs in the claims with respect to elements indicated in the figures shall also not be construed as limiting the scope of the invention. Furthermore, individual features mentioned in different claims, may possibly be advantageously combined, and the mentioning of these features in different claims does not exclude that a combination of features is not possible and advantageous.