Wearable sports monitoring equipment and method for characterizing sports performances or sportspersons
20180360374 ยท 2018-12-20
Inventors
- Mikko Martikka (Vantaa, FI)
- Heikki Nieminen (Vantaa, FI)
- Kimmo Pernu (Vantaa, FI)
- Olli-Pekka Ojanen (Vantaa, FI)
- Erik Lindman (Vantaa, FI)
Cpc classification
A61B5/7246
HUMAN NECESSITIES
A61B5/318
HUMAN NECESSITIES
A61B5/33
HUMAN NECESSITIES
A61B5/0205
HUMAN NECESSITIES
A61B5/6898
HUMAN NECESSITIES
A61B5/7278
HUMAN NECESSITIES
A61B2562/0219
HUMAN NECESSITIES
A61B5/0245
HUMAN NECESSITIES
International classification
A61B5/00
HUMAN NECESSITIES
A61B5/0205
HUMAN NECESSITIES
Abstract
The invention concerns wearable electronic devices, systems and methods for sports performance monitoring. In one embodiment, the invention provides a device comprising a heartbeat sensor for providing a heartbeat signal, a motion sensor for providing a motion signal and processing means adapted to calculate at least one performance parameter depicting said sports performance and/or the person using temporal characteristics of periodic features of the heartbeat signal compared with temporal characteristics of periodic features in the motion signal. The invention allows for utilization of an existing relation between cadence and heart rate for characterizing the performance or the person in a novel way.
Claims
1. Wearable electronic equipment for monitoring a sports performance of a person, comprising: a heartbeat sensor for providing a heartbeat signal in response to heartbeat of the person, a motion sensor for providing a motion signal in response to movement of the person, and a processing means adapted to calculate at least one performance parameter depicting said sports performance of the person based on temporal characteristics of periodic features of the heartbeat signal compared with temporal characteristics of periodic features of the motion signal, wherein the processing means is adapted to: compute, using the heartbeat signal and motion signal, a time delay parameter depicting the delay between a response in the heartbeat signal to intensity changes in the performance, and a response in the motion signal to intensity changes in the performance, and compute said at least one performance parameter as a fatigue index, such as EPOC, and/or as a fitness index, using said time delay parameter.
2. The wearable electronic equipment according to claim 1, wherein the processing means is further adapted to: associate first time stamps with individual heartbeats detected from said heartbeat signal, and associate second time stamps with said periodic features detected from said motion signal, using said first and second time stamps to detect and/or estimate a heartbeat frequency at which the temporal difference in the periodicities of the heartbeat signal and said motion signal remain essentially constant over a plurality of periods of the signals, and calculating a performance parameter based on said detected and/or estimated heartbeat frequency.
3. The wearable electronic equipment according to claim 2, wherein the processing means is further adapted to detect and/or estimate, using said first and second time stamps, a heartbeat frequency at which the temporal difference between the individual heart beats and temporally related individual movements remains essentially constant over a plurality of periods of the signals.
4. The wearable electronic equipment according to claim 1, wherein the processing means is further adapted to calculate a Fourier transformation of the heartbeat and motion signals, and to compare characteristics of the signals in a frequency domain in order to calculate said performance parameter.
5. The wearable electronic equipment according claim 1, wherein the processing means are adapted to compute said at least one performance parameter as a fatigue index using the magnitude of said time delay parameter and/or by observing changes in the time delay parameter during the performance.
6. The wearable electronic equipment according to claim 5, wherein the processing means is further adapted to determine a first value of said time delay parameter when the person is at rest and a second value of said time delay parameter during a performance, and to compute said at least one performance parameter using a mathematical function dependent on said first value and said second value.
7. The wearable electronic equipment according to claim 1, wherein the processing means is further adapted to read a predetermined time delay parameter and/or a behavior model of such a time delay parameter, and to compute said at least one performance parameter as a fitness index, using the heartbeat signal, the motion signal and the time delay parameter.
8. The wearable electronic equipment according to claim 1, further comprising an electric heart rate module integral with or functionally connectable with a heart rate belt or a smart garment having integral heart rate measurement electrodes so as to form said heartbeat sensor, said electronic heart rate module including said motion sensor.
9. The wearable electronic equipment according to claim 1, wherein the electric heart rate module further comprises said processing means.
10. The wearable electronic equipment according to claim 1, further comprising a wristop computer or mobile phone capable of wireless communication with an electric heart rate module for receiving at least said heartbeat signal, motion signal or data processed in such a heart rate module.
11. The wearable electronic equipment according to claim 1, further comprising: at least one displayless electric heart rate module integral with or functionally connectable with a heart rate belt or a smart garment having integral heart rate measurement electrodes so as to form said heartbeat sensor, and the module comprising said motion sensor and at least part of said processing means, and at least one wristop computer or mobile handheld device capable of wireless communication with the electric heart rate module and being provided with a display for visualizing said performance parameter.
12. The wearable electronic equipment according to claim 1, wherein said heartbeat sensor comprises an electrical ECG sensor, an optical sensor, a pressure sensor or an acceleration sensor.
13. A method for monitoring a sports performance of a person, comprising the steps of: measuring the person's heartbeat using a wearable heartbeat sensor for providing a heartbeat signal, measuring movement of the person using a wearable motion sensor for providing an motion signal, and in one or more computing units functionally connected to the wearable heartbeat sensor and the wearable motion sensor: detecting periodic features in the heartbeat signal and in the motion signal, determining temporal correlation of the periodic features of the heartbeat signal and the motion signal, and calculating at least one performance parameter based at least partly on said temporal correlation, wherein the at least one performance parameter comprises a fatigue and/or a fitness index determined by: computing, using the heartbeat signal and motion signal, a time delay parameter depicting the delay between a response in the heartbeat signal to intensity changes during the performance, and a response in the motion signal to intensity changes during the performance, and computing said fatigue and/or a fitness index using the time delay parameter.
14. The method according to claim 13, wherein the at least one performance parameter comprises a fatigue index determined by computing said fatigue index using the magnitude of the time delay parameter and/or by observing changes in the time delay parameter during the performance.
15. The method according to claim 14, further comprising: determining a first value of said time delay parameter when the person is at rest and a second value of said time delay parameter during a performance, and computing said fatigue index using a mathematical function dependent on said first value and said second value.
16. The method according to claim 13, wherein the at least one performance parameter includes a fitness index determined by providing a predetermined time delay parameter and/or a behavior model of such time delay parameter, and by computing the fitness index using the temporal correlation of the heartbeat signal and motion signal, and the time delay parameter.
17. The method according to claim 16, wherein the user is at a fully rested state at the beginning of the performance.
18. A non-transitory computer readable medium comprising computer-executable instructions for carrying out a method for monitoring a sports performance of a person, the method comprising the steps of: measuring the person's heartbeat using a wearable heartbeat sensor for providing a heartbeat signal, measuring movement of the person using a wearable motion sensor for providing an motion signal, and in one or more computing units functionally connected to the wearable heartbeat sensor and the wearable motion sensor, detecting periodic features in the heartbeat signal and in the motion signal, determining temporal correlation of the periodic features of the heartbeat signal and the motion signal, and calculating at least one performance parameter based at least partly on said temporal correlation, wherein the at least one performance parameter comprises a fatigue and/or a fitness index determined by: computing, using the heartbeat signal and motion signal, a time delay parameter depicting the delay between a response in the heartbeat signal to intensity changes during the performance, and a response in the motion signal to intensity changes during the performance, and computing said fatigue and/or a fitness index using the time delay parameter.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
DETAILED DESCRIPTION OF EMBODIMENTS
[0058]
[0059] According to one embodiment, the present invention takes advantage of this relation by calculating at least one correlation factor dependent on temporal characteristics of periodic features of the heartbeat signal (heartbeats) compared with temporal characteristics of periodic features in the acceleration signal (e.g. steps, revolutions). Mutual temporal comparison of the characteristic features in this way is used to calculate at least one performance parameter depicting intensity of said sports performance and/or fitness level of the person.
[0060]
[0061] Instead of peaks, the detection can be based on some other characteristic features of the signals, depending on the intended use. In particular, for the acceleration signal, different detection algorithms may be necessary for different sports and/or different location of the acceleration sensor, in order to obtain the cadence in a reliable way.
[0062] Taking the deduction made above with reference to
[0063] The performance parameter can in particular comprise anaerobic heart rate threshold level of the person determined by detecting or estimating the heart rate level at which the heart rate and stepping frequency are equal or the heart rate is a multiple of stepping frequency. In running, this means the condition that cadence multiplied by two equals the heart rate is satisfied. The parameter may also comprise deviation from anaerobic heart rate threshold level determined by detecting or estimating the heart rate level at which the periodicities of the heart rate and the acceleration are equal and determining the difference between the present heart rate level and the anaerobic heart rate threshold level determined. The outcome may also be a derivative of threshold level or deviation therefrom, i.e. another quantity calculated at least partly using the estimated threshold level or deviation.
[0064] The performance parameter can also comprise maximum step length or maximum speed in the aerobic range. In this embodiment, the step length of the person is determined using suitable means (e.g. acceleration-based foot pod measurement, combined acceleration and GPS measurements or user-given parameter). Then, the maximum speed v.sub.anaer that the person is able to maintain for a long period equals 2*cadence*step_length. This can further be used to calculate back the maximum step length or to estimate maximum oxygen intake and further fitness level of the person. For example maximum oxygen intake VO.sub.2,max is obtained using the formula A*v.sub.anaer+B, where A and B are predetermined constants. Then using VO.sub.2,max and the age and sex of the person, one can robustly estimate the fitness level of the person among a population with methods known per se.
[0065] According to one embodiment, the maximum step length or maximum speed in the aerobic range and/or anaerobic threshold heart rate are used as scaling factors in heart rate based energy consumption determination. Thus, the equipment can self-calibrate its energy consumption determination based on the fitness-related data obtained by means of the invention. These scaling factors can be used not only in characterizing running, but also other sports, after being determined on the basis of a running performance.
[0066]
[0067] Heart rate of a person typically follows changes in the intensity of physical performance with a delay. Therefore, performances that contain a lot of physical intensity changes are challenging as concerns heart rate and physical parameter comparisons.
[0068] As a more detailed example,
where P.sub.movement is the power estimate based on physical movement data, P.sub.hr is power estimate based on heart rate signal, and ?.sub.hr is the parameter describing the time delay between heart rate response and physical movement based intensity change. Changes in ?.sub.hr, relative to resting condition ?.sub.hr.sub._.sub.rest, correlate with real time EPOC. Therefore ?.sub.hr describes person's fatigue level in real time, without any need for prior exercise history data. Function
EPOC=f(?.sub.hr, ?.sub.hr.sub._.sub.rest)
that is used for EPOC calculation, can be for instance partial linear model that is formed based on test database data. The process of
[0069] In more detail,
[0070] Power that person produces can be also calculated from heart rate data. However, since the heart rate adjusts with delay to intensity level changes, this delay must be taken into account in the system. Part 1026 of the system and especially time constant tau ?.sub.hr in function 1028 presents models the delay properties of the human heart relative to motion based data. In this particular implementation of the system model there are two variables that can be allowed to change, fitness index in function 1030 and time constant tau ?.sub.hr in function 1028. The system model can change these values in order to make the heart rate power equal to motion power. When there are small changes in motion power, that is in sport intensity level, then the system model adjusts more strongly the fitness index so that the heart rate and motion based powers are equal. Thus, the system determines the user's fitness index. On the other hand, when there are a lot of intensity changes, fitness index is changed less and the system model adjusts more the time constant tau ?.sub.hr. As described earlier, changes in time constant tau ?.sub.hr during the performance give the fatigue level and thus EPOC of the user.
[0071] In some cases the value and behavior of time constant tau ?.sub.hr is known, for instance when user is fully rested prior to the performance and has done an orthostatic heart rate test. Then the fitness index of the user can be calculated accurately and quickly even in activities where the intensity changes a lot, for instance in hockey, soccer, badminton, tennis, floor ball, etc.
[0072]
[0073] Alternatively to a heart rate belt 210, a smart garment 230 can be used, providing the same functionality as the heart rate belt 210 discussed above.
[0074] In a still further embodiment, there is provided an additional unit in the system, such as a sensor unit attached to a shoe 240 of the sportsman. The additional sensor unit may comprise an acceleration sensor providing the acceleration signal and is in wireless communication with the heart rate belt 210 or smart garment 230 and/or the wristop computer 220 to provide the acceleration signal or data derived therefrom for further processing or use.
[0075] It should be noted that the wristop computer can be replaced with any other wearable device, such as another wearable sports tracking unit or mobile phone capable of communicating with other components of the system.
[0076] Wireless communication of data between separate devices of a multi-device equipment takes place advantage of a wireless radio-frequency transmitter-receiver or transceiver-transceiver pair. The wireless communication protocol can be one used for communication between computers, and/or between any remote sensors, such as a Bluetooth LE or the proprietary ANT+ protocol. These are using direct-sequence spread spectrum (DSSS) modulation techniques and an adaptive isochronous network configuration, respectively. Enabling descriptions of necessary hardware for various implementations for wireless links are available e.g. from the Texas Instrument?'s handbook Wireless Connectivity which includes IC circuits and related hardware configurations for protocols working in sub-1- and 2.4-GHz frequency bands, such as ANT?, Bluetooth?, Bluetooth? low energy, RFID/NFC, PurePath? Wireless audio, ZigBee?, IEEE 802.15.4, ZigBee RF4CE, 6LoWPAN, Wi-Fi?.
[0077]
[0078] The processing unit 522A is configured to analyze the heartbeat data (heart beat pulses, time stamps or heart rate) received from the heart rate belt 510 and acceleration data from the acceleration sensor 528 to find their temporal correlation, for example using one of the methods described above in more detail. The processing unit 522A also calculates the desired performance parameter using the correlation information.
[0079] The processing unit 522A may also be configured to execute software for determining the type of sports based on the acceleration signal and for determining energy consumption using an algorithm and source(s) of information (ECG and/or acceleration) depending on the sports type determined. Alternatively or in addition to automatic sports type determination, the processing unit may be configured to read a stored sports type parameter, typically given by the user or previously automatically determined, from a memory (not shown) of the device and to use that for selecting an appropriate algorithm and source(s) of information. Exemplary methods for automatic sports type determination are described elsewhere in this document.
[0080]
[0081]
[0082] According to one embodiment particularly suitable for monitoring running or cycling performances, speed and/or cadence length information is additionally utilized to determine the performance parameter. This option is illustrated with dashed in
[0083] According to one embodiment, the computing means is programmed to estimate energy consumption of the person during the performance using the heartbeat and/or motion signals. In particular, the equipment may comprise means for determining the type of the sports performance and the computing means for calculating the energy consumption parameter are adapted to utilize the heartbeat signal, the motion signal or both signals in combination in different manner depending on the type of the sports performance determined. The type of the sports performance can be determined either manually by the user but even more advantageously automatically.
[0084] According to one preferred embodiment, the device is capable of distinguishing the sports based on physical rhythmicity, i.e. similarity and temporal stability of successive similar movements, required in particular sports. For example, street or track running is physically very rhythmic sports, i.e. involves a stabile cadence, whereas tennis is more impulsive and irregular. The proposed solution can robustly distinguish between these kinds of sports and apply a corresponding algorithm for calculating energy consumption, which utilize at least partly different sources of information. Energy consumption of running may be better characterized by cadence and tennis by heart rate characteristics. Automatic type determination based on the stability of cadence is also capable of distinguishing between street or track running and cross county running or orienteering, which involve kinematically and/or temporally more versatile motion and in which energy consumption is usually better characterized by heart rate.
[0085] According to one embodiment, there are provided means for receiving and storing a user-specified sports performance type parameter in a memory of the equipment. This is called manual type determination. In addition, the means for determining the type of the sports performance are adapted to read said user-specified sports performance type parameter from said memory in order to determine the type of the sports performance. The means for receiving and storing may comprise user interface means and associated software and hardware means in a wristop computer or mobile phone part of the present system. If necessary, the performance type parameter can be communicated to a heart rate belt or some other unit where energy consumption calculations are carried out.
[0086] According to one embodiment, the means for determining the type of the sports performance are adapted to determine the type of the sports performance automatically based on characteristics, in particular rhythmicity, of the motion signal. According to a further embodiment, this is implemented such that the means for determining the type of the sports performance are adapted to calculate a parameter depicting rhythmicity of the performance based on the motion signal and the device is adapted to use that parameter for determining the type. In one approach, the means for calculating the energy consumption parameter are adapted to utilize only the ECG signal in calculations if the rhythmicity of the performance is below a predefined level and only the motion signal if the rhythmicity of the performance is above the predefined level. Thus, rhythmic sports are characterized by the acceleration data, for example and irregular sports by the heart rate data, allowing for more accurate estimations for energy consumption.
[0087] According to one option, the means for determining the type of the sports performance are adapted to determine rhythmicity of the motion signal by detecting repeating features in the motion signal, associating time stamps to the repeating features, and calculating correlation between intervals between successive time stamps, preferably at all sensor axes. Correlation value per axis forms characterization vector that is utilized to differentiate between types of sports. Such correlation analysis can be implemented in a wearable device efficiently in the time domain.
[0088] In an alternative option, the means for determining the type of the sports performance are adapted to apply Fourier analysis on the motion signal to determine rhythmicity of the motion signal. Discrete Fourier analysis can also be relatively efficiently implemented in small devices.
[0089]
[0090] The dashed lines in
[0091] According to one embodiment, for determining the type of sports, the motion signal is analyzed so as to detect cyclic, i.e. regular, motion characteristic to a cyclic sports, such as running, in it. Rhythmicity can be determined in the time domain for example by time stamping impulses detected in the signal using correlation analysis to determine whether the inter-impulse interval remains constant (to a predefined degree) over time, which would be indicative of a performance of regular nature. If the correlation between intervals is low, the performance is irregular. In an alternative embodiment, the motion based sensor signal is converted to frequency domain using a discrete Fourier transformation, and the presence of strong (peaked) frequency components is detected. There is a peak in the frequency data if a lot of cyclic motion takes place at constant frequency over a chosen time interval. The rhythmicity determination may be carried out continuously or repeated at predefined intervals during the performance so that the energy consumption algorithm can be changed, if the type of sports changes. This can occur for example if the user carries out gymnastic exercises every now and then during a jog.
[0092] As concerns the energy consumption part, the determination of the type of sports can have more than two outcomes (not just between rhythmic and irregular), and there may be more than two algorithms corresponding to these outcomes implemented.
[0093] According to one embodiment, it is determined if the user has specified a particular sports type manually (and wishes that to be used as a basis for algorithm selection). In the affirmative, the algorithm is chosen accordingly without automatic determination. In the negative, automatic type determination is initiated, as described above.
[0094] The rhythmicity analysis should be carried out over a time period of significant length, so that random and occasional variations in the frequency of motion or measurement errors do not result in a wrong outcome. If the rhythmicity stays relatively constant over the period chosen, a first algorithm is chosen for further calculations and on the opposite case a second algorithm is chosen.
[0095] In a still further embodiment, the computing unit is programmed to filter out movement-induced components of the heartbeat signal based on the motion signal for providing a filtered heartbeat signal and to use to filtered signal for deriving the performance parameter. This embodiment solves the problem of generation of movement-induced repeating errors in the heartbeat signal. In particular at the beginning of a performance, when the measurement electrodes of the measurement device and also the skin is dry, variations in the contact pressure between the electrodes and the skin due to cadence result in measurement artifacts. For the same reason, also static electricity may accumulate close to the electrodes and cause undesired peaks in the signal measured.
[0096]
[0097] According to one embodiment, the computing unit is programmed to filter out frequency components from the heartbeat signal that are common to the motion signal and the heartbeat signal. Preferably, this is carried out in the frequency domain by computing a Fourier transform of the heartbeat signal and a Fourier transform of the motion signal and suppressing frequency components of the muscular activity signal that correspond to some or all of the frequency components of the motion signal.
[0098] Preferably, the heartbeat sensor and the motion sensor are located in the same device unit, such as a heart rate belt or smart garment. This ensures that the motion signal corresponds to actual movement of the heartbeat sensor. It is however possible that the sensors are located in different device units potentially located on different body parts, because their rhythmic movements are typically not independent and therefore sufficient information for removing rhythmic artifacts can be obtained.
[0099]
[0100] The steps of the
[0101] It is to be understood that the embodiments of the invention disclosed are not limited to the particular process steps, units, components, devices, materials or products disclosed herein, but are extended to equivalents thereof as would be recognized by those ordinarily skilled in the relevant arts. It should also be understood that terminology employed herein is used for the purpose of describing particular embodiments only and is not intended to be limiting.
[0102] Reference throughout this specification to one embodiment or an embodiment means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases in one embodiment or in an embodiment in various places throughout this specification are not necessarily all referring to the same embodiment.
[0103] As used herein, various embodiments and examples of the present invention may be referred to herein along with alternatives for the various components thereof. It is understood that such embodiments, examples, and alternatives are not to be construed as de facto equivalents of one another, but are to be considered as separate and autonomous representations of the present invention.
[0104] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the description, numerous specific details are provided, such as examples of shapes and dimensions etc., to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the invention.
[0105] While the forgoing examples are illustrative of the principles of the present invention in one or more particular applications, it will be apparent to those of ordinary skill in the art that numerous modifications in form, usage and details of implementation can be made without the exercise of inventive faculty, and without departing from the principles and concepts of the invention. Accordingly, it is not intended that the invention be limited, except as by the claims set forth below.