System and method for detecting steps with double validation
11598649 · 2023-03-07
Assignee
Inventors
Cpc classification
G06V40/25
PHYSICS
A61B5/721
HUMAN NECESSITIES
International classification
G01C22/00
PHYSICS
A61B5/11
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
Abstract
A system for detecting steps of a user includes processing circuitry and a sensor configured to detect a variation of electrostatic charge of the user during a step of the user and generate a charge-variation signal. An accelerometer is configured to detect an acceleration as a consequence of the step and generate an acceleration signal. The processing circuitry is configured to: acquire the charge-variation signal; acquire the acceleration signal; detect, in the charge-variation signal, a first characteristic identifying the step; detect, in the acceleration signal, a second characteristic identifying the step. If both of the first and second characteristics have been detected, the presence of the step can be validated.
Claims
1. A system for detecting a step of a user, comprising: processing circuitry; a sensor coupled to the processing circuitry and configured to detect a variation of electrostatic charge of the user during execution of a step by the user and generate a charge-variation signal; and an accelerometer coupled to the processing circuitry and configured to detect an acceleration as a consequence of the step of the user and generate an acceleration signal, wherein the processing circuitry is configured to: acquire the charge-variation signal; acquire the acceleration signal; detect, in the charge-variation signal, a first charge-variation characteristic identifying the step of the user; detect, in the acceleration signal, a second acceleration signal characteristic identifying the step of the user, wherein one of the first characteristic and the second characteristic is detected prior to detecting the other of the first characteristic and the second characteristic, and the other of the first characteristic and second characteristics is detected only in a case where the one of the first characteristic and the second characteristic has been detected; and validate the execution of the step by the user in response to detecting both the first and the second characteristics.
2. The system according to claim 1, wherein the processing circuitry is configured to detect the first charge-variation characteristic prior to detecting the second acceleration signal characteristic, and the processing circuitry is configured to detect the second acceleration signal characteristic only in a case where the first charge-variation characteristic has been detected.
3. The system according to claim 1, wherein the processing circuitry is configured to detect the second acceleration signal characteristic prior to detecting the first charge-variation characteristic, and the processing circuitry is configured to detect the first charge-variation characteristic only in the case where the second acceleration signal characteristic has been detected.
4. The system according to claim 1, wherein the processing circuitry is configured to process the acceleration signal or the charge-variation signal using machine-learning or artificial-intelligence algorithms for identifying a type of step, the type of step including at least one of: a step forward, a step backward, a step up, a step down, or a sound of a footstep on the ground in the absence of displacement of the user.
5. The system according to claim 1, wherein the detecting the first charge-variation characteristic includes at least one of: detecting a peak of the charge-variation signal that exceeds a fixed threshold; detecting a peak of the charge-variation signal that exceeds an adaptive threshold; or detecting specific patterns of the charge-variation signal by machine-learning or artificial-intelligence algorithms.
6. The system according to claim 5, wherein the detecting a peak of the charge-variation signal that exceeds an adaptive threshold includes: calculating a mean value assumed by the charge-variation signal in a time interval; calculating a coefficient of standard deviation of the charge-variation signal in the time interval; and adding the mean value to a multiple of the coefficient of standard deviation.
7. The system according to claim 1, wherein the detecting the second acceleration signal characteristic includes at least one of: detecting a peak of the acceleration signal that exceeds a fixed threshold; detecting a peak of the acceleration signal that exceeds an adaptive threshold; or executing a frequency analysis of the acceleration signal.
8. The system according to claim 1, wherein the sensor is configured to be worn by the user in direct electrical contact with a body portion of the user and includes an instrumentation amplifier and an analog-to-digital converter coupled at an output of the instrumentation amplifier.
9. The system according to claim 1, configured to be worn by the user.
10. The system according to claim 1, wherein the validating the execution of the step by the user includes incrementing a counter of a number of steps made by the user.
11. The portable electronic device of claim 1, comprising at least one of: a pedometer, a smartwatch, or a smartphone.
12. A method for detecting a step of a user, comprising: supplying a charge-variation signal by a sensor configured to detect a variation of electrostatic charge of the user during the execution of a step by the user; supplying an acceleration signal by an accelerometer coupled to processing circuitry and configured to detect an acceleration as a consequence of the step of the user; detecting, in the charge-variation signal, a first charge-variation characteristic identifying the step of the user; detecting, in the acceleration signal, a second acceleration signal characteristic identifying the step of the user, wherein one of the first characteristic and the second characteristic is detected prior to detecting the other of the first characteristic and the second characteristic, and the other of the first characteristic and second characteristics is detected only in a case where the one of the first characteristic and the second characteristic has been detected; and validating the execution of the step by the user in response to detecting both of the first and second characteristics.
13. The method according to claim 12, wherein the detecting the first charge-variation characteristic is executed prior to the detecting the second acceleration signal characteristic, and the detecting the second acceleration signal characteristic is executed only in the case where the first charge-variation characteristic has been detected.
14. The method according to claim 12, wherein the detecting the second acceleration signal characteristic is executed prior to the detecting the first charge-variation characteristic, and the detecting the first charge-variation characteristic is executed only in the case where the second acceleration signal characteristic has been detected.
15. The method according to claim 12, comprising: processing the acceleration signal or the charge-variation signal by machine-learning or artificial-intelligence algorithms for identifying a type of step, the type of step including at least one of: a step forward, a step backward, a step up, a step down, or a sound of a footstep on the ground in the absence of displacement of the user.
16. The method according to claim 12, wherein the detecting the first charge-variation characteristic includes at least one of: detecting a peak of the charge-variation signal that exceeds a fixed threshold; detecting a peak of the charge-variation signal that exceeds an adaptive threshold; or detecting specific patterns of the charge-variation signal by machine-learning or artificial-intelligence algorithms.
17. The method according to claim 16, wherein the detecting a peak of the charge-variation signal that exceeds an adaptive threshold comprises: calculating a mean value assumed by the charge-variation signal in a time interval; calculating a coefficient of standard deviation of the charge-variation signal in the time interval; and adding the mean value to a multiple of the coefficient of standard deviation.
18. The method according to claim 12, wherein the detecting the second acceleration signal characteristic includes at least one of: detecting a peak of the acceleration signal that exceeds a fixed threshold; detecting a peak of the acceleration signal that exceeds an adaptive threshold; or executing a frequency analysis of the acceleration signal.
19. The method according to claim 12, wherein the validating the execution of the step by the user includes incrementing a counter of a number of steps made by the user.
20. A device, comprising: a memory; and processing circuitry coupled to the memory, wherein the processing circuitry, in operation: detects, in a charge-variation signal, a first charge-variation characteristic identifying a user-step; detects, in an acceleration signal, a second acceleration signal characteristic identifying the user-step, wherein one of the first characteristic and the second characteristic is detected prior to detecting the other of the first characteristic and the second characteristic, and the other of the first characteristic and second characteristics is detected only in a case where the one of the first characteristic and the second characteristic has been detected; and in response to detecting both the first and the second characteristics, detects the user-step.
21. The device according to claim 20, wherein the processing circuitry, in operation, detects the first charge-variation characteristic prior to detecting the second acceleration signal characteristic.
22. The device according to claim 20, wherein the processing circuitry, in operation, detects the second acceleration signal characteristic prior to detecting the first charge-variation characteristic.
23. The device according to claim 20, wherein the processing circuitry, in operation, in response to detecting a step, identifies a type of step.
24. The device according to claim 20, wherein the processing circuitry, in operation, counts a number of detected steps.
25. The device according to claim 20, comprising one or more sensors coupled to the processing circuitry, wherein the one or more sensors, in operation, generate the charge-variation signal and the acceleration signal.
26. A non-transitory computer-readable medium having contents which cause a processing device to perform a method, the method comprising: detecting, in a charge-variation signal, a first charge-variation characteristic identifying a user-step; detecting, in an acceleration signal, a second acceleration signal characteristic identifying the user-step, wherein one of the first characteristic and the second characteristic is detected prior to detecting the other of the first characteristic and the second characteristic, and the other of the first characteristic and second characteristics is detected only in a case where the one of the first characteristic and the second characteristic has been detected; and in response to detecting both the first and the second characteristics, detecting the user-step.
27. The non-transitory computer-readable medium of claim 26, wherein the contents comprise instructions executed by the processing device.
28. The non-transitory computer-readable medium of claim 26, wherein the method comprises counting a number of detected steps.
29. The non-transitory computer-readable medium of claim 26, wherein the method comprises generating the charge-variation signal and the acceleration signal.
Description
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
(1) For a better understanding of the disclosure, embodiments thereof are now described purely by way of non-limiting example and with reference to the attached drawings, wherein:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
DETAILED DESCRIPTION
(10)
(11) The accelerometer 4 is configured, in a per se known manner, for detecting at least a component of acceleration along a vertical acceleration axis (axis Z, i.e., parallel to the direction of the force of gravity vector).
(12) The processing unit 2 receives an acceleration signal S.sub.A from the accelerometer 4 and a charge-variation signal S.sub.Q from the sensor 6 for detecting variation of electrostatic charge and generates, as a function of the acceleration signal S.sub.A and of the charge-variation signal S.sub.Q, the number of steps N.sub.S of a user (not illustrated).
(13) The accelerometer 4 is preferably a triaxial accelerometer, i.e., adapted to detect the acceleration along three mutually orthogonal directions X, Y, Z. The accelerometer 4 is, for example, an integrated sensor of semiconductor material, provided in MEMS technology, of a type in itself known and for this reason not described in detail. In use, according to one embodiment, the accelerometer 4 detects the component along the sensing axis Z of the vertical acceleration generated when the step is made, and produces a corresponding acceleration signal S.sub.A (
(14) The processing unit 2 is, for example, a microcontroller or an MLC (Machine-Learning Core) residing in the ASIC (Application-Specific Integrated Circuit) integrated in the MEMS.
(15) The step-detection system 1 is formed, for example, in integrated form on a same printed-circuit board, or in integrated form within a MEMS device that houses it. In fact, it is possible to envisage a device that several sensors (“combo”), in addition to the three axes X, Y, Z of the accelerometer 4, dedicated channels may also exist for other detections (made, for example, by a gyroscope, a temperature sensor, etc.), including the sensor for detecting variation of electrostatic charge and consequently.
(16) The step-detection system 1 forms, in one embodiment (
(17)
(18) The pair of input electrodes 8a, 8b represents the differential input of an instrumentation amplifier 12 and, in use, receives an input voltage Vd.
(19) The instrumentation amplifier 12 is basically constituted by two operational amplifiers OP1 and OP2. A biasing stage (buffer) OP3 is used for biasing the instrumentation amplifier 12 at a common-mode voltage VCM.
(20) The inverting terminals of the operational amplifiers OP1 and OP2 are connected together by a resistor R.sub.2. Since the two inputs of each operational amplifier OP1, OP2 should be at the same potential, the input voltage Vd is applied also the ends of R.sub.2 and causes, through this resistor R.sub.2, a current equal to I.sub.2=Vd/R.sub.2. This current I.sub.2 does not come from the input terminals of the operational amplifiers OP1, OP2 and therefore traverses the two resistors R.sub.1 connected between the outputs of the operational amplifiers OP1, OP2, in series to the resistor R.sub.2. Therefore, the current I.sub.2, by traversing the series of the three resistors R.sub.1−R.sub.2−R.sub.1, produces an output voltage Vd′ given by Vd′=I.sub.2(2R.sub.1+R.sub.2)=Vd(1+2R.sub.1/R.sub.2). Consequently, the total gain of the circuit of
(21) The differential output Vd′, which is therefore proportional to the potential Vd between the input electrodes 8a, 8b, is supplied at input to an analog-to-digital converter 14, which supplies at output the charge-variation signal S.sub.Q to be sent the processing unit 2. The charge-variation signal S.sub.Q is, for example, a high-resolution (16-bit or 24-bit) digital stream. The analog-to-digital converter 14 is optional in so far as the processing unit 2 can be configured to work directly on the analog signal or can itself comprise an analog-to-digital converter adapted to convert the signal Vd′.
(22)
(23) As better illustrated hereinafter, the peaks p1-p7 are identified as the components of the charge-variation signal S.sub.Q that overstep a threshold Th.sub.Q.
(24) The signal S.sub.A, at output from the accelerometer 4, is represented by way of example in
(25) Detection of the step is moreover described more fully hereinafter, with reference to step 110 of
(26)
(27) With reference to steps 100 and 101, the processing unit receives, from the sensor 6 for detecting variation of electrostatic charge and from the accelerometer 4, the charge-variation signal S.sub.Q and the acceleration signal S.sub.A, respectively. The steps 100 and 101 can be indifferently executed in parallel (simultaneously), or at successive instants in time.
(28) Then, steps 104 and 105, the processing unit 2 carries out respective buffering operations on the signals S.sub.Q and S.sub.A received (saving of the data in a local memory) and filtering (e.g., by a Kalman filter). In particular, filtering has the function of recleaning the signals S.sub.Q and S.sub.A from noise or from components of disturbance at non-significant frequencies (e.g., the mains-supply at 50 Hz or 60 Hz), for example by using low-pass filters. The filters used are configured as a function of the signal to be processed. For instance, step 104 comprises filtering signal components S.sub.Q below 50 Hz; step 105 (optional) comprises filtering, by a low-pass filter (more in particular, with a cutoff frequency of 100 Hz), low-frequency components of the signal S.sub.A. In fact, in order to determine execution of the step slowly variable signals are preferable, e.g., of just a few tens of hertz. The signals at higher frequencies are of little significance or may render processing problematical.
(29) Then, step 108, the components of the charge-variation signal S.sub.Q that identify execution of a step by the user are extracted.
(30) For this purpose, the threshold Th.sub.Q (
(31) The threshold Th.sub.Q is, in one embodiment, a threshold of a fixed and pre-set type.
(32) In a further embodiment, the threshold Th.sub.Q is of an adaptive type; i.e., it varies as a function of the plot of the charge-variation signal S.sub.Q. Calculation of the threshold Th.sub.Q of an adaptive type may be conducted by exploiting techniques known in the art. For instance, it is possible to use sliding windows or overlapping windows. Other techniques for real-time calculation of adaptive threshold may be used.
(33) In an embodiment provided by way of example, the threshold Th.sub.Q is chosen as the mean of the signal S.sub.Q (in the window considered) plus a multiple of the standard deviation of the signal S.sub.Q (in the window considered): Th.sub.Q=mean(S.sub.Q)+n stddev(S.sub.Q), where n is chosen in the range between 2 and 6, for example 4 (where the term “mean” is used to refer to the operation of calculating the arithmetical mean and “stddev” refers to the operation of calculating the standard deviation).
(34) The time window is, for example, chosen from an appropriate value. Said value depends upon the type of application; the present applicant has found that values compatible with processing on a microcontroller (i.e., taking into account the buffers, the memory used, and the computational resources) range from 2 to 10 s.
(35) In step 108, the signal S.sub.A of the accelerometer 4 is not acquired by the processing unit or, in the case where it was acquired, is not processed for detecting execution of a step or for detecting walking. In other words, during the step 108, identification of the step is made only on the basis of the charge-variation signal S.sub.Q.
(36) If at least one step is detected in the charge-variation signal S.sub.Q, then step 110 is carried out (arrow 108a at output from block 108); vice versa (arrow 108b at output from block 108), the steps of acquisition of the signals S.sub.Q and S.sub.A, storage thereof, conversion into the digital domain and processing of the charge-variation signal S.sub.Q for detecting the step, are repeated. Overstepping of the threshold Th.sub.Q by the charge-variation signal S.sub.Q therefore generates a corresponding trigger signal for starting processing of the acceleration signal S.sub.A.
(37) With reference to step 110, the acceleration signal S.sub.A is processed to confirm the presence of the step identified in step 108 on the basis of the signal S.sub.Q. Processing of the acceleration signal S.sub.A is executed only when the analysis of the charge-variation signal S.sub.Q at step 108 has yielded positive outcome, i.e., it has identified the presence of at least one step. Vice versa, in the case where the charge-variation signal S.sub.Q is below the threshold Th.sub.Q, step 110 is not executed.
(38) Since the charge-variation signal S.sub.Q could be generated and/or received by the processing unit 2 with a certain delay with respect to the signal of the accelerometer (e.g., with a delay of tens or hundreds of milliseconds), according to one aspect of the present disclosure, the processing unit 2 acquires and processes samples of the acceleration signal S.sub.A starting from an instant that precedes overstepping of the threshold Th.sub.Q by the charge-variation signal S.sub.Q. This is possible owing to the fact that, as has been said, the acceleration signal S.sub.A is stored (buffered) in a memory in step 105. In particular, the acceleration signal S.sub.A is processed starting from some tens (10-100 ms) or hundreds (100-800 ms) of milliseconds prior to the instant of detection of overstepping threshold Th.sub.Q by the charge-variation signal S.sub.Q.
(39) Processing of the acceleration signal S.sub.A to identify the step is carried out according to the prior art, for example as described in the patent Nos. EP1770368 or EP1770369.
(40) With reference to
(41) As an alternative to what has been previously described (with a constant comparison threshold Th.sub.A), it is likewise possible to use a comparison threshold of an adaptive type (for example, a moving-average threshold), as described in the patent application No. US2013/0085711 or in the patent No. EP1770368. For instance, the moving-average threshold adjusts the comparison threshold on the basis of the average of the acceleration detected.
(42) Moreover, as an alternative to the foregoing embodiments, it is likewise possible to perform a frequency analysis, (e.g., by the Fast Fourier Transform, FFT), and apply a threshold in order to detect the frequency components of the signal S.sub.A that exceed said threshold. These components therefore identify execution of a step. An example is illustrated in the patent application No. US2013/0085700. Frequency analysis can be performed on the data of the accelerometer in order to determine, optionally, a dominant frequency usable to select the frequency band of a band-pass filter used for filtering the signal. For instance, if it is found that the dominant frequency is 2 Hz, it is possible to select a filter with a frequency band of 1.5-2.5 Hz to filter the signal. Filtering makes it possible to render the data uniform, for a better analysis and detection of the steps.
(43) Then, step 112 of
(44)
(45) In particular, blocks 100, 101, 104 and 105 are in common with the embodiments of
(46) However, according to the embodiment of
(47) When said processing confirms that a step has been made by the user, then (output 201a) control passes to block 202, where the charge-variation signal S.sub.Q is acquired and processed. Processing of the charge-variation signal S.sub.Q occurs according to what has already been described with reference to block 108 and to
(48) Only if also processing of the charge-variation signal S.sub.Q confirms that a step has been made, does control pass to block 112, where detection of the step is confirmed and the step is counted. Otherwise (output 201b), the step is not confirmed/counted, and the signals S.sub.A and S.sub.Q are again acquired, so that steps of blocks 100 to 105 are repeated.
(49) In a further embodiment, illustrated in
(50) Only in the case where both of the signals S.sub.Q and S.sub.A identify a step (datum at output from blocks 108 and 110) does control pass (output 301a) to block 112 where detection of the corresponding step is confirmed and the step is counted. Otherwise (output 301b), the steps 100-110 and 301 already described are repeated.
(51)
(52) Finally, it is evident that modifications and variations may be made to what has been discussed above, without thereby departing from the scope of the present disclosure.
(53) For instance, following upon detection of the peaks p1-p7 in the signal of
(54) As an alternative, machine-learning and/or artificial-intelligence techniques may be used for automatic recognition of specific patterns of the signal S.sub.Q associated with a step made by the user as an alternative to the use of the threshold TH.sub.Q, in order to identify the presence of a step in the signal S.sub.Q and/or the type of step.
(55) Likewise, algorithms of automatic pattern recognition associated with a step made by the user may be used for identifying the presence of a step and/or the type of step in the acceleration signal S.sub.A.
(56) Moreover, it may be noted that it is possible to use a charge-variation sensor of a type that cannot be worn by the user, but is configured to detect, at a distance, electrostatic variations generated following upon execution of a step by the user. In this case, only the accelerometer 4 is carried by the user, for detection of the steps made by him. A system of this type is a distributed system and may be used, for example, in applications of gaming or enhanced reality, in which the user performs his own movements in a circumscribed environment, for example a room.
(57) The advantages achieved by the present disclosure are evident from the foregoing description.
(58) In particular, the present disclosure reduces considerably the false positives in counting of steps of the user of the system, in so far as it envisages a double validation for the confirmation of the step made.
(59) In addition, since according to the embodiment of
(60) Likewise, with reference to
(61) Consequently, in both of the embodiments of
(62) The various embodiments described above can be combined to provide further embodiments. These and other changes can be made to the embodiments in light of the above-detailed description. In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but should be construed to include all possible embodiments along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.