Energy harvesting for sensor systems

Abstract

Described herein is an energy harvesting system comprising a transducer and a processor. The transducer generates an electric signal from ambient energy. The processor is configured to process the electric signal to perform pattern recognition of the electric signal so as to determine and output a characteristic of a source of the ambient energy. The pattern recognition comprises statistical analysis and frequency domain analysis.

Claims

1. An energy harvesting system comprising: a piezoelectric transducer that generates an electric signal from ambient energy; and a processor configured to process the electric signal to perform pattern recognition of the electric signal so as to determine and output a characteristic of a source of the ambient energy, wherein the pattern recognition comprises a statistical analysis and a frequency domain analysis of the electric signal, wherein the processor performs the statistical analysis includes extracting statistical features from the electric signal, wherein the extracted statistical features comprise any combination of the following: the root mean square, peak-to-peak value, peak-to-peak difference, mean peak, mean peak distance, maximum peak, and maximum peak distance.

2. The system of claim 1, wherein the characteristic is determined as being one of several characteristics.

3. The system of claim 1, wherein the system further comprises an energy store that stores energy from the electrical signal.

4. The system of claim 3, wherein the energy store provides power to the system.

5. The system of claim 1, wherein the transducer is a piezoelectric transducer with a cantilevered beam configuration.

6. The system of claim 5 wherein the kinetic energy harvester is adapted for operation in a frequency range associated with the activity.

7. The system of claim 6 wherein the kinetic energy harvester is adapted for operation in a 1-10 Hz range.

8. The system of claim 5, wherein the kinetic energy harvester comprises two or three orthogonal transducers providing multi-axial electric signals that comprise identifying features associated with directions of the activity.

9. The system of claim 1 wherein the processor performs the statistical analysis by extracting statistical features from the electric signal, wherein the extracted statistical features further comprise at least one of the following: mean, variance, standard deviation, minimum, maximum, range, absolute mean, coefficient of variation, skewness, kurtosis, quartiles, inter quartile range, mean crossing rage, absolute area, energy, mean absolute deviation, and auto-correlation.

10. The system of claim 1, wherein the processor performs the frequency domain analysis by extracting frequency domain features from the electrical signal, wherein the extracted frequency features comprise at least one of: dominant frequency, dominant frequency ratio, frequency domain entropy, and power spectrum mean.

11. The system of claim 1, wherein the characteristic comprises an indicator of human activity selected from a group consisting of: walking, running, standing, ascending stairs, descending stairs, vacuuming, ascending on an escalator, descending on an escalator, moving up a ramp and moving down a ramp.

12. The system of claim 11, wherein the characteristic comprises an indicator of a number of steps.

13. The system of claim 11, wherein the characteristic comprises a calorie expenditure estimation.

14. The system of claim 12, wherein the processor determines the characteristic by using a classification method comprising at least one of: Decision Tree (DT), K-Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), and Naïve Bayes (NB).

15. A method for energy harvesting comprising: receiving and transforming ambient energy into an electrical signal; processing the electrical signal to extract at least one distinguishing feature, wherein the processing comprises using pattern recognition comprising a statistical analysis and a frequency domain analysis of the electric signal, wherein the statistical analysis includes extracting statistical features from the electric signal, wherein the extracted statistical features comprise any combination of the following: the root mean square, peak-to-peak value, peak-to-peak difference, mean peak, mean peak distance, maximum peak, and maximum peak distance; classifying a source of the ambient energy based on the at least one distinguishing feature; and outputting the classification.

16. The method of claim 15 further comprising: storing the electrical signal for use as a power source; using the power source to power one or more of the receiving, transforming, processing, classifying and outputting.

17. The method of claim 15, wherein the statistical analysis further comprises extracting at least one of the following distinguishing features: mean, variance, standard deviation, minimum, maximum, range, absolute mean, coefficient of variation, skewness, kurtosis, quartiles, inter quartile range, mean crossing rage, absolute area, energy, mean absolute deviation, and auto-correlation.

18. The method of claim 15, wherein the frequency domain analysis comprises extracting at least one of: dominant frequency, dominant frequency ratio, frequency domain entropy, and power spectrum mean.

19. The method of claim 15, wherein the classifying is performed using at least one of: Decision Tree (DT), K-Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), and Naïve Bayes (NB).

20. The method of claim 15, wherein the source is classified as being one of several classifications.

Description

BRIEF DESCRIPTION OF DRAWINGS

(1) FIG. 1 is a schematic representation of a system for identifying the source of ambient energy.

(2) FIG. 2 is a flow diagram of a method for identifying the source of ambient energy.

(3) FIG. 3 is the voltage output from a piezoelectric energy harvester (PEH) where the voltage peaks accord with the step count.

DESCRIPTION OF EMBODIMENTS

(4) Conventional systems used for determining characteristics of movement, e.g. to provide activity-aware services such as in wearable HAR systems, typically make use of accelerometers to obtain data about the activities. However, the power requirement of accelerometers is significant, and has been shown to range between 0.35 and 5 times the harvested kinetic energy when detecting common human activities (e.g. walking and running). Some activities generate only a few μW, not enough to power both an accelerometer and radio communication required to transmit the sensed data.

(5) FIG. 1 is a schematic representation of a system 100 for identifying an activity that uses kinetic energy harvesting and does not use an accelerometer. Instead of using an accelerometer to obtain data about the activity, a transducer 102 harvests ambient energy and the power generated from the harvested energy provides information about the activity.

(6) In this embodiment the transducer 102 is a piezoelectric transducer with a cantilevered beam configuration. When the piezoelectric material is subjected to a mechanical stress due to any source of environmental vibrations, it expands on one side and contracts on the other. Positive charges accumulate on the expanded side and negative charges on the contracted side, generating an AC voltage as the beam oscillates around the neutral position. The amount of voltage is proportional to the applied stress, which means that different vibration patterns would generate different AC voltage patterns. An example of a piezoelectric KEH transducer is the MIDE Volture transducer.

(7) The AC output of the transducer is rectified and regulated by a power conditioning circuit 104 so that it can be stored in the energy storage 106 (a battery or capacitor) as DC voltage used to power the processor 108 and transmitter 110. Power regulation may include analogue to digital conversion. The stored energy may be used to fully or partially power the processor 108, memory 112, and/or transmitter 110.

(8) The regulated power may not be suitable for detecting features in the electric signal produced by the transducer because regulation removes potential patterns from the signal. In the system shown in FIG. 1, the AC voltage produced by the transducer is used by the processor 108 to determine the source of the ambient energy. In this example, determining the source of the ambient energy means recognising the activity performed by a user resulting in the kinetic energy that is harvested.

(9) The activity performed is identified as one amongst several possible activities, i.e. walking, standing, running, ascending or descending stairs, vacuuming, going up/down an escalator, walking/running up a ramp, walking/running down a ramp, etc. An activity identifier describes the identified activity performed, and may be stored in memory 112 and/or transmitted to another system or processor via the transmitter 110.

(10) The process 200 used to determine the activity identifier may be understood with reference to FIG. 2.

(11) The transducer 102 receives and transforms ambient energy 202, in this example kinetic energy. The resulting power is stored 204 over a period of time in the energy storage 104 (e.g. a capacitor or battery), and this step may include rectifying and regulating the electric signal output by the transducer.

(12) The unprocessed electric signal output from the transducer is then processed 206 by the processor 108. This includes first extracting features 208 from the electric signal. These may be any combination of distinguishing features that describe the data, for example the root mean square, peak-to-peak value, peak-to-peak difference, mean peak, mean peak distance, maximum peak, maximum peak distance, mean, variance, standard deviation, minimum, maximum, range, absolute mean, coefficient of variation, skewness, kurtosis, quartiles, inter quartile range, mean crossing rage, absolute area, dominant frequency, dominant frequency ratio, energy, frequency domain entropy, mean absolute deviation, auto-correlation, power spectrum mean.

(13) Some of these are described in Table 1 below. As can be seen, the features used for pattern recognition in the harvested signal combine both statistical analysis as well as frequency domain analysis.

(14) TABLE-US-00001 TABLE 1 An example feature set used to analyse the source of harvested ambient energy Feature Abbreviation Description Single Time- mean mean the central value of a window of samples. axis domain variance var a measure the amount of variation or dispersion from the mean. features features standard std the square root of the variance. deviation minimum min the minimum value in a window of samples maximum max the maximum value in a window of samples range range the difference between the maximum and the minimum values in a window of samples Absolute absMean average of absolute values, Mean Coefficient CV ratio of standard deviation and mean times 100; measure of signal dispersion, of Variation Skewness skew measure of asymmetry of the probability distribution of the window of samples, Kurtosis kurt measure of peakedness of the probability distribution of the window of samples, Quartiles: Q1 measures the overall distribution of the signal samples over the window, 1st Quartile: Q2 2nd Quartile Q3 3rd Quartile Inter Quartile IQR the difference between the upper (third) quartile and the lower (first) quartile Range of the window of samples; also measures the dispersion of the signal samples over the window, Mean MCR measures the number of times the signal crosses the mean value; captures Crossing how often the signal varies during the time window, Rate Absolute absArea the area under the absolute values of the signal samples. It is the sum of Area absolute values of the signal samples over the window, Frequency- Dominant DFreqR it is calculated as the ratio of highest magnitude FFT coefficient to sum of domain Frequency magnitude of all FFT coefficients. features Ratio Energy FDEnergy it is a measure of total energy in all frequencies. It is calculated as the sum of the squared discrete FFT component magnitudes. $\mathrm{Energy}=\underset{i=1}{\overset{L/2}{.Math.}}{F}_i^2$ (4.3) where F.sub.i is the magnitude of FFT coefficients. Entropy FDEntropy captures the impurity in the measured data. It is calculated as the information entropy of the normalized values of FFT coefficient magnitude. $\mathrm{Entropy}=-\underset{i=1}{\overset{L}{.Math.}}{\mathrm{Fn}}_i{\log }_2\left({\mathrm{Fn}}_i\right)$ (4.4) where Fn.sub.i is the normalized value of FFT coefficient magnitude.

(15) More particularly, it has been found that features that are particularly useful when harvesting kinetic energy with a piezoelectric KEH are the ones shown in the feature set in Table 2 below.

(16) TABLE-US-00002 TABLE 2 A “Vibration Feature Set” (VFS) used to extract features from KEH data Feature Abbreviation Description root mean RMS it is the square root of the arithmetic square mean of the squares of the values. The RMS is a measurement of the effective energy content in a the signal. peak-to-peak PktPk it is the difference between the maximum peak value and the minimum peak value. It indicates the maximum excursion of the signal. peak-to-peak PktPkDiff The difference between the maximum difference difference between peak values and the minimum difference between peak values of the sinusoidal wave. It indicates the maximum excursion of the time periods. mean Peak meanPk The mean value of the differences between all the peak values. It quantifies the average variation level of the values of the signal. mean Peak meanDisPk The mean value of the differences Distance between the all the distances (time periods) between peak values. It quantifies the average variation level of the time periods of the signal. maximum maxPk The maximum value of the differences Peak between all the peak values. It quantifies the maximum variation level of the time periods of the signal. maximum maxDisPk The maximum value of the differences Peak between all the distances (time Distance periods) between peak values. It quantifies the maximum variation level of the time periods of the signal.

(17) The kinetic energy harvester may comprise two or three orthogonal transducers providing multi-axial electric signals that comprise identifying features associated with directions of the activity. In such embodiments, the feature set used may include features particular to multi-axial data, as shown in Table 3.

(18) TABLE-US-00003 TABLE 3 Multi-axial feature set multiaxes features Time- domain features Total absolute area TAA of the three axes the absolute area of all three axis. $\mathrm{totalAA}=\underset{i=1}{\overset{L}{.Math.}}.Math.{\mathrm{Acc}}_x.Math.+.Math.{\mathrm{Acc}}_y.Math.+.Math.{\mathrm{Acc}}_z.Math.$ (4.5) where |Acc.sub.x|, |Acc.sub.x|, and |Acc.sub.x| are the absolute values of the three axes x, y, and z respectively. L is the length of the window. total magnitude area MMA the signal magnitude of the three axes averaged over the time window. $\mathrm{totalMA}=\frac{\underset{i=1}{\overset{L}{.Math.}}\sqrt{{\mathrm{Acc}}_x^2+{\mathrm{Acc}}_y^2+{\mathrm{Acc}}_z^2}}{L}$ (4.6) Correlation CorrXY it measures the dependence relationship between two axes Corr(X,Y) CorrXZ Corr(X,Z) CorrYZ Corr(Y,Z)

(19) Following the pattern recognition and feature extraction 208, the data is classified 210 according to one of several possible identifiers (at least three or more), e.g. kinetic energy may have been harvested from one of walking, running, standing, ascending or descending stairs, etc. Classification 210 is performed using a suitable known method, such as Decision Tree (DT), K-Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), or Naïve Bayes (NB).

(20) The outcome of the identification process 206 is then output 212 according to the particular application. For example, where a wearable is used for continuous HAR then the output may be stored in memory on the wearable for later retrieval (e.g. in wired communication with a computer), the output may be displayed on the wearable device, or the output may be transmitted with wireless communication to another processor or computer.

(21) It has been found that, with an appropriate feature set (e.g. as shown in Table 2), and an appropriate classifier (e.g. KNN), accuracy of up to 83% can be obtained in HAR. This can be improved even further depending on the placement of the transducer, e.g. handheld, on a wrist, on the waist, hip or at the knee. For example, moving the transducer from a handheld position to a waist position resulted in an average improvement of accuracy from 83% to 87%. By eliminating the accelerometer that is typically used in HAR systems, a power saving of 70-80% in comparison to conventional systems may be achieved.

(22) The processing 206 may include determining other information from the electric signal, as described below with reference to the examples presented.

Example 1—Step Count

(23) Characteristics of harvested energy can be used to detect steps in human motion and provide a step count as an output. One method for doing this uses a peak detection algorithm. Because of the irregularity of human movements and also hardware noise, not all detected peaks are valid steps. Peaks that are unlikely to be associated with steps and that are to be avoided in determining step count can be avoided by the use of two thresholds: T.sub.1 is the minimum peak height, and T.sub.2 is the minimum distance between every two consecutive peaks. Using these thresholds, the peaks that represent valid steps are only those peaks higher than T.sub.1 and separated by at least T.sub.2. Using peak detection, step count using this method has been shown to have an accuracy of up to 96%.

(24) The peak height threshold T.sub.1 and the step distance threshold T.sub.2 may be determined from the data collected using machine learning, or may be selected based on a predetermined value. For example, referring to FIG. 3, T.sub.1=0.2V and T.sub.2=0.4 ms for the example voltage output 300 that is output from the transducer.

(25) In addition to this peak detection algorithm, step count can also be determined using a zero crossing detection algorithm or a moving variance detection algorithm.

Example 2—Calorie Expenditure

(26) Calorie expenditure may be estimated by incorporating anthropometric features (e.g. height, age, weight) together with the electric signal in a regression model to estimate calorie expenditure. The anthropometric features are input by the user and the linear regression model is trained, e.g. using indirect calorimeters to provide a calorie expenditure estimate (CEE). A suitable regression model may be represented as follows:
CEE.sub.volt=Xβ+ε
where CEE.sub.volt indicates the estimated calorie expenditure at the kth minute. X denotes the vector of input signals, including the anthropometric features of the subjects, and the output voltage signals from the energy harvester. The β and ε are the vectors of coefficients and residual error, respectively. It has been shown that the average (over one second or longer) CEE achieved using harvested energy compares well with conventional methods using accelerometers.

(27) The description above has focused on human activity recognition with examples relating to characteristics of human activity (i.e. step count and calorie expenditure). In that respect the relevant sensing pertains to human activities, and the type of energy used for energy harvesting for these examples is kinetic energy. Advantageously, a large number of activities can be identified because the pattern recognition performed for the electric signal generated by the transducer may use both statistical analysis as well as frequency domain analysis. This sophisticated combination technique allows several different distinguishing characteristics to be identified within the harvested signals.

(28) The system and methods described herein can be extended to other types of sensed phenomena where energy may be harvested from the relevant environment in a different form. For example, a temperature sensor arrangement may be powered by harvested heat energy. In a comparable way the characteristics of the harvested heat energy may be used to indicate characteristics of the heat source such as the temperature.

(29) It will be appreciated by persons skilled in the art that numerous variations and/or modifications may be made to the above-described embodiments, without departing from the broad general scope of the present disclosure. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive.