ENERGY HARVESTING FOR SENSOR SYSTEMS
20220142510 · 2022-05-12
Assignee
Inventors
- Mahbub Hassan (Eveleigh, AU)
- Wen HU (Eveleigh, AU)
- Sara Khalifa (Eveleigh, AU)
- Aruna Seneviratne (Eveleigh, AU)
Cpc classification
A61B5/0002
HUMAN NECESSITIES
G16Z99/00
PHYSICS
A61B2560/0242
HUMAN NECESSITIES
International classification
A61B5/00
HUMAN NECESSITIES
A61B5/11
HUMAN NECESSITIES
G16Z99/00
PHYSICS
Abstract
Described is an energy harvesting system comprising a transducer that generates an electric signal from ambient energy, and a processor adapted to process the electric signal to determine and output a characteristic of a source of the ambient energy. The characteristic may be a spoken word classification.
Claims
1. An energy harvesting system comprising: a transducer that generates an electric signal from ambient energy; and a processor adapted to process the electric signal to determine and output a characteristic of a source of the ambient energy, wherein the characteristic is a spoken word classification.
2. The system of claim 1, wherein the ambient energy is kinetic or vibration energy generated by an activity, and the transducer is a kinetic energy harvester.
3. The system of claim 2 wherein the kinetic energy harvester comprises two or three orthogonal transducers providing multi-axial electric signals that comprise identifying features associated with directions of the activity.
4. The system of claim 1 wherein the transducer is a piezoelectric transducer that has a cantilevered beam configuration with a substantially horizontal orientation.
5. (canceled)
6. (canceled)
7. A method comprising: receiving and transforming ambient energy into an electrical signal; processing the electrical signal to extract at least one distinguishing feature; classifying a source of the ambient energy based on the at least one distinguishing feature; and outputting the classification, wherein classification may be a spoken word classification.
8. The method of claim 7 wherein: the ambient energy is kinetic or vibration energy, the receiving and transforming is performed by a kinetic energy harvester, and the kinetic energy harvester is a piezoelectric transducer.
9. The method of claim 8, wherein the piezoelectric transducer has a cantilevered beam configuration and has a substantially horizontal orientation.
10. (canceled)
11. (canceled)
Description
BRIEF DESCRIPTION OF DRAWINGS
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
DESCRIPTION OF EMBODIMENTS
[0027] Conventional systems used for determining characteristics of movement, e.g. to provide activity-aware services such as in wearable HAR systems, typically make use of accelerometers to obtain data about the activities. However, the power requirement of accelerometers is significant, and has been shown to range between 0.35 and 5 times the harvested kinetic energy when detecting common human activities (e.g. walking and running). Some activities generate only a few μW, not enough to power both an accelerometer and radio communication required to transmit the sensed data. The same is true for other remote sensing activities, e.g. when sensing movement or vibrations on buildings. Similarly, if energy is harvested from another source, e.g. temperature or solar energy, the same is true when sensing related parameters with a dedicated sensor, such as temperature.
[0028]
[0029] In this embodiment the transducer 102 is a piezoelectric transducer with a cantilevered beam configuration. When the piezoelectric material is subjected to a mechanical stress due to any source of environmental vibrations, it expands on one side and contracts on the other. Positive charges accumulate on the expanded side and negative charges on the contracted side, generating an AC voltage as the beam oscillates around the neutral position. The amount of voltage is proportional to the applied stress, which means that different vibration patterns would generate different AC voltage patterns. An example of a piezoelectric KEH transducer is the MIDE Volture transducer.
[0030] The AC output of the transducer is rectified and regulated by a power conditioning circuit 104 so that it can be stored in the energy storage 106 (a battery or capacitor) as DC voltage used to power the processor 108 and transmitter 110. Power regulation may include analogue to digital conversion. The stored energy may be used to fully or partially power the processor 108, memory 112, and/or transmitter 110.
[0031] The regulated power is may not be suitable for detecting features in the electric signal produced by the transducer because regulation removes potential patterns from the signal. In the system shown in
[0032] The activity identifier (i.e. walking, standing, running, ascending or descending stairs, vacuuming, going up/down an escalator, walking/running up a ramp, walking/running down a ramp, etc.) may be stored in memory 112 and/or transmitted to another system or processor via the transmitter 110.
[0033] The process 200 used to determine the activity identifier may be understood with reference to
[0034] The transducer 102 receives and transforms ambient energy 202, in this example kinetic energy. The resulting power is stored 204 over a period of time in the energy storage 104 (e.g. a capacitor or battery), and this step may include rectifying and regulating the electric signal output by the transducer.
[0035] The unprocessed electric signal output from the transducer is then processed 206 by the processor 108. This includes first extracting features 208 from the electric signal. These may be any combination of distinguishing features that describe the data, for example the root mean square, peak-to-peak value, peak-to-peak difference, mean peak, mean peak distance, maximum peak, maximum peak distance, mean, variance, standard deviation, minimum, maximum, range, absolute mean, coefficient of variation, skewness, kurtosis, quartiles, inter quartile range, mean crossing rage, absolute area, dominant frequency, dominant frequency ratio, energy, frequency domain entropy, mean absolute deviation, auto-correlation, power spectrum mean.
[0036] Some of these are described in Table 1 below.
TABLE-US-00001 TABLE 1 An example feature set used to analyse the source of harvested ambient energy Feature Abbreviation Description Single Time- mean mean the central value of a window of samples. axis domain variance var a measure the amount of variation or dispersion from the mean. features features standard de- std the square root of the variance. viation minimum min the minimum value in a window of samples maximum max the maximum value in a window of samples range range the difference between the maximum and the minimum values in a window of samples Absolute absMean average of absolute values, Mean Coefficient of CV ratio of standard deviation and mean times 100; measure of signal dispersion, Variation Skewness skew measure of asymmetry of the probability distribution of the window of sam- ples, Kurtosis kurt measure of peakedness of the probability distribution of the window of sam- ples. Quartiles: 1st Quartile: Q1 measures the overall distribution of the signal samples over the window, 2nd Quartile Q2 3rd Quartile Q3 Inter Quar- 1QR the difference between the upper (third) quartile and the lower (first) quartile tile Range of the window of samples; also measures the dispersion of the signal samples over the window, Mean Cross- MCR measures the number of times the signal crosses the mean value; captures ing Rate how often the signal varies during the time window, Absolute absArea the area under the absolute values of the signal samples. It is the sum of Area absolute values of the signal samples over the window, Frequency- Dominant DFreqR it is calculated as the ratio of highest magnitude FFT coefficient to sum of domain Frequency magnitude of all FFT coefficients. features Ratio Energy FDEnergy it is a measure of total energy in all frequencies. It is calculated as the sum of the squaed discrete FFT component magnitudes. is the magnitude of FFT coefficients. Entropy FDEntropy captures the inpurity in the measured data. It is calculated as the information entropy of the normalized values of FFT coefficient magnitude.
is the normalized value of FFT coefficient magnitude.
indicates data missing or illegible when filed
[0037] More particularly, it has been found that features that are particularly useful when harvesting kinetic energy with a piezoelectric KEH are the ones shown in the feature set in Table 2 below.
TABLE-US-00002 TABLE 2 A “Vibration Feature Set” (VFS) used to extract features from KEH data Feature Abbreviation Description root mean RMS it is the square root of the arithmetic square mean of the squares of the values. The RMS is a measurement of the effective energy content in a the signal. peak-to-peak PktPk it is the difference between the maximum peak value and the minimum peak value. It indicates the maximum excursion of the signal. peak-to-peak PktPkDiff The difference between the maximum difference difference between peak values and the minimum difference between peak values of the sinusoidal wave. It indicates the maximum excursion of the time periods. mean Peak meanPk The mean value of the differences between all the peak values. It quantifies the average variation level of the values of the signal. mean Peak meanDisPk The mean value of the differences Distance between the all the distances (time periods) between peak values. It quantifies the average variation level of the time periods of the signal. maximum Peak maxPk The maximum value of the differences between all the peak values. It quantifies the maximum variation level of the time periods of the signal. maximum Peak maxDisPk The maximum value of the differences Distance between all the distances (time periods) between peak values. It quantifies the maximum variation level of the time periods of the signal.
[0038] The kinetic energy harvester may comprise two or three orthogonal transducers providing multi-axial electric signals that comprise identifying features associated with directions of the activity. In such embodiments, the feature set used may include features particular to multi-axial data, as shown in Table 3.
TABLE-US-00003 TABLE 3 Multi-axial feature set multiaxes features Time- domain features Total abso- lute area TAA of the three axes the absolute area of all three axis.
[0039] Following feature extraction 208, the date is classified 210 according to one of the identifiers, e.g. kinetic energy may have been harvested from one of walking, running, standing, ascending or descending stairs, etc. Classification 210 is performed using a suitable known method, such as Decision Tree (D), K-Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Support Vector Machine (SVM), or Naïve Bayes (NB).
[0040] The outcome of the identification process 206 is then output 212 according to the particular application. For example, where a wearable is used for continuous HAR then the output maybe stored in memory on the wearable for later retrieval (e.g. in wired communication with a computer), the output may be displayed on the wearable device, or the output may be transmitted with wireless communication to another processor or computer.
[0041] It has been found that, with an appropriate feature set (e.g. as shown in Table 2), and an appropriate classifier (e.g. KNN), accuracy of up to 83% can be obtained in HAR. This can be improved even further depending on the placement of the transducer, e.g. handheld, on a wrist, on the waist, hip or at the knee. For example, moving the transducer from a handheld position to a waist position resulted in an average improvement of accuracy from 83% to 87%. By eliminating the accelerometer that is typically used in HAR systems, a power saving of 70-80% in comparison to conventional systems may be achieved.
[0042] The processing 206 may include determining other information from the electric signal, for example for use in health monitors or as described below with reference to the examples presented as described below with reference to the examples presented.
Example 1—Step Count
[0043] Characteristics of harvested energy can be used to detect steps in human motion and provide a step count as an output. One method for doing this uses a peak detection algorithm. Because of the irregularity of human movements and also hardware noise, not all detected peaks are valid steps. Peaks that are unlikely to be associated with steps and that are to be avoided in determining step count can be avoided by the use of two thresholds: T.sub.1 is the minimum peak height, and T.sub.2 is the minimum distance between every two consecutive peaks. Using these thresholds, the peaks that represent valid steps are only those peaks higher than T.sub.1 and separated by at least T.sub.2. Using peak detection, step court using this method has been shown to have an accuracy of up to 96%.
[0044] The peak height threshold T.sub.1 and the step distance threshold T.sub.2 may be determined from the data collected using machine learning, or may be selected based on a predetermined value. For example, referring to
[0045] In addition to this peak detection algorithm, step count can also be determined using a zero crossing detection algorithm or a moving variance detection algorithm.
Example 2—Calorie Expenditure
[0046] Calorie expenditure may be estimated by incorporating anthropometric features (e.g. height, age, weight) together with the electric signal in a regression model. The anthropometric features are input by the user and the linear regression model is trained, e.g. using indirect calorimeters to provide a calorie expenditure estimate (CEE). A suitable regression model may be represented as follows:
where
Example 3—Hotword Detection
[0047] Piezoelectric transducers are also used to harvest energy from vibration energy: vibration energy harvesting (VEH). Analogous to the preceding examples, the harvested energy can be used to determine characteristics of the source of the vibration energy.
[0048] Hotwords, such as “OK Google” are used by voice control applications to distinguish user commands from background conversations. Pervasive hotword detection requires continuous sensing of audio signals, which results in significant energy consumption when a microphone is used as an audio sensor.
[0049] Using VEH in a personal mobile device for hotword detection may therefore contribute to a reduction in power consumption.
[0050] A piezoelectric transducer with a cantilevered beam configuration is used to harvest vibration energy. The piezoelectric material is subjected to mechanical stress due to environmental vibrations, resulting in the generation of an AC voltage proportional to the applied stress. Consequently different vibration patterns result in different AC voltage patterns.
[0051] Human speech creates sound waves that cause piezoelectric transducers to generate different AC voltage patterns for different words and phrases.
[0052] Once the vibration energy has been received and transformed into electrical energy the data is processed to extract features. One or more features, e.g. from Table 1 may be used, for example the subset shown in Table 2. Classification is performed, e.g. using a Decision Tree (DT) classifier that has been trained by a number of test phrases (e.g. those shown in
where S.sub.v is the subset of S for which feature f.sub.i has a value v and |S| denotes the cardinality of the set S.
[0053] Using this method, hotword detection accuracy of up to 85% has been achieved. The best results are achieved with the correct orientation of the cantilevered beam of the transducer. Consider a horizontal cantilevered beam piezoelectric transducer 400 as shown in
Example 4—Gait Recognition
[0054] Gait recognition refers to the automatic recognition of individuals based on their walking patterns. Different people produce kinetic energy in a personalised way, providing distinctive patterns that can be used for gait-based user authentication. This can be seen in
[0055]
[0056] Offline Training 600
[0057] During the offline dictionary training 600, the raw training data 602 is provided and gait cycles are segmented 604. This may be understood with reference to
[0058] The classification method used in this example is Sparse Representation Classification (SRC), described below. Because SRC requires vectors of equal length, linear interpolation 606 is used to expand all the gate cycles to the same length, e.g. 1.3 s (or 1300 samples at 1000 Hz sampling rate).
[0059] Outliers or unusual cycles (such as temporary walking pauses or turning) are also removed 608 from the training data with the use of Dynamic Time Warping (DTW) distance scores. After unusual cycles have been removed, the remaining gait cycles are used to form the final training dictionary 610, A, with the use of SRC.
[0060] In one embodiment, a heuristic algorithm is used to find the optimal projection matrix 612, R.sub.opt. R.sub.opt is also determined during offline training 600, and is used to cast the residual calculation to a lower dimensionality, thereby simplifying the required calculation.
[0061] Sparse Representation Classification (SRC) and the Optimised Projection Matrix R.sub.opt
[0062] SRC is a classification algorithm used for pattern recognition. The SRC method solves a single-label classification problem that aims to return the class that best matches a given test sample.
[0063] STEP 1—The first step is to build a dictionary A consisting of training vectors from different classes. SRC is applied to:
where y∈.sup.q, A∈
.sup.q×(N.Math.K) is the dictionary consisting of K classes and each class contains N q-dimensional training vectors.
[0064] STEP 2—In the next step, l.sub.1 optimisation (where sparse solutions are found by solving an optimisation problem involving an l.sub.1-norm) is used to solve (1) with the following sparse assumption:
where ∈ is used to account for noise and the sparse assumption holds when the test vector can be represented by one of the classes in A.
[0065] STEP 3—In preparation for determining the residual in the next step, the coefficients vector δ.sub.i({circumflex over (x)}) is required. After solving the optimisation problem shown in equation (2), a vector of optimal solutions is found: {circumflex over (x)}. δ.sub.i({circumflex over (x)}) contains the coefficients related to class i only, and the coefficients related to other classes are set to zero.
[0066] STEP 4—The residual for class i is then determined, and the correct class produces the minimal residual.
[0067] In one embodiment, a random projection matrix is applied to the l.sub.1 optimisation. The projection matrices are randomly generated (from Bernoulli or Gaussian distributions that preserve information). The sparse representation vector is then given by:
[0068] After obtaining the sparse representation vector x the class results are determined by checking the residuals based on the Euclidian distance. In this method the residual for class i is:
where δ.sub.i ({circumflex over (x)}) contains the coefficients related to class i. The correct class produces the minimal residual so that the final result of the classification is:
[0069] In another embodiment, a heuristic algorithm is used to find the optimal projection matrix instead of the random one. The compressed residual determined in STEP 4 as described above is then given by:
where R.sub.opt∈.sup.p×q is the optimised projection matrix which is output from the offline training 600 and subsequently used during classification 660, described below.
[0070] Signal Pre-Processing 630
[0071] During signal pre-processing 630 the kinetic energy harvester (KEH) 632 provides an output voltage that is pre-processed using gait cycle segmentation 634 and interpolation 636 similar to the segmentation 604 and interpolation 606 methods described above with reference to the offline training 600. The resulting gait cycles 638 y.sub.1 to y.sub.m are output for classification 660.
[0072] Classification 660
[0073] Classification 660 may be implemented using a number of appropriate classification algorithms such as Support Vector Machine (SVM), K-Nearest Neighbour (KNN) or Naïve Bayes. However, it has been found that the sparse fusion model described below provides the best results in terms of accuracy.
[0074] The proposed sparse fusion model fuses the sparse coefficients vectors from multiple consecutive gait cycles to improve recognition accuracy. The sparse fusion model is based on the assumption that one person's consecutive gait cycles tend to have a high agreement with the sparse representations 662 (as obtained by using the optimal projection matrix) because each of the gait cycles from the same person should be linearly represented by the same class in the dictionary.
[0075] In the example shown the set of M gait cycles 638 have been acquired from the test signal, and the set of estimated coefficients vectors {circumflex over (X)}={{circumflex over (x)}.sub.1, {circumflex over (x)}.sub.2, . . . , {circumflex over (x)}.sub.M} 664 is obtained by solving the l.sub.1 optimization problem for each gait cycle when the sparse representation 662 is determined.
[0076] Theoretically, a precise sparse representation will only contain the non-zero entries at the locations related to the specific class. However, noise exists in the empirical estimations. Therefore, the estimated coefficients vector of the m-th test gait cycle can be expressed as:
where x is the theoretical sparse representation of the test vector and ∈.sub.m is used to account for noise.
[0077] The test vector could be misclassified due to low Signal to Noise Ratio (SNR). To enhance the SNR of the classification system, the new sparse representation model is used and it exploits the information from multiple gait cycles. The new sparse representation model can be expressed as:
where α.sub.m is the weight assigned to {circumflex over (x)}.sub.m based on a Sparsity Concentration Index (SCI) which is defined as:
[0078] The SCI measures how concentrated the coefficients are in the dictionary. SCI({circumflex over (x)}.sub.m)=1, if the test vector can be strictly linearly represented using training vectors from only one class; and SCI({circumflex over (x)}.sub.m)=0, if the coefficients are spread evenly over all classes. The weight of {circumflex over (x)}.sub.m is obtained by normalizing the SCIs among the obtained M gait cycles:
[0079] At 668, with the knowledge of {circumflex over (x)}.sub.sum, the compressed residual of each class is computed as:
where y.sub.sum=Σ.sub.m=1.sup.Mα.sub.my.sub.m is the weighted summation of all the test vectors. The final identity 670 is obtained by finding the minimal residual.
[0080]
[0081] It has been shown that this proposed sparse fusion method is up to 10% more accurate than other classification methods such as Naïve Bayes.
[0082] The description above has focused on human activity recognition with examples relating to characteristics of human activity. In that respect the relevant sensing pertains to human activities, and the type of energy used for energy harvesting for these examples is kinetic energy. The system and methods described herein can be extended to other applications, for example structural health monitoring where harvested kinetic energy from the movement and/or vibration of structures such as buildings or bridges provides an indication of structural health or changes in structural health over time.
[0083] The system and methods described herein can also be extended to other types of sensed phenomena where energy may be harvested from the relevant environment in a different form. For example, a temperature sensor arrangement may be powered by harvested heat energy. In a comparable way the characteristics of the harvested heat energy may be used to indicate characteristics of the heat source such as the temperature.
[0084] It will be appreciated by persons skilled in the art that numerous variations and/or modifications may be made to the above-described embodiments, without departing from the broad general scope of the present disclosure. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive.