A MECHANOMYOGRAPHY APPARATUS AND ASSOCIATED METHODS
20230210403 · 2023-07-06
Inventors
- Ravi Vaidyanathan (London, GB)
- Farokh S. Atashzar (London, GB)
- Sebastian Carlos Mancero-Castillo (London, GB)
- Samuel Wilson (London, GB)
Cpc classification
A61B5/0053
HUMAN NECESSITIES
A61B5/1107
HUMAN NECESSITIES
A61B2560/0223
HUMAN NECESSITIES
A61B5/7289
HUMAN NECESSITIES
A61B2562/164
HUMAN NECESSITIES
A61B5/6843
HUMAN NECESSITIES
A61B2562/0219
HUMAN NECESSITIES
International classification
A61B5/11
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
Abstract
An apparatus configured for application to a surface of a body, the apparatus comprising: an array of mechanomyography sensors spatially distributed across a substrate, each mechanomyography sensor configured to detect mechanomyography signals from the body to which the apparatus is applied; and a pressure bias system configured to provide a variation in contact pressure of the mechanomyography sensors to the body surface to receive mechanomyography signals at different levels of applied contact pressure.
Claims
1. An apparatus configured for application to a surface of a body, the apparatus comprising: an array of mechanomyography sensors spatially distributed across a substrate, each mechanomyography sensor configured to detect mechanomyography signals from the body to which the apparatus is applied; and a pressure bias system configured to provide a variation in contact pressure of the mechanomyography sensors to the body surface to receive mechanomyography signals at different levels of applied contact pressure.
2. The apparatus of claim 1, wherein the pressure bias system is configured to: (a) spatially modulate the applied pressure across the sensor array; or (b) temporally modulate the applied pressure of at least some of the mechanomyography sensors in the sensor array.
3. The apparatus of claim 2, wherein the spatial modulation of applied pressure is effected by a plurality of the mechanomyography sensors in the sensor array being distributed at different distances from and orthogonal to a reference plane of the substrate.
4. The apparatus of claim 3, wherein the pressure bias system comprises a plurality of platforms on the substrate at different heights relative to the reference plane of the substrate, each platform bearing at least one mechanomyography sensor of the sensor array.
5. (canceled)
6. The apparatus of claim 2, wherein the temporal modulation of applied pressure is effected by at least some of the mechanomyography sensors having an adjustable height relative to a reference plane of the substrate.
7. The apparatus of claim 6, wherein the pressure bias system comprises one or more actuators or inflatable elements configured for adjusting the height of at least one mechanomyography sensor relative to the reference plane of the substrate.
8. The apparatus of claim 2, wherein the substrate is configured to be worn around the body, and wherein the pressure bias system comprises means for adjusting the tightness of the substrate around the body and optionally, wherein the substrate comprises a plurality of rigid substrate portions linked together by flexible and/or stretchable connectors.
9. The apparatus of claim 8, wherein the means for adjusting the tightness of the substrate around the body comprise one or more of a fastener and an inflatable chamber attached to the substrate.
10. The apparatus of claim 9, wherein the substrate comprises a plurality of rigid substrate portions linked together by flexible and/or stretchable connectors.
11. The apparatus of claim 11, further comprising: (a) an array of pressure sensors, each pressure sensor configured to provide an indication of the contact pressure of a respective mechanomyography sensor as applied to the body surface; and/or (b) an array of electromyography electrodes disposed on the substrate, each electromyography electrode configured to detect electromyography signals from the body to which the apparatus is applied.
12. (canceled)
13. The apparatus of claim 1, wherein: (a) the array is a two-dimensional array; (b) the array is a regular array; and/or (c) the sensors of the array have a spacing of no more than 5 mm, 10 mm, 15 mm or 20 mm.
14. (canceled)
15. (canceled)
16. The apparatus of claim 1, wherein the apparatus comprises processing circuitry configured to process the mechanomyography signals detected from the body at different levels of applied contact pressure to determine activity associated with one or more muscles located within the body.
17. The apparatus of claim 16, wherein the determined activity associated with the one or more muscles within the body comprises at least one of muscle activity, neural activity, neuronal activity and cerebral activity.
18. The apparatus of claim 17, wherein the determined muscle activity comprises one or more biomechanical properties of the muscles.
19. The apparatus of any of claim 16, wherein: (a) the processing circuitry is configured to process the detected mechanomyography signals to determine activity associated with one or more muscles located at different corresponding depths within the body; and/or (b) the processing circuitry is configured to process the detected mechanomyography signals to detect the frequency response of one or more muscles at different levels of applied contact pressure.
20. (canceled)
21. The apparatus of claim 16, further comprising an array of pressure sensors, each pressure sensor configured to provide an indication of the contact pressure of a respective mechanomyography sensor as applied to the body surface, wherein the processing circuitry is configured to associate mechanomyography signals received from the mechanomyography sensors with pressure signals received from the respective pressure sensors.
22. The apparatus of claim 21, wherein: (a) the processing circuitry is configured to associate the mechanomyography signals with the pressure signals by synchronising read-out of the mechanomyography sensors with read-out of the respective pressure sensors; and/or (b) the processing circuitry is configured to fuse the mechanomyography signals with the pressure signals.
23. (canceled)
24. An apparatus configured for application to a surface of a body, the apparatus comprising: a mechanomyography sensor configured to detect mechanomyography signals from the body to which the apparatus is applied; a pressure sensor integrated with the mechanomyography sensor and configured to provide an indication of contact pressure of the mechanomyography sensor on the body surface; and processing circuitry configured to calibrate the detected mechanomyography signals using the indicated contact pressure for use in determining activity associated with a muscle located within the body.
25. The apparatus of claim 24, wherein the apparatus comprises a casing configured to house the mechanomyography sensor, and an attachment member for attaching the casing to the body, and wherein the pressure sensor is positioned between the casing and the attachment member such that the contact pressure causes compression of the pressure sensor.
26. An apparatus configured for application to a surface of a body, the apparatus comprising: an array of mechanomyography sensors spatially distributed across a substrate with a spacing of no more than 20 mm, each mechanomyography sensor configured to detect mechanomyography signals from the body to which the apparatus is applied; and processing circuitry configured to decompose the mechanomyography signals detected by the array of mechanomyography sensors for use in determining neural activity associated with one or more muscles located within the body.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0079] A description is now given, by way of example only, with reference to the accompanying schematic drawings, in which:—
[0080]
[0081]
[0082]
[0083]
[0084]
[0085]
[0086]
[0087]
[0088]
[0089]
[0090]
[0091]
[0092]
[0093]
[0094]
[0095]
[0096]
[0097]
[0098]
[0099]
[0100]
[0101]
[0102]
DESCRIPTION OF SPECIFIC ASPECTS/EMBODIMENTS
[0103] As mentioned in the background section, there are a number of challenges with existing sEMG and MMG systems. There will now be described an apparatus and associated methods that may address one or more of these challenges. Other examples depicted in the figures have been provided with reference numerals that correspond to similar features of earlier described examples. For example, feature number 1 can also correspond to numbers 101, 201, 301 etc. These numbered features may appear in the figures but may not have been directly referred to within the description of these particular examples. These have still been provided in the figures to aid understanding of the further examples, particularly in relation to the features of similar earlier described examples.
[0104]
[0105] It has been found that MMG sensors 101 have some degree of sensitivity to the contact pressure whereby an increase in the contact pressure at the point of contact with the skin can increase the amplitude and signal-to-noise ratio of the MMG signal. The contact pressure not only reduces the volume conduction effect (signal damping due to the tissue between the muscle and the sensor 101), but also results in a higher density of tissue (due to the non-linear viscoelastic characteristics of tissue) which increases the conductivity, and varies the frequency, of mechanical waves from the muscle to the skin.
[0106] The combination of the MMG sensor array 101 and the pressure bias system 103 of the present apparatus 100 therefore enables MMG signals to be detected from muscles located at different regions and depths beneath the surface of the body. This increases the spatial information context of the signal space relative to conventional MMG systems. It also allows the propagation of mechanical vibrations on the skin to be monitored.
[0107] As shown in
[0108]
[0109] The MMG sensors 101 may have a spacing of no more than 5 mm, 10 mm, 15 mm or 20 mm. The proximity of adjacent sensors enables multiple sensors to detect MMG signals from the same muscle or muscle group within the body, thereby increasing the resolution of the system. This sensor spacing also means that the apparatus 100 is more robust if some of the MMG sensors 101 in the array are defective. The same spacing may also be used for the EMG 104 and/or pressure 108 sensor arrays.
[0110]
[0111] The apparatus 200 of
[0112] The array of MMG sensors 201 described herein may comprise one or more of acoustic sensors, accelerometers, piezoelectric sensors and force sensors. The accelerometers may be configured to measure in one, two or three dimensions. The primary component of the MMG signal is perpendicular to the skin, but components such as the large muscle movements and others may have non-perpendicular components which can be observed using multi-dimensional MMG sensors. The force sensors are configured to detect pressure changes upon muscle activation due to changes in muscle volume and are not to be confused with the pressure sensors 208 described herein for measuring the static pressure applied by the pressure bias system 203 to the body surface.
[0113] The array of pressure sensors 208 may comprise one or more of piezoresistive pressure sensors, strain gauge pressure sensors, capacitive pressure sensors, potentiometric pressure sensors, inductive pressure sensors, resonant pressure sensors, electromagnetic pressure sensors, variable reluctance pressure sensors, and optical pressure sensors. The use of multiple types of MMG 201 and/or pressure sensor 208 within the same apparatus 200 could help to address the limitations associated with any one modality.
[0114]
[0115]
[0116] Rather than using a spatial modulation pressure bias system 203, the present apparatus 200 may incorporate a pressure bias system that is configured to temporally modulate the applied pressure of at least some of the MMG sensors 201 in the sensor array. In this scenario, the temporal modulation of applied pressure may be effected by at least some of the MMG sensors 201 having an adjustable height relative to a reference plane of the substrate 202 (e.g. the upper surface 210 of the substrate 202).
[0117] The temporal modulation may be applied globally across all MMG sensors 201 of the array simultaneously, or it may be applied locally with respect to one or more specific MMG sensors 201. A global application of temporal modulation may be achieved using a substrate 202 that is configured to be worn around the body (e.g. in a bracelet or armband form) and a pressure bias system that comprises means for adjusting the tightness of the substrate 202 around the body. In this scenario, the substrate 202 could be formed from a flexible or stretchable material, or it may comprise a plurality of rigid substrate portions linked together by flexible/stretchable connectors. Furthermore, the means for adjusting the tightness of the substrate 202 around the body could comprise one or more of a fastener and an inflatable chamber attached to the substrate (similar to a blood pressure cuff).
[0118] With a global application of the temporal modulation, the MMG measurements may be repeated at different levels of contact pressure for all MMG sensors 201. With a local application of the temporal modulation, on the other hand, a single measurement with all sensors 201 simultaneously may be sufficient if MMG signals can be detected at different contact pressures for the same muscle or muscle group. The latter would depend on the spatial proximity of the MMG sensors 201 on the substrate 202.
[0119]
[0120]
[0121]
[0122] The present apparatus may be used to determine at least one of muscle activity, neural activity, neuronal activity and cerebral activity associated with one or more muscles. In this context, “muscle activity” includes one or more biomechanical properties of the muscles, e.g. the state of contraction and the action of going from one state of contraction to another. Furthermore, the neural, neuronal and cerebral activity includes the original neural signals which invoke the muscle activity. The neural signals may be determined using the present apparatus without necessarily having to determine the muscle signals.
[0123] In view of the above, the present apparatus has a variety of different applications. Examples include the evaluation of muscle fatigue, muscle strength, balance, muscle functions, and analysis of mechanical muscle responses during exercise. Other applications include the examination of neuromuscular disorders and prosthetic limb/robotic control. Regarding prosthetic control, experiments have shown that the present apparatus may be used to improve the performance and accuracy of gesture (or gesture intent) detection. These experiments will now be described.
[0124]
[0125] In each one of the segments 724, 725, two housing parts are coupled together by socket head cap screws 727 to form slots through which the elastic cord 726 is passed in order to hold the segments 724, 725 together. This design allows each MMG segment 724 to be slid along the cord 726 so that it can be placed over the target muscles. Depending on the arm diameter of each individual, the active length of the elastic cord 726 can be adjusted using a spring buckle 728 prior to the experiment to ensure the same tension values on each MMG segment 724 for every participant. The length of the armband can be adjusted to values ranging from 13.5 cm (L1) to 28.5 cm (L2). In this study, the length of the armband was tuned and normalized based on the diameter of the limb of the participant to maximize the similarity of conditions. It is assumed that slight differences in the initial conditions caused when adjusting the length of the armband to each subject's arm diameter did not significantly affect the quality of the MMG activity and can therefore be neglected.
[0126] Six abled-bodied right-handed individuals (4 males and two females) between the ages of 19 to 35 years old and three amputees (2 males and one female) between the ages of 30 to 50 years old participated in this experiment that took place on a single session per participant. The experiments involved the collection of MMG activity while participants were asked to perform different hand gestures. Able-bodied participants were asked to perform six different gestures, and amputees were asked to perform only four of them.
[0127]
[0128]
[0129]
[0130] Data collection was divided into three groups with a 30-second resting period between each recording. Groups were divided as follows: Flexion-Extension, Pronation-Supination, and Adduction-Abduction. Only the first two groups applied to the amputees. Each group consisted of 5 repetitions of each gesture. Initially, participants were asked to place the hand in the resting position. After initiating data collection, participants were asked to maintain the resting position for a period of 10 seconds before carrying out the first contraction. Participants were then asked to perform the sustained contractions for a period of 5 seconds with a 5-second interval to rest between each contraction. At the end of each trial, participants were asked to maintain the hand at rest for a period of 10 seconds before stopping the recording in order to facilitate data extraction. After the three groups of recordings had finished, each of the MMG sensors were pushed out to the next level to increase the amount of contact force. The process of data recording for the three groups of hand gestures was then performed again. This process was repeated twice for able-bodied participants in order to record data for all hand gestures at three levels of contact pressure. In order to avoid the muscle fatigue, and due to time restrictions, the amputee data collection process was repeated only once in order to collect data for all gestures at two levels of contact pressure.
[0131]
[0132] The signal was analysed during the steady-state phase of the contraction only, thus discarding the transient phases which have a high degree of stochastic non-stationarity. This makes the steady state of the signal more robust for classification and gesture detection purposes. In addition, the duration of the transient phases cannot be controlled accurately for systematically training of the machine learning algorithms under practical situations without rigorous and excessive calibration.
[0133] For each trial, the onset and offset of each gesture were marked, and data for the first and last second was discarded. The information for the remaining 3 seconds in between was extracted for further analysis (see
[0134] In this work, a total of 213 spectrotemporal features were extracted for each channel, including 200 features in the frequency domain and 13 features in the time domain. Data was segmented into windows of 200 ms with no overlapping. The frequency features were extracted using fast Fourier transform. The time domain features included: Root Mean Square, Integrated Absolute Value, Mean Absolute Value, Modified Mean Absolute Value type 1, Modified Mean Absolute Value type 2, Simple Square Integral, Variance, The 3rd Temporal Moment, The 4th Temporal Moment, The 5th Temporal Moment, Average Amplitude Change, Difference Absolute Standard Deviation Value and Difference Absolute Mean.
[0135] After feature extraction, a Neighbourhood Component Analysis (NCA) was applied in order to extract the most relevant features for classification purposes. NCA is a relatively new feature scoring technique that assigns a power weight to each feature based on the discriminative power of the corresponding feature. This technique enables ranking of the features, comparing the importance of each feature based on the discriminative power and selecting features which contain most of the power for classification. After feature scoring and selection using a holdout validation method, features from the first data set were used to train a linear support vector machine (SVM) classifier, and the second data set was used to test the performance of the model.
[0136]
[0137]
[0138] For the able-bodied participants, increasing the contact pressure from the first level to the second level resulted in a 5.65% decrease in the average accuracy, but increasing the contact pressure to the third level caused an average increase of 6.58%. For Participant #2 of the able-bodied group, increasing the contact pressure from the first level to the second level reduced the performance from 73% to 70% but further increasing the contact pressure to the third level improved the accuracy from 70% to almost 80%.
[0139] A more intense clinical evaluation will be needed to assess the performance of the system on a large population of patients and disabled users. Nevertheless, the current results support a relationship between the level of contact pressure and the performance of MMG-based gesture detection. It suggests that the accuracy is not linearly increased by the contact pressure. Rather, each participant may have an optimal contact pressure for maximising the MMG performance. The results on two out of the three amputees tested also illustrate the benefits of the present apparatus. Due to the user-specific signature of performance and the corresponding nonlinear dependency on the contact pressure, an average behaviour may not be representative of the overall performance.
[0140] An analysis of the signal-to-noise ratio (SNR) was performed at each level of contact pressure for every participant (not shown). The average SNR values across all able-bodied participants was 5.95 dB, 5.87 dB, and 6.63 dB for contact pressure levels of 1, 2, and 3, respectively. In the case of the amputee data, the average SNR values were 5.76 dB and 5.86 dB for contact pressure levels 1 and 2, respectively. A calculation of the bandwidth was also performed for each level of contact pressure and averaged across all participants (not shown). The estimated occupied bandwidths of the signals from able-bodied participants for contact pressure levels 1, 2, and 3 were 24.33, 24.86, and 22.04, respectively. The estimated bandwidths of the signals from amputee participants for contact pressure levels 1 and 2 were 28.08 and 27.83, respectively. It should be highlighted, however, that the focus of this study was on the discriminative power of the signal space (in particular, for the data collected from amputee users). This may relate in an indirect manner to the SNR value and signal bandwidth. The results provide insight into the potential effect of different levels of contact force on the MMG signal, SNR and bandwidth. A gradual improvement of the SNR value and decrease in the bandwidth was observed, as stated above.
[0141] Although the above description relates to an array of MMG sensors, another example of the present apparatus (not illustrated) may comprise one or more MMG sensors configured to detect MMG signals from the body to which the apparatus is applied, and one or more pressure sensors configured to provide an indication of contact pressure of a respective MMG sensor on the body surface (with or without a temporal modulation pressure bias system). This combination not only enables quantitative tracking (and possibly tuning) of the contact pressure, but also allows measurement of force myography (FMG) signals for fusion with the MMG signals as a potential solution for detecting the transient phases of muscle contraction. In this example, the apparatus may also comprise processing circuitry configured to associate the detected MMG signals with the indicated contact pressure for use in determining activity associated with a muscle located within the body. Association of the detected MMG signals and indicated contact pressure may be based on timing information. The contact pressure throughout the relevant MMG signal is required, and thus, the signals from the MMG sensors should be synchronised with the signals from the pressure sensors. For example, when classifying using segmented data, the average contact pressure during detection of the segmented MMG signal can be used. Here the term “segmented” defines the part of the signal currently being examined by the system. So, for example, if a 200 ms segment of the MMG data is being considered, features from the same 200 ms segment of the pressure data should be included (and average pressure could be one of those features).
[0142] Additionally or alternatively, the processing circuitry may be configured for fusion of the MMG and FMG signals as mentioned above. Signal fusion may be used to maintain consistency between the training and test data sets. For example, both signals could be used as inputs to a deep learning algorithm such as a convolutional neural network. The contact pressure data could be used to select training data from the training set which was taken at a similar (relevant) contact pressure. Contact pressure could also be used to configure the cut-off frequency for the MMG sensors, since changing contact pressure can (in some circumstances) modify the frequency response of a muscle. Contact pressure may further be used to configure a frequency equaliser to amplify specific relevant frequencies, or to normalise/calibrate between data taken at different contact pressures where contact pressure has affected the frequency response of the muscle.
[0143] Yet another example of the present apparatus (not illustrated) may comprise an array of MMG sensors spatially distributed across a substrate with a spacing of no more than 20 mm (and in some cases, no more than 5 mm, 10 mm or 15 mm), each configured to detect MMG signals from the body to which the apparatus is applied. In this example, the apparatus may or may not comprise a pressure bias system for modulating the contact pressure, and may or may not comprise an array of pressure sensors for measuring the contact pressure of respective MMG sensors. Nevertheless, this arrangement does allow multiple MMG sensors to detect MMG signals from the same muscle or muscle group, thereby increasing the spatial resolution and robustness against defective sensors. The apparatus may also comprise processing circuitry (e.g. a decomposition module running an associated computer program) configured to decompose the MMG signals detected by the array of MMG sensors for use in determining neural activity associated with one or more muscles located within the body. In this scenario, the processing circuitry decomposes the signals from many data streams representing the combined muscle signals to individual data streams each representing a signal from a single muscle. Furthermore, since each motor unit is controlled by a single nerve, it is possible to determine information about the neural activity triggering a motor unit contraction from signals obtained from a single motor unit. Such decomposition requires a relatively high spatial density of MMG sensors (e.g. a spacing of no more than 20 mm) to be able to detect the same contraction, as the subtle differences in position introduce distortions in the way the signals combine.
[0144] The applicant hereby discloses in isolation each individual feature described herein and any combination of two or more such features, to the extent that such features or combinations are capable of being carried out based on the present specification as a whole, in the light of the common general knowledge of a person skilled in the art, irrespective of whether such features or combinations of features solve any problems disclosed herein, and without limitation to the scope of the claims. The applicant indicates that the disclosed aspects/embodiments may consist of any such individual feature or combination of features. In view of the foregoing description it will be evident to a person skilled in the art that various modifications may be made within the scope of the disclosure.