CONTROL OF AN ACTIVE ORTHOTIC DEVICE
20220023133 · 2022-01-27
Inventors
- Sofie WOGE (Lund, SE)
- Robin GUSTAFSSON (Lund, SE)
- Pontus RENMARKER (Malmo, SE)
- Sarawut Kaewwiset KOPFER (Middelfart, DK)
Cpc classification
A61H2230/605
HUMAN NECESSITIES
B25J9/0006
PERFORMING OPERATIONS; TRANSPORTING
A61B5/225
HUMAN NECESSITIES
A61B5/4836
HUMAN NECESSITIES
A61B5/24
HUMAN NECESSITIES
A61H2230/085
HUMAN NECESSITIES
International classification
A61H1/02
HUMAN NECESSITIES
Abstract
An active orthotic device, e.g. a hand orthosis, is attached to one or more limbs of a human subject and comprises a respective set of actuators (21) for moving a respective limb (1A) among the one or more limbs. A method for controlling the orthotic device comprises obtaining one or more bioelectric signals, [S(t)], from one or more bioelectric sensors (10) attached to or implanted in the human subject; processing the one or more bioelectric signals, [5(t)], for prediction of an intended application force, FA(t), of the respective limb (1A) onto an object; obtaining a force signal, PA(t), from a force sensing device (22) associated with the respective set of actuators (21) and/or the respective limb (1A); and generating, as a function of a momentary difference, e(t), between the intended application force, FA(t), and the force signal, PA(t), a respective set of control signals, it(t), for the respective set of actuators (21).
Claims
1. A method of controlling an active orthotic device attached to one or more limbs of a human subject, said active orthotic device comprising a respective set of actuators for moving a respective limb among the one or more limbs, said method comprising: obtaining one or more bioelectric signals from one or more bioelectric sensors attached to or implanted in the human subject, processing the one or more bioelectric signals for prediction of an intended application force of the respective limb onto an object, obtaining a force signal from a force sensing device associated with the respective set of actuators and/or the respective limb, and generating, as a function of a momentary difference between the intended application force and the force signal, a respective set of control signals for the respective set of actuators.
2. The method of claim 1, further comprising: determining an intended limb movement for the respective limb, wherein the respective set of control signals is further generated as a function of the intended limb movement.
3. The method of claim 2, said method further comprising: identifying one or more selected actuators among the respective set of actuators based on the intended limb movement for the respective limb, and generating the respective set of control signals for the one or more selected actuators.
4. The method of claim 2, wherein the respective set of control signals is generated to cause the respective limb to perform the intended limb movement and apply the intended application force.
5. The method of claim 2, wherein the intended limb movement is determined among at least two predefined limb movements, wherein each of the predefined limb movements corresponds to a predefined movement trajectory of the respective limb.
6. The method of claim 5, wherein one of the predefined limb movements corresponds to a predefined movement trajectory in which the respective limb is in a relaxed and/or stationary state.
7. The method of claim 2, wherein the intended limb movement is determined collectively for two or more limbs of the human subject.
8. The method of claim 2, wherein said determining the intended limb movement comprises: processing the one or more bioelectric signals by a pattern recognition algorithm.
9. The method of claim 8, further comprising: extracting signal features from the one or more bioelectric signals, and operating the pattern recognition algorithm on input values comprising the signal features, to cause the pattern recognition algorithm to process the input values for determination of the intended limb movement of the respective limb.
10. The method of claim 8, wherein the pattern recognition algorithm outputs at least one candidate limb movement for the respective limb, and wherein said determining the intended limb movement further comprises validating the at least one candidate limb movement against a position signal representing actual movement of the respective limb.
11. The method of claim 9, further comprising: determining a force value from the force signal, and providing the force value as a further input value for the pattern recognition algorithm.
12. The method of claim 9, further comprising: obtaining an inertial signal from an inertial sensor in the active orthotic device or on the human subject, determining an inertial value from the inertial signal, and providing the inertial value as a further input value for the pattern recognition algorithm.
13. The method of claim 9, further comprising: obtaining a respective position signal from a respective position sensing device associated with the respective set of actuators and/or the respective limb, determining a position value from the respective position signal, the position value being indicative of a momentary position of the respective limb, and providing the position value as a further input value for the pattern recognition algorithm.
14. The method of claim 9, wherein the pattern recognition algorithm comprises an artificial neural network, which is trained to process the input values for determination of the intended limb movement of the respective limb.
15. The method of claim 14, wherein the artificial neural network has an output layer configured to provide output data indicative of the intended limb movement, said method further comprising: obtaining a respective position signal representing actual movement of the respective limb, and modifying one or more weight factors of the output layer as a function of the respective position signal.
16. The method of claim 1, wherein the respective limb is a finger on a hand of the human subject.
17. The method of claim 2, wherein the respective limb is a respective finger on a hand of the human subject, and the intended limb movement corresponds to an intended grip to be formed by one or more fingers on the hand.
18. The method of claim 1, further comprising: obtaining an inertial signal from an inertial sensor in the active orthotic device or on the human subject, processing the inertial signal for detection of a disturbance condition, and, when detecting the disturbance condition, disabling at least the step of generating the respective set of control signals.
19. A non-transitory computer-readable medium storing computer instructions which, when executed by a processor, cause the processor to perform the method of claim 1.
20. A control device for an active orthotic device attached to one or more limbs of a human subject, said active orthotic device comprising a respective set of actuators for moving a respective limb among the one or more limbs, said control device being configured to: obtain one or more bioelectric signals from one or more bioelectric sensors attached to or implanted in the human subject, process the one or more bioelectric signals for prediction of an intended application force of the respective limb onto an object, obtain a force signal from a force sensing device associated with the respective set of actuators and/or the respective limb, and generate, as a function of a momentary difference between the intended application force and the force signal, a respective set of control signals for the respective set of actuators.
21. An active orthotic device configured to be attached to one or more limbs of a human subject, said active orthotic device comprising a respective set of actuators for moving a respective limb among the one or more limbs, and the control device according to claim 20.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Embodiments of the invention will now be described in more detail with reference to the accompanying drawings.
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS
[0046] Embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all, embodiments of the invention are shown. Indeed, the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure may satisfy applicable legal requirements. Like numbers refer to like elements throughout.
[0047] Also, it will be understood that, where possible, any of the advantages, features, functions, devices, and/or operational aspects of any of the embodiments of the present invention described and/or contemplated herein may be included in any of the other embodiments of the present invention described and/or contemplated herein, and/or vice versa. In addition, where possible, any terms expressed in the singular form herein are meant to also include the plural form and/or vice versa, unless explicitly stated otherwise. As used herein, “at least one” shall mean “one or more” and these phrases are intended to be interchangeable. Accordingly, the terms “a” and/or “an” shall mean “at least one” or “one or more”, even though the phrase “one or more” or “at least one” is also used herein. As used herein, except where the context requires otherwise owing to express language or necessary implication, the word “comprise” or variations such as “comprises” or “comprising” is used in an inclusive sense, that is, to specify the presence of the stated features but not to preclude the presence or addition of further features in various embodiments of the invention. As used herein, a “set” of items is intended to imply a provision of one or more items.
[0048] As used herein, an “orthotic device” or “orthosis” refers to an externally applied device that is designed and fitted to the body of an individual to modify structural and functional characteristics of the neuromuscular and skeletal system. The wearer of the orthosis may be incapable of moving one or more limbs or may have an impaired ability to control or effect the movement of one or more limbs. The orthosis may thus be arranged to perform, stabilize or assist a movement of one or more limbs, and well as to enhance the force by which a limb interacts with an object. The orthosis may be configured for any limbs or combinations of limbs, including but not limited to any upper body extremity such as an upper arm, a forearm, a hand, a finger, a phalange, or any lower body extremity such as a thigh, a lower leg, a foot, a toe or a phalange. Each such limb is moved in relation to one or more joints, such as a shoulder joint, an elbow joint, a wrist, finger joint, a hip joint, a knee joint, an ankle or a toe joint.
[0049] In the following, the orthotic device will be exemplified as a hand orthosis, which is configured to be worn on the hand of an individual and is operable to impart a controlled limb movement to one or more fingers. In the context of a hand orthosis, such a controlled limb movement for one or more limbs may be referred to as a “grip”. The hand orthosis may perform, stabilize or assist a grip involving one or more fingers and/or strengthen a grip in contact with an object.
[0050]
[0051] In the illustrated example, the hand orthosis 2 comprises cords or lines that serve as artificial tendons 4. The tendons 4 are fastened to the sheath 3 on distal portions of the fingers 1A, 1B and are arranged to extend in channels and/or guides (not shown) to a control module 5. The control module 5 contains a power source, one or more actuators and control electronics for imparting a defined movement to the respective tendon 4 so as to move the fingers 1A, 1B into one or more predefined grips. The respective actuator may comprise an electric motor with one or more gears connected to a winding device, e.g. a cord reel, to which one or more of the tendons 4 is fastened. It is realized that, depending on implementation, the orthosis 2 may include one or more actuators for each finger and/or one actuator may be attached to a tendon 4 extending to two or more fingers. In the example of
[0052] The control module 5 is arranged onto the forearm 6 of the individual by a band or strap 3B. As indicated by dashed lines, a set of bioelectric sensors 10 are arranged for contact with the forearm 6. Although four sensors 10 are shown in
[0053] The orthosis 2 is operable, via the actuators, to attain different states, where each state corresponds to a predefined grip. As used herein, a “grip” not only includes activated grips in which one or more fingers 1A-1E are actively operated to apply a force onto an object, e.g. an external object or a body part, but also passive grips in which the fingers 1A-1E are relaxed and/or stationary and do not apply any force. The passive grip is thus an “open grip” or “relaxed grip”. The arrangement of the fingers 1A-1E in the open grip may be left to the wearer, e.g. by decoupling the actuators so as to allow the wearer to attain any desired relaxed grip. Alternatively, the arrangement of the fingers 1A-1E in the relaxed grip may be set by the actuators and/or by the design of the sheath 3A. Examples of different grips are shown in
[0054] Embodiments of the invention involve a technique of operating an orthosis 2 to better mimic the movement of the fingers of a healthy individual when attaining different grips. One such embodiment involves determining, based on signals from the bioelectric sensors 10, an intended grip and an intended grip force for each finger 1A-1E involved in the intended grip. The intended grip may be determined among a set of predefined (predetermined) grips, e.g. as exemplified in
[0055] While the following description may refer to the orthosis 2 as shown in
[0056]
[0057] The force prediction module 12 may be configured to evaluate (compute) one or more force-related parameters based on one or more of the EMG signals [S(t)] and determine the intended force data [{circumflex over (F)}(t)] as a function thereof. Such force-related parameters may represent the time domain, the frequency domain or the time-frequency domain, or any combination thereof. Examples of force-related parameters include, without limitation, Wilson amplitude, variance, mean absolute value, waveform length, histogram, mean frequency, entropy, slope, etc. These and other potential force-related parameters are defined in the article “Prediction of grasping force based on features of surface and intramuscular EMG”, by Mathiesen et al., published in 7th semester conference paper (2010) 1-9, and citations listed therein, all of which are incorporated herein by this reference. For example, the article indicates a linear relationship between Wilson amplitude and intended force.
[0058] The grip prediction module 14 may be configured to evaluate (compute) a plurality of grip-related signal features based on one or more of the EMG signals [S(t)] and operate a pattern recognition algorithm on the signal features to determine the grip data [Ĝ(t)], by assigning the signal features to one or more predefined classes that each represents an predefined grip. Such signal features are well-known in the art and may represent the time domain, the frequency domain or the time-frequency domain, or any combination thereof. Examples of signal features are given in the above-identified article by Mathiesen et al. The pattern recognition algorithm, if properly defined, ensures consistent and robust grip prediction. The pattern recognition algorithm may range in complexity from simple to advanced, e.g. depending on the number of sensors 10, the number of predefined grips, the number of fingers controlled by the orthosis, the degrees of freedom of the respective finger, etc. Examples of pattern recognition algorithms include, without limitation, a simple combination of evaluation rules, Bayes classifier, linear discriminant analysis (LDA), support vector machine (SVM), Gaussian mixture model (GMM), quadratic classifier, kernel density estimation, decision tree, artificial neural network (ANN), recurrent neural network (RNN), and Long Short Term Memory (LSTM). A more detailed example is given below with reference to
[0059] In
[0060]
[0061]
[0062] The finger controllers 18B-18N in
[0063]
[0064] In step 401, EMG signals [S(t)] are obtained from the EMG sensors 10. The EMG signals [S(t)], or a respective subset thereof, are processed by sub-sequence 400A and sub-sequence 400B. In sub-sequence 400A, one or more EMG signals [S(t)] are pre-processed (step 402A), e.g. by amplification, filtering for noise reduction, normalization and rectification, as is well-known in the art. In step 403, a plurality of EMG signal features are extracted within a time window in the pre-processed EMG signal(s), e.g. as exemplified above with reference to module 14. Steps 404-406 are optional and may be included to improve the prediction of the intended grip. In step 404, one or more inertial signal features are extracted from the inertial signal(s) I(t). The inertial signal feature(s) may represent any type of inertial parameter, including without limitation linear acceleration in one or more directions, linear velocity in one or more directions, one or more orientation angles, angular velocity in one or more directions, angular acceleration in one or more directions, etc. In step 405, one or more force features are extracted from the measured force signal for the respective finger (cf. {tilde over (F)}.sub.A(t) in
[0065]
[0066] The inventors have further found that by including the relaxed grip Ĝ.sub.0 among the candidate grips, irrespective of pattern recognition algorithm, the user is able to control the orthosis 2 to release an active grip in a natural and intuitive way.
[0067] Reverting to sub-sequence 400B in
[0068] In sub-sequence 400C, step 411 selects the actuators that should be operated to perform the intended grip. Step 411 may be omitted if all actuators of a finger controller are operated for all of the predefined grips. Step 412 obtains a current value of the actual application force for the respective finger that is involved in the intended grip. As understood from the foregoing, step 412 may obtain the current value from the respective measured force signal (cf. {tilde over (F)}.sub.A (t) in
[0069] It is realized that the method 400 is repeatedly executed to progressively move the fingers into the intended grip. The grip prediction by sub-sequence 400A and the force prediction by sub-sequence 400B may but need not be performed concurrently. It should also be understood that the orthosis 2 may configured to allow the wearer to move its fingers, assuming that the wearer has such ability, without resistance from the actuators. For example, the orthosis may be a handgrip strengthener, which allows the wearer to move its fingers towards or into the intended grip, and the orthosis strengthens the intended grip in accordance with the intended force. Thus, the force-based movement control as described in the foregoing may be performed only during part of the movement into the intended grip. In another example, if an intended non-relaxed grip is detected but no intended force, the orthosis may nevertheless move the fingers towards the intended grip, e.g. by the coordination module 16 generating the intended force signals F.sub.A(t), . . . , F.sub.N(t) with predefined values. If an intended force is detected during the movement, the coordination module 16 may switch to generating the intended force signals F.sub.A(t) , . . . , F.sub.N(t) to reflect the intended force, so as to achieve the intended grip with the intended force. It is also conceivable that the grip prediction by sub-sequence 400A is omitted, e.g. if the orthosis is configured to perform a single grip.
[0070] It is realized that if the momentary position of the respective finger is measured (cf. {tilde over (P)}.sub.A(t) in
[0071] The bioelectric signals are typically weak and noisy and thereby susceptible to disturbances. For example, sudden movements of the body or a body part of the wearer may distort the bioelectric signals [S(t)] and disturb the operation of the orthosis. In some embodiments, the method 400 may include a step of processing the inertial signal(s) I(t) for detection of a disturbance condition, e.g. a sudden change in velocity, position or orientation, and step of disabling at least step 414 if the disturbance condition is detected. In one example, the detection of a disturbance condition may cause the operation of the orthosis 2 to be temporarily suspended. In another example, step 414 may be replaced with a step of using the latest intended force signals F.sub.A(t), . . . , F.sub.N(t) until the disturbance has subsided or for a predefined time period, so that the operation of the orthosis 2 continues in a safe way during the disturbance.
[0072] To further exemplify embodiments of the invention, reference is made to
[0073]
[0074] While the invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not to be limited to the disclosed embodiments, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and the scope of the appended claims.