MODEL-BASED NEUROMECHANICAL CONTROLLER FOR A ROBOTIC LEG
20170049587 ยท 2017-02-23
Inventors
- Hugh M. Herr (Somerville, MA)
- Hartmut Geyer (Pittsburgh, PA, US)
- Michael Frederick Eilenberg (Cambridge, MA, US)
Cpc classification
A61F2002/6872
HUMAN NECESSITIES
A61F2002/7635
HUMAN NECESSITIES
A61F2002/763
HUMAN NECESSITIES
A61F2002/5075
HUMAN NECESSITIES
A61F2002/7645
HUMAN NECESSITIES
A61F2/76
HUMAN NECESSITIES
B25J9/0006
PERFORMING OPERATIONS; TRANSPORTING
B25J9/1633
PERFORMING OPERATIONS; TRANSPORTING
A61F2/741
HUMAN NECESSITIES
A61F2002/5004
HUMAN NECESSITIES
A61F2002/503
HUMAN NECESSITIES
A61F2002/701
HUMAN NECESSITIES
International classification
Abstract
A model-based neuromechanical controller for a robotic limb having at least one joint includes a finite state machine configured to receive feedback data relating to the state of the robotic limb and to determine the state of the robotic limb, a muscle model processor configured to receive state information from the finite state machine and, using muscle geometry and reflex architecture information and a neuromuscular model, to determine at least one desired joint torque or stiffness command to be sent to the robotic limb, and a joint command processor configured to command the biomimetic torques and stiffnesses determined by the muscle model processor at the robotic limb joint. The feedback data is preferably provided by at least one sensor mounted at each joint of the robotic limb. In a preferred embodiment, the robotic limb is a leg and the finite state machine is synchronized to the leg gait cycle.
Claims
1. A method for controlling at least one robotic limb joint of a robotic limb, the method comprising the steps of: providing a neuromuscular model including a muscle model and reflex control equations; receiving feedback data relating to a measured state of the robotic limb; determining, using the feedback data, the muscle model and the reflex control equations of the neuromuscular model, at least one torque command to be applied to the at least one robotic limb joint; and applying the at least one torque command at the at least one robotic limb joint.
2. The method of claim 1, further including receiving the at least one torque command from the neuromuscular model with a torque control system, and wherein the at least one torque command is applied by the torque control system.
3. The method of claim 2, wherein the robotic limb includes at least one sensor mounted to the robotic limb, and the feedback data is provided by the at least one sensor mounted to the robotic limb.
4. The method of claim 3, wherein the neuromuscular model and the torque control system are configured to control the robotic limb, wherein the robotic limb is a robotic leg, and wherein the method further includes, with a finite state machine synchronized to a leg gait cycle, receiving the feedback data from the at least one sensor and determining a gait phase of the robotic leg using the feedback data received.
5. The method of claim 4, wherein the neuromuscular model and the torque control system are configured to control the robotic leg, and wherein the robotic leg comprises an ankle joint.
6. The method of claim 4, wherein the neuromuscular model and the torque control system are configured to control the robotic leg, and wherein the robotic leg comprises a knee joint.
7. The method of claim 5, wherein the robotic leg further comprises a knee joint.
8. The method of claim 7, wherein the robotic leg further comprises a hip joint.
9. The method of claim 3, wherein the at least one sensor is an angular joint displacement and velocity sensor, a torque sensor, or an inertial measurement unit.
10. The method of claim 3, wherein the feedback data includes a joint angle and a joint angular velocity measured by the at least one sensor.
11. (canceled)
12. (canceled)
13. The method of claim 10, wherein the muscle model comprises a contractile element and a series-elastic element arranged in a muscle tendon unit.
14. The method of claim 13, wherein the reflex control equations are configured in a local feedback loop, and further including, with the reflex control equations, receiving muscle force feedback from the muscle model and providing the stimulation input to the muscle model.
15. The method of claim 14, wherein the muscle force feedback is positive force feedback.
16. The method of claim 14, wherein the reflex control equations are configured to mimic a stretch reflex of an intact human muscle.
17. The method of claim 2, wherein the torque control system includes a feed forward gain, a lead compensator and a friction compensator to adapt the at least one torque command and thereby obtain at least one current command.
18. The method of claim 17, wherein the torque control system further includes a motor controller, and wherein applying the at least one torque command includes driving an actuator of the at least one robotic limb joint with the at least one current command using the motor controller.
19. The method of claim 18, wherein the torque control system further includes a parallel spring model.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Other aspects, advantages and novel features of the invention will become more apparent from the following detailed description of the invention when considered in conjunction with the accompanying drawings wherein:
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
DETAILED DESCRIPTION
[0043] A control architecture is presented to command biomimetic torques at the ankle, knee, and hip joints of a powered leg prosthesis, orthosis, or exoskeleton during walking. In this embodiment, the powered device includes artificial ankle and knee joints that are torque controllable. Appropriate joint torques are provided to the user as determined by the feedback information provided by sensors mounted at each joint of the robotic leg device. These sensors include, but are not limited to, angular joint displacement and velocity using digital encoders, hall-effect sensors or the like, torque sensors at the ankle and knee joints and at least one inertial measurement unit (IMU) located between the knee and the ankle joints.
[0044] Sensory information of joint state (position and velocity) from the robotic leg (hip, knee and ankle) is used as inputs to a neuromuscular model of human locomotion. This model uses joint state sensory information from the robotic leg to determine the internal state for each of its virtual muscles, and establishes what the individual virtual muscle force and stiffness should be given particular levels of muscle activation determined from a spinal reflex model. If the robotic leg is a leg prosthesis worn by a transfemoral amputee, angular sensors at the ankle and knee measure joint state for these joints. For the hip joint, the absolute orientation of the user's thigh is determined using both the angular joint sensor at the prosthetic knee and an IMU positioned between the prosthetic knee and the ankle joints. To estimate hip position and velocity, the control architecture works under the assumption that the upper body (torso) maintains a relative vertical position during gait.
[0045] As used herein, and in the Appl.s incorporated by reference herein, the following terms expressly include, but are not to be limited to:
[0046] Actuator means a type of motor, as defined below.
[0047] Agonist means a contracting element that is resisted or counteracted by another element, the antagonist.
[0048] Agonist-antagonist actuator means a mechanism comprising (at least) two actuators that operate in opposition to one another: an agonist actuator that, when energized, draws two elements together and an antagonist actuator that, when energized, urges the two elements apart.
[0049] Antagonist means an expanding element that is resisted or counteracted by another element, the agonist.
[0050] Biomimetic means a man-made structure or mechanism that mimics the properties and behavior of biological structures or mechanisms, such as joints or limbs.
[0051] Dorsiflexion means bending the ankle joint so that the end of the foot moves upward.
[0052] Elastic means capable of resuming an original shape after deformation by stretching or compression.
[0053] Extension means a bending movement around a joint in a limb that increases the angle between the bones of the limb at the joint.
[0054] Flexion means a bending movement around a joint in a limb that decreases the angle between the bones of the limb at the joint.
[0055] Motor means an active element that produces or imparts motion by converting supplied energy into mechanical energy, including electric, pneumatic, or hydraulic motors and actuators.
[0056] Plantarflexion means bending the ankle joint so that the end of the foot moves downward.
[0057] Spring means an elastic device, such as a metal coil or leaf structure, which regains its original shape after being compressed or extended.
[0058] An exemplary embodiment of a neuromuscular model-based control scheme according to this aspect of the invention is shown as a block diagram in
[0059] In order for each of the virtual muscle to produce its required force, a muscle stimulation parameter STIM(t) is required. This parameter can be determined from either an outside input or a local feedback loop. In the control methodology for the exemplary biomimetic leg, the STIM(t) is computed based on local feedback loops. This architecture is based on the reflex feedback framework developed by Geyer and Herr [H. Geyer, H. Herr, A muscle-reflex model that encodes principles of legged mechanics predicts human walking dynamics and muscle activities, (Submitted for publication), herein incorporated by reference in its entirety]. In this framework the neural-control is designed to mimic the stretch reflex of an intact human muscle. This neuromuscular reflex-based control methodology allows the biomimetic robotic leg to replicate human-like joint mechanics.
[0060] Neuromechanical model. A human model with a reflex control that encodes principles of legged mechanics predicts human walking dynamics and muscle activities. While neuroscientists identify increasingly complex neural networks that control animal and human gait, biomechanists find that locomotion requires little motor control if principles of legged mechanics are heeded. Here it is shown how muscle reflex behavior could be vital to link these two observations. A model of human locomotion was developed that is driven by muscle reflex behaviors that encode principles of legged mechanics. Equipped with this principle-based reflex control, the model stabilizes into the walking gait from its dynamic interplay with the ground, tolerates ground disturbances, and self-adapts to stairs. Moreover, the model shows qualitative agreement with joint angles, joint torques and muscle activations known from experiments, suggesting that human motor output could largely be shaped by muscle reflex behaviors that link principles of legged mechanics into the neural networks responsible for locomotion.
[0061] A human walking model with a motor control is based on muscle reflexes, which are designed to include such principles of legged mechanics. These principles derive from simple conceptual models of legged locomotion and include the reliance on compliant leg behavior in stance [Blickhan, R., 1989. The spring-mass model for running and hopping. J. of Biomech. 22, 1217-1227; Ghigliazza, R., Altendorfer, R., Holmes, P., Koditschek, D., 2003. A simply stabilized running model. SIAM J. Applied. Dynamical Systems 2 (2), 187-218; Geyer, H., Seyfarth, A., Blickhan, R., 2006. Compliant leg behaviour explains the basic dynamics of walking and running. Proc. R. Soc. Lond. B 273, 2861-2867], the stabilization of segmented legs based on static joint torque equilibria [Seyfarth, A., Gnther, M., Blickhan, R., 2001. Stable operation of an elastic three-segmented leg. Biol. Cybern. 84, 365-382; Gnther, M., Keppler, V, Seyfarth, A., Blickhan, R., 2004. Human leg design: optimal axial alignment under constraints. J. Math. Biol. 48, 623-646], the exploitation of ballistic swing-leg mechanics [Mochon, S., McMahon, T., 1980. Ballistic walking. J. Biomech. 13 (1), 49-57], and the enhancement of gait stability using swing-leg retraction [Seyfarth, A., Geyer, H., Gnther, M., Blickhan, R., 2002. A movement criterion for running. J. of Biomech. 35, 649-655; Seyfarth, A., Geyer, H., Herr, H. M., 2003. Swing-leg retraction: a simple control model for stable running. J. Exp. Biol. 206, 2547-2555]. Hill-type muscles combined with spinal reflexes are employed. including positive force and length feedback schemes, to effectively encode these mechanical features.
[0062] Comparing the model's behavior with kinetic, kinematic, and electromyographic evidence from the literature for human walking, it has been shown that a neuromuscular model with a motor control designed to encode principles of legged mechanics can produce biological walking mechanics and muscle activities. This reflex control allows the model to tolerate sudden changes in ground level and to adapt to stair ascent and descent without parameter interventions.
[0063] The structure and control of the human model evolves in six steps from a conceptual point-mass model into a neuromuscular biped with an upper body and two, three-segment legs each actuated by seven muscles and controlled by muscle reflexes.
[0064] In
[0065] Stance leg compliance and stability. The bipedal spring-mass model is used as the starting point for the conceptual basis for human locomotion (
[0066] To implement compliant behavior in neuromuscular legs, each spring 210, 215 is replaced with thigh 220, shank 225, and foot 230, and a soleus muscle (SOL) 235 and a vasti muscle group (VAS) 240 are added, both generating their muscle activity through local positive force feedback (F+) during the stance period of gait (
[0067] While compliant leg behavior is essential, it also threatens joint stability in segmented legs [Seyfarth, A., Gnther, M., Blickhan, R., 2001. Stable operation of an elastic three-segmented leg. Biol. Cybern. 84, 365-382; Gnther, M., Keppler, V, Seyfarth, A., Blickhan, R., 2004. Human leg design: optimal axial alignment under constraints. J. Math. Biol. 48, 623-646]. In segmented legs, the knee and ankle torques, .sub.k and .sub.a, obey the static equilibrium .sub.k/.sub.a=h.sub.k/h.sub.a, where h.sub.k and h.sub.a are the perpendicular distances from the knee and the ankle to the leg force vector Fleg, respectively. In effect, a large extension torque at one joint forces the other joint closer to Fleg, threatening its overextension for spring-like behaving legs [for details see Seyfarth, A., Gnther, M., Blickhan, R., 2001. Stable operation of an elastic three-segmented leg. Biol. Cybern. 84, 365-382].
[0068] This tendency to overextend at the knee or the ankle is countered by adding the gastrocnemius (GAS) 245 and tibialis anterior (TA) 250 muscles (
[0069] Upper body and its balance. In the next step of evolving from the conceptual spring-mass model into a neuromuscular biped, the point mass representation is discarded and an upper body 255 around which the legs can be swung (
[0070] Swing leg pro- and retraction. The human model's structure is complete, except for a muscle-reflex control that produces swing leg pro- and retraction. It is assumed that a stance leg's functional importance reduces in proportion to the amount of body weight (bw) borne by the contralateral leg, and initiate swing leg protraction already in double support (
[0071] During actual swing, the main reliance is on a leg's ballistic motion, but it is influenced in two ways (
[0072] Furthermore, the swing leg is also prevented from overreaching and its retraction is ensured. If legs reach and maintain a proper orientation during swing, legged systems self-stabilize into a gait cycle [McGeer, T., 1990. Passive dynamic walking. Int. J. Rob. Res. 9 (2), 62-82; Seyfarth, A., Geyer, H., Gnther, M., Blickhan, R., 2002. A movement criterion for running. J. of Biomech. 35, 649-655; Ghigliazza, R., Altendorfer, R., Holmes, P., Koditschek, D., 2003. A simply stabilized running model. SIAM J. Applied. Dynamical Systems 2 (2), 187-218; Geyer, H., Seyfarth, A., Blickhan, R., 2006. Compliant leg behaviour explains the basic dynamics of walking and running. Proc. R. Soc. Lond. B 273, 2861-2867]. The tolerance of this mechanical self-stability against disturbances can largely be enhanced if swing legs additionally retract before landing [Seyfarth, A., Geyer, H., 2002. Natural control of spring-like runningoptimized self-stabilization. In: Proceedings of the 5th international conference on climbing and walking robots. Professional Engineering Publishing Limited, pp. 81-85; Seyfarth, A., Geyer, H., Herr, H. M., 2003. Swing-leg retraction: a simple control model for stable running. J. Exp. Biol. 206, 2547-2555]. To implement this halt-and-retract strategy, three muscle reflexes are included in the human model. The overreaching of the swing leg that would result from the forward impulse the leg receives when the knee reaches full extension during protraction is prevented. Hereto, the HFL's L+ is inhibited proportional to the stretch which the HAM receives in swing, S.sub.HFL(t)=k.sub.lean (.sub.ref)TO+G.sub.HFL(l.sub.CE,HFLl.sub.off,HFL)(t.sub.t,HFL)G.sub.HAMHFL(l.sub.CE,HAMl.sub.off,HAM)(t.sub.t,HAM). In addition, F+ is used for the GLU, S.sub.GLU(t)=S.sub.0,GLU+G.sub.GLUF.sub.GLU(tt.sub.GLU), and for the HAM, S.sub.HAM(t)=S.sub.0,HAM+G.sub.HAM F.sub.HAM (tt.sub.HAM), to ensure that, dependent on the actual protraction momentum, the swing leg not only halts, but also transfers part of this momentum into leg straightening and retraction. Finally, the TA L+ introduced to ensure foot clearance is kept throughout the swing. The SOL, GAS, and VAS remain silent during this phase.
[0073] Reflex control parameters. The different reflex contributions to the muscle stimulations Sm(t) are governed through the equations used in the model. No parameter optimization was performed. Parameters were derived from previous knowledge of reflex behavior (F+, L+) or by making plausible estimates. All muscle stimulations are limited in range from 0.01 to 1 before being translated into muscle activations A.sub.m(t). Table 1 presents the stance reflex equations used in the preferred embodiment.
TABLE-US-00001 TABLE 1
[0074] Table 2 presents the swing reflex equations used in the preferred embodiment.
TABLE-US-00002 TABLE 2
[0075] Results. Although the human model has no central pattern generator (CPG) that feed-forwardly activates its muscles, it switches for each leg between the different reflexes for stance and swing using sensors located at the ball and heel of each foot to detect ground. As a result, the model's dynamic interaction with its mechanical environment becomes a vital part of generating muscle activities.
[0076] Walking gait. To study how important this interdependence of mechanics and motor control can be to human locomotion, the model was started with its left leg in stance and its right leg in swing at a normal walking speed v0=1.3 ms1. Since the modeled muscle reflexes include time delays of up to 20 ms, all muscles are silent at first.
[0077] Because of these disturbed initial conditions, the model slightly collapses and slows down in its first step (
[0078] Steady-state patterns of angles, torques and muscle activations. This similarity also holds upon closer inspection; the model shows qualitative agreement with angle, torque and muscle activation patterns known from human walking data.
[0079] The strongest agreement between model prediction and walking data can be found at the ankle (
[0080] The comparison shows a weaker agreement for the knee and the hip. For instance, although the general trajectory .sub.k of the human knee is captured by the model, its knee flexes about 10 degree or 30% more than the human's in early stance (
[0081] Self-adaptation to ground changes. Despite its limited reflex control, the human model tolerates sudden, and self-adapts to permanent, changes of the ground level.
[0082] Approaching from steady-state walking (1st stride), the model hits the stairs at the end of the 2nd stride with the foot of its outstretched right leg (
[0083]
[0084]
[0085] For both walking up and down stairs, no single control is responsible. The key to the model's tolerance and adaptation are its dynamic muscle-reflex responses. The rebound of the stance leg depends on how much load the leg extensors SOL, GAS and VAS feel, which guarantees that the leg yields sufficiently to allow forward progression when going up, but brakes substantially when going down. On the other hand, the forward propulsion of the swing leg varies with the model dynamics. Sudden deceleration after impact of the opposite leg, forward lean of the upper body, and ankle extension rate near the end of stance-all contribute to leg propulsion in swing. These combined features ensure that the swing leg protracts enough in upstair walking and substantially in downstair walking. For the latter, the force feedbacks of GLU and HAM constrain excess rotations of the leg and instead force it to rapidly retract and straighten.
[0086] Muscle tendon units. All 14 muscle-tendon units (MTUs) of the biped have the same model structure.
[0087] As seen in
[0088] Table 3 presents individual MTU parameters. All parameters are estimated from Yamaguchi et al. [Yamaguchi, G. T., Sawa, A. G.-U., Moran, D. W., Fessler, M. J., Winters, J. M., 1990. A survey of human musculotendon actuator parameters. In: Winters, J., Woo, S.-Y. (Eds.), Multiple Muscle Systems: Biomechanics and Movement Organization. Springer-Verlag, New York, pp. 717-778]. The maximum isometric forces F.sub.max are estimated from individual or grouped muscle-physiological cross-sectional areas assuming a force of 25N per cm.sup.2. The maximum contraction speeds v.sub.max are set to 6 l.sub.opt s.sup.1 for slow muscles and to 12 l.sub.opt s.sup.1 for medium fast muscles. The optimum CE lengths l.sub.opt and the SE slack lengths l.sub.slack reflect muscle fiber and tendon lengths.
TABLE-US-00003 TABLE 3 SOL TA GAS VAS HAM GLU HFL F.sub.max (N) 4000 800 1500 6000 3000 1500 2000 v.sub.max ( .sub.opt s.sup.1) 6 12 12 12 12 12 12
.sub.opt (cm) 4 6 5 8 10 11 11
.sub.slack (cm) 26 24 40 23 31 13 10
[0089] Details on how CE and SE were modeled can be found in Geyer et al. [Geyer, H., Seyfarth, A., Blickhan, R., 2003. Positive force feedback in bouncing gaits? Proc. R. Soc. Lond. B 270, 2173-2183]. The force of the CE, F.sub.CE=A F.sub.max f.sub.l (l.sub.CE)f.sub.v (v.sub.CE), is a product of muscle activation A, CE force-length relationship f.sub.l (l.sub.CE), and CE force-velocity relationship f.sub.v (v.sub.CE). Based on this product approach, the MTU dynamics are computed by integrating the CE velocity v.sub.CE, which is found by inverting f.sub.v (v.sub.CE). Given that F.sub.SE=F.sub.CE+FP.sub.EF.sub.BE, f.sub.v (V.sub.CE)=(F.sub.SEF.sub.PE+F.sub.BE)/(A F.sub.max f.sub.l(l.sub.CE)). This equation has a numerically critical point during muscle stretch when F.sub.SEF.sub.PE approaches zero. To speed up simulations, this critical point is avoided by introducing f.sub.v (v.sub.CE) into the force production of the parallel elasticity F.sub.PE(l.sub.CEl.sub.opt).sup.2 f.sub.v (v.sub.CE). Note that PE engages outside the normal range of operation in the model, and like BE, plays a minor role for the muscle dynamics during normal locomotion. With this approach, however, f.sub.v (v.sub.CE)=(F.sub.SE+F.sub.BE)/(A F.sub.maxf.sub.l (l.sub.CE)+F.sub.PE) is obtained, which can numerically be integrated using coarse time steps. While this approach is convenient to speed up the model simulation, it was also critical when muscle dynamics were emulated on PC boards with fixed and limited time resolution.
[0090] The MTUs have common and individual parameters. The common parameters include the time constant of the excitation contraction coupling, t.sub.ecc=0.01; the CE force-length relationship's width, w=0.56 l.sub.opt, and residual force factor, c=0.05; the CE force-velocity relationship's eccentric force enhancement, N=1.5, and shape factor, K=5; and the SE reference strain, .sub.ref=0.04 [for details, see Geyer, H., Seyfarth, A., Blickhan, R., 2003. Positive force feedback in bouncing gaits? Proc. R. Soc. Lond. B 270, 2173-2183]. Also common parameters are the PE reference strain .sub.PE=w where F.sub.PE=F.sub.max (l.sub.CE/l.sub.opt1).sup.2/.sub.PE.sup.2 f.sub.v (v.sub.CE), and the BE rest length l.sub.min=l.sub.optw and its reference compression .sub.BE=w/2 where F.sub.BE=F.sub.max [(l.sub.minl.sub.CE)/l.sub.opt].sup.2/.sub.PE.sup.2. The individual MTU attachment parameters are readily available from the literature and distinguish each muscle or muscle group. Their values are listed in Table 4.
TABLE-US-00004 TABLE 4 MTU attachment parameters ankle knee hip SOL TA GAS GAS VAS HAM HAM GLU HFL r.sub.0 (cm) 5 4 5 5 6 5 8 10 10 .sub.max (deg) 110 80 110 140 165 180 .sub.ref (deg) 80 110 80 165 125 180 155 150 180 0.5 0.7 0.7 0.7 0.7 0.7 0.7 0.5 0.5
[0091] Musculoskeletal connections and mass distribution. The MTUs connect to the skeleton by spanning one or two joints. The transfer from muscle forces F.sub.m to joint torques .sub.m is modeled using variable lever arms r.sub.m()=r.sub.0 cos(.sub.max) for the ankle and knee where is the joint angle, .sub.max is the angle at which r.sub.m reaches its maximum, and .sub.m=r.sub.m()F.sub.m. For the hip, it is simply assumed that r.sub.m()=r.sub.0. On the other hand, changes l.sub.m in MTU lengths are modeled as l.sub.m=r[sin(.sub.maxsin(.sub.ref.sub.max)] for the ankle and knee; and as l.sub.m=r(.sub.ref) for the hip. The reference angle .sub.ref is the joint angle where l.sub.m=l.sub.opt+l.sub.slack. The factor accounts for muscle pennation angles and ensures that an MTU's fiber length stays within physiological limits throughout the working range of the joint. The specific parameters for each muscle and joint are listed in Table 4. These values are either supported by experimental evidence [Muraoka, T., Kawakami, Y., Tachi, M., Fukunaga, T., 2001. Muscle fiber and tendon length changes in the human vastus lateralis during slow pedaling. J. Appl. Physiol. 91, 2035-2040; Maganaris, C., 2001. Force-length characteristics of in vivo human skeletal muscle. Acta Physiol. Scand. 172, 279-285; Maganaris, C., 2003. Force-length characteristics of the in vivo human gastrocnemius muscle. Clin. Anat. 16, 215-223; Oda, T., Kanehisa, H., Chino, K., Kurihara, T., Nagayoshi, T., Kato, E., Fukunaga, T., Kawakami, Y, 2005. In vivo length-force relationships on muscle fiver and muscle tendon complex in the tibialis anterior muscle. Int. J. Sport and Health Sciences 3, 245-252], or were obtained through rough anatomical estimates.
[0092] The seven segments of the human model are simple rigid bodies whose parameters are listed in Table 5. Their values are similar to those used in other modeling studies, for instance, in Gnther and Ruder [Gnther, M., Ruder, H., 2003. Synthesis of two-dimensional human walking: a test of the -model. Biol. Cybern. 89, 89-106]. The segments are connected by revolute joints. As in humans, these joints have free ranges of operation (70<.sub.a<130, .sub.k<175 and .sub.h<230) outside of which mechanical soft limits engage, which is modelled in the same way as the ground impact points. The model's segments have different masses m.sub.S and lengths l.sub.S, and characteristic distances of their local center of mass, d.sub.G,S, and joint location, d.sub.J,S (measured from distal end), and inertias .sub.S.
TABLE-US-00005 TABLE 5 Feet Shanks Thighs HAT l.sub.S (cm) 20 50 50 80 d.sub.G,S (cm) 14 30 30 35 d.sub.J,S (cm) 16 50 50 m.sub.S (cm) 1.25 3.5 8.5 53.5 .sub.S (kgm2) 0.005 0.05 0.15 3
[0093] Ground contacts and joint limits. Each foot segment of the bipedal model has contact points at its toe and heel. When impacting the ground, a contact point (CP) gets pushed back by a vertical reaction force F.sub.y=F.sub.reff.sub.1 f.sub.v, which, like the muscle force, is the product of a force-length relationship f.sub.1 (y.sub.CP)=y.sub.CP/y.sub.ref and a force-velocity relationship f.sub.v (dy.sub.CP/dt)=1dy.sub.CP/dt/v.sub.max (
[0094]
[0095] In addition to the vertical reaction force, a horizontal reaction force is applied to the CP during ground contact. Initially, this force is modeled as a kinetic friction force that opposes the CP's motion on the ground with a force F.sub.x=.sub.sl F.sub.y. When the CP slows down to below a speed v.sub.lim, the horizontal reaction force is modelled as a stiction force computed in a manner similar to that in which the vertical impact force is computed (
[0096] The results suggest that mechanics and motor control cannot be viewed separately in human locomotion. A neuromuscular model of human locomotion according to one aspect of the invention self-organizes into the walking gait after an initial push, tolerates sudden changes in ground level, and adapts to stair walking without interventions. Central to this model's tolerance and adaptiveness is its reliance on muscle reflexes, which integrate sensory information about locomotion mechanics into the activation of the leg muscles. Having no CPG, the model shows that in principle no central input is required to generate walking motions, suggesting that reflex inputs that continuously mediate between the nervous system and its mechanical environment may even take precedence over central inputs in the control of normal human locomotion.
[0097] In addition, the model results suggest that these continuous reflex inputs encode principles of legged mechanics. Current experimental and modeling research on the role of spinal reflexes during locomotion focuses on their contribution to the timing of swing and stance phases and to the production of muscle force in load bearing extensor muscles [Pang, M. Y., Yang, J. F., 2000. The initiation of the swing phase in human infant stepping: importance of hip position and leg loading. J Physiol 528 Pt 2, 389-404; Dietz, V, 2002. Proprioception and locomotor disorders. Nat Rev Neurosci 3 (10), 781-790; Ivashko, D. G., Prilutski, B. I., Markin, S. N., Chapin, J. K., Rybak, I. A., 2003. Modeling the spinal cord neural circuitry controlling cat hindlimb movement during locomotion. Neurocomputing 52-54, 621-629; Yakovenko, S., Gritsenko, V, Prochazka, A., 2004. Contribution of stretch reflexes to locomotor control: a modeling study. Biol Cybern 90 (2), 146-155; Ekeberg, O., Pearson, K., 2005. Computer simulation of stepping in the hind legs of the cat: an examination of mechanisms regulating the stance-to-swing transition. J Neurophysiol 94 (6), 4256-4268; Maufroy, C., Kimura, H., Takase, K., 2008. Towards a general neural controller for quadrupedal locomotion. Neural Netw 21(4), 667-681; Donelan, J. M., Pearson, K. G., 2004. Contribution of sensory feedback to ongoing ankle extensor activity during the stance phase of walking. Can J Physiol Pharmacol 82 (8-9), 589-598; Frigon, A., Rossignol, S., 2006. Experiments and models of sensorimotor interactions during locomotion. Biol Cybern 95 (6), 607-627; Grey, M. J., Nielsen, J. B., Mazzaro, N., Sinkjaer, T., 2007. Positive force feedback in human walking. J Physiol 581 (1), 99-105]. The reflex contribution to load bearing has started to link positive force feedback to the underlying dynamics of the locomotor system [Prochazka, A., Gillard, D., Bennett, D., 1997. Positive force feedback control of muscles. J. of Neurophys. 77, 3226-3236; Geyer, H., Seyfarth, A., Blickhan, R., 2003. Positive force feedback in bouncing gaits? Proc. R. Soc. Lond. B 270, 2173-2183]. There appears to be no previous work that systematically expands on the idea of encoding principles of legged dynamics in the motor control system. While some of the muscle reflexes implemented in the human model were simple expedients to let it enter cyclic motions (trunk balance, swing-leg initiation), mainly the stance phase reflexes encoded principles of legged dynamics and control described previously, including compliant stance leg behavior [Blickhan, R., 1989. The spring-mass model for running and hopping. J. of Biomech. 22, 1217-1227; McMahon, T., Cheng, G., 1990. The mechanism of running: how does stiffness couple with speed? J. of Biomech. 23, 65-78; Geyer, H., Seyfarth, A., Blickhan, R., 2006. Compliant leg behaviour explains the basic dynamics of walking and running. Proc. R. Soc. Lond. B 273, 2861-2867], stabilization of segmented chains [Seyfarth, A., Gnther, M., Blickhan, R., 2001. Stable operation of an elastic three-segmented leg. Biol. Cybern. 84, 365-382; Gnther, M., Keppler, V, Seyfarth, A., Blickhan, R., 2004. Human leg design: optimal axial alignment under constraints. J. Math. Biol. 48, 623-646], and swing-leg retraction [Herr, H., McMahon, T., 2000. A trotting horse model. Int. J. Robotics Res. 19, 566-581; Herr, H., McMahon, T., 2001. A galloping horse model. Int. J. Robotics Res. 20, 26-37; Herr, H. M., Huang, G. T., McMahon, T. A., April 2002. A model of scale effects in mammalian quadrupedal running. J Exp Biol 205 (Pt 7), 959-967; Seyfarth, A., Geyer, H., 2002. Natural control of spring-like runningoptimized self-stabilization. In: Proceedings of the 5th international conference on climbing and walking robots. Professional Engineering Publishing Limited, pp. 81-85; Seyfarth, A., Geyer, H., Herr, H. M., 2003. Swing-leg retraction: a simple control model for stable running. J. Exp. Biol. 206, 2547-2555]. Based on these functional reflexes, the model not only converges to known joint angle and torque trajectories of human walking, but also predicts some individual muscle activation patterns observed in walking experiments. This match between predicted and observed muscle activations suggests that principles of legged mechanics could play a larger role in motor control than anticipated before, with muscle reflexes linking these principles into the neural networks responsible for locomotion.
[0098] In a preferred embodiment, the neuromechanical model of the invention has been implemented as a muscle reflex controller for a powered ankle-foot prosthesis. This embodiment is an adaptive muscle-reflex controller, based on simulation studies, that utilizes an ankle plantar flexor comprising a Hill-type muscle with a positive force feedback reflex. The model's parameters were fitted to match the human ankle's torque-angle profile as obtained from level-ground walking measurements of a weight and height-matched intact subject walking at 1 m/sec. Using this single parameter set, clinical trials were conducted with a transtibial amputee walking on level ground, ramp ascent, and ramp descent conditions. During these trials, an adaptation of prosthetic ankle work was observed in response to ground slope variation, in a manner comparable to intact subjects, without the difficulties of explicit terrain sensing. Specifically, the energy provided by the prosthesis was directly correlated to the ground slope angle. This study highlights the importance of neuromuscular controllers for enhancing the adaptiveness of powered prosthetic devices across varied terrain surfaces.
[0099] In order to produce a controller with the ability to adapt, the neuromuscular model with a positive force feedback reflex scheme as the basis of control of the invention was used as part of the control system for a powered ankle-foot prosthesis. The controller presented here employs a model of the ankle-foot complex for determining the physical torque to command at the ankle joint. In this model, the ankle joint is provided with two virtual actuators. For plantar flexion torque, the actuator is a Hill-type muscle with a positive force feedback reflex scheme. This scheme models the reflexive muscle response due to some combination of afferent signals from muscle spindles and Golgi tendon organs. For dorsiflexion torque, an impedance is provided by a virtual rotary spring-damper.
[0100] The parameters of this neuromuscular model were fitted by an optimization procedure to provide the best match between the measured ankle torque of an intact subject walking at a target speed of 1.0 m/sec, and the model's output torque when given as inputs the measured motion of the intact subject. The neuromuscular model-based prosthetic controller was used to provide torque commands to a powered ankle-foot prosthesis worn by an amputee. This control strategy was evaluated using two criteria. First, the controller was tested for the ability to produce prosthesis ankle torque and ankle angle profiles that qualitatively match those of a comparable, intact subject at a target level-ground walking speed. The second performance criterion was the controller's ability to exhibit a biologically-consistent trend of increasing gait cycle net-work for increasing walking slope without changing controller parameters. Detecting variations in ground slope is difficult using typical sensors, so a controller with an inherent ability to adapt to these changes is of particular value.
[0101]
[0102] The ankle joint is a rolling bearing design joining a lower foot structure to an upper leg shank structure topped with a prosthetic pyramid fixture for attachment to the amputee's socket. The foot includes a passive low profile Flex-Foot (Osur) to minimize ground contact shock to the amputee. A unidirectional leaf spring, the parallel spring, acts across the ankle joint, engaging when the ankle and foot are perpendicular to each other. It acts in parallel to a powered drive train, providing the passive function of an Achilles tendon. The powered drive train is a motorized link across the ankle joint as represented in
[0103] At the foot, the series spring, a Kevlar-composite leaf spring, connects the foot to the ball nut with a moment arm, r.sub.s, that is direction-dependent. Therefore, the effective rotary stiffness of the series spring, as evaluated by locking the drive train and exerting a torque about the ankle joint, is 533 N.Math.m/rad for positive torque, and 1200 N.Math.m/rad for negative torque, where positive torque (or plantar flexion torque) is that tending to compress the series spring as represented in
[0104] Sensors. A hall-effect angle sensor at the ankle joint is a primary control input, and has a range of 0.19 to 0.19 radians, where zero corresponds to the foot being perpendicular to the shank. Joint angle is estimated with a linear hall-effect sensor (Allegro A1395) mounted on the main housing. This sensor is proximate to a magnet that is rigidly connected to the foot structure so that the magnetic axis is tangent to the arc of the magnet's motion. As a result of this arrangement, the magnetic field strength at the sensor location varies as the magnet rotates past the sensor. Strain gauges are located inside the prosthetic pyramid attachment, allowing for an estimate of the torque at the ankle joint. Strain gauges located on the series spring permit sensing of the output torque of the motorized drive train, thereby allowing for closed-loop force control of the SEA. The motor itself contains Hall-effect commutation sensors and is fitted with an optical shaft encoder that enables the use of advanced brushless motor control techniques.
[0105] Microcontroller. Overall control and communications for the ankle-foot prosthesis are provided by a single-chip, 16-bit, DSP oriented microcontroller, the Microchip Technology Incorporated dsPIC33FJ128MC706. The microcontroller operates at 40 million instructions per second, with 128 kilo-bytes of flash program memory, and 16384 bytes of RAM. It provides adequate computation to support real time control.
[0106] Motor Controller. A second 16-bit dsPIC33FJ128MC706 was used as a dedicated motor controller. The high computation load and speed requirements of modern brushless motor control methodologies, along with task isolation from the main microcontroller's real time demands motivated this architecture. A high speed digital link between the main microcontroller and the motor microcontroller supplied virtually instantaneous command of the motor.
[0107] Wireless Interface. For development and data collection, a high speed serial port of the microcontroller is dedicated to external communications. This port may be used directly via cable or may have a wide variety of wireless communication devices attached. For the present study, the 500 Hz sensor and internal state information is telemetered over the serial port at 460 Kilobaud and transmitted via an IEEE 802.11g wireless local area network device (Lantronix Wiport).
[0108] Battery. All power for the prosthesis was provided by a 0.22 kg lithium polymer battery having a 165 Watt-Hour/kg energy density. The battery was able to provide a day's power requirements including 5000 steps of powered walking.
[0109] Optimal Mechanical Component Selection. Meeting the requirements for mass, size, torque, speed, energy efficiency, shock tolerance, and nearly silent operation is not a trivial task. Of particular importance is the modeling and optimization of the drive train for the production of the biological torques and motions of walking. Some effects of the motor selection, overall transmission ratio, series elastic spring, and parallel spring are described in S. K. Au, H. Herr, On the Design of a Powered Ankle-Foot Prosthesis: The Importance of Series and Parallel Elasticity, IEEE Robotics & Automation Magazine. pp. 52-59, September 2008.
[0110] Control Architecture. The purpose of the control architecture is to command an ankle torque appropriate to the amputee's gait cycle as determined from available sensor measurements of prosthetic ankle state. The controller determines the appropriate torque using a neuromuscular model of the human ankle-foot complex. In this model, a hinge joint, representing the human ankle joint, is actuated by two competing virtual actuators: a unidirectional plantar flexor which is a Hill-type muscle model, and a dorsiflexor which acts as either a bi-directional proportional-derivative position controller, or a unidirectional virtual rotary spring-damper, depending on the gait phase. A finite state machine maintains an estimate of the phase of the amputee's gait. Depending on this estimated gait phase, one or the other, or both of the virtual actuators produce torques at the virtual ankle joint. The net virtual torque is then used as the ankle torque command to the prosthesis hardware. Physical torque at the ankle joint is produced by both the motorized drive train and the parallel spring. The ankle angle sensor is used to determine the torque produced by the parallel spring, and the remaining desired torque is commanded through the motor controller.
[0111] Top Level State Machine Control. Top level control of the prosthesis is implemented by a finite state machine synchronized to the gait cycle. During walking, two states are recognized: swing phase and stance phase. Prosthesis sensor inputs (ankle torque as estimated from the pyramid strain gauges, ankle angle, and motor velocity) are continuously observed to determine state transitions. Conditions for these state transitions were experimentally determined.
[0112] In
[0113] The transition to swing phase when the foot leaves the ground is detected by either a drop in total ankle torque to less than 5 N.Math.m, as measured using the pyramid strain gauges, or a drop in measured ankle angle, , below 0.19 radians to prevent angle sensor saturation. Positive torque is defined as actuator torque tending to plantar flex the ankle, and positive angles correspond to dorsiflexion. To prevent premature state transitions, the ankle torque developed during the stance phase must exceed 20 Nm for these transitions to be enabled. In addition, a 200 ms buffer time provides a minimum time frame for the stance period. The transition to stance phase upon heel-strike is detected by a decrease in torque below 7 N.Math.m as measured using the pyramid strain gauges.
[0114] A block diagram of an exemplary embodiment of a control system for an ankle-foot prosthesis according to this aspect of the invention is shown in
[0115] The prosthesis measured ankle state, (.sub.m, {dot over ()}.sub.m) is used to produce a torque command from the neuromuscular model, .sub.d. This desired ankle torque is fed through a torque control system to obtain a current command to the prosthesis actuator. The three primary components of this torque control system are the feedforward gain K.sub.ff, lead compensator, and friction compensation term. The parallel spring contribution to prosthesis ankle torque, .sub.p, is subtracted from the desired ankle torque to obtain the desired actuator torque .sub.d,SEA. The closed-loop torque controller then enforces the desired actuator torque using the measured actuator torque, .sub.SEA. Finally, the friction compensation term produces an additional torque value, .sub.f, which is added to the output of the closed-loop torque controller.
[0116]
[0117] Dorsiflexor Model.
[0118] The dorsiflexor in
T.sub.dorsi=K.sub.P+K.sub.V{dot over ()}.(1)
[0119] Here, K.sub.P is the spring constant, and K.sub.V is the damping constant, is the ankle angle and {dot over ()} is the ankle angular velocity. For the stance phase, the value of K.sub.P was optimized along with other muscle model parameters to best match the stance phase behavior of the biological ankle for normal level-ground walking. The damping term, K.sub.V, was experimentally tuned for stance phase to 5 Nm-s/rad to prevent the forefoot from bouncing off the ground at foot-flat. Also during the stance phase, the dorsiflexor acts only to provide dorsiflexion torque, so to mimic the unidirectional property of biological muscles. Furthermore, when the torque generated by the dorsiflexor drops to zero during stance as a result of the foot becoming perpendicular to the shank, the dorsiflexor is disabled for the remainder of the stance phase. Therefore, the dorsiflexor only contributes to the torque production early in the stance phase, when human dorsiflexor muscles are known to play a significant role [J. Perry, Gait Analysis: Normal and Pathological Function, New Jersey: SLACK Inc., 1992, Chapter 4, pp. 55-57]. In the swing phase, the dorsiflexor acts as a position controller, driving the foot to the set-point [=0, {dot over ()}=0]. For this, a gain of K.sub.P=220 Nm/rad and damping constant of K.sub.V=7 N.Math.m.Math.s/rad provides for quick ground clearance of the foot early in the swing phase.
[0120] Plantar Flexor Model. The virtual plantar flexor in
[0121] Plantar Flexor Series Elastic Element. The series elastic element (SE) operates as a tendon in series with the muscle contractile element as in [H. Geyer, A. Seyfarth, R. Blickhan, Positive force feedback in bouncing gaits?, Proc. R Society. Lond. B 270, pp. 2173-2183, 2003]. Taking as the tendon strain defined as:
where 1.sub.SE is the length of the series element and 1.sub.slack is its rest length, the series element is specified to be a nonlinear spring described by H. Geyer, A. Seyfarth, R. Blickhan, Positive force feedback in bouncing gaits?, Proc. R Society. Lond. B 270, pp. 2173-2183, 2003:
where F.sub.max is the maximum isometric force that the muscle can exert. Following H. Geyer, A. Seyfarth, R. Blickhan, Positive force feedback in bouncing gaits?, Proc. R Society. Lond. B 270, pp. 2173-2183, 2003, this quadratic form was used as an approximation of the commonly-modeled piecewise exponential-linear tendon stiffness curve. This approximation was made so to reduce the number of model parameters.
[0122] Plantar Flexor Contractile Element. The contractile element (CE) of the plantar flexor virtual actuator,
F.sub.MF(l.sub.CE,v.sub.CE,A)=F.sub.maxf.sub.L(l.sub.CE)f.sub.V(v.sub.CE)A.(4)
The force-length relationship, f.sub.L(1.sub.CE), of the Hill-type muscle is a bell-shaped curve given by:
where, 1.sub.opt is the contractile element length, 1.sub.CE, at which the muscle can provide the maximum isometric force, F.sub.max. The parameter w is the width of the bell-shaped curve, and the parameter c describes the curve's magnitude near the extremes of the bell, where:
f.sub.L(l.sub.CE=(1w)l.sub.opt)=exp(c).(6)
The force-velocity relationship, f.sub.v(v.sub.CE), of the CE is the Hill equation:
where v.sub.max<0 is the maximum contractile velocity of the muscle, v.sub.CE is the fiber contraction velocity, K is the curvature constant, and N defines the dimensionless muscle force (normalized by F.sub.max) such that
N=f.sub.V(v.sub.CE=v.sub.max).(8)
[0123] Following H. Geyer, H. Herr, A muscle-reflex model that encodes principles of legged mechanics predicts human walking dynamics and muscle activities, (Submitted for publication), the force-length relationship for the high-limit parallel elasticity (HPE), set in parallel with the CE, is given by:
A low-limit, buffer parallel elasticity (LPE) is also included, based on H. Geyer, H. Herr, A muscle-reflex model that encodes principles of legged mechanics predicts human walking dynamics and muscle activities, (Submitted for publication). This was given the form of the nonlinear spring:
Therefore, the total plantar flexor force is described by:
F.sub.CE=F.sub.MF(l.sub.CE,v.sub.CE,A)+F.sub.HPEF.sub.LPE.(11)
Where F.sub.CE is the force developed by the contractile element. Since the CE and SE are in series, the following equation holds: F.sub.CE=F.sub.SE=F.sub.MTC.
[0124] Reflex Scheme. The contractile element activation, A, is generated using the positive-force feedback reflex scheme shown in
[0125] As depicted in
[0126] Plantar Flexor Geometry and Implementation. Within the muscle model framework, the ankle angle, .sub.foot, is defined as shown in
l.sub.MTC=r.sub.foot(sin(.sub.ref.sub.max)sin(.sub.foot.sub.max))+l.sub.slack+l.sub.opt.(12)
where is a scaling factor representing the pennation angle of the muscle fibers, and .sub.ref is the ankle angle at which l.sub.CE=l.sub.op, under no load.
[0127] The fiber length, l.sub.CE can be computed using l.sub.CE=l.sub.MTCl.sub.SE, where l.sub.SE is obtained from the inverse of (3) given the current value of F.sub.CE=F.sub.SE=F.sub.MTC from the muscle dynamics. The fiber contraction velocity, v.sub.CE, can then be obtained via differentiation. This creates a first order differential equation governed by the dynamics of the neuromuscular model. This equation can be solved for F.sub.MTC given the time history of .sub.foot and initial condition. However, since integration is computationally more robust than differentiation, an integral form of this implementation was used to solve for F.sub.MTC, as described in H. Geyer, H. Herr, A muscle-reflex model that encodes principles of legged mechanics predicts human walking dynamics and muscle activities, (Submitted for publication).
[0128] Given the attachment radius, r.sub.foot, and the angle, .sub.max, at which maximum muscle-tendon moment arm is realized, the relationship between F.sub.MTC and the resulting plantar flexor contribution to ankle torque, T.sub.plantar, is given by
T.sub.plantar=F.sub.MTC cos(.sub.foot.sub.max)r.sub.foot=F.sub.MTC.Math.R(.sub.foot)(13)
where R(.sub.root) is a variable moment arm resulting from the muscle attachment to the ankle joint model. This relationship is shown graphically in
[0129] Neuromuscular Model Parameter Determination. The plantar flexor model is a lumped representation of all of the biological plantar flexor muscles. Likewise, the dorsiflexor represents all biological dorsiflexor muscles. In this work, joint and torque measurements were taken only at the ankle joint. As a result, the state of multi-articular muscles, such as the gastrocnemius, could not be accurately estimated. Therefore the plantar flexor was based upon the dominant monarticular plantar flexor in humans, the Soleus. Therefore, the majority of the plantar flexor parameters values are those reported in H. Geyer, H. Herr, A muscle-reflex model that encodes principles of legged mechanics predicts human walking dynamics and muscle activities, (Submitted for publication) for the Soleus muscle. Some parameters of the plantar flexor, as well as those for the dorsiflexor, however, were expected to either have been significantly affected by the lumped models, or were not well known from biology. These six parameters were fitted using a combination of a Genetic Algorithm and gradient descent to enable the neuromuscular model to best match the walking data of an intact subject.
[0130] Non-Optimized Parameter Values are shown in Table 6.
TABLE-US-00006 TABLE 6 l.sub.opt [m] 0.04 w 0.56 l.sub.slack [m] 0.26 c ln(0.05) v.sub.max [l.sub.opt/s] 6.0 N 1.5 .sub.ref 0.04 K 5 PreA 0.01 0.5 T [s] 0.01 r.sub.foot [m] 0.05 PreSTIM 0.01 Delay.sub.RF [s] 0.02
[0131] Non-amputee Subject Data Collection. Kinetic and kinematic walking data were collected at the Gait Laboratory of Spaulding Rehabilitation Hospital, Harvard Medical School, in a study approved by the Spaulding committee on the Use of Humans as Experimental Subjects [H. Herr, M. Popovic, Angular momentum in human walking, The Journal of Experimental Biology, Vol. 211, pp 487-481, 2008]. A healthy adult male (81.9 kg) was asked to walk at slow walking speed across a 10 m walkway in the motion capture laboratory after informed consent was given.
[0132] The motion-capture was performed using a VICON 512 motion-capture system with eight infrared cameras. Reflective markers were placed at 33 locations on the subject's body in order to allow the infrared cameras to track said locations during the trials. The cameras were operated at 120 Hz and were able to track a given marker to within approximately 1 mm. The markers were placed at the following bony landmarks for tracking the lower body: bilateral anterior superior iliac spines, posterior superior iliac spines, lateral femoral condyles, lateral malleoli, forefeet and heels. Wands were placed over the tibia and femur, and markers were attached to the wands over the mid-shaft of the tibia and the mid-femur. Markers were also placed on the upper body at the following sites: sternum, clavicle, C7 and T10 vertebrae, head, and bilaterally on the shoulder, elbow, and wrist joints.
[0133] Ground reaction forces were measured using two staggered force plates (model no. 2222 or OR6-5-1, by Advanced Mechanical Technology Inc., Watertown, Mass., USA) which were incorporated into the walkway. The precision of these force plates measuring ground reaction force and center of pressure is approximately 0.1 N and 2 mm respectively. The force plate data was collected at 1080 Hz and synchronized with the VICON motion capture data. Joint torques were calculated from the ground reaction forces and joint kinematics using a modified version of a standard inverse dynamics model. Vicon Bodybuilder, by Oxford Metrics, UK was used to perform the inverse dynamics calculations.
[0134] Six trials were obtained for a slow level-ground walking speed (1.0 m/s mean) and a single trial was used to represent the target ankle and torque trajectories for this walking condition. The end of the stance phase was defined as the point in time when the joint torque first dropped to zero after the peak torque was reached in the gait cycle. This event occurred at 67% gait-cycle for the selected trial.
[0135]
[0136] Fitting of Model Parameters to Experimental Data via Optimization. The following parameters were chosen for tuning: F.sub.max, Gain.sub.FB, Gain.sub.SUPP, .sub.ref, and .sub.max. The goal of the parameter tuning was to find the parameter set that would enable the neuromuscular model to best match a biological ankle torque trajectory for a particular walking condition, given the corresponding biological ankle angle trajectory as input to the model. The cost function for the optimization was defined as the squared error between the biologic and model torque profiles during the stance phase, given the biological ankle angle trajectory, i.e.:
where T.sub.m is the torque output of the model, and T.sub.bio is the biological ankle torque.
[0137] A Genetic Algorithm optimization was chosen to perform the initial search for optimal parameter values, and a direct search was included to pinpoint the optimal parameter set. The Genetic-Algorithm tool in Matlab was used to implement both optimization methods. The level-ground human walking data at the selected 1.0 m/s walking speed was used to provide the reference behavior for the optimization. The allowable range for each of the optimization parameters are shown in Table 7.
TABLE-US-00007 TABLE 7 Optimization Parameter Ranges Parameter (Units) Minimum Value Maximum Value F.sub.max (N) 3000 7000 Gain.sub.FB 0.6 1.5 K.sub.P (N .Math. m/rad) 20 250 Gain.sub.SUPP 0 5 .sub.ref (rad) 0.52 2.09 .sub.max (rad) 1.40 2.44
[0138] The initial population was chosen by the optimizer. The parameter values obtained from the parameter optimization are shown in Table 8.
TABLE-US-00008 TABLE 8 Fitted Values of Neuromuscular Model Parameters F.sub.max (N) 3377 Gain.sub.FB 1.22 K.sub.P (N .Math. m/rad) 72.9 Gain.sub.SUPP 0 .sub.ref (rad) 1.49 .sub.max (rad) 1.95
[0139] Results of the parameter optimization. As a verification of the optimization effectiveness, the optimization was run with the final parameters using the biological ankle angle profile as input to the neuromuscular model. A comparison of the resulting torque profile to the biologic torque profile is shown in
[0140] As shown in
[0141] Low-Level Torque Control. The physical torque actually produced at the ankle joint during stance phase is from the combined actions of the parallel spring and the motorized drive train. The rotary parallel spring stiffness is approximately linear in the range of operation, with a spring stiffness of 500 N.Math.m/rad. Using this spring constant, the parallel spring contribution is predicted and subtracted from the desired ankle torque. The remaining torque must be produced by the motorized drive train.
[0142] The performance of the motorized drive train is improved by use of lead compensation, friction compensation and feed-forward techniques, as shown in
[0143] Clinical Evaluation. The prosthesis was placed on the right leg of a healthy, active, 75 kg transtibial amputee. The subject was allowed time to walk on the prosthesis for natural adjustment. The wireless link to the prosthesis was used to record the walking data from these trials. During the level-ground walking trials, the subject was asked to walk across a 10 m long path. The target intended walking speed was set to 1.0 m/s to match that of the intact subject. The subject began walking approximately 5 m from the beginning of the pathway, and stopped walking approximately 3 m past the end of the path. Markers on the ground were used to note the beginning and end of the 10 m path. A stopwatch was used to verify the average walking speed for each trial by noting when the subject's center of mass passed over each of the markers. A total of 10 trials were captured. Trials with walking speeds within 5% of the target speeds were used for processing, resulting in 45 gait cycles. The subject was next asked to walk up an 11-degree, 2 m long incline at a self-selected speed. The subject started on level-ground approximately 2 m from the start of the incline and stopped approximately 1 m past the incline on a platform for 10 ramp-ascent trials. This same path was then navigated in reverse for 12 ramp-descent trials.
[0144] Data Analysis. The first three and last three gait cycles of the level-ground trials were assumed to be transients, and were therefore ignored. Each of the remaining gait cycles were re-sampled to span 1000 data points. Mean and standard-deviation trajectories were computed from the resulting data. For both ramp ascent and descent, the last step on the ramp was used as the representative gait cycle. Each selected gait cycle was re-sampled and averaged in the same manner as described for the level-ground trials.
[0145] The net work was calculated for each individual gait cycle by numerically integrating ankle torque over ankle angle from heel-strike to toe-off. Here the swing phase was ignored for the net work calculations. The average net work for each walking condition was then computed from the individual gait cycle net work values.
[0146] Results. Torque Tracking. A precondition of the present experiments was the ability of the ankle-foot prosthesis to actually produce the torques and speeds that would be commanded by the neuromuscular controller. This ability is demonstrated in
[0147] Adaptation to Ground Slope. The evaluation of ground slope adaptation of the neuromuscular-model controlled prosthesis was confirmed by the clinical trial data of
TABLE-US-00009 Level-Ground 5.4 0.5 Joules Ramp Ascent 12.5 0.6 Joules Ramp Descent 0.1 1.7 Joules
[0148] Comparison to a Biological Ankle. The purpose of this neuromuscular model is to represent the inherent dynamics of the human ankle-foot complex in a useful way. Therefore, one may evaluate the resulting prosthesis controller based upon its ability to mimic the human behavior.
[0149]
[0150] The measured ankle torque and ankle angle profiles of the prosthesis qualitatively match those of a comparable intact individual for level-ground walking. The differences observed are of a low order, and may reasonably be attributed to a number of factors, including atrophy and/or hypertrophy in the clinical subject's leg muscles resulting from amputation, differences in limb lengths, and perhaps the lack of a functional biarticular gastrocnemius muscle. In addition, the limited range of the prosthetic angle sensor prohibited the prosthesis from reaching the full range of motion of the intact ankle.
[0151] Ground Slope Adaptation. The neuromuscular control presented here exhibits an inherent adaptation to ground slope without explicit sensing of terrain. The increased ankle net work during ramp ascent, and the decreased ankle net work during ramp descent, as compared to that of level ground walking, is consistent with the behavior of an intact human ankle under the same conditions, according to data from [A. S. McIntosh, K. T. Beatty, L. N. Dwan, and D. R. Vickers, Gait dynamics on an inclined walkway, Journal of Biomechanics, Vol. 39, pp 2491-2502, 2006]. This variation of stance-phase positive net work across walking conditions indicates a slope-adaptive behavior that is emergent of the neuromuscular model. The ability of the neuromuscular model to produce these biomimetic changes in behavior suggests that the model embodies an important characteristic of the human plantar flexor muscles. In addition, it is anticipated that the model has the potential for speed adaptation. In an attempt to move faster, the wearer may push harder on the prosthesis. This additional force could cause the modeled reflex to command higher virtual muscle forces, resulting in greater energy output, and hence higher walking speeds.
[0152] While a preferred embodiment is disclosed, many other implementations will occur to one of ordinary skill in the art and are all within the scope of the invention. Each of the various embodiments described above may be combined with other described embodiments in order to provide multiple features. Furthermore, while the foregoing describes a number of separate embodiments of the apparatus and method of the present invention, what has been described herein is merely illustrative of the Appl. of the principles of the present invention. Other arrangements, methods, modifications, and substitutions by one of ordinary skill in the art are therefore also considered to be within the scope of the present invention, which is not to be limited except by the claims that follow.