METHOD FOR THE OPEN-LOOP AND CLOSED-LOOP CONTROL OF A DEVICE INCLUDING A MOVEMENT MODULE DURING THE INTERACTION OF THE DEVICE WITH A HUMAN, AND DEVICE CONTROLLED IN SUCH A MANNER
20220362930 · 2022-11-17
Inventors
- Alexander Koenig (Muenchen, DE)
- Helfried Peyrl (Oberhaching, DE)
- Erfan Shahriari (Muenchen, DE)
- Sami Haddadin (Hannover, DE)
- Dinmukhamed Zardykhan (Muenchen, DE)
- Xavier Hildenbrand (Muenchen, DE)
Cpc classification
International classification
Abstract
A method for open-loop and closed-loop control of a device having a movement module, in terms of its interaction with a human, is based on an energy-based control process that makes it possible to monitor the amount of an overall energy in the system including the device and the human in dependence on a measured control variable describing the speed at which the device or its movement module moves. The method considers the entire power cycle, in particular the dynamics of the energy or power flow, in the system including the device and the human and takes into account the performance of the human during the closed-loop control. The method also enables the participation state of the human who is using the device to be determined in an iterative learning process without additional sensors. A device for carrying out the method is also provided.
Claims
1-15. (canceled)
16. A method for open-loop and closed-loop control of a device, at least including a movement module, in terms of an interaction of the device with a human, the method comprising: defining an energy network formed at least of: a first power component describing an amount of energy per unit time supplied by the device to an overall energy of a system of the device and the human; a second power component describing an amount of energy per unit time lost by the device by way of internal open-loop and closed-loop control processes outside of work to be carried out primarily aided by the movement module; and a third power component describing an amount of energy per unit time supplied by the human to the overall energy; defining the overall energy of the energy network of the system of the device and the human as a controlled variable; defining a speed with which the device interacts with the human by way of the movement module as a control variable, with the movement module intended to traverse a desired trajectory; causing the overall energy of the energy network to: increase as more movement independently carried out by the human deviates from a movement along the trajectory initially specified by the device; and decrease again as the movement independently carried out by the human approaches the movement along the trajectory initially specified by the device; determining the overall energy of the energy network during the movement of the movement module, and varying the control variable during the movement of the movement module, depending on the determined overall energy, causing the overall energy to: remain in an interval of S≤S.sub.max−−SΔ when located in the interval, or approach the interval S≤S.sub.max−SΔ again when located in an interval of S>S.sub.max−SΔA, where: S.sub.max=a chosen upper boundary of the overall energy; and SΔ=S.sub.max−Sx1, where Sx1 represents individual values of the controlled variable or the overall energy S and x=n is used to designate values in an interval with P.sub.in>0 and x=p is used to designate values in an interval with P.sub.in<0.
17. The method according to claim 16, which further comprises: using the device as a rehabilitation mechanism configured for a rehabilitation of at least joints, muscles and tendons of lower extremities of a human according to plan; bringing the movement module into an operative connection with the lower extremities of the human; and providing the movement module with: at least one force sensor for measuring an absolute value of a force between the movement module and the lower extremity of the human, and at least one angle sensor for measuring a direction of the force between the movement module and the lower extremity of the human.
18. The method according to claim 16, which further comprises defining the control variable as:
19. The method according to claim 16, which further comprises defining the control variable as:
20. The method according to claim 16, which further comprises defining the control variable as:
21. The method according to claim 16, which further comprises damping the variation of the control variable during the movement of the movement module based on the determined overall energy or by implementing at least one of a filter, a rate restriction or a limitation of an absolute value of a first derivative of the control variable with respect to the overall energy.
22. The method according to claim 16, which further comprises: defining the overall energy of the system of the device and the human, or including a virtual absolute energy value and an actual absolute energy value, as an overall storage function S=S.sub.ce or as an overall storage function S=S.sub.ce+S.sub.ee; and defining the energy storage function of the control deviation as:
S.sub.ce½{tilde over ({dot over (x)})}.sup.TM.sub.C(q){tilde over ({dot over (x)})}+½{tilde over (x)}.sup.TK.sub.x{tilde over (x)}. where: S.sub.ce=control error energy storage function; M.sub.C(q)=the Cartesian moment of inertia matrix; K.sub.x=the Cartesian stiffness matrix; and S.sub.ee=overall energy of an end effector of the device or of the movement module formed of kinetic and potential energy.
23. The method according to claim 22, which further comprises: determining the energy storage function by way of the first power component, and combining the first power component by calculation with the second power component; or calculating the energy storage function by way of an interaction force between the device and the human, or measuring the energy storage function by using a force sensor for measuring an absolute value of a force between the movement module and the lower extremity of the human.
24. The method according to claim 22, which further comprises determining a time derivative of the overall storage function as {dot over (S)}=P.sub.in+P.sub.h−P.sub.diss, where: P.sub.in∈R=power input into the system generated by a movement generator; P.sub.diss∈R=power lost by control damping; and P.sub.h=power supplied to the system of the device and the human by the human.
25. The method according to claim 16, which further comprises determining a limit to be chosen for carrying out a movement by way of an iterative learning process by the device while the movement is carried out, the limit being for at least one of the overall storage function corresponding to the overall energy or a variable SΔ=S.sub.max−S.sub.p_x, where S.sub.p_x are individual values of the overall energy; and changing at least one of a learning factor or a forgetting factor for determining a participation state of the human in the movement specified by the device over time, or changing linearly over time, within a scope of the iterative learning process until at least one of the learning factor or the forgetting factor has reached a final value defined in advance.
26. The method according to claim 25, which further comprises: choosing a value for the limit in a first iteration step, when the device fully assists the human with carrying out the movement and the control variable has a value of 1; reducing the value of the limit in each further iteration step for as long as the control variable maintains the value of 1; and when the control variable deviates from the value of 1, increasing the value of the limit again in a next iteration step.
27. The method according to claim 25, which further comprises determining an initial limit by: initially running the device through n movement cycles without a given limit, providing a number n of movement cycles in an interval of 2≤n≤5 movement cycles or providing 3 movement cycles; recording an S profile; subsequently calculating a mean value of the recorded S values as the initial limit, serving as a start value for the limit in a first iteration step of the iterative learning process in a form λ.Math.S.sub.init with λ≥1; and scaling at least one of the learning factor or the forgetting factor for determining a participation state of the human in the movement specified by the device based on the initial limit when initializing the iterative learning process.
28. The method according to claim 27, which further comprises choosing a limit for carrying out a movement, the limit being for the overall storage function corresponding to the overall energy and being split into regions based on a phase value describing a movement progress within a movement cycle of the device and determining an initial limit for each region.
29. The method according to claim 16, which further comprises: choosing a limit for carrying out a movement, the limit being for the overall storage function corresponding to the overall energy, and being: split into regions based on a phase value describing the movement progress within a movement cycle of the device, with a region describing the phase value interval from ϕ.sub.str, i to ϕ.sub.str, i+1, and defining the limit to be chosen independently for each region, with the following applying to all phase values of a region:
30. A device, comprising: a rehabilitation mechanism configured for a rehabilitation of at least joints, muscles and tendons of lower extremities of a human according to plan; a movement module configured to be brought into an operative connection with the lower extremities of the human, said the movement module including: at least one force sensor for measuring an absolute value of a force between said movement module and the lower extremity of the human, and at least one angle sensor for measuring a direction of the force between said movement module and the lower extremity of the human; and a control unit configured for open-loop and closed-loop control of the device according to the method of claim 16.
Description
[0113] Additional details and further advantages of the invention are described below on the basis of preferred exemplary embodiments, which however do not restrict the present invention, and in conjunction with the attached drawing,
[0114] in which schematically:
[0115]
[0116]
[0117]
[0118]
[0119]
[0120]
[0121]
[0122] In the following description of preferred embodiments of the present invention, the same reference signs denote the same or comparable components.
[0123] The method according to the invention for open-loop and closed-loop control of a device 1, at least comprising a movement module 50, in terms of its interaction with a human M, is not device-specific as a matter of principle and can find use in the open-loop and closed-loop control of a multiplicity of devices 1, especially robotic systems. However, the use of the method is particularly preferred for open-loop and closed-loop control of robotic systems which are used to provide medical engineering-based assistance in the rehabilitation of patients, in particular following a cerebrovascular accident or a severe accident which has impaired physical and/or cognitive abilities. In this respect, exemplary reference is made to a rehabilitation mechanism as disclosed in DE 10 2015 117 596 B3 by one of the applicants.
[0124] To explain the method according to the invention, a robotic rehabilitation system consisting of a bed that can be driven into the vertical and two robotic arms for interaction with the legs of a human M is considered below as a model system or device 1 (also cf.
[0125] A first and a second embodiment of a device 1 which can be controlled by the method according to the invention are shown in
[0126] Such a device 1 preferably comprises a rehabilitation mechanism 30 suitably designed for a rehabilitation of at least the joints, muscles and tendons of the lower extremities of a human M according to plan, using a movement module 50 that is able to be brought into an operative connection with the lower extremities of the human M; the movement module 50 comprising at least one force sensor 51 for measuring an absolute value of a force between the movement module 50 and the lower extremity of the human M, and at least one angle sensor 52 for measuring the direction of the force between the movement module 50 and the lower extremity of the human M. By means of a control unit 11, there is open-loop or closed-loop control of the device 1 in accordance with the method according to the invention.
[0127] Each robotic arm preferably comprises n motor-driven joints and a passive end joint in order to avoid overdetermination and consequently to consider the respective orientation of the thigh or thighs of the human M. The robotic arms are considered identical for the following derivation of the control model and for the explanation of the method according to the invention, and so the explanations can be restricted to one robotic arm, although these equally apply accordingly to the other arm.
I) Model for Describing the Device 1, Especially the Robotic Rehabilitation System
[0128] Within the scope of considering the kinematic structure of the robotic system, the assumption is made that the end effector and the joints of the robot move only parallel to the xy-plane (cf.
[0129] Taking account of n motor-driven joints of the robot and the orientation q.sub.b of the bed, the coordinates of the robot including the last joint emerge as q∈R.sup.n+1 and the direct kinematic (forward kinematic) emerges as
x.sub.r=f(q) (1)
[0130] where the orientation of the bed q.sub.b is contained in q.
[0131] Further, the assumption is made that the orientation of the bed is driven by a separate actuator such that the correspondingly introduced torque is not considered in the dynamic model described here.
[0132] The dynamic model is described as follows:
τ.sub.in+τ.sub.r=M(q′){umlaut over (q)}′+C(q′,{dot over (q)}+){dot over (q)}′+g(q), (2)
q=[q.sub.b,q′].sup.T (3)
[0133] with M(q′) (=the moment of inertia matrix of the robot), C(q′, {dot over (q)}′) (=the Coriolis and centrifugal matrix of the robot)∈R.sup.n×n and g(q)∈R.sup.n (=gravitational vector of the robot). τ.sub.in∈R.sup.n is the torque introduced to the robotic actuators, whereas τ.sub.r∈ denotes the action of force (“wrench”) F.sub.r, mapped on the motor-driven joints of the robot by way of
[0134] with J(q)∈R.sup.n×3=Jacobi matrix of the robot.
II) Control Method on the Basis of Energy Considerations
[0135] The control scheme according to the invention is based on adapting the movement to be carried out by the robot (“robot desired motion”) {x.sub.d, {dot over (x)}.sub.d, {umlaut over (x)}.sub.d}∈R.sup.3 in order to shape the energy flow within the system of device 1 and human M and thereby control the energy transfer between human M and device 1. Taking account of a cyclical trajectory with an assigned movement amplitude, which is specified for a specific rehabilitation movement, the speed with which the trajectory is traversed by the robot is adjusted so that a specified energy limit is also observed. The adjusted trajectory obtained in this way (“re-shaped trajectory”) is then transferred as an input to a control unit for controlling the interaction movement in order to obtain an introduced torque (“input torque”) for the robot actuators (cf.
[0136]
[0137] Below, a law of motion for the control method is now initially set up in exemplary fashion and an energy network for the model is subsequently derived.
a) Controlling the Interaction Movement
[0138] The assumption is made that the device 1, especially the robot, is in physical contact with the human M throughout the entire therapy (=carrying out the therapy movement). Therefore, the use of a compliant control method such as Cartesian impedance control, for example, is recommended.
[0139] If {x.sub.d, {dot over (x)}.sub.d, {umlaut over (x)}.sub.d} is accordingly considered as a trajectory of the device 1, especially of the robot, described in Cartesian coordinates, then the following relationships arise:
τ.sub.in=J.sup.T(q)(M.sub.C(q){umlaut over (x)}.sub.d+C.sub.C(q,{dot over (q)}){dot over (x)}.sub.d+D.sub.x
{tilde over (x)}=x.sub.d−x.sub.r, (7)
[0140] with K.sub.x (=Cartesian stiffness matrix); D.sub.x (=Cartesian damping matrix)∈R.sup.3×3 and M.sub.C(q) (=Cartesian moment of inertia matrix), C.sub.C(q, {dot over (q)}) (=Cartesian Coriolis and centrifugal matrix)∈R.sup.3×3.
[0141] These matrices are defined as:
M.sub.C(q)=J.sup.−1.sup.
C.sub.C(q,{dot over (q)})=(J.sup.−1.sup.
b) Description of the Energy Flow in the System
[0142] Taking account of Equations (2) and (6), the following arises for the dynamics of the closed-loop control circuit:
M.sub.C(q){tilde over ({umlaut over (x)})}+(C.sub.C(q,{dot over (q)})+D.sub.x){tilde over ({dot over (x)})}+K.sub.x{tilde over (x)}=F.sub.r. (10)
[0143] The following control error energy storage function can be defined for such a device 1, especially for such a robot:
S.sub.ce=½{tilde over ({dot over (x)})}.sup.TM.sub.C(q){tilde over ({dot over (x)})}+½{umlaut over (x)}.sup.TK.sub.x{umlaut over (x)}. (11)
[0144] Taking account of Equation (10) and the skew-symmetric properties of ({dot over (M)}.sub.C(q; {dot over (q)})−2C.sub.C(q; {dot over (q)})), it is possible to prove the following:
[0145] where P.sub.in∈R describes the power input into the system generated by the movement generator (especially corresponding to a movement module 50 of the device 1), P.sub.r∈R describes the power input into the system generated by the surroundings, and P.sub.diss∈R describes the power lost by control damping. These variables are defined as follows:
P.sub.in:=−{dot over (x)}.sub.d.sup.TF.sub.r, (13)
P.sub.r:={dot over (x)}.sub.r.sup.TF.sub.r, (14)
P.sub.diss:=−{tilde over ({dot over (x)})}.sup.TD.sub.x{tilde over ({dot over (x)})}. (15)
[0146] What moreover emerges from taking
S.sub.ee=½{dot over (x)}.sub.ee.sup.TM.sub.ee{dot over (x)}.sub.ee+m.sub.eeg.sub.0.sup.Tx.sub.ee. (16)
[0147] where x.sub.ee∈R.sup.3 describes the coordinates of the center of mass of the respective end effector pose, g.sub.0=[0, g.sub.0, 0].sup.T describes the gravitational vector in world coordinates, and m.sub.ee∈R.sub.+ and M.sub.ee∈R.sup.3×3 describes the mass or moment of inertia matrix of the end effector. The moment of inertia matrix is defined as:
M.sub.ee=diag(m.sub.ee,m.sub.ee,I.sub.zz,ee), (17)
[0148] where I.sub.zz,ee∈R.sub.+ is the last component of the moment of inertia tensor of the end effector.
[0149] Taking account of Newton's second law and the sum of the forces acting on the end effector, the following arises:
[0150] Now it is possible to define an overall storage function S∈R.sub.>0 as:
S:=S.sub.ce+S.sub.ee, (19)
[0151] and, by taking account of Equations (12) and (18), the following arises:
{dot over (S)}=P.sub.in+P.sub.h−P.sub.diss, (20)
[0152] where P.sub.h describes the power supplied to the system of device 1 and human M by the human M, in turn defined as:
P.sub.h:={dot over (x)}.sub.h.sup.TF.sub.h. (21)
[0153]
c) Energy Limitation
[0154] Normally, energy-based control modeling is used to examine the stability of a system by means of a passivity analysis. However, such models have further advantages, specifically for example a description of the energy flow between two independent (partial) systems. This is of particular interest should one of the (partial) systems act unpredictably, as in the case of a human M (in terms of their interaction with a device 1).
[0155] A corresponding example is found in SHAHRIARI, E., KRAMBERGER, A.; GAMS, A., UDE, A., HADDADIN, S.: Adapting to contacts: Energy tanks and task energy for passivity-based dynamic movement primitives; 2017 IEEE-RAS 17.sup.th International Conference on Humanoid Robotics (Humanoids), Birmingham, 2017, pp. 136-142 (doi: 10.1109/HUMANOIDS.2017.8239548).
[0156] The open-loop and closed-loop control method according to the invention now provides for the above-derived energy models to be applied such that the energy transferred from the device 1 to the human M is restricted, and provides for the responsiveness level of the device 1 to be matched to movements of the human M according to plan.
[0157] Proceeding from Equation (20), it emerges that the controlled device 1, especially the robot, is passive in relation to the channels −{dot over (x)}.sub.d, F.sub.r
and
{dot over (x)}.sub.h, F.sub.h
. For the overall stability of the system, it is therefore necessary to passivate the effect/influence of the aforementioned channels on the system. One option for doing this lies in increasing a virtual energy tank that has been defined for these channels since a design of a virtual energy tank according to plan amounts to a limitation of the overall storage function S. The stability of the overall system is ensured if the overall storage function S (corresponding to the overall energy of the system consisting of virtual and actual (“real”) energy) is guaranteed to always be bounded.
[0158] What moreover arises from Equation (20) is that the energy flow between device 1 and human M depends directly on the overall storage function S. A high value of S can be interpreted as a large absolute value of stored energy which can be transferred to the human M whenever P.sub.h<0. According to Equation (21), this may be the case if the movement specified (generated) by the device 1 is counter to a force exerted by the human M. The size of the possible energy transfer from the device 1 to the human M can be restricted to a safe range by restricting the stored energy S. From the statements made above, it is possible to derive that there is an absolute upper boundary for the overall storage function S (=overall energy), which meets both stability and safety requirements. Consequently, it is possible to define any limit S.sub.max between the value of 0 and the aforementioned absolute upper boundary. The precise choice of S.sub.max influences the responsiveness level of the device 1 to deviations between the movement of the human M and the desired, specified movement of the device 1, especially of the robot or of the movement module 50 of the device 1.
[0159] Under the assumption of S.sub.ee<<S.sub.r, Equations (11) and (19) yield that the overall storage function S is predominantly determined by the size of the tracking error variables {tilde over (x)} and {tilde over ({dot over (x)})}. The values of these variables can in turn only be reduced on the control side by changing the specified trajectory in line with the movement of the human M. For the application, this means that the result of choosing a smaller value for S.sub.max leads to the device 1 becoming more responsive within the scope of an interaction with the human.
d) Energy-Based Movement Generator
[0160] The overall storage function S cannot be controlled directly because it is a function of the unpredictable movement of the human M, that is to say S=f ({dot over (x)}.sub.h, F.sub.h),
[0161] as emerges from Equations (20) and (21). However, as emerges from Equation (13), S can be controlled, or expressed differently “shaped”, indirectly by way of P.sub.in, by adjusting x.sub.d using (S−S.sub.max) as a reference. In this case, consideration has to be given to the fact that controlling or shaping the energy should not change the trajectory pattern specified by a therapist or the desired trajectory amplitude, but only the speed of the desired movement. In theory, the trajectory pattern can be specified in any way; however, especially for demonstration purposes, the use of a smooth sinusoidal function
x.sub.d=0.5A(1−cos(2πϕ)), (22)
{dot over (x)}.sub.d=ΩAπ sin(2πϕ), (23)
[0162] has proven its worth, where A∈R.sub.≥0 describes the amplitude and Ω∈R.sub.≥0 describes the frequency of the desired cyclical movement. The periodic phase ϕ∈[0,1] describes the advance of the movement within a cycle and is determined for any time t by
ϕ=∫.sub.t.sub.
[0163] where t.sub.0 describes the start time of the cyclical movement.
[0164] It is evident from Equations (22) and (23) that the desired speed and ultimately also the energy of the overall system can be controlled or shaped by adjusting Ω while a specified trajectory amplitude is taken into account. Moreover, the phase value ϕ can also be used to determine when the leg of a human M has run through a full movement cycle, in order to thereupon trigger the movement of the other leg. This advantageously prevents independent and chaotic movement profiles of the legs in relation to one another.
[0165] A movement adjustment law for smoothly adjusting Ω can finally be as follows:
[0166] where S.sub.max−SΔ describes the limit for S where the energy control or shaping starts, and γ.sub.p and γ.sub.n denote the maximum permitted positive and negative value for Ω, respectively.
[0167] Alternatively, a preferred movement adjustment law for smoothly adjusting Ω according to the invention can also be as follows:
[0168] In this case, a region Sδ in which the control variable Ω is set equal to zero is defined in the middle of the interval SΔ in the interval of P.sub.in>0 (corresponding to the respective left side in the diagrams in
[0169]
[0170] The standard value for Ω is 1. If S exceeds the allowed limit, the control or change of Ω depends on the value of P.sub.in, that is to say on the direction of the power flow. If P.sub.in>0, that is to say the device 1 supplies energy to the system at the time the limit is exceeded, Ω is reduced in order to slow down or even reverse the desired, specified movement. If P.sub.in<0, that is to say the energy limit is exceeded by virtue of the human M supplying energy to the system, Ω is increased in order to reduce the tracking error, i.e., {tilde over (x)} and {tilde over ({dot over (x)})}, as a result of which energy is taken from the system and the system is brought to a safer (stability) level.
[0171] A second example of a functional dependence of the control variable Ω on an overall energy S as a controlled variable, especially as can be described by Equation (25a), is shown in
[0172] Moreover, if Sδ is set equal to zero ((Sδ=0), the following arises:
[0173] where now
[0174] applies.
[0175] To set different response thresholds (“responsiveness levels”) of the device 1, it is possible in particular to choose the following values for the parameters or relationships between the parameters:
TABLE-US-00001 Responsiveness level high γ.sub.p = 2; γ.sub.n = 1 S.sub.n1 = S.sub.p1 S.sub.p2 = S.sub.p1 S.sub.n2 = 2.5S.sub.p1 S.sub.n3 = 2.5S.sub.p1 S.sub.n4 = 4S.sub.p1 middle γ.sub.p = 2; γ.sub.n = 1 S.sub.n1 = S.sub.p1 S.sub.p2 = 2S.sub.p1 S.sub.n2 = 2S.sub.p1 S.sub.n3 = 3S.sub.p1 S.sub.n4 = 4S.sub.p1 low γ.sub.p = 1; γ.sub.n = 0 S.sub.n1 = S.sub.p1 S.sub.p2 = 2S.sub.p1 S.sub.n2 = 2S.sub.p1 S.sub.n3 = 3S.sub.p1 S.sub.n4 = 4S.sub.p1
[0176] Here, the value S.sub.p2 corresponds to the value S.sub.max from
[0177] Moreover, there can be further parameter specifications for obtaining certain device properties. For example, the value γ.sub.n can be set equal to zero in a first case, making it impossible for the patient to (inadvertently) reverse the specified movement direction. Secondly, setting the parameters S.sub.n2 and S.sub.n3 equal may lead to a destabilization of the movement of the device 1.
[0178] The previously described adjustment of the control variable Ω, and hence the open-loop and closed-loop control of the assistance action by the device 1 operated by the method according to the invention, is based purely on energy considerations. However, the factor time can also be considered for the purposes of extending the present method.
[0179] In this variant of the method according to the invention, the control variable Ω is defined as follows:
[0180] the chosen upper limit S.sub.max of the overall energy S always being multiplied by a factor ζ in this case, where
[0181] The
III) Iterative Learning Process of the Control
[0182] As already described above, high values of S.sub.max correspond to a low responsiveness level of the device 1 to movements of the human M, and vice versa. Therefore, the desired, specified movement is not adjusted in the case of high values of S.sub.max. Instead, the human M is pulled along by the device 1, especially by the robot or the movement module 50 of the device 1, in accordance with the movement trajectory/trajectory specified by a therapist, with the extent of the active participation or even of a possible resistance against the specified movement (in each case represented by the variable P.sub.h) by said human being taken into account. Such control is useful in cases where the human M is not capable of independently moving their legs and requires significant or complete assistance by the device 1. However, if the value of S.sub.max is reduced, the responsiveness level of the device 1 with regard to the human M increases (=the device 1 reacts quicker), meaning that the desired, specified movement is adjusted if the human M does not participate or exerts resistance to the specified movement. In this case, the movement of the device 1 is slowed down, stopped or reversed until the human M actively starts to follow the specified movement. A preferred way of realizing this consists in a reduction of the interaction force between the leg/legs and the device 1.
[0183] Within the scope of a rehabilitation, the choice of the value S.sub.max depends on the health of the human M, the intention being to give consideration to the fact that an active involvement may have an advantageous effect on the healing process and may prevent the risk of an occurrence of further complications. For this reason, a control with small values of S.sub.max is advantageous for humans M with a relatively high inherent strength who are capable of acting on the device 1, especially on the robot or the movement module 50 of the device 1, independently. However, if a human M is unable to actively participate in the movement, the value of S.sub.max must be kept at a large value in order to carry out a therapy movement. The optimal value for S.sub.max consequently arises from the lowest value for the respective human M at which the desired, specified movement is only altered minimally. If S.sub.max is continuously adjusted in accordance with this rule, the variable S.sub.max can consequently be used as a measure for the ability of the human to participate in the specified movement.
[0184] Moreover, it should be borne in mind that the strength or the ability of the human M to participate may change while carrying out a movement, for example on account of tiredness or circulatory changes, and so this may render continually changing the assistance level by the device 1, that is to say continually changing the responsiveness level, necessary. For an optimal assistance of a human M, especially a patient, during a (therapy) movement, S.sub.max should accordingly be adjusted to the current ability of the human M to participate during the entire performance of the movement. In this case, the participation state of the human M can be monitored by additional sensors, especially within the scope of electromyography (EMG). However, as shown below, the participation state can also be determined by a learning algorithm of the device 1, advantageously without the use of further sensors.
[0185]
[0186] A comparatively high value for S.sub.max is chosen at the start of a therapy session. This value is set so high that the device 1 fully assists the human M with the movement such that the law for the adjustment to a desired, specified movement according to Equation (25) is thus not “triggered” and Ω maintains the value of 1. Within the scope of the session, the value of S.sub.max is iteratively reduced with each run-through cyclical movement (that is to say, a forgetting algorithm (“forgetting process”) is used) for as long as Ω maintains the value of 1. Since reducing the value of S.sub.max increases the sensitivity of the device 1 to the participation of the human M in the movement (i.e., the responsiveness level), this makes it possible to successively determine a value for S.sub.max which is small enough so that the human M is no longer capable of following the specified movement accurately enough, thus “triggering” the control variable Ω by a deviation from the value of 1. Should this be the case, S.sub.max is increased for the next movement iteration (that is to say, a learning process takes place). By measuring the value of the control variable Ω during each iteration (=each movement iteration), it is thus possible to determine the participation state of the human M and accordingly adjust the value for S.sub.max. Mathematically, this learning process following the i-th iteration can be described as follows:
S.sub.max,t+1=S.sub.max,i+κ.sub.l(1−
[0187] where
[0188] Such an iterative learning process is shown in exemplary fashion in
[0189] An extension of the described open-loop and closed-loop control method may moreover now consist in allowing a therapist to categorize the mode of operation of the device 1 into different areas (regions Φ.sub.i) on the basis of the muscles or muscle groups to be activated or trained, and to set the extent of assistance (“assistance level”) or the mode of operation of the device 1 for each of these regions Φ.sub.i in a targeted manner. The extent of assistance, that is to say the “assistance level”, of the device 1 is defined here as a smooth function which avoids interruptions in the movement of the device 1 where possible. According to the invention, such an open-loop and closed-loop control can preferably be based on a division into regions Φ.sub.i on the basis of the phase value ϕ, as defined in Equation (24).
[0190]
[0191] In this case, the region Φ.sub.i describes the phase value interval from ϕ.sub.str, i to ϕ.sub.str, i+1. To prepare a movement therapy, the therapist can set the regions in accordance with the needs of the respective patient, in particular there can be a division into four regions Φ.sub.i, with ϕ.sub.str, 1=0, ϕ.sub.str, 2=0.25, ϕ.sub.str, 3=0.5, ϕ.sub.str, 4=0.75, ϕ.sub.str, 5=1. Now, an independent limit S.sub.max, i (ϕ) can be defined for each of these regions Φ.sub.i, with the following applying to all phase values ϕ.sub.i of a region Φ.sub.i:
[0192] The value is linked here to the respective region Φ.sub.i and can be improved (adjusted and optimized for the therapy progress) during the movement therapy by way of an iterative learning process, especially as described above. In this case, the so-called smoothing interval Δ≥0 preferably has a smaller value range of phase values ϕ than the respective region Φ.sub.i(ϕ). In particular, the smoothing interval Δ may comprise one tenth of the phase values ϕ of the corresponding region Φ.sub.i(ϕ).
[0193] In the case of a split into for example four regions Φ.sub.i(ϕ) for each leg of the human M and a value range for the phase values ϕ from 0 to 1 for one leg (cf. Equation 24 in this respect), this may yield a length of in each case 0.25 “phase units” for the individual regions Φ.sub.i(ϕ) with a length of 0.025 “phase units” of the smoothing interval Δ.
[0194] Finally, as a further improvement of the iterative learning process for determining an initial limit S.sub.init(ϕ), the device 1 can initially run through n movement cycles without a given limit S.sub.max, the number n of movement cycles being in the interval of 2≤n≤5 movement cycles, preferably being 3 movement cycles. In this case, an S(ϕ) profile is preferably recorded, and a mean value of the recorded S(ϕ) values is subsequently calculated as an initial limit S.sub.init(ϕ). This initial limit S.sub.init(ϕ) is then used as a start value for the limit (S.sub.max) in a first iteration step of the iterative learning process, especially as described above, in the form λ.Math.S.sub.init(ϕ) with λ≥1. This automatic determination of the initial limit S.sub.init(ϕ) as “first value for S.sub.max” advantageously allows a suitable start value for different patients with very different starting points in respect of their health to be determined individually, reliably and quickly.
[0195] The present invention relates to a method for open-loop and closed-loop control of a device 1, at least comprising a movement module 50, in terms of its interaction with a human M, said method being based on an energy-based control scheme that makes it possible to monitor the amount of an overall energy (S) in the system comprising the device 1 and the human M in dependence on a measured control variable Ω describing the speed at which the device 1 or its movement module 50 moves. The method advantageously considers the entire power cycle, in particular the dynamics of the energy or power flow, in the system comprising the device 1 and the human M and takes into account the performance of the human M during the closed-loop control. The method also advantageously enables the participation state of the human M who is using the device 1 to be determined in an iterative learning process without additional sensors.
LIST OF REFERENCE SIGNS
[0196] 1 Device
[0197] 11 Control unit
[0198] 30 Rehabilitation mechanism
[0199] 50 Movement module
[0200] 51 Force sensor
[0201] 52 Angle sensor
[0202] {dot over (x)}.sub.d Time derivative (velocity) of the Cartesian coordinates for describing the movement trajectory
[0203] S Overall energy (overall storage function)
[0204] S.sub.max chosen limit of the overall energy S
[0205] P.sub.in the power input into the system generated by the movement generator
[0206] P.sub.h the power supplied to the system of device (1) and human (M) by the human (M)
[0207] P.sub.diss the power lost by control damping
[0208] M Human