Paretic limb rehabilitation methods and systems
11883175 ยท 2024-01-30
Assignee
Inventors
- Ander Ramos Murguialday (Donostia, ES)
- Andrea Sarasola (Tubingen, DE)
- Jose Miguel Carmena Ramon (Berkeley, CA, US)
- Joseph McIntyre (Donostia, ES)
Cpc classification
A61F2002/6872
HUMAN NECESSITIES
A61B5/1107
HUMAN NECESSITIES
A61H2230/60
HUMAN NECESSITIES
A61B5/4082
HUMAN NECESSITIES
A61B5/4052
HUMAN NECESSITIES
A61B5/225
HUMAN NECESSITIES
A61B5/24
HUMAN NECESSITIES
A61H2230/085
HUMAN NECESSITIES
International classification
A61B5/24
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
A61B5/11
HUMAN NECESSITIES
A61B5/22
HUMAN NECESSITIES
Abstract
Generator systems and methods are provided for generating a neuromuscular-to-motion decoder from a healthy limb. The generator system is configured to receive neuromuscular signals from neuromuscular sensors associated to predefined muscle/nerve locations of at least one pair of agonist and antagonist muscles/nerves of the healthy limb, obtained during performance by the person of a predefined exercise (defined by predefined exercise data) with the healthy limb; to receive motion signals from motion sensors associated to predefined positions of the healthy limb, during performance by the person of the predefined exercise with the healthy limb; and to generate the neuromuscular-to-motion decoder by mapping the neuromuscular signals to the motion signals over time using a mapping method. Rehabilitation systems are also provided for rehabilitating a paretic limb by using a neuromuscular-to-motion decoder produced by a generator system.
Claims
1. A method of treating a paretic limb of a patient, the method comprising: obtaining a neuromuscular-to-motion decoder using a computing system that includes a memory, a processor, and instructions stored in the memory executable by the processor, the instructions comprising functionality to execute a mapping method that maps first neuromuscular signals to first motion signals during a person performing a predefined exercise with a healthy limb, the mapping of the first neuromuscular signals to the first motion signals is performed using a method selected from the group consisting of a machine learning method, a statistical method, a data mining method and any combination of the machine learning method, statistical method and data mining method, the first neuromuscular signals having been generated by at least first and second neuromuscular sensors situated at first predefined locations on or in agonist and antagonist muscles of the healthy limb of the person during the person performing the predefined exercise, the first motion signals having been generated by a first plurality of motion sensors situated at second predefined locations on the healthy limb during the person performing the predefined exercise; respectively placing at least third and fourth neuromuscular sensors at third predefined locations on or in the agonist and antagonist muscles of a paretic limb of the patient, the agonist and antagonist muscles of the paretic limb corresponding to the agonist and antagonist muscles of the healthy limb, the third predefined locations corresponding to the first predefined locations, the third and fourth neuromuscular sensors configured to produce second neuromuscular signals upon the patient attempting to perform the predefined exercise with the paretic limb; inputting the second neuromuscular signals to the neuromuscular-to-motion decoder for causing the neuromuscular-to-motion decoder to output first motion commands; placing a second plurality of motion sensors at fourth predefined locations on the paretic limb, the fourth predefined locations on the paretic limb corresponding to the second predefined locations of the healthy limb, the second plurality of motion sensors configured to produce second motion signals upon the patient attempting to perform the predefined exercise with the paretic limb; producing trajectory data defining a trajectory to be followed by the paretic limb depending on a deviation between the second motion signals and predefined exercise data defining the predefined exercise; producing second motion commands depending on the trajectory data to be followed by the paretic limb; producing final motion commands depending on the first motion commands and the second motion commands; and sending the final motion commands to a body actuator associated to the paretic limb to cause the body actuator to stimulate the paretic limb to perform the predefined exercise, one or more of the first, second, third and fourth neuromuscular sensors being a sensor selected from the group consisting of an electromyography sensor, an electroneurography sensor, an ultrasound sensor, and an optical sensor, one or more of the first and second plurality of motion sensors being selected from the group consisting of an inertial sensor, a magnetic sensor, and an optical sensor.
2. The method of treating a paretic limb of a patient according to claim 1, wherein each of the at least third and fourth neuromuscular sensors and each of the at least first and second neuromuscular sensors are a same type of neuromuscular sensor.
3. The method of treating a paretic limb of a patient according to claim 1, wherein each of the second plurality of motion sensors and each of the first plurality of motion sensors are a same type of motion sensor.
4. The method of treating a paretic limb of a patient according to claim 1, wherein the final motion commands are produced depending on the first motion commands and the second motion commands by weighting the first motion commands and the second motion commands based on a predefined weighting criterion.
5. The method of treating a paretic limb of a patient according to claim 4, wherein the first motion commands and the second motion commands are weighted based on the predefined weighting criterion by: comparing the first motion commands to the second motion commands to obtain a first indicator of similarity between the first motion commands and the second motion commands; and determining a first weight for the first motion commands and a second weight for the second motion commands depending on the first indicator of similarity, in such a way that the higher is the first indicator of similarity, the higher is the first weight and the lower is the second weight; the final motion commands being produced based on the first motion commands weighted with the first weight and the second motion commands weighted with the second weight.
6. The method of treating a paretic limb of a patient according to claim 5, wherein the first motion commands and second motion commands are compared by performing a normalized root-mean-square error method and/or a correlation coefficient method.
7. The method of treating a paretic limb of a patient according to claim 4, wherein the first motion commands and the second motion commands are weighted based on the predefined weighting criterion by: receiving input from a user that includes an indicator of evolution of the rehabilitation; and weighting the first motion commands and the second motion commands based on the indicator of evolution of the rehabilitation.
8. The method of treating a paretic limb of a patient according to claim 7, wherein the first motion commands and the second motion commands are weighted based on the indicator of evolution of the rehabilitation by determining a third weight for the first motion commands and a fourth weight for the second motion commands depending on the indicator of evolution of the rehabilitation, in such a way that the higher is the indicator of evolution of the rehabilitation, the higher is the third weight and the lower is the fourth weight; the final motion commands being produced based on the first motion commands weighted with the third weight and the second motion commands weighted with the fourth weight.
9. The method of treating a paretic limb of a patient according to claim 1, wherein the final motion commands are produced depending on the first motion commands and the second motion commands either by: aggregating the first motion commands and the second motion commands, or by comparing the first motion commands to the second motion commands to obtain a second indicator of similarity between the first motion commands and the second motion commands; transforming the first motion commands based on the second indicator of similarity between the first motion commands and the second motion commands; and determining the final motion commands based on the transformed first motion commands and the second motion commands.
10. The method of treating a paretic limb of a patient according to claim 9, wherein the first motion commands are transformed based on a projection of the first motion commands on the second motion commands.
11. The method of treating a paretic limb of a patient according to claim 4, wherein the first motion commands and the second motion commands are weighted based on the predefined weighting criterion by: comparing the second neuromuscular signals to the first neuromuscular signals for obtaining a third indicator of similarity between the second neuromuscular signals and the first neuromuscular signals; and determining a fifth weight for the first motion commands and a sixth weight for the second motion commands depending on the third indicator of similarity, in such a way that the higher is the third indicator of similarity, the higher is the sixth weight and the lower is the fifth weight; the final motion commands being produced based on the first motion commands weighted with the fifth weight and the second motion commands weighted with the sixth weight.
12. The method of treating a paretic limb of a patient according to claim 1, wherein the trajectory data is produced based on a Linear-quadratic regulator method.
13. The method of treating a paretic limb of a patient according to claim 1, comprising fitting a robotic exoskeleton that includes the second plurality of motion sensors to the paretic limb.
14. The method of treating a paretic limb of a patient according to claim 1, comprising fitting a robotic exoskeleton that includes a Functional electrical stimulation system and/or an ultrasound-based neuromuscular stimulation system and/or an optical-based neuromuscular stimulation system.
15. The method of treating a paretic limb of a patient according to claim 1, wherein the person is the patient.
16. A system for treating a paretic limb of a person, the system comprising: at least first and second neuromuscular sensors that are respectively configured for placement at first predefined locations on or in agonist and antagonist muscles of a healthy limb of a person, the first and second neuromuscular sensors configured to produce first neuromuscular signals upon the person performing a predefined exercise with the healthy limb; a first plurality of motion sensors that are configured for placement at second predefined locations on the healthy limb, the first plurality of motion sensors configured to produce first motion signals upon the person performing the predefined exercise with the healthy limb; at least third and fourth neuromuscular sensors that are respectively configured for placement at third predefined locations on or in agonist and antagonist muscles of a paretic limb of the person, the agonist and antagonist muscles of the paretic limb corresponding to the agonist and antagonist muscles of the healthy limb, the third predefined locations corresponding to the first predefined locations, the third and fourth neuromuscular sensors configured to produce second neuromuscular signals upon the person attempting to perform the predefined exercise with the paretic limb; a second plurality of motion sensors that are configured for placement at fourth predefined locations on the paretic limb, the fourth predefined locations on the paretic limb corresponding to the second predefined locations of the healthy limb, the second plurality of motion sensors configured to produce second motion signals upon the person attempting to perform the predefined exercise with the paretic limb; a body actuator associated with the paretic limb that is configured to stimulate the paretic limb to perform the predetermined exercise; and a control system comprising one or more memories and one or more hardware processors, wherein the one or more memories comprise instructions, that when executed by the one or more hardware processors, are operable to: generate a neuromuscular-to-motion decoder by mapping the first neuromuscular signals to the first motion signals over time using a mapping method during the person performing the predefined exercise with the healthy limb, the mapping method selected from the group consisting of a machine learning method, a statistical method, a data mining method and any combination of the machine learning method, statistical method and data mining method; input the second neuromuscular signals to the neuromuscular-to-motion decoder for causing the neuromuscular-to-motion decoder to output first motion commands; produce trajectory data defining a trajectory to be followed by the paretic limb depending on a deviation between the second motion signals and predefined exercise data defining the predefined exercise; produce second motion commands depending on the trajectory data to be followed by the paretic limb; produce final motion commands depending on the first motion commands and the second motion commands; and send the final motion commands to the body actuator associated to the paretic limb to cause the body actuator to stimulate the paretic limb to perform the predefined exercise, one or more of the first, second, third and fourth neuromuscular sensors being a sensor selected from the group consisting of an electromyography sensor, an electroneurography sensor, an ultrasound sensor, and an optical sensor, one or more of the first and second plurality of motion sensors being selected from the group consisting of an inertial sensor, a magnetic sensor, and an optical sensor.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Non-limiting examples of the present disclosure will be described in the following, with reference to the appended drawings, in which:
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION
(7) An example of generator system is schematically shown in
(8) The generator system 100 may be configured to be applied to a healthy arm 110 but, in other examples, the system 100 could be configured to be applied to a healthy leg.
(9) The generator system 100 may comprise a plurality of neuromuscular sensors 101-104, a control unit 106 and corresponding connections 105 connecting the neuromuscular sensors 101-104 and the control unit 106. In the particular case shown, the connections 105 are wired connections. However, all or part of said connections may be wireless. The generator system 100 may further comprise a computing (or controller) system 109.
(10) The neuromuscular sensors 101-104 may comprise EMG sensor(s) and/or ENG sensor(s) and/or ultrasound sensor(s) and/or optical sensor(s) aimed at the same purpose. The neuromuscular sensors 101-104 may be invasive or not.
(11) The control unit 106 may comprise a neuromuscular signal amplifier 107 for amplifying analogic neuromuscular signals from the neuromuscular sensors 101-104, and an Analog-to-Digital (AD) converter 108 for converting the amplified neuromuscular signals into digital neuromuscular signals.
(12) A first set of neuromuscular sensors 101, 102 may be configured to be applied to a first pair of agonist and antagonist muscles/nerves of the arm (or leg) 110. A second set of neuromuscular sensors 103, 104 may be configured to be applied to a second pair of agonist and antagonist muscles/nerves of the arm (or leg) 110. Other sensor configurations different from the one shown are also possible. For example, the number of sensors applied to an agonist and to its antagonist may not coincide, i.e. unbalanced numbers of sensors are also possible.
(13) The sensors (e.g. electrodes) 101-104 may be, for example, bipolar surface electrodes with conductive gel, and may be provided (or not) as an array with a high density of electrodes. The sensors (e.g. electrodes) 101-104 may be configured to be adhered (or, in some examples, implanted) to the skin of the patient for sensing neuromuscular activity at corresponding muscle and/or nerve locations. The sensors 101-104 may comprise e.g. subcutaneous sensors (e.g. electrodes).
(14) The generator system may further comprise motion sensors (not shown) including e.g. inertial, magnetic or optical sensors (such as e.g. accelerometers, gyroscopes, etc.) arranged and configured to provide functionalities of motion detection and quantification. These sensors may be included (or embedded) in suitable devices, such as e.g. data gloves or the like, or even in an exoskeleton movable by the healthy limb with or without guiding functionalities aimed at guiding the healthy limb to perform a predefined exercise.
(15) The control unit 106 may be connected to the computing system 109 in such a way that the computer 109 may receive neuromuscular signals from the sensors 101-104 during performance of a predefined exercise. Suitable connections between the motion sensors and the computing system 109 may also exist for the computer 109 to receive motion signals generated by the motion sensors.
(16) The computing system 109 may comprise a memory and a processor. The memory may store a computer program comprising instructions that are executable by the processor for causing the performance of a generator method for generating a neuromuscular-to-motion decoder from a healthy limb. This generator computer program may be a standalone program or may require the loading of external module(s) or other pieces of software.
(17) A resulting neuromuscular-to-motion decoder may be stored in a repository (e.g. hard disk) associated to the computing system 109. This repository may be local or remote with respect to the computer system 109.
(18)
(19) In some examples, a generator system such as the one shown in
(20) In the particular case of
(21) The robotic exoskeleton 200 may be movable according to a number of degrees of freedom so as to permit the motion of different segments of the arm 201, such as e.g. upper arm (not shown), forearm 203, wrist 204 and fingers 205. The exoskeleton 200 may be configured to permit functional movements of the arm (or leg).
(22) In particular examples, the robotic exoskeleton 200 may comprise a mobile base 202 and a hand-module 210 that may be mountable on the mobile base 202.
(23) The mobile base 202 may have, in some examples, three degrees of freedom and may (optionally) include a camera for tracking bi-dimensional movements of the base on a plane of reference. Other quantities of degrees of freedom different from three may be considered in other examples.
(24) The hand-module 210 may have, in some examples, four degrees of freedom and (optionally) may be configured to track the motion of the wrist 204 and/or fingers 205. Other numbers of degrees of freedom may be considered in different examples.
(25) The robotic exoskeleton 200 may comprise motors 206-208 each configured to cause movement of the exoskeleton in a corresponding degree of freedom.
(26) For the sake of simplicity, only some motors 206-208 are indicated in the figure. The exoskeleton 200 may however comprise other quantities of motors, depending on e.g. the number of degrees of freedom under consideration.
(27) A controller of the motors 206-208 of the exoskeleton 200 may be connectable to the computer system 109 through a connection 209 that may be e.g. a USB connection. Other types of connections are also possible, such as e.g. wireless connections.
(28) Different motors 206-208 of the exoskeleton 200 may communicate between them through a CAN communication, so that a proper communication channel between the computer system 109 and the motors 206-208 may be defined.
(29) The exoskeleton 200 may also provide functionalities of motion detection and quantification. These functionalities may be provided through e.g. rotary encoders (a type of motion sensors) configured to generate motion signals representing motion conditions associated to different degrees of freedom. A (rotatory) encoder may be included in a corresponding motor 206-208.
(30) Motion sensors similar to the ones described with reference to generator system (of
(31) In any case, with respect to motion sensors of either a generator or rehabilitation system or a combination thereof, a motion condition (sensed by a motion sensor) may comprise e.g. at least one of a position, a velocity, an acceleration, a torque, a force etc. in a given degree of freedom.
(32) Additionally or alternatively to the encoders described before, known inertial, magnetic or optical sensors embedded in suitable devices, such as e.g. data gloves, or in wearable parts of the exoskeleton, may be used to implement the functionalities of motion detection and quantification.
(33) The communication channel(s) established between the computer system 109 and the motors 206-208 of the exoskeleton 200 may permit the computer system 109 to receive the motion signals (from encoders). As explained in detail in other parts of the description, said motion signals may be suitably processed by the computer system 109 in the context of methods for rehabilitating a paretic limb.
(34) The communication channel(s) between the computer system 109 and the motors 206-208 of the exoskeleton 200 may permit the computer system 109 to generate and send (final) motion commands to the exoskeleton 200. These (final) motion commands may induce the exoskeleton 200 to move as required in the context of methods for rehabilitating a paretic limb. Details about this are disclosed in other parts of the description.
(35) The camera included in the mobile base 202 may also be connectable to the computer system 109 through e.g. a USB or wireless connection and/or may optionally permit determining bi-dimensional positions of the base 202 on the plane of reference. Said positions may be determined, for example, by decoding Data-matrix codes printed on a table defining the plane of reference.
(36) The exoskeleton 200 may be configured to be indistinctly applied to a (right or left) healthy arm/leg, and to a (right or left) paretic arm/leg. This way, the same exoskeleton 200 may be used for performing both a generator method (with healthy limb or limbs) and a rehabilitation method (with paretic limb). Details about how the exoskeleton may be used in said generator and rehabilitation methods are explained in detail in other parts of the description.
(37) Alternatively to an exoskeleton, such as the one of
(38) The neuromuscular stimulation system (e.g. FES system) may be configured to provide functionalities of motion induction substantially equivalent to those provided by the exoskeleton as described before. That is, based on received motion commands, the (FES) system may (electro-) stimulate the arm (or leg) 201 in such a way that required motions of the arm (or leg) 201 are induced with same or similar results as if the exoskeleton were used.
(39) Permitted motion directions substantially equivalent to the degrees of freedom described in relation to the exoskeleton may be taken into account if a neuromuscular stimulation system (e.g. FES system) is used as body actuator. That is, in the case of using a FES system instead of an exoskeleton, the arm 201 may be electro stimulated so as to cause the motion of the arm 201 only in said permitted motion directions.
(40) The memory of the computing system 109 may further store a computer program comprising instructions that are executable by the processor for performing a rehabilitation method for rehabilitating a paretic limb. This rehabilitation program may be a separate program with respect to the generator program described in relation to
(41) The neuromuscular-to-motion decoder to be used by the rehabilitation system may be retrieved from a repository (e.g. hard disk) associated to the computing system 109. This repository may be local or remote with respect to the computer system 109.
(42)
(43) This generator method may be performed by using a generator system equal or similar to the ones described before with reference to previous figures. References to said previous figures may be thus included along the following description about
(44) At block 300, the method may be started as a result of receiving a starting condition, such as e.g. a user request inputted by an operator of the generator system.
(45) At this point, the person may be requested to perform the predefined exercise with the healthy arm. The predefined exercise may be defined by predefined exercise data which is available to the computer system 109.
(46) In some examples, the computer system 109 may process the predefined exercise data to generate reproducible data and send it to a reproducing system, so as to provide audio and/or visual instructions to the person of how to perform the predefined exercise.
(47) At block 301, neuromuscular signals may be received (by the computer system 109) from neuromuscular sensors 101-104 attached to the healthy arm, during performance of the predefined exercise.
(48) The neuromuscular sensors 101-104 may be attached to regions of the healthy arm associated to predefined muscle and/or nerve locations of at least one pair of agonist and antagonist muscles/nerves of the healthy arm. The attachment of the neuromuscular sensors 101-104 may be equal or similar to the attachment shown in
(49) At block 302, motion signals may be received from motion sensors associated to predefined positions of the healthy limb, during performance of the predefined exercise. The nature of said motion sensors and corresponding motion signals are explained in detail in other parts of the description, in any case wherein an exoskeleton or a stimulation system (e.g. FES system) or a combination thereof is employed.
(50) At block 303, a neuromuscular-to-motion decoder may be generated for each of all or some of the degrees of freedom (in exoskeleton-based examples) or permitted motion directions (in examples based on a stimulation system) under consideration.
(51) Given a particular degree of freedom (or permitted motion direction), a neuromuscular-to-motion decoder may be generated by mapping the received neuromuscular signals and motion signals corresponding to said degree of freedom (or permitted motion direction). It is also possible to generate a single neuromuscular-to-motion decoder with different outputs corresponding to different degrees of freedom.
(52) A neuromuscular-to-motion decoder may be, for example, a mathematical function or module defining a cause-effect relationship between both types of signals, i.e. an evolution over time of motion signals (effect) depending on neuromuscular signals (cause).
(53) A diversity of mapping methods may be used to generate the neuromuscular-to-motion decoder, such as e.g. machine learning methods, statistical methods, datamining methods, etc. or a combination of at least some of them. In particular, linear regression, non-linear regression, Lasso regression, ridge regression, Kalman filter, support vector machine, neural network, fuzzy logic, etc. may be employed for that purpose.
(54) For instance, a mathematical module may result from e.g. training a machine learning model based on the received neuromuscular signals and motion signals. A mathematical module may therefore result from said training that is configured to output motion values corresponding to input neuromuscular values.
(55) In other examples, the received neuromuscular and motion signals (for different degrees of freedom or permitted motion directions under consideration) may be correlated (mapped), so that a shape or profile of a cloud of points corresponding to the neuromuscular and motion signals over time is modelled. A function may result from said correlation that is configured to output motion values corresponding to input neuromuscular values according to said modelling of the cloud of neuromuscular-motion points.
(56)
(57) This rehabilitation method may take into account (neuromuscular and motion) signals from the paretic arm of the patient during an attempt by the patient of performing the predefined exercise with the paretic arm.
(58) This rehabilitation method may be performed by using a rehabilitation system similar to the ones described before with reference to previous figures. A computer program implementing the rehabilitation method may be stored and performed by the computer system 109. References to previous figures may also be included along the following description of
(59) At block 400, the rehabilitation method may be started when desired by an operator of the rehabilitation system. The rehabilitation method may hence be triggered upon reception of a corresponding request inputted by the operator, for example.
(60) At block 401, neuromuscular signals may be received (by the computer system 109) from neuromuscular sensors 101-104 attached to the paretic arm, during performance of the predefined exercise.
(61) The attachment of the neuromuscular sensors 101-104 may be such that the neuromuscular sensors are associated to predefined muscle and/or nerve locations of the paretic arm (or leg) corresponding to predefined muscle and/or nerve locations of the healthy arm (or leg) taken into account in the generation of the neuromuscular-to-motion decoder to be used.
(62) The rehabilitation system may provide audio and/or visual instructions to the patient of how to perform the predefined exercise.
(63) At block 402, the neuromuscular signals may be inputted to the neuromuscular-to-motion decoder generated by corresponding generator method, for causing the neuromuscular-to-motion decoder to output first motion commands in different degrees of freedom (in exoskeleton-based examples) or permitted motion directions (in examples based on stimulation e.g. FES) under consideration.
(64) The first motion commands may be seen as inductors of a motion due to the neuromuscular activity of the paretic arm, according to a cause-effect relationship between neuromuscular activity (cause) and motion (effect) of corresponding healthy arm, previously determined in the generator method.
(65) At initial rehabilitation stages, said first motion commands may probably define a certainly erratic motion of the arm, so that a reduced weight may be initially attributed to the first motion commands.
(66) At block 403, motion signals may be received from motion sensors (of the rehabilitation system) associated to predefined positions of the paretic arm (or leg) corresponding to predefined positions of the healthy arm (or leg) taken into account in the generation of the neuromuscular-to-motion decoder.
(67) These motion signals may represent the motion that the paretic arm is actually following in the different degrees of freedom (or permitted motion directions) under consideration. The motion actually followed by the paretic arm may not match the trajectory to be followed as defined by the predefined exercise data.
(68) At block 404, trajectory data defining a trajectory to be followed by the paretic arm may be determined depending on a deviation between the motion signals and the predefined exercise data, in the different degrees of freedom (or permitted motion directions) under consideration.
(69) The determined trajectory data may be seen as defining a corrected trajectory of the motion actually followed by the paretic arm (according to the received motion signals) for redirecting the motion of the arm towards a valid trajectory (according to the predefined exercise data).
(70) In final rehabilitation phases, the trajectory defined by the received motion signals and the trajectory defined by the predefined exercise data may substantially coincide, in which case no redirection of the motion of the arm may be considered.
(71) At block 405, second motion commands may be determined depending on the determined trajectory data to be followed by the paretic limb, in the different degrees of freedom (or permitted motion directions) under consideration.
(72) The second motion commands may be seen as inductors of a corrective motion for redirecting (if needed) the paretic arm towards a valid trajectory according to the predefined exercise data.
(73) In some examples, a Linear-quadratic regulator (LQR) method may be used for determining the trajectory data at block 404, and for determining the second motion commands at block 405.
(74) At block 406, final motion commands may be determined depending on the first motion commands (from block 402) and the second motion commands (from block 405), in the different degrees of freedom (or permitted motion directions) under consideration.
(75) The final motion commands may thus be seen as a combination of inductors of motion due to the neuromuscular activity of the paretic arm (first motion commands) and inductors of motion to redirect (if required) the paretic arm towards a valid trajectory (second motion commands).
(76) At block 407, the final motion commands may be sent to the body actuator (robotic exoskeleton and/or stimulation system e.g. FES) so as to suitably stimulate (or induce) the patient to perform the predefined exercise with the paretic arm (or leg).
(77) The execution of the final motion commands by the body actuator may provoke a visual and proprioceptive feedback about the correctness of muscle/nerve activations of the patient. The body actuator induces a hybrid motion on the paretic arm combining an incorrect motion component due to incorrect neuromuscular activity, and a corrective motion component aimed at redirecting the arm towards a valid trajectory (for completing the predefined exercise successfully). At final rehabilitation stages, the neuromuscular activity in the paretic arm may be correct or minimally incorrect, in which case the corrective component may be substantially negligible.
(78) Blocks 401-407 may be continuously performed until the predefined exercise with the paretic arm has been completed. In this case, the rehabilitation method proceeds to final block 408.
(79) The determination of the final motion commands depending on the first motion commands and the second motion commands, in the different degrees of freedom (or permitted motion directions) under consideration, may be performed in a diversity of manners.
(80)
(81) At block 500, the first motion commands and the second motion commands may be compared for obtaining a first indicator of similarity, in each or some of the degrees of freedom (or permitted motion directions) under consideration. This comparison may be performed, in some examples, using a normalized root-mean-square error (NRMSE) method and/or a correlation coefficient method.
(82) In alternative examples, the indicator of similarity may be determined (with similar results) by comparing the neuromuscular signals (from paretic limb) and the neuromuscular signals (from healthy limb) taken into account to generate the neuromuscular-to-motion decoder. In this case, for example, the computing system 109 may store the neuromuscular signals from healthy limb, along with the neuromuscular-to-motion decoder.
(83) At block 501, a first weight may be determined for the first motion commands and a second weight may be determined for the second motion commands depending on the first indicator of similarity (obtained at previous block 500).
(84) The determination of the first weight and the second weight may be such that the higher is the first indicator of similarity, the higher is the first weight and the lower is the second weight. In particular examples, the second weight may be determined as a function of the first weight.
(85) At block 502, the final motion commands may be determined based on the first motion commands weighted with the first weight and the second motion commands weighted with the second weight.
(86) For example, the final motion commands may be determined according to the following formula:
V.sub.final=V.sub.neuro*w.sub.1+V.sub.assist*w.sub.2=V.sub.neuro*w.sub.1+V.sub.assist*(1w.sub.1)Formula 1
wherein V.sub.final is a final motion (e.g. velocity) command, V.sub.neuro is a first motion command (due to neuromuscular activity), w.sub.1 is a first weight, V.sub.assist is a second motion command (for redirecting to valid trajectory) and w.sub.2 is a second weight.
(87) The first weight w.sub.1 may be a value between 0 and 1, and the second weight w.sub.2 may be equal to 1w.sub.1 (as indicated in second part of Formula 1). This way, w.sub.1=0 implies that w.sub.2=1 and V.sub.final=V.sub.assist which means that a completely assistive motion is induced by the body actuator on the arm (neuromuscular activity is ignored). Accordingly, w.sub.1=1 implies that w.sub.2=0 and V.sub.final=V.sub.neuro which means that a motion fully depending on neuromuscular activity is induced by the body actuator on the arm (assistive component is ignored).
(88) The more similar are the first motion commands V.sub.neuro (neuromuscular activity) to the second motion commands V.sub.assist (assistive control) the better may be considered the neuromuscular activity generated by the patient on the paretic arm. So, in this case, the final motion commands V.sub.final may be calculated with higher influence of V.sub.neuro (higher w.sub.1) and lower influence of V.sub.assist (lower w.sub.2).
(89) The algorithm according to
(90)
(91) At block 600, input from a user, such as e.g. an operator of the rehabilitation system, may be received including an indicator of evolution of the rehabilitation of the patient. This indicator may be predetermined from previous executions of the rehabilitation method, for example.
(92) At block 601, a third weight may be determined for the first motion commands and a fourth weight may be determined for the second motion commands, depending on the indicator of evolution of the rehabilitation (received at block 600).
(93) The determination of the third weight and the fourth weight may be such that the higher is the indicator of evolution of the rehabilitation, the higher is the third weight and the lower is the fourth weight. In particular examples, the third weight may be determined as a function of the fourth weight.
(94) At block 602, the final motion commands may be determined based on the first motion commands weighted with the third weight and the second motion commands weighted with the fourth weight.
(95) For example, the final motion commands may be determined according to the following formula:
V.sub.final=V.sub.neuro*w.sub.3+V.sub.assist*w.sub.4=V.sub.neuro*w.sub.3+V.sub.assist*(1w.sub.3)Formula 2
wherein V.sub.final is a final motion (e.g. velocity) command, V.sub.neuro is a first motion command (due to neuromuscular activity), w.sub.3 is a third weight, V.sub.assist is a second motion command (for redirecting to valid trajectory) and w.sub.4 is a fourth weight.
(96) The higher is the indicator of evolution of the rehabilitation the better may be considered the evolution and, hence, the neuromuscular activity generated by the patient on the paretic arm. So, in this case, the final motion commands V.sub.final may be calculated with higher influence of V.sub.neuro (higher w.sub.3) and lower influence of V.sub.assist (lower w.sub.4). Weights w.sub.3 and w.sub.4 may be accordingly varied for that aim in a similar manner as described for weights w.sub.1 and w.sub.2 with respect to
(97) The algorithm according to
(98)
(99) At block 700, the first motion commands and the second motion commands may be compared for obtaining a second indicator of similarity between the first motion commands and the second motion commands, in each or some of the degrees of freedom (or permitted motion directions) under consideration.
(100) At block 701, the first motion commands may be transformed based on the second indicator of similarity (between the first motion commands and the second motion commands). The first motion commands may be transformed based on a projection of vectors representing first motion commands on vectors representing second motion commands, for example. The first and second motion commands may be e.g. velocity vectors.
(101) At block 702, the final motion commands may be determined based on the transformed first motion commands and the second motion commands.
(102) For example, the final motion commands may be determined according to the following formula:
V.sub.final=transformed(V.sub.neuro)+V.sub.assistFormula 3
wherein V.sub.final is a final motion (e.g. velocity) command, V.sub.neuro is a first motion command (due to neuromuscular activity), V.sub.assist is a second motion command (for redirecting to valid trajectory) and transformed(V.sub.neuro) is the transformed first motion command.
(103) The algorithm according to
(104) In any of the described examples based on weights, said weights may be updated in real-time (within same rehabilitation session or same execution of rehabilitation method). Alternatively, said weights may be kept fixed during one or more rehabilitation sessions or executions of rehabilitation method.
(105) In any of the described examples relating to generator and rehabilitation methods, the received neuromuscular signals may be (optionally) rectified, and (optionally) filtered, and (optionally) processed by an algorithm of features extraction, and (optionally) normalized, and (optionally) processed by an algorithm of dimensionality reduction. Examples of algorithms of dimensionality reduction are Principal Component Analysis (PCA), Independent Component Analysis (ICA), Non-negative matrix factorization (NMF), etc. Examples of features that can be extracted from neuromuscular signals are time-domain features, frequency-domain features, muscle synergies, etc.
(106) With respect to the normalization of the neuromuscular signals, it is aimed at adjusting the neuromuscular signals irrespective of any difference in amplitude between neuromuscular signals from healthy limb and neuromuscular signals from paretic limb. The normalization may be performed using e.g. a Z-score method or any other method aimed at the mentioned purpose.
(107) According to the Z-score method, the normalization may be carried out by applying the following formula:
Normalized_Neuro=(Neuromean)/stdFormula 4
wherein Neuro is a neuromuscular signal to be normalized, Normalized_Neuro is the neuromuscular signal once normalized, mean is a mean of neuromuscular signals from same muscle/nerve location as Neuro, and std is a standard deviation of neuromuscular signals from same muscle/nerve location as Neuro.
(108) Given a neuromuscular signal to be normalized, the mean and the standard deviation applicable to said signal may be calculated from neuromuscular signals previously received within the execution of the generator method or rehabilitation method.
(109) In the case of generator method, the whole neuromuscular signals may be received (from healthy limb) and recorded in a first step and, subsequently, their normalization may be performed in a second step once the first step has been completed. This way, the mean and standard deviation to be used in the normalization may be calculated taking into account the whole neuromuscular signals (from healthy limb).
(110) In the case of rehabilitation method, a predefined time interval of neuromuscular signals already received (from paretic limb) may be considered to calculate the mean and standard deviation. For example, the predefined time interval may comprise the last 60 seconds of already received neuromuscular signals.
(111) Although only a number of examples have been disclosed herein, other alternatives, modifications, uses and/or equivalents thereof are possible. Furthermore, all possible combinations of the described examples are also covered.
(112) The following clauses disclose in an unlimited way additional embodiments.
(113) Clause 1. A generator system for generating a neuromuscular-to-motion decoder from a healthy limb of a person, the generator system comprising neuromuscular sensors, motion sensors, and a controller system that is configured to
(114) receive neuromuscular signals obtained by the neuromuscular sensors associated to predefined muscle and/or nerve locations of at least one pair of agonist and antagonist muscles/nerves of the healthy limb, said neuromuscular signals being obtained during performance by the person of a predefined exercise with the healthy limb, said predefined exercise being defined by predefined exercise data;
(115) receive motion signals obtained by the motion sensors associated to predefined positions of the healthy limb, said motion signals being obtained during performance by the person of the predefined exercise with the healthy limb; and
(116) generate the neuromuscular-to-motion decoder by mapping the neuromuscular signals to the motion signals over time using a mapping method whereby the neuromuscular-to-motion decoder is to be used for rehabilitating a paretic limb.
(117) Clause 2. A generator system according to clause 1, wherein the neuromuscular sensors comprise one or more electromyography (EMG) sensors, and/or one or more electroneurography (ENG) sensors, and/or one or more ultrasound sensors, and/or one or more optical sensors.
(118) Clause 3. A generator system according to any of clauses 1 or 2, wherein the neuromuscular sensors comprise one or more invasive sensors, and/or one or more non-invasive sensors.
(119) Clause 4. A generator system according to any of clauses 1 to 3, wherein the motion sensors are configured to generate the motion signals as velocity signals, and/or position signals, and/or torque signals, and/or force signals, and/or acceleration signals.
(120) Clause 5. A generator system according to any of clauses 1 to 4, wherein the mapping method comprises a machine learning method, or a statistical method, or a data mining method, or a combination of at least some of them.
(121) Clause 6. A generator system according to clause 5, wherein the mapping method comprises a support vector machine method, or a neural network method, or a fuzzy logic method, or a linear regression method, or a non-linear regression method, or a Lasso regression method, or a ridge regression method, or a Kalman filter method, or a combination of at least some of them.
(122) Clause 7. A generator system according to any of clauses 1 to 6, wherein the controller system is configured to
(123) determine reproducible data of the predefined exercise based on the predefined exercise data; and
(124) send said reproducible data to a reproducing device so as to provide the person with audio and/or visual indications about the predefined exercise to be performed.
(125) Clause 8. A generator system according to any of clauses 1 to 7, comprising a body actuator.
(126) Clause 9. A generator system according to clause 8, wherein the body actuator is a robotic exoskeleton configured to be mounted on the healthy limb.
(127) Clause 10. A generator system according to clause 9, wherein the motion sensors are comprised in the robotic exoskeleton.
(128) Clause 11. A generator system according to any of clauses 9 or 10, wherein the robotic exoskeleton is configured to guide the person in performing the predefined exercise with the healthy limb based on the predefined exercise data.
(129) Clause 12. A rehabilitation system for rehabilitating a paretic limb of a patient by using a neuromuscular-to-motion decoder generated by a generator system according to any of clauses 1 to 11, the rehabilitation system comprising neuromuscular sensors, motion sensors, and a controller system that is configured to
(130) receive neuromuscular signals obtained by the neuromuscular sensors associated to predefined muscle and/or nerve locations of the paretic limb corresponding to predefined muscle and/or nerve locations of a healthy limb taken into account in the generation of the neuromuscular-to-motion decoder, the neuromuscular signals being obtained during an attempt by the patient to perform with the paretic limb a predefined exercise defined by predefined exercise data taken into account in the generation of the neuromuscular-to-motion decoder;
(131) input the neuromuscular signals to the neuromuscular-to-motion decoder for causing the neuromuscular-to-motion decoder to output first motion commands;
(132) receive motion signals obtained by the motion sensors associated to predefined positions of the paretic limb corresponding to predefined positions of the healthy limb taken into account in the generation of the neuromuscular-to-motion decoder, the motion signals being obtained during the attempt by the patient to perform the predefined exercise with the paretic limb;
(133) determine trajectory data defining a trajectory to be followed by the paretic limb depending on a deviation between the motion signals and the predefined exercise data;
(134) determine second motion commands depending on the determined trajectory data to be followed by the paretic limb;
(135) determine final motion commands depending on the first motion commands and the second motion commands; and
(136) send the final motion commands to a body actuator associated to the paretic limb for controlling the body actuator so as to stimulate the patient to perform the predefined exercise with the paretic limb.
(137) Clause 13. A rehabilitation system according to clause 12, wherein the controller system is configured to determine the final motion commands depending on the first motion commands and the second motion commands by
(138) weighting the first motion commands and the second motion commands based on a predefined weighting criterion; and
(139) determining the final motion commands based on the weighted first and second motion commands.
(140) Clause 14. A rehabilitation system according to clause 13, wherein the controller system is configured to weight the first motion commands and the second motion commands based on the predefined weighting criterion by
(141) comparing the first motion commands to the second motion commands for obtaining a first indicator of similarity between the first motion commands and the second motion commands; and
(142) determining a first weight for the first motion commands and a second weight for the second motion commands depending on the first indicator of similarity, in such a way that the higher is the first indicator of similarity, the higher is the first weight and the lower is the second weight; and wherein
(143) the controller system is configured to determine the final motion commands based on the first motion commands weighted with the first weight and the second motion commands weighted with the second weight.
(144) Clause 15. A rehabilitation system according to clause 14, wherein the controller system is configured to compare the first motion commands to the second motion commands by performing a normalized root-mean-square error (NRMSE) method and/or a correlation coefficient method.
(145) Clause 16. A rehabilitation system according to any of clauses 14 or 15, wherein the controller system is configured to determine the second weight as a function of the first weight.
(146) Clause 17. A rehabilitation system according to clause 13, wherein the controller system is configured to weight the first motion commands and the second motion commands based on the predefined weighting criterion by
(147) receiving input from a user including an indicator of evolution of the rehabilitation; and
(148) weighting the first motion commands and the second motion commands based on the indicator of evolution of the rehabilitation.
(149) Clause 18. A rehabilitation system according to clause 17, wherein the controller system is configured to weight the first motion commands and the second motion commands based on the indicator of evolution of the rehabilitation by
(150) determining a third weight for the first motion commands and a fourth weight for the second motion commands depending on the indicator of evolution of the rehabilitation, in such a way that the higher is the indicator of evolution of the rehabilitation, the higher is the third weight and the lower is the fourth weight; and wherein
(151) the controller system is configured to determine the final motion commands based on the first motion commands weighted with the third weight and the second motion commands weighted with the fourth weight.
(152) Clause 19. A rehabilitation system according to clause 18, wherein the controller system is configured to determine the third weight as a function of the fourth weight.
(153) Clause 20. A rehabilitation system according to clause 12, wherein the controller system is configured to determine the final motion commands depending on the first motion commands and the second motion commands by aggregating the first motion commands and the second motion commands.
(154) Clause 21. A rehabilitation system according to clause 12, wherein the controller system is configured to determine the final motion commands depending on the first motion commands and the second motion commands by
(155) comparing the first motion commands to the second motion commands for obtaining a second indicator of similarity between the first motion commands and the second motion commands;
(156) transforming the first motion commands based on the second indicator of similarity between the first motion commands and the second motion commands; and
(157) determining the final motion commands based on the transformed first motion commands and the second motion commands.
(158) Clause 22. A rehabilitation system according to clause 21, wherein the controller system is configured to transform the first motion commands based on a projection of the first motion commands on the second motion commands.
(159) Clause 23. A rehabilitation system according to clause 13, wherein the controller system is configured to weight the first motion commands and the second motion commands based on the predefined weighting criterion by
(160) comparing the received neuromuscular signals to neuromuscular signals taken into account to generate the neuromuscular-to-motion decoder, for obtaining a third indicator of similarity between the received neuromuscular signals and the neuromuscular signals taken into account to generate the neuromuscular-to-motion decoder; and
(161) determining a fifth weight for the first motion commands and a sixth weight for the second motion commands depending on the third indicator of similarity, in such a way that the higher is the third indicator of similarity, the higher is the sixth weight and the lower is the fifth weight; and wherein
(162) the controller system is configured to determine the final motion commands based on the first motion commands weighted with the fifth weight and the second motion commands weighted with the sixth weight.
(163) Clause 24. A rehabilitation system according to any of clauses 12 to 23, wherein the controller system is configured to
(164) determine reproducible data of the predefined exercise based on the predefined exercise data; and
(165) send said reproducible data to a reproducing device so as to provide the patient with audio and/or visual indications about the predefined exercise to be attempted.
(166) Clause 25. A rehabilitation system according to any of clauses 12 to 24, wherein the controller system is configured to determine the trajectory data defining the trajectory to be followed by the paretic limb based on a Linear-quadratic regulator (LQR) method.
(167) Clause 26. A rehabilitation system according to any of clauses 12 to 25, wherein the neuromuscular sensors comprise one or more electromyography (EMG) sensors, and/or one or more electroneurography (ENG) sensors, and/or one or more ultrasound sensors, and/or one or more optical sensors.
(168) Clause 27. A rehabilitation system according to any of clauses 12 to 26, wherein the neuromuscular sensors comprise one or more invasive sensors, and/or one or more non-invasive sensors.
(169) Clause 28. A rehabilitation system according to any of clauses 12 to 27, wherein the motion sensors are configured to generate the motion signals as velocity signals, and/or position signals, and/or torque signals, and/or force signals, and/or acceleration signals.
(170) Clause 29. A rehabilitation system according to any of clauses 12 to 28, comprising the body actuator.
(171) Clause 30. A rehabilitation system according to clause 29, wherein the body actuator comprises a robotic exoskeleton configured to be mounted on the paretic limb.
(172) Clause 31. A rehabilitation system according to clause 30, wherein the motion sensors are comprised in the robotic exoskeleton.
(173) Clause 32. A rehabilitation system according to any of clauses 29 to 31, wherein the body actuator comprises a Functional electrical stimulation (FES) system, and/or an ultrasound-based neuromuscular stimulation system and/or an optical-based neuromuscular stimulation system.
(174) Clause 33. A rehabilitation system according to any of clauses 12 to 32, comprising the generator system.
(175) Clause 34. A rehabilitation system according to clause 33, wherein the neuromuscular sensors of the rehabilitation system and the neuromuscular sensors of the generator system are the same neuromuscular sensors.
(176) Clause 35. A rehabilitation system according to any of clauses 33 or 34, wherein the motion sensors of the rehabilitation system and the motion sensors of the generator system are the same motion sensors.
(177) Clause 36. A generator method for generating a neuromuscular-to-motion decoder from a healthy limb of a person, the generator method comprising
(178) receiving neuromuscular signals obtained by neuromuscular sensors associated to predefined muscle and/or nerve locations of at least one pair of agonist and antagonist muscles/nerves of the healthy limb, said neuromuscular signals being obtained during performance by the person of a predefined exercise with the healthy limb, and said predefined exercise being defined by predefined exercise data;
(179) receiving motion signals obtained by motion sensors associated to predefined positions of the healthy limb, said motion signals being obtained during performance by the person of the predefined exercise with the healthy limb; and
(180) generating the neuromuscular-to-motion decoder by mapping the neuromuscular signals to the motion signals over time using a mapping method whereby the neuromuscular-to-motion decoder is to be used for rehabilitating a paretic limb.
(181) Clause 37. A rehabilitation method for rehabilitating a paretic limb of a patient by using a neuromuscular-to-motion decoder generated by a generator method according to clause 36, the rehabilitation method comprising
(182) receiving neuromuscular signals obtained by neuromuscular sensors associated to predefined muscle and/or nerve locations of the paretic limb corresponding to predefined muscle and/or nerve locations of a healthy limb taken into account in the generation of the neuromuscular-to-motion decoder, the neuromuscular signals being obtained during an attempt by the patient to perform with the paretic limb a predefined exercise defined by predefined exercise data taken into account in the generation of the neuromuscular-to-motion decoder;
(183) inputting the neuromuscular signals to the neuromuscular-to-motion decoder for causing the neuromuscular-to-motion decoder to output first motion commands;
(184) receiving motion signals obtained by motion sensors associated to predefined positions of the paretic limb corresponding to predefined positions of the healthy limb taken into account in the generation of the neuromuscular-to-motion decoder, the motion signals being obtained during the attempt by the patient to perform the predefined exercise with the paretic limb;
(185) determining trajectory data defining a trajectory to be followed by the paretic limb depending on a deviation between the motion signals and the predefined exercise data;
(186) determining second motion commands depending on the determined trajectory data to be followed by the paretic limb;
(187) determining final motion commands depending on the first motion commands and the second motion commands; and
(188) sending the final motion commands to a body actuator associated to the paretic limb for controlling the body actuator so as to stimulate the patient to perform the predefined exercise with the paretic limb.
(189) Clause 38. A rehabilitation method according to clause 37, comprising the generator method.
(190) Clause 39. A computing system comprising a memory and a processor, embodying instructions stored in the memory and executable by the processor, the instructions comprising functionality to execute a generator method according to clause 36 for generating a neuromuscular-to-motion decoder from a healthy limb of a person.
(191) Clause 40. A computer program product comprising program instructions for causing a computing system to perform a generator method according to clause 36 for generating a neuromuscular-to-motion decoder from a healthy limb of a person.
(192) Clause 41. A computer program product according to clause 40, embodied on a storage medium.
(193) Clause 42. A computer program product according to clause 40, carried on a carrier signal.
(194) Clause 43. A computing system comprising a memory and a processor, embodying instructions stored in the memory and executable by the processor, the instructions comprising functionality to execute a rehabilitation method according to any of clauses 37 or 38 for rehabilitating a paretic limb of a patient.
(195) Clause 44. Computer program product comprising program instructions for causing a computing system to perform a rehabilitation method according to any of clauses 37 or 38 for rehabilitating a paretic limb of a patient.