Method and system for using haptic device and brain-computer interface for rehabilitation
10869804 ยท 2020-12-22
Assignee
Inventors
- Kai Keng ANG (Singapore, SG)
- Cuntai Guan (Singapore, SG)
- Kok Soon PHUA (Singapore, SG)
- Longjiang Zhou (Singapore, SG)
- Chuan Chu WANG (Singapore, SG)
Cpc classification
G09B5/06
PHYSICS
A61B5/7475
HUMAN NECESSITIES
A61B2560/0223
HUMAN NECESSITIES
A61H2230/105
HUMAN NECESSITIES
A61H2201/5048
HUMAN NECESSITIES
A61H2001/0203
HUMAN NECESSITIES
G06F3/015
PHYSICS
A61H1/02
HUMAN NECESSITIES
A61B5/225
HUMAN NECESSITIES
A61B5/1121
HUMAN NECESSITIES
G06F3/016
PHYSICS
International classification
A61H1/02
HUMAN NECESSITIES
G09B5/06
PHYSICS
A61B5/11
HUMAN NECESSITIES
Abstract
A method for calibrating and executing a rehabilitation exercise for a stroke-affected limb of a stroke patient is disclosed, the method comprising the steps of providing a haptic device for an able limb of the stroke patient to manipulate to perform a calibration action to result in a first position of the haptic device, and providing the haptic device for the stroke-affected limb to manipulate to perform the calibration action to result in a second position of the haptic device. The method further comprises the steps of moving the haptic device coupled with the stroke-affected limb from the second position towards the first position until a predetermined counterforce is detected, indicating an extreme position for the stroke-affected limb using the haptic device, and calibrating the haptic device with the extreme position such that during the rehabilitation exercise, the haptic device is prevented from moving beyond the extreme position.
Claims
1. A method for calibrating and executing a rehabilitation exercise for a stroke-affected limb of a stroke patient, the stroke patient having an able limb, the method comprising: providing a haptic device for the able limb to manipulate; providing with a screen, automated visual/audio instructions to guide the stroke patient in using the able limb to manipulate the haptic device to perform at least one calibration action; determining a first position of the haptic device, the first position resultant from the manipulation of the haptic device by the able limb in completing the at least one calibration action; providing the haptic device for the stroke-affected limb to manipulate; providing with the screen, automated visual/audio instructions to guide the stroke patient in using the stroke-affected limb to manipulate the haptic device to perform the at least one calibration action; determining a second position of the haptic device, the second position resultant from the manipulation of the haptic device by the stroke-affected limb in completing the at least one calibration action; moving the haptic device coupled with the stroke-affected limb from the second position towards the first position until a predetermined counterforce emanating from the stroke-affected limb is detected, indicating an extreme position for the stroke-affected limb using the haptic device; and calibrating the haptic device with the extreme position such that during the rehabilitation exercise for the stroke-affected limb, the haptic device is prevented from moving beyond the extreme position, wherein a force applied by the haptic device is a function of a motor imagery score of the stroke patient, a limb strength of the stroke-affected limb and a maximum limb strength of the able limb, and wherein the force applied by the haptic device is represented by an equation
2. The method of claim 1 wherein the rehabilitation exercise has the same sequence of movements as the at least one calibration action.
3. The method of claim 1 wherein the at least one calibration action is any one of, or any combination of the following actions: finger flexion, finger extension, forearm pronation and forearm supination.
4. The method of claim 1 further comprising: providing with the screen, automated visual/audio instructions to guide the stroke patient in using the able limb to apply maximum strength when the haptic device is stationary; and determining the maximum limb strength of the able limb by measuring the maximum strength applied by the able limb.
5. The method of claim 4 wherein the predetermined counterforce is greater than one quarter of the maximum limb strength of the able limb.
6. The method of claim 4 further comprising the operation of determining a limb strength of the stroke-affected limb by measuring the driving motor current necessary to maintain the same servo motor position during the rehabilitation exercise for the stroke-affected limb.
7. The method of claim 6 further comprising the operation of using a brain computer interface (BCI) system to obtain electroencephalogram (EEG) data from the brain of the stroke patient, and determining from the EEG data, a motor imagery score of the stroke patient.
8. The method of claim 7 further comprising the operation of executing the rehabilitation exercise for the stroke-affected limb by applying the force with the haptic device.
9. The method of claim 8 wherein the force applied by the haptic device is an assistive force or a resistive force depending on the limb strength of the stroke-affected limb.
10. The method of claim 7 further comprising the operation of using the EEG data to compute a Temporal Spectral-dependent Brain Index (TSBI), and then plotting the TSBI against Fugi-Meyer Score Improvement in a graph so as to predict the progress of stroke rehabilitation.
11. The method of claim 10 wherein the TSBI is calculated using the equation
12. A system for calibrating and executing a rehabilitation exercise for a stroke-affected limb of a stroke patient, the stroke patient having an able limb, the system comprising a haptic device, a screen, at least one sensor and a processor; wherein the haptic device is capable of: being manipulated by the able limb, in response to automated visual/audio instructions provided by the screen to guide the stroke patient in using the able limb to manipulate the haptic device to perform at least one calibration action, wherein the at least one sensor is configured to determine a first position of the haptic device, the first position resultant from the manipulation of the haptic device by the able limb in completing the at least one calibration action; being manipulated by the stroke-affected limb, in response to automated visual/audio instructions provided by the screen to guide the stroke patient in using the stroke-affected limb to manipulate the haptic device to perform the at least one calibration action; wherein the at least one sensor is configured to determine a second position of the haptic device, the second position resultant from the manipulation of the haptic device by the stroke-affected limb in completing the at least one calibration action; and moving, coupled with the stroke-affected limb, from the second position towards the first position until a predetermined counterforce emanating from the stroke-affected limb is detected by the least one sensor, indicating an extreme position for the stroke-affected limb using the haptic device; wherein the processor is configured to calibrate the haptic device with the extreme position such that during the rehabilitation exercise for the stroke-affected limb, the haptic device is prevented from moving beyond the extreme position, wherein a force applied by the haptic device is a function of a motor imagery score of the stroke patient, a limb strength of the stroke-affected limb and a maximum limb strength of the able limb, and wherein the force applied by the haptic device is represented by an equation
13. The system of claim 12 wherein the haptic device is a glove that fits onto a hand of the stroke patient.
14. The system of claim 12 wherein the at least one sensor comprises position encoders for providing position and orientation data of the haptic device.
15. The system of claim 12 further comprising a brain computer interface (BCI) system, the BCI system configured to obtain electroencephalogram (EEG) data from a brain of the stroke patient, and determine from the EEG data the motor imagery score of the stroke patient.
16. The system of claim 15 wherein the haptic device is configured to execute the rehabilitation exercise by applying the force during the rehabilitation exercise for the stroke-affected limb, wherein the force is a function of the motor imagery score of the stroke patient, the limb strength of the stroke-affected limb and the maximum limb strength of the able limb.
17. The system of claim 16 wherein the force applied by the haptic device is an assistive force or a resistive force depending on the limb strength of the stroke-affected limb.
18. The system of claim 15 wherein the EEG data is used to compute a Temporal Spectral-dependent Brain Index (TSBI), and the TSBI is then plotted against Fugi-Meyer Score Improvement in a graph so as to predict progress of stroke rehabilitation.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The accompanying figures, where like reference numerals refer to identical or functionally similar elements throughout the separate views and which together with the detailed description below are incorporated in and form part of the specification, serve to illustrate various embodiments, by way of example only, and to explain various principles and advantages in accordance with a present embodiment.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13) Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been depicted to scale. For example, the dimensions of some of the elements in the block diagrams or steps in the flowcharts may be exaggerated in respect to other elements to help improve understanding of the present embodiment.
DETAILED DESCRIPTION
(14) The following detailed description is merely exemplary in nature and is not intended to limit the invention or the application and uses of the invention. Furthermore, there is no intention to be bound by any theory presented in the preceding background of the invention or the following detailed description. It is the intent of the preferred embodiments to disclose a method and system which is able to effectively and accurately calibrate the haptic device. Furthermore, the extreme positions for the stroke-affected hand when using the haptic device can be automatically and accurately determined, enhancing the effectiveness of the rehabilitation exercises and avoiding excruciating pain for the patient. The disclosed method and system is fully automated and does not rely on the manual calibration of a therapist which is subject to human error.
(15) Further, in accordance with the present embodiments, during the execution of the rehabilitation exercises, the haptic device takes into account the maximum hand strength of the able hand, the hand strength of the stroke-affected hand and motor imagery ability of the patient when applying an assistive force as well as a resistive force during the rehabilitation exercises. Further still, in accordance with the present embodiments, the electroencephalogram (EEG) data can be used to predict the progress of the stroke rehabilitation. While exemplary embodiments have been presented in the foregoing detailed description of the invention, it should be appreciated that a vast number of variations exist.
(16)
(17) The method for calibrating haptic device 102 as disclosed involves a patient performing calibration actions. These calibration actions can include a finger flexion action, a finger extension action, a forearm supination action and a forearm pronation action. An illustration of a finger flexion action and a finger extension action is shown in
(18)
(19) In step 301 of
(20) In step 302 of
(21) In step 303 of
(22) In step 304 of
(23) In step 305 of
(24) In step 306 of
(25) In step 307 of
(26) In step 308 of
(27) In step 309 of
(28) In step 310 of
(29) It is to be noted that the manipulation of haptic device 102 by the patient through steps 301 to 310 is unassisted (no force is applied by haptic device 102) and is done entirely by the patient's able hand.
(30) In step 401 of
(31) In step 402 of
(32) In step 403 of
(33) In step 404 of
(34) In step 405 of
(35) It is to be noted that the manipulation of haptic device 102 by the patient through steps 401 to 405 is unassisted (no force is applied by haptic device 102) and is done entirely by the patient's stroke-affected hand.
(36) In step 501 of
(37) In step 502 of
(38) In step 503 of
(39) In step 504 of
(40) In step 505 of
(41) In step 506 of
(42) In step 507 of
(43) In step 508 of
(44) The range of movement to rehabilitate the fingers of the patient's stroke-affected hand is therefore determined i.e. f.sub.p for the finger flexion action and e.sub.p for the finger extension action. The range of movement to rehabilitate the fingers of the patient's stroke-affected hand is illustrated in
(45) Once memory 104 has stored f.sub.p for the finger flexion action, e.sub.p for the finger extension action, p.sub.p for the pronation action and s.sub.p for the supination action, haptic device 102 is successfully calibrated and configured for the patient. f.sub.p, e.sub.p, p.sub.p and s.sub.p represent the extreme positions for the stroke-affected hand when using haptic device 102 for the rehabilitation exercises. In other words, during the rehabilitation exercises, the haptic device 102 would not move beyond these extreme positions. These extreme positions represent the ideal upper limit for the rehabilitation exercises. Any position before or below these extreme positions mean that the stroke-affected hand still has room for improvement, while any position beyond these extreme positions will cause the patient excruciating pain. The calibration process is advantageous because it can automatically determine the extreme positions which haptic device 102 can assume when the patient undergoes the rehabilitation exercises.
(46) The calibration process is also advantageous because it is automatic and does not require a therapist, thereby reducing manpower costs. Further, as the calibration process is computerized with sensors 103 providing the necessary feedback, this calibration process is not subject to human error. Furthermore, the calibration process is robust enough to accommodate patients with varying hand sizes as well as right handed and left handed individuals. Obviously, for varying hand sizes, the range of movement and extreme positions will be different.
(47) After the calibration of haptic device 102, the patient can begin the rehabilitation exercises.
(48) Once motor imaginary is successfully detected, patient 802 can then perform the rehabilitation exercises which can include finger flexion, finger extension, forearm pronation and forearm supination exercises. To supplement these rehabilitation exercises, screen 803 can display a virtual simulation which mirrors the rehabilitation exercises being performed by patient 802.
(49) In an embodiment of the invention, haptic device 102 executes or helps executes the rehabilitation exercises by applying an assistive force or resistive force when necessary. This assistive force or resistive force is denoted as . When a is a positive value (+ve), haptic device 102 provides an assistive force to aid patient 802 in performing the exercises. When a is a negative value (ve), haptic device 102 provides a resistive force to prevent patient 802 from overexerting himself/herself during the exercises. Assistive force/resistive force can be a function of the hand strength of stroke-affected hand h, maximum hand strength of the able hand h.sub.max (h.sub.max,1 if it is a finger flexion and extension exercise, and h.sub.max,2 if it is a forearm pronation and supination exercise), motor imagery score m, and maximum motor imagery score m.sub.max.Math.m.sub.max is typically 100. The reason why assistive/resistive force is dependent on the maximum hand strength h.sub.max is because different patients have different hand strength. So instead of setting assistive force/resistive force to a fixed value, it is advantageous to account for the varying hand strength of patients by making assistive force/resistive force dependent on the hand strength of the patient 802. The maximum strength of patient's 802 stroke-affected hand is more or less the same as the maximum strength of his able hand. Therefore, the maximum strength of patient's 802 able hand is used as an approximation of the maximum strength of his stroke-affected hand.
(50) Assistive force/resistive force can therefore be presented as:
(51)
(52)
(53) However, if patient 802 applies a significant amount of hand strength with his/her stroke-affected hand when performing the rehabilitation exercise, becomes a negative value and haptic device 102 applies a resistive force to slow down the movement of patient 802 stroke-affected hand, thereby increasing the effort patient 802 has to exert on his/her stroke-affected hand during the rehabilitation exercise. This is advantageous as existing haptic systems provides only an assistive force, and not a resistive force. The haptic device 102 as described herein therefore contemplates a scenario where patient 802 may be able to move his/her stroke-affected hand, which in this case the haptic device 102 applies a resistive force and moving against this resistive force helps patient 802 to gain further strength on the stroke-affected hand. In other words, if patient 802 is capable of moving his/her stroke-affected hand, one of the objectives of the rehabilitation exercises would be to make patient 802 exert even more force. Therefore, a resistive force is applied so that patient 802 can be trained to exert even more effort. This is similar in concept to weight training Once a person can move a certain amount of weights, the training will progress on to heavier weights.
(54)
(55)
(56) The hand strength of the stroke-affected hand h exerted by patient 802 when performing the rehabilitation exercises can be evaluated by measuring the force applied to sensors 103. However, sometimes sensors 103 can be cumbersome due to the additional wiring. Therefore preferably, hand strength of the stroke-affected hand h is measured by measuring the driving motor current necessary to maintain the same servo motor position. The linear relationship between the applied force F and the driving motor current I is given by:
I=kcF+I.sub.0,
and therefore
(57)
where k is the transferring factor of the applied to the analogous current output of the motor for hand grasping movement, c is the conversion factor of the analog-to-digital (AD) convertor of the driving motor, and I.sub.0 is a constant caused by inertia and friction of the mechanism.
(58) Therefore, the hand strength of the stroke-affected hand applied during the rehabilitation exercises is therefore:
(59)
where F.sub.i is the average hand strength of the stroke-affected hand for the i.sup.th rehabilitation exercise, F.sub.i,j is the actively evaluated hand strength of the stroke-affected hand for the j.sup.th rehabilitation exercise.
(60) In another embodiment of the invention, the EEG data collected during the rehabilitation exercises can be used to compute the Temporal Spectral-dependent Brain Index (TSBI). TSBI can be computed using the following equation:
(61)
evaluates the averaged Fourier coefficient of eleven channel electrodes 1001 taken from the right hemisphere of the brain as shown in
(62) and where
(63)
evaluates the averaged Fourier coefficient of eleven channel electrodes 1002 taken from the left hemisphere of the brain as shown in
(64) and where
a.sub.n(c,t)
is the Fourier coefficient of index n of channel electrode c evaluated at time t that corresponds to a particular time segment [tT, t], with T being the duration in which the motor imagery is being performed;
(65) and where the Fourier coefficients [k.sub.1 and k.sub.2] corresponds to the frequency band [4-40 Hz] evaluated by the brain-computer interface (BCI) for performing motor imagery, and n.sub.k is the number of Fourier coefficients evaluated that correspond to the frequency band [4-40 Hz].
(66) Preferably, TSBI can be used as a prognostic measure to predict the possible outcome of the rehabilitation. When TSBIs are plotted against Fugi-Meyer Score Improvement, the results show that a lower TSBI resulted in a higher Fugi-Meyer Score Improvement. See
(67) Although all the embodiments of the invention have been described with the rehabilitation of a stroke-affected hand, forearm or wrist, one skilled in the art will appreciate that the invention can be applied to rehabilitate other stroke-affected limbs, for example, a stroke-affected leg.
(68) It should further be appreciated that the exemplary embodiments are only examples, and are not intended to limit the scope, applicability, operation, or configuration of the invention in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing an exemplary embodiment of the invention, it being understood that various changes may be made in the function and arrangement of elements and method of operation described in an exemplary embodiment without departing from the scope of the invention as set forth in the appended claims.