BIDIRECTIONAL LIMB NEURO-PROSTHESIS
20190117417 ยท 2019-04-25
Inventors
- Stanisa RASPOPOVIC (Lausanne, CH)
- Francesco Maria Petrini (Lausanne, CH)
- Marco Capogrosso (Pully, CH)
- Marco Bonizzato (Lausanne, CH)
- Silvestro MICERA (Saint-Sulpice, CH)
Cpc classification
A61F2002/6872
HUMAN NECESSITIES
A61B5/24
HUMAN NECESSITIES
A61F2/7812
HUMAN NECESSITIES
International classification
A61N1/05
HUMAN NECESSITIES
Abstract
Integrated closed-loop real-time limb neuro-prosthetic system comprising an artificial limb, a microprocessor, sensors, a signal conditioner, a stimulator, at least one EMG electrode and at least one sensory feedback electrode, characterized by the fact that said sensory feedback electrode is all intraneural electrode which is adapted to be implanted in an intact and healthy portion of a nerve.
Claims
1-12. (canceled)
13. A method performed on a closed-loop real-time limb neuroprosthetic system, the system including an artificial limb or a sensorized glove or sock, a microprocessor, sensors, a signal conditioner, a stimulator, an electromyography (EMG) electrode, and a sensory feedback electrode, the method comprising the steps of: implanting the sensory feedback electrode transversally in an intact and healthy portion of a nerve; and modulating an intensity of a sensory feedback from the sensory feedback electrode by changing an injected charge with respect to a readout of the sensors, the sensors being embedded in the artificial limb or in the sensorized glove or sock.
14. The method according to claim 13, wherein the step of modulating further comprises: modulating the intensity of the sensory feedback by changing a stimulation frequency with respect to the readout of the sensors that are embedded in the artificial limb or in the sensorized glove or sock.
15. The method according to claim 13, wherein the step of modulating further comprises: modulating the intensity of the sensory feedback by changing a time occurrence of a stimulation pattern with respect to the readout of the sensors that are embedded in the artificial limb or in the sensorized glove or sock.
16. The method according to claim 13, wherein the step of modulating further comprises: modulating the intensity of the sensory feedback by a multi-polar stimulation with respect to the readout of the sensors embedded in the artificial limb or in the sensorized glove or sock.
17. The method according to claim 13, wherein the step of modulating further comprises: modulating at least one of a type and location of the sensory feedback by changing the stimulation of an active site of a peripheral nerve interface with respect to the readout of the sensors embedded in the artificial limb or in the sensorized glove or sock.
18. The method according to claim 13, wherein the step of modulating further comprises: modulating at least one of a type and location of the sensory feedback by multi polar stimulation with respect to the readout of the sensors embedded in the artificial limb or in a sensorized glove or sock.
19. The method according to claim 13, wherein implanting the sensory feedback electrode is performed in a way as to differentiate a fiber recruitment of a fascicle.
20. The method according to claim 13, wherein implanting the sensory feedback electrode is performed in a way as to differentiate a fiber recruitment of two fascicles.
21. The method according to claim 13, wherein implanting the sensory feedback electrode is performed through insertion within a nerve fascicle.
22. The method according to claim 13, wherein the step of implanting the sensory feedback electrode includes an implanting of the sensory feedback electrode in a transversal section of a median nerve extracted at the elbow.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0039]
[0040]
[0041]
[0042]
DETAILED DESCRIPTION OF THE INVENTION
[0043] The invention will be better understood in the following text, in a detailed description and with non-limiting examples.
[0044]
[0045] The system is constituted by a robotic limb with embedded sensors or provided with a sensorized glove (or sock), a superficial/implantable stimulator, EMG electrodes mounted in a socket or inserted in the amputee remnant muscles, a signal conditioner and multichannel intrafascicular electrodes. The robotic limb must be connectable to the socket.
[0046] A microprocessor, cable/wireless connected to the robotic limb and to the stimulator, handles the acquisition of the EMG/ENG signals and uses them for the control of the robotic limb. Furthermore, this device reads the signals from the pressure/force/angular/position sensors and uses them to drive the stimulator for current/voltage injection to the peripheral nervous system of the amputee.
Components of the System
[0047] 1. Robotic limb
[0048] The robotic limb is comprised by several features: [0049] i) The robotic limb should have one or preferably more degrees of freedom, and be equipped with at least one, preferably more, touch-pressure sensors and angular sensors on/within the finger/fingertips/palm/joints/foot. In the case the robotic limb is not provided with sensors, a sensorized glove (or sock) can be put over it. [0050] ii) In the case of more proximal (e.g. above the elbow or the knee) amputations, it should be equipped with controllable wrist/elbow/knee/ankle, provided with sensors. [0051] iii) The functionalized socket to be adapted to the stump should include monopolar or bipolar surface EMG electrodes or multipolar electrode arrays for electromyographic activity. [0052] iv) In the case of the intramuscular EMG step iii) is not required. [0053] v) In the case of targeted-muscle re-innervation (TMR) users, the electrode arrays can be placed over the targeted breast/leg muscles. [0054] 2. Artificial sensors within robotic limb or glove (or sock)
[0055] Any prosthetic hand/foot/arm/leg with force/pressure/angular/position sensors in/on the fingers/finger tips/palm/wrist/elbow/knee/ankle can be used for the method. The sensors must give a continuous measurement with a sampling frequency of minimum 10 Hz, in Pa (for pressure sensors) or N (for force-tension sensors). Position and/or angular sensors of the fingers/joints are to be used for providing proprioceptive sensations. The sensors should have capacity to detect the area of contact and precise timing of its dynamic change. [0056] 3. Implanted Electrodes
[0057] Multi- and intra-fascicular electrodes (provided with bio-compatible cables and connectors) to be implanted in the Median and/or Ulnar and /or Radial nerves, within the residual arm, or in the case of TMR amputees within the transferred nerves. For the lower limb to be implanted within femoral/sciatic/tibial residual nerves, or in the case of lower limb TMR amputees within the transferred nerves. [0058] 4. Current/voltage Stimulator
[0059] The stimulator can be transcutaneously connected to the electrodes or can be implantable. It must have at least 2 independent (in terms of the all stimulation parameters: amplitude, pulsewidth, frequency) channels, being preferable the solution with many channels. [0060] 5. Signal Conditioner
[0061] A signal conditioner picks-up the signals coming from the ENG, EMG electrodes, then amplifies and filters them. This device has to be connected wireless or wired with the ENG, EMG electrodes. Then, it has to send the amplified signals to the processor. The signal amplifier can be implantable or external to the body. [0062] 6. Microprocessor
[0063] A microprocessor unit will manage: [0064] i) a) The acquisition of biological signals (muscular and neural) b) processing and c) decoding the voluntary intention of user, in order to control the motion of the robotic limb. [0065] ii) a) The acquisition of robotic limb sensors readouts, b) Processing and c) Encoding of the information, in order to control the stimulator for the sensory restoration.
Methods
[0066] The system schematically illustrated in
[0068] The hybrid control strategy of the artificial limb is composed of two steps that could work as independent or synergistic modules: [0069] i) Electromyographic (EMG) control module: the control is implemented through a classifier, which recognizes the EMG activity at fixed steps (for example 100 ms) and decode the type of grasp/movement that the user wants to perform. The amputee can in every moment change the muscular activity and switch from one to another type of grasp/movement. This control should work with different electrodes for EMG recordings that could be surface electrodes, surface electrodes arrays or intramuscular electrodes. [0070] ii) Electroneurographic (ENG) control module: the ENG signal is used in combination with the EMG module to control the grasping force/velocity of the selected grasp by working in synergy with it. [0071] iii) In the case of the absence or impossibility of recording the ENG signal, the velocity of the motors will be controlled by the EMG control module. [0072] 2. Transfer function to the Nervous System.
[0073] The readout of the sensors embedded in the prosthetic limb or the glove (or sock) is used as an input for the delivery of afferent neural stimulation. The system can select and modulate 4 (or more) different characteristics of sensations: [0074] i) type of sensation [0075] ii) strength (intensity) [0076] iii) location over phantom limb [0077] iv) spatial extension
Type of Sensation
[0078] The type of sensation is selected by the stimulation of particular active sites of the peripheral nerve interface. In the case of multi- and intra-fascicular electrodes each usable active site will in fact elicit a specific type of sensation. These sensations could be touch/pressure and proprioception among others.
Strength of Sensation
[0079] The strength of sensation can be modulated through the use of charge (amplitude/pulse width), frequency and pattern of stimulus time occurrence modulation. In the case of the charge modulation an intrafascicular device ensure a quasi-linear dynamic relationship strength-amplitude.
[0080] The relationship between the tension-touch hand sensors readout and the charge of the stimulation current pulses could be implemented (nut not limited to) as follows:
c=(c.sub.maxc.sub.min)*(ss.sub.15)/(s.sub.75s.sub.15)+c.sub.min, when s.sub.15ss.sub.75;
c=0, when s.sub.15<s;
c=c.sub.max, when s>s.sub.75;
where:
[0081] c is the amplitude of stimulation current,
[0082] s is the sensor readout,
[0083] s.sub.15 and s.sub.75 represent 15% and 75% respectively of the maximum range of the sensor readout, which characterize, respectively, the contact point of the robotic hand with an object and a value tuned to exploit the full range of sensations for all objects, c.sub.min and c.sub.max are the stimulation current amplitudes that elicited, respectively, the minimum and the maximum (i.e., below pain threshold) touch sensations, as reported by the subject. The frequency of the stimulation in this example is fixed.
[0084] An analogous relation can be implemented in the case of frequency modulation:
f=(fmaxfmin)*(ss15)/(s75s15)+fmin, when s15ss75;
f=0, when s15<s;
f=cmax, when s>s75;
[0085] In this case f is the frequency of the stimulation. The current amplitude is fixed and set to a value that elicits a sensation in the middle between minimum and below pain threshold perceived sensations.
[0086] In the case of the modulation of the time occurrence (TO) of the stimulation pattern, several relations (sensors readouts-TO) can be implemented. The TO is defined as the time delay between a pattern of stimulation and the successive one.
[0087] A linear (sensors readouts-TO) relation is defined as follows:
TO=(TOmaxTOmin)*(ss15)/(s75s15)+TOmax, s15ss75;
No stimulation, s15<s;
TO=TOmax, s>s75;
[0088] In this case, the current amplitude is fixed and set to a value that elicits a sensation in the middle between minimum and below pain threshold perceived sensation.
[0089] In all the presented cases, other possible relations can be implemented between the sensors readouts and the stimulation (e.g. sigmoid or Poisson relations). Moreover, similar relations can be implemented in the case a voltage stimulator and other types of sensors are used in the bidirectional prosthesis.
[0090] Charge, frequency and pattern time occurrence modulation can be implemented and exploited together or separately in the bidirectional prosthesis.
Location Over Phantom Limb
[0091] This characteristic is controlled by the spatial location of the electrodes: different active sites of the electrode, debt to transversal somato-topography of peripheral nerves, will elicit the sensations over different areas of the missing limb. Intra-fascicular electrodes ensure a localized sensation per active site, being able to stimulate single nerve fascicles, thus each active site could control a specific and delimited sensory area. For example in the case of hand/arm amputation an electrode implanted in the residual median nerve will elicit the sensations over first three fingers and underlying palm area. Electrode implanted in residual ulnar nerve will elicit the sensations over last two fingers and underlying palm area. Finally, electrode implanted in radial nerve will elicit sensations over wrist and dorsal hand. In the lower limb the sciatic nerve stimulation will enable for the coverage of the main part of the phantom foot sensations.
Spatial Extension
[0092] This characteristic is controlled by a combination of the spatial location and amplitude modulation of the active sites. Several active sites of electrode, that elicit different sensations, will be used together in multipolar stimulation strategies to move the sensation over different hand areas (e.g. the sensations elicited in thumb and index finger could be combined so to obtain the feeling of the palm that is under these two fingers). [0093] 3. Real-time integration microprocessor unit
[0094] The recording of biological signals, features extraction, and final decoding of the user intended grasp/movement will be done in parallel with sensors readout, and transformation for encoding of the sensation. All the computation should be performed in timing within 100 msec that is essential to be imperceptible to the user.
[0095] Of course the invention is not limited to the examples presented previously.
[0096] Any suitable highly selective neural fiber stimulation tool can be used, for instance the use of optogenetic technologies [26] or a combination of electrical and optical stimulation [27].
[0097] The number of EMG and/or sensory feedback electrodes is also not limited, the main objective being to provide a highly selective stimulation between two adjacent fascicules or between the axons located within the same fascicule.
REFERENCES
[0098] 1. K. T. Reilly, C. Mercier, M. H. Schieber, A. Sirigu, Persistent hand motor commands in the amputees' brain. Brain 129, 2211-23 (2006). [0099] 2. A. W. Goodwin, H. E. Wheat, Sensory signals in neural populations underlying tactile perception and manipulation. Annu Rev Neurosci. 27, 53-77 (2004). [0100] 3. W. Schady, J. L. Ochoa, H. E. Torebjork, L. S. Chen, Peripheral projections of fascicles in the human median nerve. Brain 106, 745-760 (1983). [0101] 4. P. Marchettini, M. Cline, J. L. O choa, Innervation territories for touch and pain afferents of single fascicles of the human ulnar nerve. Mapping through intraneural microrecording and microstimulation. Brain 113, 1491-500 (1990). [0102] 5. W. Schady, S. Braune, S. Watson, H. E. Torebjrk, R. Schmidt, Responsiveness of the somatosensory system after nerve injury and amputation in the human hand. Ann. Neurol. 36, 68-75 (1994). [0103] 6. D. Atkins, D. Heard, W. Donovan, Epidemiologic overview of individuals with upper-limb loss and their reported research priorities. J Prosthet. Orthot. 8, 2-11 (1996). [0104] 7. E. Biddiss, D. Beaton, T. Chau, Consumer design priorities for upper limb prosthetics. Disabil. Rehabil. Assist. Technol. 2, 346-57 (2006). [0105] 8. M. C. Carrozza, G. Cappiello, S. Micera, B. B. Edin, L. Beccai L., et al., Design of a cybernetic hand for perception and action. Biol. Cybern. 95, 629-644 (2006). [0106] 9. M. S. Johannes, J. D. Bigelow, J. M Burck, S. D. Harshbarger, M. V. Kozlowski, T. Van Doren, An Overview of the Developmental Process for the Modular Prosthetic Limb. Johns Hopkins APL Tech Dig, 30, 207-216 (2011). [0107] 10. C. Connolly, Prosthetic hands from Touch Bionics. Industrial Robot. 35, 290-293 (2008). [0108] 11. T. A. Kuiken, L. A. Miller, R. D. Lipschutz, B. A. Lock, K. Stubblefield, et al., Targeted reinnervation for enhanced prosthetic arm function in a woman with a proximal amputation: a case study. Lancet 369, 371-380 (2007). [0109] 12. T. A. Kuiken, G. Li, B. A. Lock, R. D. Lipschutz, L. A. Miller, et al., Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. JAMA 301, 619-628 (2009). [0110] 13. P. D. Marasco, A. E. Schultz, T. A. Kuiken, Sensory capacity of reinnervated skin after redirection of amputated upper limb nerves to the chest. Brain 132, 1441-8 (2009). [0111] 14. T. A. Kuiken, P. D. Marasco, B. Lock, R. Harden, J. Dewald, Redirection of cutaneous sensation from the hand to the chest skin of human amputees with targeted reinnervation. Proc. Natl. Acad. Sci. USA 104, 20061-6 (2007). [0112] 15. R. Kristeva-Feige, S. Rossi, V. Pizzella, L. Lopez, S. N. Erne, J. Edrich, P. M. Rossini A neuromagnetic study of movement-related somatosensory gating in the human brain. Exp Brain Res. 107, 504-14 (1996). [0113] 16. L Hargrove, A, Simon; A. Young; R Lipschutz, S, Finucane, D. Smith, T. Kuiken, Robotic leg control with EMG decoding in an amputee with nerve transfers. New England Journal of Medicine. 369, 1237-1242 (2013) [0114] 17. X. Navarro, T. Krueger, N. Lago, S. Micera, T. Stieglitz, et al., A critical review of interfaces with the peripheral nervous system for the control of neuroprostheses and hybrid bionic systems. J. Peripher. Nerv. System 10, 229-258 (2005). [0115] 18. G. S. Dhillon, T. B. Kruger, J. S. Sandhu, K. W. Horch, Effects of short-term training on sensory and motor function in severed nerves of long-term human amputees. J Neurophysiol. 93, 2625-2633 (2005) [0116] 19. G. S. Dhillon, S. M. Lawrence, D. T. Hutchinson, K. W. Horch, Residual function in peripheral nerve stumps of amputees: implications for neural control of artificial limbs J Hand Surg Am. ;29, 605-15 (2004) [0117] 20. P. M. Rossini, S. Micera, A. Benvenuto, J. Carpaneto, G. Cavallo, et al,. Double nerve intraneural interface implant on a human amputee for robotic hand control. Clin. Neurophysiol. 121, 777-783 (2010). [0118] 21. X. Jia, M. A. Koenig, X. Zhang, J. Zhang, T. Chen, et al., Residual motor signal in longterm human severed peripheral nerves and feasibility of neural signal controlled artificial limb. J. Hand Surg. Am. 32, 657-66 (2007). [0119] 22. J. Badia, T. Boretius, D. Andreu, C. Azevedo-Coste, T. Stieglitz, and X. Navarro, Comparative analysis of transverse intrafascicular multi-channel, longitudinal intrafascicular and multipolar cuff electrodes for the selective stimulation of nerve fascicles, J. Neural Eng., vol. 8, no. 3, (2011). [0120] 23. S. Raspopovic, M. Capogrosso, and S. Micera, A computational model for the stimulation of the rat sciatic nerve using a transverse intrafascicular multichannel electrode, IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 4, pp. 333-344, Aug. (2011). [0121] 24. T. R. Farrell, R. F. Weir, The optimal controller delay for myoelectric prostheses. IEEE Trans. Neural. Syst. Rehabil. Eng. 15, 111-8 (2007). [0122] 25. T. Boretius , J. Badia , A. Pascual-Font, M. Schuettler, X. Navarro, K Yoshida, T. Stieglitz, A transverse intrafascicular multichannel electrode (TIME) to interface with the peripheral nerve. Biosensors and Bioelectronics, 26(1), 62-69, 2010. [0123] 26. M. E. Llewellyn, K. R. Thompson, K. Deisseroth, S. L. Delp, Orderly recruitment of motor units under optical control in vivo Nature Medicine 16, 1161-1165, 2010. [0124] 27. Duke AR.sup.1, Peterson E, Mackanos M A, Atkinson J, Tyler D, Jansen E D. Hybrid electro-optical stimulation of the rat sciatic nerve induces force generation in the plantarflexor muscles, J Neural Eng, 9(6):066006. 2012. [0125] 28. Cipriani, Christian, Marco D'Alonzo, and Maria Chiara Carrozza. A miniature vibrotactile sensory substitution device for multifingered hand prosthetics. Biomedical Engineering, IEEE Transactions on 59.2 (2012): 400-408. [0126] 29. A. Y. j Szeto e F. A. Saunders, Electrocutaneous Stimulation for Sensory
[0127] Communication in Rehabilitation Engineering, IEEE Trans. Biomed. Eng., vol. BME-29, n. 4, pagg. 300-308, apr. 1982. [0128] 30. Kuhn, Andreas, et al. The influence of electrode size on selectivity and comfort in transcutaneous electrical stimulation of the forearm. Neural Systems and Rehabilitation Engineering, IEEE Transactions on 18.3 (2010): 255-262. [0129] 31. Jabaley, Michael E., William H. Wallace, and Frederick R. Heckler. Internal topography of major nerves of the forearm and hand: a current view. The Journal of hand surgery 5.1, (1980).