Neuromorphic controlled powered orthotic and prosthetic system
12016788 ยท 2024-06-25
Assignee
Inventors
- Ranu Jung (Coral Gables, FL, US)
- Shah Vikram Jung (Freemont, CA, US)
- Brundavani Srimattirumalaparle (Glendale, AZ, US)
Cpc classification
International classification
Abstract
A neuromorphic controlled powered orthotic and prosthetic system and device including a custom or universal fit fixed-ankle orthosis, to stabilize or immobilize an injured lower limb or act as an ankle prosthesis, and an actuated or powered articulated false-foot connected to the fixed-ankle orthosis or the prosthesis to form an actuated articulated false-foot orthosis. Associated with or mounted on the actuated articulated false-foot, or in or on the body, are sensors for sensing the intent of the subject to move, and the movement range of the articulating false-foot or AAFO and an environmental perturbation. An actuator is used to drive the articulated false-foot orthosis. The system and device further include a controller having an electronic circuit with a biomimetic design based on knowledge of connectivity of neurons within the spinal cord of a primitive vertebrate. The system and device include an electronic circuit made from analog very large scale integrated components and discrete electronic components capable of autonomously generating cyclic voltage output. An integral power supply serves the portable controller and AAFO.
Claims
1. A system for generating a neuromorphic signal pattern for use as a control signal in a powered assistive false-foot configured to surround and support a foot within footwear of a lower limb for assisting a user wearing the powered assistive false-foot, comprising, a controller having an electronic pattern generating circuit with a biomimetic design that mimics the simplified connectivity of a 9-neuron network within the spinal cord of primitive vertebrates, wherein the electronic pattern generating circuit is made from analog integrated components and discrete electronic components and is configured to generate an autonomous signal for initiating movement of the powered assistive false-foot; and a surfaces sensor supported on the powered assistive false-foot for detecting changes in the powered assistive false-foot and a surfaces sensor supported on the user wearing the powered assistive false-foot, and the surfaces sensors are configured to provide the changes detected to the controller having the electronic pattern generating circuit with the biomimetic design which generates an autonomous signal for adjusting the signal pattern output of the system to match the sensed changes.
2. A powered device for assisting a user with walking, comprising: a controller for controlling movement of the powered device having an electronic circuit with a biomimetic design that mimics the connectivity of neurons within the spinal cord of primitive vertebrates, wherein the electronic circuit is an electronic pattern generating circuit is made from analog integrated components and discrete electronic components and is configured to generate an autonomous signal; an actuated articulated false-foot configured to connect to, surround, and support a foot within footwear of an injured lower limb within the articulated false-foot to form an actuated articulated false-foot prosthesis; a linear actuator supported between an upper attachment location, and a lower attachment location on the actuated articulated false-foot for driving the articulated false-foot prosthesis; and a sensor mounted on the articulated false-foot to sense movement of the articulating false-foot prosthesis.
3. The powered device for assisting a user with walking of claim 2, wherein the controller is configured to automatically start and stop movement of the actuated articulated false-foot prosthesis.
4. The powered device for assisting a user with walking of claim 2, wherein the controller is configured to automatically move the actuated articulated false-foot prosthesis at a user selected walking speed.
5. The powered device for assisting a user with walking of claim 2, wherein the controller is configured to automatically respond to external environmental input to adjust the movement pattern of the actuated articulated false-foot prosthesis.
6. The powered device for assisting a user with walking of claim 2, wherein the device is portable and is configured to be carried by the user.
7. A powered device for assisting a user with walking, comprising: a controller for controlling movement of the powered device, the controller having an electronic circuit with a biomimetic design that mimics the connectivity of neurons within the spinal cord of primitive vertebrates, wherein the electronic circuit is an electronic pattern generating circuit made from analog integrated components and discrete electronic components and is configured to generate an autonomous signal; an actuated articulated false-foot configured to connect to, surround and support a foot within footwear of an injured lower limb within the articulated false-foot to form an actuated articulated false-foot prosthesis; a linear actuator supported on the powered device for driving the articulated false-foot prosthesis; and a sensor mounted on the articulated false-foot and a surface sensor configured to be mounted on the user to sense movement changes, and the sensors configured to provide sensed movement changes detected to the controller for adjusting the signal pattern output of the controller to match the sensed movement changes.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
DETAILED DESCRIPTION OF THE INVENTION
(19) The present invention provides an integrated control system, based on principles of architecture and functions of the spinal cord of primitive vertebrates for control of rhythmic movement, to sense and control an actuated powered orthotic splint or prosthetic system for the lower limb. The system is generally referenced here as a neuromorphic controlled powered orthotic and prosthetic system or NOCS.
(20) The NOCS portable system and device of the present application 10, as schematically illustrated in
(21) In the present application, a fixed-ankle orthosis or AFO 12 is provided which may also be a passive ankle prosthesis. The fixed-ankle orthosis 12 allows lower limb L and ankle A immobilization and forms a housing for the injured lower leg of the user or subject S. Such an AFO 12 can be fit to the user S, and universally shaped to accommodate a shoe B on a foot. Alternatively, the AFO 12 can be a universal, non-custom fit bilateral application, so that the device can be readily deployed under combat conditions, and a combat boot B of any size, right or left boot, can remain on the user S within the AFO until evacuation from the battlefield. The AFO can also be custom fit to the lower limb L, ankle and foot F.
(22) As shown in
(23) In an alternate embodiment of the device 10 for an above the knee application, the AFO 12 is provided with a thigh support, not shown, which is interconnected with the calf support 13 at a rigid articulated knee connection, all secured to the user via Velcro straps 40 or other flexible attachments.
(24) As shown in
(25) As shown in
(26) The base 14 of the false-foot 16 and support 13 of the AFO 12 are each secured to the actuator 22, which operates to move the support 13 with respect to the base of the false-foot 16 at the pivot point. The AAFO 18 is preferably lightweight and allows one degree of freedom of movement. The AAFO preferably operates to provide plantar-flexion between approximately 0 and 30 degrees, and less than 35 degrees at a maximum, and the user S may actively control this angle. The dorsi-flexion of the AAFO during operation is preferably between approximately 0 and 18 degrees during operation, and less than 30 degrees at a maximum, also with active control allowed. The range of motion provided by the AAFO 18 is shown by the difference in position between the support 13 and base of the false-foot 16 in
(27) Where the above the knee universal fit orthosis is used to provide further offloading of the injured leg L, such an orthosis can also be utilized in a trans-tibial amputee with the articulated false-foot 16 acting as ankle prosthesis. To prevent debris from entering the space between the AFO 12 and the false-foot 16, a scree gaiter, a skirt, or dense foam can be used as a debris guard (not shown). A similar debris guard 44 is used to provide a protective cover for the actuator 22.
(28) Several alternate methods may be used to form and connect the AFO to the articulating false-foot 18 to form the AAFO 18.
(29) One form of actuator secured to the acute AAFO 18 includes a direct rotary drive, as shown in
(30) Alternatively, a pneumatic actuator could be used, such as a commercially available pneumatic actuator. For example, the McKibben artificial muscle pneumatic actuator may be used, which has a cylindrical flexible bladder which is covered by a braided mesh of non-stretching fibers. Both ends of the bladder are connected to the mesh. By changing the force applied to the free end of the mesh and the pressure inside the bladder, the actuator's diameter increases while the length decreases.
(31) A worm gear may also be used for the actuator, as in
(32) A still further actuator, shown in
(33) As a further option, energy storage may be utilized in conjunction with the actuator as it is connected to the false-foot 16 to reduce energy required by the mechanical actuators in the system. Examples of methods for storing and transferring kinetic energy back into the false-foot to reduce demands for peak force and peak power, include elastomeric top or bottom mounted bumpers, shown in
(34) As shown in the preferred embodiment of
(35) In the preferred embodiment shown in
(36) As shown in more detail in
(37) Several types of sensors may be used to transmit position information for components of the NOCS 10. The sensors 20a, 20b, 20c are interconnected with the system controller 24 or motor controller 47 and provide accurate information about the angular excursion of the false-foot 16, sense initiation, respond to continuous movement of the user, and termination of a gait event cycle, provide feedback to the controller about the self selected walking speeds of the user S, provide information about external disturbances and perturbations and help reset the locomotor rhythm.
(38) A first type of sensor is provided in or adjacent the pivot point P of the AAFO or in the motor 46 of the actuator. As shown in
(39) A second type of sensor 20b is provided to sense initiation and termination of a gait event cycle, as well as continuous movement of the uninjured limb or the contralateral leg, thereby providing real-time output at the self-selected walking speed of the user S. This second sensor type may be mounted anywhere along the AAFO or AFO bracket front, back or side, an in-body sensor, on the uninjured swinging limb, on the intact portion of the injured limb or on any body part that moves at the self-selected walking pace. The output of the second sensor 20b can be a continuous signal or a periodic discrete pulse-like signal, where the pulse is generated when the sensor output goes above a predefined threshold. The output of the second sensor 20b provides feedforward input to the PG 26 of the NOCS via the auxiliary neuron as described below. The PG provides trajectory timing for driving the actuator motor 46. Although the illustrated sensor 20b, shown mounted laterally on the AAFO 18, is a gyroscope type sensor, and specifically a MEMS based gyroscope from Analog Devices, product ADXRS300, multiple sensors may be used, and multiple types of sensors may be used. Alternatively, this sensor 20b, which senses the initiation and termination of the user S may be the sole sensor used.
(40) A third type of sensor 20c may provide information about the episodic external disturbances and perturbations and helps reset the locomotor rhythm by providing a brief input signal to the PG. The sensor 20c may be mounted on a sensor board of the controller.
(41) Key characteristics of sensors 20a, 20b, 20c used in the NOCS are their low-profile, light weight, simple power requirements, fast response times, and low susceptibility to noise. The rotational velocity signal provided by sensor 20a may also be used to provide information to the controller neuromorphic orthotic control system, for detection of key gait events or to provide a continuous estimate of rotational velocity or orientation if the signal is integrated.
(42) Sensors may alternatively be located on or in the user's body, or mounted on either leg. Alternatively or additionally, hip-angle sensors (commercial goniometers), tilt-sensors mounted on the shank of un-injured leg, surface electromyogram sensors may be mounted on a thigh of the injured leg or thigh or shank of un-injured leg, accelerometers; force sensitive resistors; or potentiometers operational in the range 0-35 degrees, with 180 degrees maximum, may also be used. Set forth below is a chart of the types and advantages of sensors that may be used electrodes. The output of the sensing electrodes will be processed through the electronic circuitry to provide the appropriate voltage or current analog or digital input to the PG.
(43) TABLE-US-00001 TYPE OF SENSOR ADVANTAGES Surface Metal plate with electrolyte gel, noninvasive In/On Muscle Lower thresholds and better selectivity compared to surface electrodes Intramuscular Implanted in the muscle, multistranded Teflon coated stainless steel wire, monopolar and bipolar con- figurations, good tensile strength, and flexibility Epimysial Implanted under the skin: on the muscle, monopolar and bipolar configurations, less prone to mechanical failure BIONs Injected into or near the muscle, hermetically sealed glass/ceramic capsule integrated with electronics Near/On Nerve Lower threshold levels and better selectivity than the above mentioned electrodes Nerve Cuffs Monopolar, bipolar and tripolar configurations, good power efficiency, improved selectivity, comparatively stable FINE Reshape or maintain nerve geometry Intrafascicular Penetrate the epineurium and into the fascicle, selective stimulation, lower current and charge levels LIFE Stable, suitable for stimulating and recording SPINE Reduced nerve damage Intraspinal Microwires Near to normal recruitment, reduced fatigue, highly selective stimulation
(44) The NOCS 10 system controller 24 includes an electronic pattern generating circuit 26 which was developed based on the simplified connectivity pattern of neurons forming a neural network within the spinal cord of a primitive vertebrate, specifically a lamprey eel, to produce a rhythmic pattern for signaling the actuator 22 to move the AAFO 18, and associated electronic circuitry to receive inputs from sensors, provide 24 V DC to 5 V DC voltage converter from the power source and to provide impedance matching between the controller 24 and the actuator motor controller 47. The neural network design within the electronic pattern generating circuit, together with the other discrete electronic components are provided as the NOCS system controller, which are enabled in a portable unit capable of being worn by a user S are as shown in
(45) The neural network structure of the PG is based upon a 9-neuron network mimicking the simplified connectivity pattern of spinal cord neurons in primitive vertebrates to produce rhythmic movement output. The 4 types of neurons on each side of the body, or 8 in total, are the excitatory E, lateral L, crossed C and motor M. An auxiliary neuron A is also used. An auxiliary neuron (A) was added to the PG circuit to provide input to the constituent neurons for entrainment of the PG output to an external signal. The external signal will be a voltage proportional to one of the continuous gait measure signals. The A neuron modifies this voltage to a current to be injected into one of the other eight neurons. The number of neurons used to form a network, besides the A neuron, can be modified to fewer neurons, or a single neuron on each side, or the 8-neuron network may be replaced by a single neuron. Thus, the network oscillator 60, shown schematically in
(46) Each neuron provides a periodic output signal that can be utilized to provide the periodic drive signal to the actuator motor controller 47. All neurons of the PG 26 are driven by a constant tonic input and one or more neurons of the PG are driven by a phasic input, obtained from signal data capturing from the sensors 20 during walking movement. The dynamic activity of each neuron is described by the following differential equations.
(47) In the preferred embodiment, each neuron is described by the following differential equation example:
(48)
(49) Ipm are other pacemaker currents that allow a single neuron to produce cyclic voltage output and may or may not be used.
(50) Iext are injected currents in proportion to the sensor outputs.
(51) Each neuron's output represents the firing frequency and is assumed to be related to its membrane voltage by a nonlinear function given by a seventh order polynomial h(v) with a strict threshold and saturation.
(52)
(53) With these membrane properties and the interconnections shown in
(54) The output voltages of the PG are scaled to lie between 0 and 5 volts. The cyclic output from the PG 26 provides feedforward or open loop input to the motor controller 47 of the actuator 22 connected to the AAFO 18. Descending voluntary control of the user S, which is determined based upon rhythmic lower limb L movement detected by sensors 20, such as the sensor on the injured limb or the in-body or on-body sensors on the injured or uninjured (opposite) limb, provides an input signal to the PG to initiate or terminate the rhythmic control of the AAFO 18 using the motor controller 47 of the actuator 22, thereby capturing the user's intent to move. Such analog cycle-to-cycle control or entrainment of the PG rhythm through an electronic auxiliary neuronal circuit is used to match AAFO 18 motion or rhythm to a self-selected walking speed.
(55) Sensors 20b on the AAFO 18 or user S, or an encoder within the motor controller 47 driving the actuator, provide a feedback signal FB to the motor controller 47 of the actuator 22 to provide closed loop control of the false-foot 16 position and stiffness, in combination with the feedforward drive signal from the PG.
(56) Sensors 20b on AAFO provide feedback FB to the PG for phase dependent resetting, or adjustment of the cycle period, which is dependent on the phase of the cyclic movement or of the cyclic output of the PG, in response to external disturbance. During such phase dependent resetting, the actuator 20 causes the AAFO 18 to plantar-flex and/or dorsi-flex.
(57) It should be understood that the PG 26 and auxiliary or A neuron in
(58) In either embodiment, the PG 26 can work as an autonomous oscillator, meaning that it does not need periodic drive signal input from the sensors 20a, 20b, 20c, to enable oscillation. The PG oscillations can be suppressed if there is a constant external signal input to the PG. Additionally, the NOCS speed of operation can be entrained to an external signal input from the sensors 20 to the PG. The PG responds to external changes in speed within a cycle of perturbation. Additionally, no programming if-then rules are used to adjust the PG signal output. The PG could also be programmed to respond to simultaneous inputs from more than one entrainment and/or perturbation signal, and thus can be entrained and respond to brief perturbations at the same time. If more than one PG is used, and were provided in appropriate phase relationship, a knee and ankle prosthesis could both be controlled at the same time.
(59) Alternatively, in other embodiments it may be desired to use the PG to drive other cyclic processes, which maybe physiological or not, and which are not locomotor related. Still other examples of locomotor related applications, involve use of the PG to control an articulated actuated ankle foot orthosis, where the powered articulated false-foot 16 connects to an ankle and acts as a robotic assist device for therapy of the injured ankle The PG could be used without any input from the user S in a passive mode of exercise or could be entrained by signals from on-body sensors or in-body sensors, such as neural cuff, as the person is walking, to entrain the PG to provide active control of the articulated actuated ankle-foot orthosis.
(60) The PG is simulated for oscillation, and has the ability to be entrained at a variety of frequencies that would be within the range of human walking speed. Current in proportion to the amplitude of a simulated phasic input was provided and the PG oscillation frequency monitored. Under default conditions, the PG oscillates at a pre-entrainment default frequency (f.sub.pre) of 0.75 Hz. Once entrainment begins, the PG circuit quickly assumes the frequency (f.sub.post) of the current input. The PG circuit can thus be entrained to a 1:1 ratio (f.sub.post/f.sub.pre).
(61)
(62) Noise is important in all analog circuits because it limits dynamic range. Some common techniques were included in the PG design to reduce noise, such as multi-gate finger layout, inter-digitization, substrate plugging and a common-centroid layout.
(63) The PG 26 design operates using a voltage of approximately 5V, but which can range from about 1.2V to 5V, and is capable of battery operation. The design operating temperature range is approximately ?55 deg C. to +125 deg C. The chip 28 is packaged using commercially available techniques but preferably uses a ceramic DIP package that when plugged into a DIP socket, can be replaced, stored, or transferred from one board to another. The current chip utilizes ceramic DIP packaging.
(64) To ensure the capture of signals regarding intent to move and environmental conditions, trials were conducted during which the user S walked over a foot high obstacle with the limb with the active NOCS. The user S did not stumble and the false-foot 16 remained in position during the step over the obstacle. When a subject walked with a passive/off orthosis there was left-right asymmetry in gait kinematics as shown in the left graph of
(65) As shown in
(66)
(67) The foregoing descriptions of various aspects of the device of the present application have been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and obviously, many modifications and variations are possible. Such modifications and variations that may be apparent to a person skilled in the art are intended to be included within the scope of the invention as defined by the accompanying claims.