INTELLIGENT HAND EXOSKELETON WITH GRASPING ASSISTANCE
20230166391 · 2023-06-01
Inventors
Cpc classification
B25J9/0006
PERFORMING OPERATIONS; TRANSPORTING
A61H2201/1659
HUMAN NECESSITIES
International classification
Abstract
A device for providing assistance in dexterous grasping operations. The device is a nine degree of freedom exoskeleton glove capable of reproducing grasping tasks present in ordinary daily activity. The device relies on series elastic actuators and a motion amplification controller for movement and support of finger joints of a user and is easily modifiable to fit individual users with different hand sizes. The user driven control scheme requires no additional hardware (e.g., camera or EMG sensors) but relies on user movements (even weak movements). Intelligent assistance prevents uncomfortable motion beyond the natural range of motion of the fingers while reacting very quickly to the user's physical input.
Claims
1. A hand exoskeleton device comprising: a dorsum base and palmer base adapted for use with a wearer's hand; a first phalanx pad and a second phalanx pad; a first actuator in operable communication with the first phalanx pad and the dorsum base, and a second actuator in operable communication with the second phalanx pad and the first actuator; wherein the first actuator is in operable communication with the first phalanx pad by way of a first linkage length connected with a first revolute joint connected with a second linkage length connected with a second revolute joint connected with a third linkage length connected with the first phalanx pad; wherein the first actuator is connected to the second actuator with a third revolute joint; wherein the second actuator is connected to a fourth linkage length connected to a fourth revolute joint connected to a fifth linkage length connected to the second phalanx pad; and a motion amplification controller in operable communication with the first and second actuators and capable of controlling movement of one or more finger(s) or a thumb of the wearer's hand.
2. The device of claim 1, wherein the first or second actuator is a series elastic actuator.
3. The device of claim 1, wherein the first and second actuators are disposed in a manner capable of being in operable communication with one finger of the wearer's hand.
4. The device of claim 3, wherein the first actuator is disposed in operable communication with the first phalanx pad in a manner to affect a metacarpophalangeal joint of a finger of the wearer and the second actuator is disposed in operable communication with the second phalanx pad in a manner to affect a proximal interphalangeal joint of the finger of the wearer.
5. The device of claim 1, wherein the actuators comprise a thumb actuator affecting a carpometacarpal flexion joint and a metacarpophalangeal joint of a thumb of the wearer's hand.
6. The device of claim 1, wherein the adduction/abduction degrees of freedom of all fingers of the wearer's hand are passive and located on the dorsum base.
7. (canceled)
8. The device of claim 1, further comprising a glove configured for indirectly affixing the device to the wearer's hand.
9. The device of claim 1, wherein the motion amplification controller is configured to enforce one or more equations of motion on one or more of the actuator(s).
10. The device of claim 1, wherein the motion amplification controller is configured to control movement of one or more finger(s) or a thumb of the wearer's hand.
11. The device of claim 9, wherein the motion amplification controller is configured to determine a force needed to move one or more finger(s) or thumb of the wearer's hand.
12. The device of claim 10, wherein the motion amplification controller is configured to amplify an input motion from the wearer's hand, providing assistance in grasping an object.
13-15. (canceled)
16. The device of claim 1, wherein the motion amplification controller is capable of reversing direction and is capable of ceasing movement upon either a lack of continued input from the wearer or input in the direction opposite current motion.
17. The device of claim 16, wherein the motion amplification controller comprises a virtual sliding spring base to enable the reversing and/or ceasing of movement.
18. The device of claim 17, wherein spring deflection, alpha, autonomously approaches zero.
19. The device of claim 1, wherein smooth operation of the device is enabled by a nonlinear damping manifold, beta, which allows the device to smoothly observe a natural range of motion of the wearer in that the nonlinear damping manifold is capable of providing infinite resistance as any finger joint attempts to exceed its limits.
20-22. (canceled)
23. The device of claim 1, further comprising: up to four finger mechanisms, each comprising: the first and second phalanx pads; the first and second actuators; and the first, second, third, fourth and fifth linkage lengths and the first, second, third and fourth revolute joints; a thumb mechanism comprising: a thumb base; a thumb phalanx pad; and a thumb actuator disposed in operable communication with the thumb phalanx pad and the base.
24-25. (canceled)
26. The device of claim 1, wherein the motion amplification controller is configured to impart the following equations of motion on one or more actuator:
27-28. (canceled)
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0042] The accompanying drawings illustrate certain aspects of embodiments of the present invention, and should not be used to limit the invention. Together with the written description, the drawings serve to explain certain principles of the invention.
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
DETAILED DESCRIPTION OF VARIOUS EMBODIMENTS OF THE INVENTION
[0058] Reference will now be made in detail to various exemplary embodiments of the invention. It is to be understood that the following discussion of exemplary embodiments is not intended as a limitation on the invention. Rather, the following discussion is provided to give the reader a more detailed understanding of certain aspects and features of the invention.
[0059] Exoskeleton
[0060] In embodiments of the invention, the device comprises a nine degree of freedom exoskeleton capable of reproducing grasping tasks present in ordinary daily activity. An exemplary exoskeleton design according to an embodiment of the invention is shown in
[0061] A finger mechanism according to an embodiment of the invention is shown in
[0062]
[0063] Affixing of the device/exoskeleton to a wearer at the finger phalanxes, dorsum, and/or palm leads to the assumption that link lengths, excluding the actuator length d, are constant (
[0064] The series elastic actuator (SEA) 10 used in the finger mechanism according to an embodiment of the invention as shown in
[0065] The load paths for the pushing and pulling forces are shown in
[0066] Motion Amplification Controller
[0067] According to embodiments of the invention, a motion amplification controller can be programmed to control the exoskeleton or parts thereof to perform particular motions, such as any one or more or all of the 33 configurations of the GRASP taxonomy. The controller can be used in combination with any number of other controllers, such as low-level controllers, to cause the device/exoskeleton/wearer to perform a particular motion, such as a particular grasp. The controller can be programmed to enforce any one or more or all of the following equations of motion on one or more of the actuator(s) for the fingers or thumb:
[0068] where x.sub.1 is the spring deflection in the SEA and a is the virtual spring constant. The spring deflection is calculated as x.sub.1′-x.sub.1ref′ (see
[0069] In embodiments, as shown in
[0070] where x.sub.1 is x.sub.1′ and x.sub.3 is x.sub.1ref′. In implementations, this can be realized by using a low-pass filter on the spring base based on the actuator position as the input. The system is inherently stable given that the virtual spring and damping coefficients are strictly positive. The time constant for the filter can be chosen to be large based on the assumption that the motion of the wearer is slow. In embodiments, the value is conservatively chosen as 1.5 seconds so as to be slower than the actuator which takes approximately 0.5 seconds to completely travel a finger joint's ROM. In other embodiments, the time constant for the filter is in the range of 0.5 seconds to 3 seconds, such as 0.75 seconds, 1 second, 1.25 seconds, 1.75 seconds, 2 seconds, 2.25 seconds, 2.5 seconds, or 2.75 seconds. The value of x.sub.2 is integrated twice to determine a reference position that is input into a low-level PID controller responsible for moving the actuator itself, running on the microcontroller unit (MCU).
[0071] The motion amplification controller and PID controller can comprise computer programs comprising computer executable instructions, which when the program is executed by a computer, cause the computer to carry out any one or more of the processes, methods, and/or algorithms according to the above. The computer-executable instructions can be programmed in any suitable programming language, including JavaScript, C, C#, C++, Java, Python, Perl, Ruby, Swift, Visual Basic, and Objective C. Also provided herein is a non-transitory computer-readable medium (or media) comprising computer-executable instructions, which when executed by a computer, cause the computer to carry out any of the processes, methods, and/or algorithms according to the above. As used in the context of this specification, a “non-transitory computer-readable medium (or media)” may include any kind of computer memory, including magnetic storage media, optical storage media, nonvolatile memory storage media, and volatile memory. Non-limiting examples of non-transitory computer-readable storage media include floppy disks, magnetic tape, conventional hard disks, CD-ROM, DVD-ROM, BLU-RAY, Flash ROM, memory cards, optical drives, solid state drives, flash drives, erasable programmable read only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), non-volatile ROM, and RAM. The non-transitory computer readable media can include one or more sets of computer-executable instructions for providing an operating system as well as for implementing the processes, methods, and/or algorithms of the invention.
[0072] In embodiments, the device/exoskeleton is capable of providing assistance in flexion, extension, adduction, and/or abduction of one or more joints to any degree of rotation within the natural ROM of said joint. The device can provide assistance relative to one or more joints of any extremity, or all joints of the extremity. With respect to the hands, the device can be adapted to assist movement by affecting one or more or all of the MCP, PIP and/or DIP joints of the fingers and/or thumb. For example, the device can provide assistance in MCP abduction in the range of 0° to 25°, MCP adduction in the range of 20° to 0°, MCP flexion in the range of 0° to 90°, and MCP extension in the range of 0° to 30°. In embodiments, the device can provide flexion of the PIP joint between 0° and 120° and/or extension of the PIP joint between 120° and 0°. In embodiments, such as by including an actuator and support base(s) for assisting movement of the DIP joint, the device can provide flexion of the DIP joint of the finger between 0° and 80° and extension of the DIP joint between 80° and 0°. Motion of the DIP joint can also be passive as a result of assisted movement of the PIP joint. Further the device is capable of providing rotation of the MCP joint of the thumb as follows: abduction between 0° and 50°, adduction between 40° and 0°, flexion between 0° and 70°, and/or extension between 60° and 0°. Further, the device is capable of providing flexion of the IP joint of the thumb between 0° and 90° and/or extension of the thumb between 90° and 0°. In embodiments, the device can be modified accordingly to meet motion needs for any joint, for any extremity, and for any desired application. For example, the range of motion described above for the PIP joint of a finger can be applied to a device adapted for use with a leg and for assistive motion at the knee. Likewise, the range of motion described above for the MCP joint can be applied to a device adapted for use with a leg and for assistive motion at the hip.
[0073] In embodiments, a maximum degree of joint rotation (for each joint receiving assistance) can be set for a user to prevent uncomfortable motion beyond the user's current range of motion. For example, in a patient experiencing reduced range of motion of one or more joints, the maximum degree of joint rotation of the one or more affected joints can be slowly increased as the user regains flexibility. In another embodiment, the device can be programmed with a predetermined set of values for range of motion based on user parameters such as age, sex, prior injury, disease presence, and/or dominant vs. non-dominant hand. The predetermined set values can be re-adjusted at any time according to a particular user/wearer's needs and as those need may change over time.
[0074] In embodiments, the device is capable of providing grasp assistance to lift objects weighing in the range of 1 g to 5 kg, such as 2 g, 5 g, 10 g, 50 g, 100 g, 250 g, 500 g, 1 kg, 2 kg, 3 kg, 4 kg, or 4.5 kg. In embodiments, the device is capable of augmenting the force applied by the user to assist with lifting objects having appreciable weight. For example, the controller can be adapted to be capable of weight sensing, which could rely on determining the orientation of the hand relative to an object, and/or capable of slip detection by incorporating appropriate slip detection sensors and a controller adapted for tighter pinching.
[0075] In embodiments, the device is capable of being used with and/or incorporated into other devices/systems capable of providing movement assistance, such as assistance to the wrist, elbow, and/or shoulder. In embodiments, the device is capable of being used with artificial limbs.
[0076] In embodiments, the device is capable of modification to provide support to any number of fingers (to include the thumb, index, middle, ring, and/or little fingers) of the hand, such as 1, 2, 3, 4, and/or 5. In embodiments, the device does not include support to the thumb. In other embodiments the device can be adapted for use with the foot (shorter linkage lengths, fewer or additional actuators, etc.), or can be modified accordingly to control other limbs such as arms or legs, such as by affixing a first actuator to control movement of a leg at the hip, a second actuator to control movement of the leg at the knee, and/or a third actuator to control movement of a foot at the ankle. Similar modifications can be made to control movement of the arms.
[0077] Exemplary Device/System Integration
[0078] An embodiment of the device/system is shown in
[0079] Embodiment Testing
[0080] The primary contribution of the exoskeleton design is that it is able to achieve the wide variety of necessary grasps without the need to conform to an object. The glove, as worn by the same user as before, was commanded to execute each of the 33 grasps in the GRASP taxonomy (see “The GRASP Taxonomy of Human Grasp Types” IEEE Transactions on Human-Machine Systems, Vol. 46, No. 1, February 2016, pages 66-77, which is incorporated by reference herein in its entirety) (
[0081] The utility of the device in providing grasping assistance for activities of daily living was then demonstrated by using the device to grasp different objects (
[0082] Motion Amplification Testing
[0083] The motion amplification controller was designed for the bidirectional motion of the finger joints. Since the previous tests focused on flexion of the finger joint and then stopping once the desired configuration was reached, a test was conducted to verify the ability of the system to reverse direction. The results of this test are shown in
[0084] In order to illustrate the repeatability of the glove with the motion amplification controller, Grasp 9 (
[0085] This work contributed the design of an exoskeleton glove capable of assisting in dexterous grasping operations using a motion amplification controller. The glove itself was designed to perfectly/comfortably fit the hand of a specific individual and is capable of independent motion of the MCP and PIP joints of the IMRL fingers and flexion along the thumb as a whole. Actuation is accomplished by SEAs which allow deflection of the glove by the wearer. This deflection is used to inform a motion amplification controller to help the wearer complete their intended grasping motions.
[0086] The motion amplification controller implements a virtual spring-mass-damper system, the glove can amplify the input motion to provide assistance. The virtual spring is responsible for amplifying the motion while the nonlinear damper prevents the system from traveling beyond the natural ROM of the finger joints. The input into the system is through the deflection of the springs in SEAs that are used to control the finger joints.
[0087] Tests were performed in order to validate this functionality. The first was the completion of 33 grasps in the GRASP taxonomy. Each grasp was executed while the exoskeleton was being worn. It was observed in the execution of those grasps that many of these grasps are similar to each other kinematically, and their distinction comes from their interaction with objects. Specific attention was paid to grasps that featured unique kinematic configurations. These grasps were repeated with objects pertinent to the grasp, using the motion amplification controller. Flexion and extension motions of a finger joint were tested to observe the relationship between the displacement of the spring in the SEA and the motion of the actuator. Finally, the motion amplification controller was tested multiple times on one of the unique grasps to ensure the repeatability of the control for a specific grasp.
Example 1: Grasp Assistance for Holding a Bottle (GRASP Taxonomy Grasp #1)
[0088] A user wearing the device according to an embodiment of the invention reaches toward a bottle with the hand in a natural, relaxed position. With the hand in an open position around, but not touching, the bottle, the user provides movements in the thumb and the fingers to initiate the grasp motion. The initial movements are felt/sensed by the motion amplification controller, which receives the user's intent from the initial movements and instructs the actuator to move the thumb from an adducted position to an abducted position. As each finger deflects while performing the grasp, the controller is informed of the user's intention and assists in curling the thumb and fingers around the bottle. The motion amplification controller accordingly instructs one or more of the series elastic actuators to amplify the user's movement.
[0089] The present invention has been described with reference to particular embodiments having various features. In light of the disclosure provided above, it will be apparent to those skilled in the art that various modifications and variations can be made in the practice of the present invention without departing from the scope or spirit of the invention. One skilled in the art will recognize that the disclosed features may be used singularly, in any combination, or omitted based on the requirements and specifications of a given application or design. When an embodiment refers to “comprising” certain features, it is to be understood that the embodiments can alternatively “consist of” or “consist essentially of” any one or more of the features. Any of the methods disclosed herein can be used with any of the devices/systems disclosed herein or with any other devices/systems. Likewise, any of the disclosed devices/systems can be used with any of the methods disclosed herein or with any other methods. Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention, such as modifying the device according to a particular user's needs.
[0090] It is noted in particular that where a range of values is provided in this specification, each value between the upper and lower limits of that range is also specifically disclosed. The upper and lower limits of these smaller ranges may independently be included or excluded in the range as well. The singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. It is intended that the specification and examples be considered as exemplary in nature and that variations that do not depart from the essence of the invention fall within the scope of the invention. Further, all of the references cited in this disclosure are each individually incorporated by reference herein in their entireties and as such are intended to provide an efficient way of supplementing the enabling disclosure of this invention as well as provide background detailing the level of ordinary skill in the art.