Grasp assist device with automatic mode control logic
09878452 ยท 2018-01-30
Assignee
- Gm Global Technology Operations Llc (Detroit, MI)
- The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration (Washington, DC)
Inventors
Cpc classification
Y10S901/36
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
A61B2562/04
HUMAN NECESSITIES
B25J9/104
PERFORMING OPERATIONS; TRANSPORTING
A61B5/225
HUMAN NECESSITIES
A61B2562/0219
HUMAN NECESSITIES
International classification
B25J13/08
PERFORMING OPERATIONS; TRANSPORTING
A61B5/00
HUMAN NECESSITIES
Abstract
A system includes a glove, sensors, actuator assemblies, and controller. The sensors include load sensors which measure an actual grasping force and attitude sensors which determine a glove attitude. The actuator assembly provides a grasp assist force to the glove. Respective locations of work cells in the work environment and permitted work tasks for each work cell are programmed into the controller. The controller detects the glove location and attitude. A work task is selected by the controller for the location. The controller calculates a required grasp assist force using measured actual grasping forces from the load sensors. The required grasp assist force is applied via the glove using the actuator assembly to thereby assist the operator in performing the identified work task.
Claims
1. A system comprising: a glove; a plurality of sensors positioned with respect to the glove, including load sensors configured to measure an actual grasping force applied to an object by an operator wearing the glove, and attitude sensors configured to determine an attitude of the glove; an actuator assembly operable for providing a grasp assist force via the glove; and a controller programmed with a respective location of each of a plurality of work cells in a work environment, and also with a set of permitted work tasks for each of the work cells, wherein the controller is further programmed to: determine a location of the glove within the work environment; determine the attitude of the glove within the detected location by processing the attitude signals from the attitude sensors; select a work task from a list of permitted work tasks for the detected location using the determined location and attitude; calculate a required grasp assist force using the actual grasping force from the load sensors; and command an application of the required grasp assist force to the object, via the glove using the actuator assembly, to thereby assist the operator in performing the identified work task.
2. The system of claim 1, further comprising flexible tendons connected to the glove, wherein the actuator assembly is configured to apply the required grasp assist force by applying a tensile force to the flexible tendons.
3. The system of claim 1, wherein the plurality of sensors includes a location sensor configured to determine the location of the glove within the work environment.
4. The system of claim 3, wherein the location sensor is a global positioning system (GPS) sensor.
5. The system of claim 3, wherein the location sensor is a radio frequency identification (RFID) sensor.
6. The system of claim 1, wherein the attitude sensors include at least one accelerometer.
7. The system of claim 1, wherein the attitude sensors include at least one joint angle sensor.
8. The system of claim 1, further comprising a display screen in communication with the controller, wherein the controller is programmed to communicate information regarding the identified work task via the display screen.
9. The system of claim 1, wherein the controller is programmed to detect a predetermined gesture of the glove and to temporarily discontinue the commanded application of the required grasp assist force in response to the detected predetermined gesture.
10. A method for controlling a system having a glove, load sensors configured to measure an actual grasping force applied to an object by an operator wearing the glove, attitude sensors configured to determine an attitude of the glove, and an actuator assembly operable for applying a required grasp assist force to the glove, the method comprising: determining a location of the glove within the work environment via a controller; determining the attitude of the glove within the determined location, via the controller, by processing attitude signals from the attitude sensors; identifying a work task from a list of permitted work tasks for the determined location using the determined location and attitude; measuring, via the load sensors, an actual grasping force applied by the operator to an object; calculating the required grasp assist force for the identified work task via the controller using the measured actual grasping force; and commanding an application of the required grasp assist force to the object, via the glove using the actuator assembly, to thereby assist the operator in performing the identified work task.
11. The method of claim 10, wherein the system includes flexible tendons connected to the glove, the method further comprising: applying the required grasp assist force by applying a tensile force to the flexible tendons.
12. The method of claim 10, wherein the system includes a location sensor operable for determining the location of the glove, and wherein determining the location of the glove includes processing a location signal from the location sensor using the controller.
13. The method of claim 12, wherein the location sensor is a global positioning system (GPS) sensor.
14. The method of claim 12, wherein the location sensor is a radio frequency identification (RFID) sensor.
15. The method of claim 10, wherein determining an attitude of the glove includes using an accelerometer as at least one of the attitude sensors.
16. The method of claim 10, wherein determining an attitude of the glove includes using a joint angle sensor as at least one of the attitude sensors.
17. The method of claim 10, further transmitting an output signal from the controller to a display screen within the determined location to thereby present information regarding the identified work task.
18. The method of claim 10, further comprising: detecting a predetermined gesture of the glove; and temporarily discontinuing the application of the required grasp assist force in response to the detected predetermined gesture.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
DETAILED DESCRIPTION
(5) With reference to the drawings, wherein like reference numbers refer to the same or similar components throughout the several views, an example grasp assist device 10 is shown in
(6) Existing control schemes used for conventional grasp assist devices may be less than optimal in facilities having a large variety of work tasks divided into different work cells, as such designs tend to require a mode decision and affirmative selection by an operator. For example, an operator may be required to alert a controller as to the particular task to be performed, or select a desired grasp assist level, or the grasp assist device may be programmed to provide only a limited range of predetermined grasp assist levels. The present design is intended to address this control problem by offloading the control decision to the controller in cooperation with a sensor array as described herein, and to thereby optimize operator efficiency when performing device-assisted work tasks.
(7) Apart from the automatic control functionality described below with reference to
(8) The glove 12 may include one or more digit portions, i.e., a thumb portion 14 and/or one or more finger portions 15. The glove 12 may be configured as a conventional full four-finger/one thumb glove as shown, or with fewer fingers 15/no thumb 14 in other embodiments. Connected to material 17 of the glove 12, for example sewn in place, may be a plurality of phalange rings 26 or another suitable load bearing structure. Each of the phalange rings 26 may at least partially circumscribe a digit of the operator's hand, i.e., by at least partially circumscribing a respective one of the thumb portion 14 or finger portions 15 of the glove 12. Alternatively, the phalange rings 26 may be positioned within the thumb portion 12/finger portions 15. Thus, any tensile force (arrow F.sub.A) imparted by some or all of the tendons 20 can indirectly act on an operator's actual fingers/thumb through the phalange rings 26.
(9) The load sensors 28 shown in
(10) Within the sensor array, the load sensors 28 are used to signal a desired grasp/grasp release, and to trigger a corresponding controlled application or discontinuation of the tensile force (arrow F.sub.A) as noted above. The location sensor 78 is used to detect a present location and also calculate a direction or heading of the grasp assist device 10 in a work cell as needed, as set forth below with reference to
(11) Examples of the attitude sensors 88 include any wireless location positioning sensors, transceivers, receivers, or devices operable to determine an orientation or pose of the grasp assist device 10 within an inertial frame of reference, and/or for determining the location of the glove 12 when a dedicated location sensor 78 is not used, for instance joint angle sensors, gyroscopes, digital compasses, accelerometers, altimeters, magnetometers, and the like. Such devices may include multi-axis motion tracking chip-based devices of the types known in the art for use in smartphones and wearable sensors. For instance, magnetometers may be used to determine orientation of the glove 12 with respect to earth's magnetic field, as is known in the art, and when used in conjunction with accelerometers can help eliminate drift from any derived location when locations sensors 78 are not used. More or fewer attitude sensors 88 may be used in a given design relative to the number shown in
(12) With respect to the optional location sensor(s) 78, a radio frequency identification (RFID) sensor system may be used in one possible approach. As is well known in the art, typical RFID sensors suitable for indoor use include wireless RFID tags and antennas. When used with the grasp assist device 10 of
(13) In general, a grasp force exerted on an object in the operator's grasp activates the load sensor(s) 28. The phalange rings 26 in turn are connected to the tendons 20 that run through the phalange rings 26, with at least some of the phalange rings 26 acting as guides for the tendons 20. Two types of phalange rings 26 may be provided herein: the phalange rings positioned at the distal end (arrow D) of each finger portion 15 and thumb portion 14, and respective medial (arrow Md) and proximal (arrow Pr) phalange rings 26. In some embodiments, the tendons 20 may terminate at the distal (arrow D) phalange rings 26, while the medial (arrow Md) and proximal (arrow Pr) phalange rings 26 are primarily used to guide or direct the tendons 20 and to support the operator's finger. However, other configurations may be envisioned within the intended inventive scope.
(14) The load sensors 28 may be positioned and configured to sense only the grasping force applied by the operator to an object. In this embodiment, the load sensor(s) 28 may be positioned on an inner surface of the distal phalange rings 26 (arrow D). Other designs may also be used without departing from the intended scope of the control method 100 shown in
(15) When an object is grasped by an operator, the actual grasping force or pressure applied by the operator to an object is measured by the load sensor(s) 28 and relayed as the force feedback signals (arrow 24) to the controller 50, which may be worn on/in the sleeve 18 of the grasp assist device 10 or located external to the device 10 and controlled wirelessly. Each of the load sensors 28 may be configured as a pressure transducer or any other suitable load or contact cell that precisely measures the amount of force between the load sensor 28 and any object grasped by the operator. Additionally, a location signal (arrow L.sub.10) and an attitude signal (A.sub.10) are received and processed by the controller 50 from the respective location sensor 78 and attitude sensor(s) 88.
(16) With respect to the tendons 20, each of the tendons 20 may be optionally configured as a braided polymer, e.g., fluorocarbon, to increase the wear life of each tendon 20. However, other materials and/or designs may also be used without departing from the intended scope of the invention. The tendons 20 may pass through an optional tendon concentrator 21 located on or near the base of the palm or wrist area of the operator. The tendons 20 run through the conduit 30 for at least part of the lengths of the tendons 20, and freely between the tendon concentrator 21 and the phalange rings 26. This arrangement may help isolate the grasping assist motion to the area on the operator's hand from the fingertips to the base of the operator's palm, i.e., isolate the effect of any augmenting tensile force to the area between the tendon concentrator 21 and the phalange rings 26. From the finger side of the tendon concentrator 21 to the distal phalange rings 26, the tendons 20 may be contained in channels 35 embedded or contained within the material of the glove 12.
(17) As shown in phantom, multiple actuator assemblies 32, for instance motorized ball screw devices, may be configured in an array within the TDS 16. Each actuator assembly 32 acts on a portion of a corresponding flexible tendon 20. While not shown for illustrative simplicity, a tendon 20 may loop through a nut within a given one of the actuator assemblies 32 so that the tendon 20 can slide freely, with ends of the tendons 20 attached, for example, to different finger portions 15. In such a design, as one finger portion 15 grasps or comes in contact with an object, the tendon 20 will slide through the nut so the other finger portion 15 can continue to grasp or close. Thereafter, the actuator assembly 32 can apply a grasping force to both finger portions 15. Other tendon-driven designs may be envisioned, as well as drive systems that do not use tendons, without departing from the intended scope. When only one TDS 16 is used, the tendon concentrator 21 may be used to connect the flexible tendons 20 leading from a thumb portion 14 and each finger portion 15 to a single actuator tendon, i.e., the flexible tendon shown via solid lines in
(18) Still referring to
(19) The controller 50 may include one or more integrated circuits, which may be augmented by various electronic devices such as voltage regulators, capacitors, drivers, timing crystals, communication ports, etc. The controller 50 may be a microcontroller having a processor and memory, e.g., optical or magnetic read only memory (ROM), as well as sufficient amounts of random access memory (RAM) and/or electrically-programmable read only memory (EPROM), input/output (I/O) circuitry, signal conditioning and buffer electronics, and the like. Output signals (arrow 13) may be transmitted to an optional static or mobile display screen 45 (see
(20) Referring to
(21) The boundaries 19, 190, 290, 390, 490, and 590 may be real or imaginary. For example, while walls or other solid physical barriers may be used to separate the work cells WC.sub.A, WC.sub.B, and WC.sub.A from each other and/or from the walkway 21, the boundaries 19, 190, 290, 390, 490, and 590 may simply denote defined imaginary perimeters of the work cells WC.sub.A, WC.sub.B, and WC.sub.A. In either case, the coordinates of each of the boundaries 19, 190, 290, 390, 490, and 590 may be programmed into memory M of the controller 50 of
(22) As the operator 11 wearing the grasp assist device 10 moves within the work environment 60 of
(23) To enable the functionality noted above, the controller 50 may be programmed with the geographic coordinates of the various work cells in the work environment. Thus, the controller 50 may compare received location signals from the location sensor 78 of
(24) With respect to the optional display screens 45, such devices may be static display screens such as video monitors in wireless communication with the controller 50 of
(25) Referring to
(26) The calibrated list of work tasks 93 includes example work tasks WT.sub.1, WT.sub.2, WT.sub.3, and WT.sub.4 as shown. For instance, for a given work cell WC.sub.A the operator 11 of
(27) In order to quickly differentiate between all of the possible work tasks in the example work cell WC.sub.A, the controller 50 receives and processes signals (arrow A.sub.10) from the attitude sensor(s) 88 of
(28) Optionally, the controller 50 may be programmed with a calibration mode. Such a mode may be desirable as each grasp assist device 10 may be worn at different times by different operators 11, and as each operator 11 may exhibit unique grasp characteristics relative to other operators 11. Thus, a one-size-fits-all design may be less than optimal. In such a calibration mode, the operator 11 of
(29) Referring to
(30) At step S104, the controller 50 next determines the location of the glove 12 within the work environment. For instance, the controller 50 may receive and process location signals (arrow L.sub.10) from the location sensor 78 of
(31) Step S106 entails determining, again via the controller 50, whether the operator 11 has entered a predetermined work cell, e.g., WC.sub.A, WC.sub.B, or WC.sub.C. For instance, the controller 50 may compare the present coordinates of the operator 11 to predetermined coordinates demarcating the perimeters of the various work cells WC.sub.A, WC.sub.B, and WC.sub.C to determine if the operator 11 has entered one of the work cells WC.sub.A, WC.sub.B, or WC.sub.C. The method 100 proceeds to step S108 if the operator 11 has entered one of the work cells WC.sub.A, WC.sub.B, or WC.sub.C. Otherwise, step S106 is repeated and the grasp assist device 10 remains off or in a default standby mode.
(32) Step S108 entails identifying a work task from a list of permitted work tasks for the determined location of step S106 using the determined location and attitude. As part of step S108, the controller 50 extracts the calibrated list of work tasks 93, which is shown in
(33) As part of step S108 the controller 50 determines whether the received attitude signals (arrow A.sub.10) correspond to one of the predetermined work tasks, permitted for the present work cell, e.g., work tasks WT.sub.1, WT.sub.2, WT.sub.3, and WT.sub.4 for example work cell WC.sub.A. If so, the controller 50 extracts instructions from its memory (M) for assisting the detected task and proceeds to step S112. Otherwise, step S110 is repeated. Optionally, an alert or error message may be displayed via the display screen 42 of
(34) At step S112, the controller 50 receives measured actual grasping forces from the load sensors 28 of
(35) Step S114 includes detecting a default gesture of the operator 11 signaling a desire to temporarily disable the grasp assist device 10 of
(36) By using the above-described approach, those of ordinary skill in the art will appreciate that conventional operator-intensive grasp assistance controls may be optimized via the use of dynamic mode selection based on sensor data. Position information can be used to determine the location and heading of an operator, while inertial and joint angle/position sensors can provide attitude data, i.e., pitch, roll, yaw, etc. Together, the sensor data is processed with minimal operator interference to thereby increase operator efficiency.
(37) Additionally, the number of possible control modes is increased relative to manually-selected/GUI-based devices, which are limited in large part due to the limited space on the sleeve 18 of
(38) While the best modes for carrying out the disclosure have been described in detail, those familiar with the art to which this disclosure relates will recognize various alternative designs and embodiments for practicing the disclosure within the scope of the appended claims.