BIOMETRIC SENSOR SYSTEMS AND CONTROL LOGIC FOR ACTIVE-PASSIVE ROBOTIC EXOSKELETONS
20240074934 ยท 2024-03-07
Assignee
Inventors
Cpc classification
B25J9/0006
PERFORMING OPERATIONS; TRANSPORTING
International classification
A61H1/02
HUMAN NECESSITIES
A61H3/00
HUMAN NECESSITIES
Abstract
Disclosed herein are wearable, wireless-enabled biometric sensor systems, methods for manufacturing/operating such biometric sensor systems, and robotic exoskeletons equipped with such biometric sensor systems. A biometric sensor system includes a first biometric subassembly that mounts to an upper-extremity portion of a user's appendage, and a second biometric subassembly that mounts to a lower-extremity portion of the user's appendage. Each biometric subassembly includes a respective biometric sensor that monitors a biometric characteristic of the respective extremity portion of the user appendage and wirelessly outputs a sensor signal indicative thereof. A system central processing unit (CPU), which mounts onto the user, is programmed to receive sensor signals from the biometric sensors, calculate a biometric parameter of the user appendage using biometric characteristics indicated by the received sensor signals, and command a subsystem (e.g., exoskeleton joint assembly motor module) to execute one or more control operations based on the calculated biometric parameter.
Claims
1. A biometric sensor system, comprising: a first biometric subassembly configured to mount to an upper-extremity portion of a first appendage of a user, the first biometric subassembly including a first biometric sensor operable to monitor a first biometric characteristic of the upper-extremity portion of the first appendage and wirelessly output a first sensor signal indicative thereof; a second biometric subassembly configured to mount to a lower-extremity portion of the first appendage of the user, the second biometric subassembly including a second biometric sensor operable to monitor a second biometric characteristic of the lower-extremity portion of the first appendage and wirelessly output a second sensor signal indicative thereof; and a system central processing unit (CPU) configured to mount onto the user and wirelessly communicate with the first and second biometric subassemblies, the system CPU being programmed to: receive the first sensor signal from the first biometric sensor and the second sensor signal from the second biometric sensor; calculate a first biometric parameter of the first appendage using the first and second biometric characteristics indicated by the first and second sensor signals received from the first and second biometric sensors; and transmit a command signal to a subsystem to execute a control operation based on the calculated first biometric parameter.
2. The biometric sensor system of claim 1, wherein the first biometric characteristic is a first relative angle, the second biometric characteristic is a second relative angle, and the first biometric parameter of the first appendage is a joint angle of a joint of the first appendage.
3. The biometric sensor system of claim 2, wherein the joint angle is calculated as an absolute value of a mathematical difference between the first and second relative angles.
4. The biometric sensor system of claim 1, wherein the system CPU is further programmed to: receive a selection of a desired operating mode for the subsystem, the desired operating mode being selected from a group comprising an active mode and a passive mode; and responsive to the desired operating mode being the active mode, transmit a power-on command signal to the subsystem to transition to an active operating state.
5. The biometric sensor system of claim 1, wherein the subsystem includes an electric motor, a position encoder, and a motor driver, and wherein the control operation includes the position encoder determining a current position of the electric motor and the motor driver changing the current position of the electric motor based on the calculated first biometric parameter.
6. The biometric sensor system of claim 5, wherein the control operation further includes the motor driver moving the electric motor to an omega set point via systematically repeating a position convergence loop until a position convergence is achieved between the current position of the electric motor and the omega set point.
7. The biometric sensor system of claim 5, wherein the subsystem further includes a torque-transmitting clutch mechanism drivingly connected to the electric motor, and wherein the control operation further includes activating the clutch mechanism to transmit torque received from the electric motor.
8. The biometric sensor system of claim 1, wherein the first biometric sensor of the first biometric subassembly includes a biometric sensor motion module operable to monitor one or more dynamic characteristics of the first appendage and a biometric sensor module operable to monitor one or more physiological characteristics of the first appendage.
9. The biometric sensor system of claim 1, further comprising a rechargeable energy storage device configured to mount onto the user and selectively power the system CPU.
10. The biometric sensor system of claim 1, further comprising a waist biometric subassembly configured to mount to a waist portion of the user, the waist biometric subassembly including a biometric sensor operable to monitor a biometric characteristic of the waist portion of the user and wirelessly output a sensor signal indicative thereof to the system CPU.
11. The biometric sensor system of claim 1, further comprising: a third biometric subassembly configured to mount to an upper-extremity portion of a second appendage of the user, the third biometric subassembly including a third biometric sensor operable to monitor a third biometric characteristic of the upper-extremity portion of the second appendage and wirelessly output a third sensor signal indicative thereof to the system CPU; and a fourth biometric subassembly configured to mount to a lower-extremity portion of the second appendage, the fourth biometric subassembly including a fourth biometric sensor operable to monitor a fourth biometric characteristic of the lower-extremity portion of the second appendage and wirelessly output a fourth sensor signal indicative thereof to the system CPU.
12. The biometric sensor system of claim 1, wherein the first biometric subassembly includes a first strap mounting thereto the first biometric sensor, the second biometric subassembly includes a second strap mounting thereto the second biometric sensor, the first strap being shaped and sized to immovably mount onto the upper-extremity portion of the first appendage, and the second strap being shaped and sized to immovably mount onto the lower-extremity portion.
13. The biometric sensor system of claim 1, wherein the first appendage is an arm or a leg, the upper-extremity portion to which mounts the first biometric subassembly includes a bicep portion of the arm or a thigh portion of the leg, and the lower-extremity portion to which mounts the second biometric subassembly includes a forearm portion of the arm or a tibia portion of the leg.
14. An exoskeleton system comprising: an exoskeleton frame with a joint assembly configured to attach to an appendage of a user; a motor unit removably attached to the exoskeleton frame and selectively operable to transmit a motor torque to the joint assembly to thereby assist with movement of the appendage of the user; and a biometric sensor system, including: a first biometric subassembly configured to mount to an upper-extremity portion of the appendage and including a first biometric sensor operable to monitor a first biometric characteristic of the upper-extremity portion and wirelessly output a first sensor signal indicative thereof; a second biometric subassembly configured to mount to a lower-extremity portion of the appendage and including a second biometric sensor operable to monitor a second biometric characteristic of the lower-extremity portion and wirelessly output a second sensor signal indicative thereof; and a system central processing unit (CPU) configured to mount onto the user and wirelessly communicate with the first and second biometric subassemblies, the system CPU being programmed to: receive the first sensor signal from the first biometric sensor and the second sensor signal from the second biometric sensor; calculate a first biometric parameter of the first appendage using the first and second biometric characteristics indicated by the first and second sensor signals received from the first and second biometric sensors; and transmit a command signal to the motor unit to output a motor torque and thereby change a motor position based on the calculated first biometric parameter.
15. A method of operating a biometric sensor system for a user with multiple appendages, the method comprising: mounting a first biometric subassembly to an upper-extremity portion of a first appendage of the user appendages, the first biometric subassembly including a first biometric sensor operable to monitor a first biometric characteristic of the upper-extremity portion of the first appendage and wirelessly output a first sensor signal indicative thereof; mounting a second biometric subassembly to a lower-extremity portion of the first appendage, the second biometric subassembly including a second biometric sensor operable to monitor a second biometric characteristic of the lower-extremity portion of the first appendage and wirelessly output a second sensor signal indicative thereof; mounting a system central processing unit (CPU) onto the user; receiving, via the system CPU, the first sensor signal from the first biometric sensor and the second sensor signal from the second biometric sensor; calculating, via the system CPU, a first biometric parameter of the first appendage using the first and second biometric characteristics indicated by the first and second sensor signals received from the first and second biometric sensors; and transmitting, via the system CPU to a subsystem, a command signal to execute a control operation based on the calculated first biometric parameter.
16. The method of claim 15, wherein the first biometric characteristic is a first relative angle, the second biometric characteristic is a second relative angle, and the first biometric parameter of the first appendage is a joint angle of a joint of the first appendage.
17. The method of claim 16, wherein the joint angle is calculated as an absolute value of a mathematical difference between the first and second relative angles.
18. The method of claim 15, wherein the subsystem includes an electric motor, a position encoder, and a motor driver, and wherein the control operation includes the position encoder determining a current position of the electric motor and the motor driver changing the current position of the electric motor based on the calculated first biometric parameter.
19. The method of claim 18, wherein the control operation further includes the motor driver moving the electric motor to an omega set point via systematically repeating a position convergence loop until a position convergence is achieved between the current position of the electric motor and the omega set point.
20. The method of claim 18, wherein the subsystem further includes a torque-transmitting clutch mechanism drivingly connected to the electric motor, and wherein the control operation further includes activating the clutch mechanism to transmit torque received from the electric motor.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032] The present disclosure is amenable to various modifications and alternative forms, and some representative embodiments are shown by way of example in the drawings and will be described in detail herein. It should be understood, however, that the novel aspects of this disclosure are not limited to the particular forms illustrated in the above-enumerated drawings. Rather, this disclosure covers all modifications, equivalents, combinations, permutations, groupings, and alternatives falling within the scope of this disclosure as encompassed, for example, by the appended claims.
DETAILED DESCRIPTION
[0033] This disclosure is susceptible of embodiment in many different forms. Representative embodiments of the disclosure are shown in the drawings and will herein be described in detail with the understanding that these embodiments are provided as exemplifications of the disclosed principles, not limitations of the broad aspects of the disclosure. To that extent, elements and limitations that are described, for example, in the Abstract, Technical Field, Background, Summary, and Detailed Description sections, but not explicitly set forth in the claims, should not be incorporated into the claims, singly or collectively, by implication, inference, or otherwise.
[0034] For purposes of the present detailed description, unless specifically disclaimed: the singular includes the plural and vice versa; the words and and or shall be both conjunctive and disjunctive; the words any and all shall both mean any and all; and the words including, containing, comprising, having, and the like, shall each mean including without limitation. Moreover, words of approximation, such as about, almost, substantially, generally, approximately, and the like, may each be used herein in the sense of at, near, or nearly at, or within 0-5% of, or within acceptable manufacturing tolerances, or any logical combination thereof, for example.
[0035] Referring now to the drawings, wherein like reference numbers refer to the same or similar features throughout the several views, there is shown in
[0036] The exoskeleton system 10 of
[0037] A lower outer side region of the hip assembly 14 of
[0038] Continuing with the discussion of the exoskeleton's lower extremity section 10B, the two (left and right) tibial bracket connectors 31 are each connected to a respective ankle outer shell 33 via a respective lower-leg bracket 35. The two (left and right) lower-leg brackets 35 are attached to the (left and right) ankle outer shells 33 via respective shin size adjusters 34. Inner side regions of the ankle outer shells 33 are each provided with an ankle strap 95 that wraps around and releasably attaches the ankle outer shells 33 and, thus, the lower extremity section 10B to the user's ankles/lower legs. A bottom outer side region of each ankle outer shell 33 may optionally attach to a respective exoskeleton foot outer shell 36, which seats thereon and operatively attaches to a user's foot/shoe/boot. The two (left and right) ankle outer shells 33 may articulate with respect to the tibial bracket connectors 31, the connectors 31 may articulate with respect to the thigh assemblies 26, and the thigh assemblies 26 may articulate with respect to the hip assembles 14.
[0039] To securely attach and selectively detach the lower extremity section 10B to/from the upper extremity section 10A, e.g., for a full body exoskeleton architecture, the hip assembly 14 releasably attaches to a bottom end of the spine unit assembly 58 via a socket assembly 23 and a tailbone outer shell 16. This spine unit assembly 58 connects at an upper end thereof to a flexible back plate assembly 38, which may abut a wearer's thoracic spinal (upper back) region. Left and right flanks of the back plate assembly 38 of
[0040] To transform the unassisted, passive-type exoskeleton architecture of
[0041] A pair of (right and left) knee motor unit modules 103 mount on and drivingly connect to the knee motor adaptors 27 via knee motor unit brackets 106. Each mated modular knee motor unit 103 and corresponding bracket 106 securely attach to their respective knee assembly 30 via a knee bracket alignment adaptor 107. In so doing, the motor unit modules 103 are selectively actuable to boost and/or automate movement of the knee assemblies 30 and, thus, the user's knee joints and lower legs. When operated in unison, the motor unit modules 102, 103 may assist with gaited locomotion of a user as well as jumping, squatting, climbing, lifting, etc. It should be appreciated that the exoskeleton 10 of
[0042] With continuing reference to
[0043] A pair of (left and right) elbow motor unit modules 105 mount on and drivingly connect to complementary forearm attachment assemblies 108. Each forearm attachment assembly 108 removably attaches to a user's forearms via straps (as shown). In this regard, each of the herein-described joint and appendage assemblies may employ straps, cables, harnesses, cuffs, or any other suitable means of attachment to operatively mount onto a user. Each of the modular elbow motor units 105 operatively attaches to a respective upper arm bracket assembly 57 on one of the exoskeleton shoulder assemblies 37. In so doing, the motor unit modules 105 are selectively actuable to boost and/or automate movement of the exoskeleton elbow assemblies and, thus, the user's elbow joints and forearms. When operated in unison, the motor unit modules 104, 105 may assist with movement of the upper appendages, e.g., to facilitate lifting, throwing, carrying, gait-related arm swing, etc. It should be appreciated that the exoskeleton 10 of
[0044] To govern individual and synchronized operation of the motor unit modules 102, 103, 104, 105, the exoskeleton system 10 may employ a distributed array of sensing devices for actively monitoring real-time or near real-time user variables and system characteristics. The sensing devices may include: (1) a waist biometric sensor assembly 65; (2) a pair of thigh biometric sensor assemblies 68; (3) a pair of lower-leg biometric sensor assemblies 71; (4) a pair of upper arm biometric sensor assemblies 75; and (5) a pair of forearm biometric sensor assemblies 79. A rechargeable energy storage device, such as battery pack 100, may be attached to the back of the back plate assembly 38 and operable to power the exoskeleton's various electronic components. A lower body subsystem CPU 24 provisions input/output (I/O) logic-controlled operation of the sensors, motors, etc., of the lower extremity section 10B, whereas an upper body subsystem CPU 46 provisions I/O logic-controlled operation of the sensors, motors, etc., of the upper extremity section 10A. With this architecture, detachment of the upper extremity exo section 10A from the lower extremity exo section 10A, 10B creates a stand-alone lower body active/passive exoskeleton unit and a stand-alone upper body active/passive exoskeleton unit that may be operated independently from each other. This allows the user to further customize use of the exoskeleton 10 to a myriad of distinct upper and lower body applications. Additional information about the contents, arrangement, and functionality of the exoskeleton system 10 and attendant biometric sensor devices may be found in U.S. Provisional Patent App. Nos. 63/403,425 (hereinafter '425 Application) and 63/418,135 (hereinafter '135 Application), as well as U.S. patent application Ser. No. 18/298,687, all of which are incorporated herein by reference in their respective entireties and for all purposes.
[0045] Turning next to
[0046] An alpha biometric sensor module may measure an upper (first) absolute angle of a subject limb above a joint of interest, and a beta biometric sensor module may measure a lower (second) absolute angle of the subject limb below the joint of interest. In order to operate a hip motor unit, for example, a waist alpha biometric sensor may measure a real-time absolute angle of a user's lower back/torso with respect to the ground, and a thigh beta biometric sensor may measure a real-time absolute angle of the user's thigh with respect to the ground. The mounting locations of the various biometric sensor subassemblies, as portrayed in
[0047] With continuing reference to
[0048] Each of the bicep sensor straps 78, like their thigh counterparts described above, secures a respective biometric sensor motion module 76 and a respective biometric sensor module 77 to a respective upper-arm (bicep) portion of one of the user's arms, e.g., to monitor that extremity's physiological data and dynamics data during movement of a user. Each forearm sensor strap 81, like their calf counterparts described above, secures a respective biometric sensor motion module 80 to a respective lower-arm (forearm) portion of one of the user's arms, e.g., to monitor that extremity's dynamic movement. While some of the aforementioned extremity biometric subassemblies are described as having only a biometric motion module and some are described as having both a motion module and a physiology module, it should be appreciated that the individual subassemblies may be modified to include one, both, or more sensor modules, e.g., depending on the intended end-use of the biometric sensor system 200. It is envisioned, for example, that any of the herein described biometric subassemblies may include both proprioceptive and exteroceptive sensors that monitor and output information on the functional status and environment interaction of the user and/or the exo suit.
[0049] Performance of networked biometric sensor arrays may be affected by differing environmental and operating conditions. Consequently, biometric sensors may present parametric variances whose operative overlap offer opportunities for sensory fusion. A discrete or embedded sensor fusion control module may execute a fusion algorithm in conjunction with associated memory-stored, application-specific calibration settings to receive sensor data from available sensors, cluster the data into usable estimations and measurements, and fuse the clustered observations to determine, for example, user dynamics and user performance estimates. The fusion algorithm may utilize any suitable sensor fusion method, such as convolutional neural network (CNN) or Kalman Filter (KF) fusion techniques. A KF application may be used to explore correlative characteristics of joints, extremities, and/or appendages along a temporal axis (e.g., assuming that a tracked target moves smoothly over a predefined period of time). Likewise, a KF application may capture spatial correlations, namely the relative position of each target object to a common origin as observed by multiple sensors.
[0050] The distributed array of thigh, calf, bicep and forearm biometric sensor subassemblies of the biometric sensor system 200 may wirelessly communicate with a centralized system CPU 46 that is mounted onto the back plate assembly 38 and powered by a rechargeable battery pack 100. The back plate assembly 38 may be fabricated with a flexible and robust center back flex plate 82 that is connected, e.g., via machine screws, to a pair of (left and right) side midback flex plates 83, a pair of (left and right) upper back flex plates 85, and a center midback flex plate 84, all of which may be formed from polyurethane (PU). A pair of adjustable shoulder harnesses 47 pass through respective shoulder strap outer shell 54 located at the top-right and top-left sides of the center back flex plate 82. Top and bottom shell portions 55 and 56, respectively of the shoulder strap outer shell 54 may be made of a flexible polyurethane material and attach together via machine screws.
[0051]
[0052] Turning next to
[0053]
Omega=|alphabeta|
where alpha is an absolute angle from an alpha biometric sensor module, and beta is an absolute angle from a beta biometric sensor module, as described above. After the calculation of limb joint angle omega, the motor unit CPUs 165, 182 use the limb joint angle as an input for motor control.
[0054] Upon receipt of joint angle omega generated by motor unit CPUs 165, 182, an absolute position encoder 154, 172 determines a current position of an electric motor 145, 167, such as a brushless direct-current (DC) motor within one or more of the motor unit modules 102, 103, 104, 105. The corresponding motor unit CPU 165, 182 transmits command signals to a motor driver 159, 222 to move the motor 145, 167 in a direction corresponding to a defined location of an omega set point. This process may systematically repeat in a position convergence loop until a position convergence is achieved. When position convergence is achieved, the motor unit has successfully moved to the omega joint angle set point. A result of this control process may include real-time movement of an exoskeleton limb to assist a user's action. An output movement signal may be sent via wireless transmission to a central CPU (e.g., lower body subsystem CPU 24 or upper body subsystem CPU 46) for processing. Commensurate data may be concurrently sent via wireless transmission from the central CPU to an IoT device, such as a phone, tablet, computer app, etc., (collectively 205 in
[0055] With reference next to
[0056] If a passive (disengaged) operating mode 309 is selected by a user or system operator, the electric motor 184 and its torque-transmitting clutch 191 mechanism may be powered off or maintained in an off state such that the motor 184 does not generate assist torque and the clutch 191 is disengaged or remains disengaged. This passive operating mode may allow the user to freely move around with limited or no assistance from the motor 184. Comparatively, if an active (engaged) operating mode 311 is selected by the user or the system operator, the motor 184 and clutch 191 may be powered on and maintained in an on state of operation; in so doing, the clutch angle touch sensor 196 may be used as an input for automated alignment and control of the motor unit 184. When the clutch 191 is engaged (i.e., takes up a torque-carrying capacity), the alpha and beta biometric sensors 301, 303 may output (advertise) wireless angle data.
[0057] When one or more of the motor unit CPUs 165, 182 subscribes to the wireless transmission of sensor data from one or more of the biometric sensors 301, 303, e.g., as indicated at process block 307, it may responsively calculate a limb joint angle omega, as indicated at process block 313 (Omega=| (Alpha Angle)(Beta Angle)|). After the calculation of omega, the motor unit CPUs 165, 182 use the limb joint angle as an input for motor control at process block 315. The absolute encoder 199 may then determine a real-time or near real-time angular position of the motor 184; the motor unit CPU 165, 182 may responsively transmit command signals to the motor driver 199, 228 to move the motor 145, 167 in a direction corresponding to an omega set point. As noted above, this process may systematically repeat until a position convergence is achieved.
[0058] Using the above-noted motor control system and method may help to provision real-time automated movement of an exoskeleton limb or limbs to assist or provide a desired user movement. At process block 317, an output movement signal may be sent via wireless transmission to the Central CPU (e.g., CPU 24 and/or CPU 46) for processing; corresponding data may be sent via wireless transmission to an IoT device or a smartphone, tablet computer, or computer app for data display and logging. If the user selects hybrid mode at process block 319, the clutch angle touch sensor 196 angle may be used as an input for continuous motor control as if the motor is following the clutch position. When an EMG threshold on the biometric sensors is reached, the clutch may engage and the active mode process described may be executed. If the motor-clutch button is released, the motor 184 may be powered off and/or the clutch 191 disengaged; at this juncture, a joint and appendage assembly may be locked in place.
[0059] Aspects of this disclosure may be implemented, in some embodiments, through a computer-executable program of instructions, such as program modules, generally referred to as software applications or application programs executed by any of a controller or the controller variations described herein. Software may include, in non-limiting examples, routines, programs, objects, components, and data structures that perform particular tasks or implement particular data types. The software may form an interface to allow a computer to react according to a source of input. The software may also cooperate with other code segments to initiate a variety of tasks in response to data received in conjunction with the source of the received data. The software may be stored on any of a variety of memory media, such as CD-ROM, magnetic disk, and semiconductor memory (e.g., various types of RAM or ROM).
[0060] Moreover, aspects of the present disclosure may be practiced with a variety of computer-system and computer-network configurations, including multiprocessor systems, microprocessor-based or programmable-consumer electronics, minicomputers, mainframe computers, and the like. In addition, aspects of the present disclosure may be practiced in distributed-computing environments where tasks are performed by resident and remote-processing devices that are linked through a communications network. In a distributed-computing environment, program modules may be located in both local and remote computer-storage media including memory storage devices. Aspects of the present disclosure may therefore be implemented in connection with various hardware, software, or a combination thereof, in a computer system or other processing system.
[0061] Any of the methods described herein may include machine readable instructions for execution by: (a) a processor, (b) a controller, and/or (c) any other suitable processing device. Any algorithm, software, control logic, protocol or method disclosed herein may be embodied as software stored on a tangible medium such as, for example, a flash memory, a solid-state drive (SSD) memory, a hard-disk drive (HDD) memory, a CD-ROM, a digital versatile disk (DVD), or other memory devices. The entire algorithm, control logic, protocol, or method, and/or parts thereof, may alternatively be executed by a device other than a controller and/or embodied in firmware or dedicated hardware in an available manner (e.g., implemented by an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable logic device (FPLD), discrete logic, etc.). Further, although specific algorithms may be described with reference to flowcharts and/or workflow diagrams depicted herein, many other methods for implementing the example machine-readable instructions may alternatively be used.
[0062] Aspects of the present disclosure have been described in detail with reference to the illustrated embodiments; those skilled in the art will recognize, however, that many modifications may be made thereto without departing from the scope of the present disclosure. The present disclosure is not limited to the precise construction and compositions disclosed herein; any and all modifications, changes, and variations apparent from the foregoing descriptions are within the scope of the disclosure as defined by the appended claims. Moreover, the disclosure expressly includes any and all combinations and subcombinations of the preceding elements and features.