METHOD FOR ESTIMATING POSTURE OF ROBOTIC WALKING AID
20170151070 ยท 2017-06-01
Inventors
- Kuan-Chun Sun (Yunlin County, TW)
- YI-JENG TSAI (TAOYUAN CITY, TW)
- CHENG-HUA WU (HSINCHU CITY, TW)
- Jwu-Sheng Hu (Hsinchu County, TW)
Cpc classification
A61H1/0255
HUMAN NECESSITIES
B25J9/0006
PERFORMING OPERATIONS; TRANSPORTING
A61H3/00
HUMAN NECESSITIES
A61B2562/0219
HUMAN NECESSITIES
International classification
A61H3/00
HUMAN NECESSITIES
A61H1/02
HUMAN NECESSITIES
Abstract
A method for estimating posture of robotic walking aid comprises: providing a motor controller, a motor encoder and a motor on right and left hip joints, and right and left knee joints of a robotic walking aid, providing an inertial sensor on upper body of the robotic walking aid, wherein the motor controller, the motor encoder, the motor and the inertial sensor are coupled to a control unit; installing the robotic walking aid on a user; inputting the lengths of the upper body, two thighs, two shanks, two feet of the robotic walking aid to the control unit, wherein the upper body, two thighs, two shanks, two feet form a plurality of points; obtaining an angle of the upper body corresponding to a reference frame with the inertial sensor; obtaining angles of those joints with those motor encoders; and calculating 3 dimensional coordinates of each point with a motion model.
Claims
1. A method for estimating posture of a robotic walking aid, comprising the steps of: providing a motor controller, a motor encoder and a motor on each of right and left hip joints, and right and left knee joints of a robotic walking aid, and providing an inertial sensor on upper body of the robotic walking aid, while coupling the motor controllers, the motor encoders, the motors and the inertial sensor to a control unit; installing the robotic walking aid on a user; with the robotic walking aid installed on the user, an angle of the upper body of the robotic walking aid being formed corresponding to a reference frame, and each of the aforesaid joints having an individual angle; inputting the lengths of the upper body, two thighs, two shanks, two feet of the robotic walking aid to the control unit, while the upper body, two thighs, two shanks, two feet forming a plurality of end points; using the inertial sensor to obtain the angle of the upper body corresponding to the reference frame; using the motor encoders to obtain the individual angle of each of the aforesaid joints; and using a motion model to calculate three dimensional ( 3D ) coordinates for each of the plurality of end points.
2. The method of claim 1, wherein after the step of using of the motion model to calculate 3D coordinates for each of the plurality of end points is performed, a process for calculating 3D coordinates of the center of gravity of the user is performed, and the process comprises the steps of: calculating mass of the upper body, the two thighs, the two shanks and the two feet; and using the 3D coordinates of each of the plurality of end points and the mass of the upper body, the two thighs, the two shanks and the two feet to calculate 3D coordinates of the center of gravity of the robotic walking aid.
3. The method of claim 2, wherein after the center of gravity of the robotic walking aid is obtained, a process for determining whether the 3D coordinates of the center of gravity of the user is abnormal is performed, and the process comprises the steps of: using the two end points corresponding to the two feet to construct a base of support; projecting the 3D coordinates of the center of gravity to the base of the support; and determining whether the 3D coordinates of the center of gravity is projected and located outside the base of support; and if so, issuing an alarm or enabling the robotic walking aid to rest; otherwise, returning to the step of using the inertial sensor to obtain the angle of the upper body corresponding to the reference frame.
4. The method of claim 1, wherein the robotic walking aid is defined by a plurality of links, and the plurality of links include: a first link and a second link, serially connected to each other to compose a pelvis; a third link, a fourth link, and a fifth link, serially connected to one another to compose a right leg while allowing the right leg to couple to one end of the pelvis in a form that a node between the right leg and the pelvis is defined to be the right hip joint, a node between the third link and the fourth link is defined to be the right knee joint, and the fifth link is defined to be the right foot; a sixth link, a seventh link, and an eighth link, serially connected to one another to compose a left leg while allowing the left leg to couple to one end of the pelvis that is not connected to the right leg in a form that a node between the left leg and the pelvis is defined to be the left hip joint, a node between the sixth link and the seventh link is defined to be the left knee joint, and the eighth link is defined to be the left foot; and a ninth link, used as the upper body and one end thereof being connected to a node between the first link and the second link
5. The method of claim 4, wherein the plurality of end points include: a first end point, disposed at an end of the ninth link that is connected to the first and the second links; an upper body end point, disposed at an end of the ninth link that is opposite to the first end point; a second end point, disposed at an end of the third link that is connected to the first link; a third end point, disposed at an end of the third link that is connected to the fourth link; a fourth end point, disposed at an end of the fourth link that is connected to the fifth link; a fifth end point, disposed at an end of the fifth link that is opposite to the fourth end point; a sixth end point, disposed at an end of the sixth link that is connected to the second link; a seventh end point, disposed at an end of the sixth link that is connected to the seventh link; an eighth end point, disposed at an end of the seventh link that is connected to the eighth link; and a ninth end point, disposed at an end of the eighth link that is opposite to the eighth end point.
6. The method of claim 5, wherein in the step of using the motion model to calculate 3D coordinates for each of the plurality of end points, a direction that the user is walking toward is defined to be the positive direction of an x-axis in the reference frame; the node between the upper body and the pelvis of the robotic walking aid is defined to be the origin of the reference frame while respectively defining the first end point to the ninth end point to be the origins of a sub-coordinate frame 1 to a sub-coordinate frame 9 and the upper body end point to be the origin of a sub-coordinate frame 0; and consequently the 3D coordinates of each of the first end point to the ninth end point and the upper body end point corresponding to the reference frame can be obtained by a homogeneous transformation matrixes defined by the plurality of the aforesaid end points.
7. The method of claim 1, wherein the control unit is connected to a mobile communication device with GPS function and a database, wherein the mobile communication device with GPS function provides the GPS coordinates of the user with the robotic walking aid installed on, and the GPS coordinates of the user and the angles relating to the upper body and the aforesaid joints of the robotic walking aid are stored in the database for further use in remote service.
8. The method of claim 7, wherein the remote service includes a topography feedback process, a danger prompting process, a falling alert and distress call process, an exercise amount estimation process, a walking distance estimation process, a behavior monitoring process, an activity record process, and a rehabilitation feedback process.
9. The method of claim 8, wherein in the topography feedback process, the GPS coordinates of the user is matched to a map for identifying terrains of specific topographic marks, and when a user approaches any of those specific topographic marks, a remote prompting is issued for suggesting the user to alter his/her walking mode for adapting to the terrain of the approached topographic mark.
10. The method of claim 8, wherein in the danger prompting process, the GPS coordinates of the user is matched to a map for identifying dangerous locations, and when a user approaches any of those dangerous locations, a remote prompting is issued for alerting the user to cope with the coming danger.
11. The method of claim 8, wherein in the falling alert and distress call process, the posture of the user is obtained using the angles relating to the upper body and the aforesaid joints of the robotic walking aid, and when the posture is determined to be abnormal, a call is made to find out the condition of the user, and if there is no response from the user, an active distress call is issued to an emergency medical unit that is located nearest to the user according to the GPS coordinates of the user.
12. The method of claim 8, wherein in the exercise amount estimation process, an exercise amount is calculated and obtained using the following formula:
(m.sub.r+m.sub.h)gd=W.sub.r+W.sub.h; and m.sub.r is the mass of the robotic walking aid; g is the gravitational acceleration; m.sub.h is the mass of the user; d is the walking distance; W.sub.r is the mechanic energy generated by the robotic walking aid; and W.sub.h is the exercise amount of the user.
13. The method of claim 12, wherein W.sub.r=W.sub.mechanical=W.sub.electrical; and W.sub.mechanical is the mechanical energy generated by the robotic walking aid; W.sub.electrical is the electrical energy consumed by the robotic walking aid; and is the conversion efficiency.
14. The method of claim 8, wherein in the walking distance estimation process, a posture of the user is obtained remotely using the angles relating to the upper body and the aforesaid joints of the robotic walking aid and a step length of the user is estimated so as to be used for estimating and recording the walking distance.
15. The method of claim 8, wherein in the behavior monitoring process, postures of the user are obtained remotely using the angles relating to the upper body and the aforesaid joints of the robotic walking aid, and the postures of the user are classified into different behaviors according to a classification rule to be recorded.
16. The method of claim 8, wherein in the activity record process, the GPS coordinates of the user are matched to a map for identifying and recording places where the user perform his/her daily activities.
17. The method of claim 8, wherein in the rehabilitation feedback process, the posture, step length, step frequency, and exercise amount are recorded and provided remotely to a rehabilitation therapist for constructing a rehabilitation treatment accordingly.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The present disclosure will become more fully understood from the detailed description given herein below and the accompanying drawings which are given by way of illustration only, and thus are not limitative of the present disclosure and wherein:
[0017]
[0018]
[0019]
[0020]
DETAILED DESCRIPTION
[0021] In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the disclosed embodiments. It will be apparent, however, that one or more embodiments may be practiced without these specific details. In other instances, well-known structures and devices are schematically shown in order to simplify the drawing. Please refer to
[0029] Please refer to
[0030] In this embodiment, at each of the right and left hip joints, and the right and left knee joints of a robotic walking aid 1, there are a motor controller 50, a motor encoder 71 and a motor 70 to be mounted respectively thereat; and there is an inertial sensor 60 to be mounted on the upper body 40 of the robotic walking aid 1, whereas the motor controllers 50, the motor encoders 71, the motors 70 and the inertial sensor 60 are coupled to a control unit 80. Thereby, by the use of a cloud computing means 130, the robotic walking aid 1 is able to connect to a mobile communication device 90 via the control unit 80. It is noted that the mobile communication device 90 can be a smart phone, a tablet computer or a smart watch, whichever is built with GPS function. Therefore, the mobile communication device 90 is able to for provide the GPS coordinates of the user with the robotic walking aid installed on so as to be used in an activity motoring, and moreover, while working cooperatively with the inertial sensor 60, the mobile communication device 90 can provide indoor positioning information for monitoring any user wearing the mobile communication device 90. In addition, the control unit 80 is further connected to a database 120 for allowing information to be transmitted between the control unit 80, the mobile communication device 90 and the database 90 via the cloud computing means 130 for future used in remote service, and the remote service can include a topography feedback process, a danger prompting process, a falling alert and distress call process, an exercise amount estimation process, a walking distance estimation process, a behavior monitoring process, an activity record process, and a rehabilitation feedback process. The robotic walking aid 1 is designed to be worn by a user for helping the user to walk. Moreover, there can be a power source for providing power to the robotic walking aid 1.
[0031] Although the control unit 80 is connected to the robotic walking aid 1 in a wireless manner in this embodiment, it can be connected to the robotic walking aid 1 in a wired manner, or in another embodiment, the control unit 80 can be installed directly on the robotic walking aid 1.
[0032] The inertial sensor 60 can be the composition of an accelerometer, a gyroscope, a magnetometer, and an angle gauge, whichever can perform a posture estimation algorithm for estimating upper body posture of a user, estimating walking steps of a user and for indoor positioning, and so on. In an embodiment, the inertial sensor 60 is a 9-degree-of-freedom inertial measurement unit (9D IMU), which is generally an assembly including a three-axis accelerometer, a gyroscope and a magnetometer, and is used for estimating an inertial motion of an object, or for calculating a transformation matrix for the coordinate of the inertial sensor corresponding to a reference coordinate system. The accelerometer is a device that will measure acceleration forces, whereas these forces may be static, like the constant force of gravity, or they could be dynamic, caused by moving or vibrating the accelerometer. The gyroscope is a device capable of measuring the angular rate of an object, and while working cooperatively with an accelerometer, the gyroscope can measure moment of inertial that is not detectable by the accelerometer, so that the dimension of detection as well as the system frequency are enhanced. The magnetometer is a device capable of direction of the magnetic field at a point in space, and can be used as an electronic compass that can work cooperatively with an accelerometer and a gyroscope for estimating a yaw angle of an object.
[0033] Please refer to
[0034] In the following description, the step 114 of
[0035] Consequently, R.sub.r1 is substantially a transformation matrix for the transformation from sub-coordinate frame 1 to the reference frame; R.sub.12 is substantially a transformation matrix for the transformation from the sub-coordinate frame 2 to the sub-coordinate frame 1, R.sub.23 is substantially a transformation matrix for the transformation from the sub-coordinate frame 3 to the sub-coordinate frame 2, R.sub.34 is substantially a transformation matrix for the transformation from the sub-coordinate frame 4 to the sub-coordinate frame 3, R.sub.45 is substantially a transformation matrix for the transformation from the sub-coordinate frame 5 to the sub-coordinate frame 4, R.sub.16 is substantially a transformation matrix for the transformation from the sub-coordinate frame 6 to the sub-coordinate frame 1, R.sub.67 is substantially a transformation matrix for the transformation from the sub-coordinate frame 7 to the sub-coordinate frame 6, R.sub.78 is substantially a transformation matrix for the transformation from the sub-coordinate frame 8 to the sub-coordinate frame 7, and R.sub.89 is substantially a transformation matrix for the transformation from the sub-coordinate frame 9 to the sub-coordinate frame 8.
[0036] For instance, for obtaining the transformation relationship of the third end point P.sub.3 corresponding to the reference frame, it can be obtained using the following formula:
p.sub.3=R.sub.r1.Math.R.sub.12.Math.R.sub.23.Math.[0 0 0 1].sup.T;
and similarly, the other end points can be obtained in the following formulas:
p.sub.b=R.sub.r1.Math.[0 H.sub.body 0 1].sup.T p.sub.1=R.sub.r1.Math.[0 0 0 1].sup.T
p.sub.2=R.sub.r1.Math.R.sub.12.Math.[0 0 0 1].sup.T
p.sub.4=R.sub.r1.Math.R.sub.12.Math.R.sub.23.Math.R.sub.34.Math.[0 0 0 1].sup.T
p.sub.5=R.sub.r1.Math.R.sub.12.Math.R.sub.23.Math.R.sub.34.Math.R.sub.45.Math.[0 0 0 1]hu T
p.sub.6=R.sub.r1.Math.R.sub.16.Math.[0 0 0 1].sup.T p.sub.7=R.sub.r1.Math.R.sub.16.Math.R.sub.67.Math.[0 0 0 1].sub.T
p.sub.8=R.sub.r1.Math.R.sub.16.Math.R.sub.67.Math.R.sub.78.Math.[0 0 0 1].sup.T
p.sub.9=R.sub.r1.Math.R.sub.16.Math.R.sub.67.Math.R.sub.78.Math.R.sub.89.Math.[0 0 0 1].sup.T
[0037] Therefore, as shown in
[0038] Moreover, a base of support B can be constructed by projecting a plane formed by the connection of the fourth end point P.sub.4, the fifth end point P.sub.5, the eighth end point P.sub.8, and the ninth end point P.sub.9. Thereafter, the mass center of the user wearing the robotic walking aid 1 can be calculated. First, the center coordinates of those links are obtained using the following formulas:
Then, after obtaining the ratio of each linkage rate corresponding to the overall weight of the user by the use of the Dempster's coefficient, the spatial coordinate corresponding to the center of gravity of the robotic walking aid can be obtained as following:
Consequently, the center of gravity is projected to the base of support B for obtaining the required spatial relationship.
[0039] In addition, after the angular orientation of the user with respect to gravity is detected and provided by the inertial sensor 60, the motion model can be modified accordingly and then to be used in mapping marks via the GPS positioning function of the mobile communication device 90 for next user.
[0040] Accordingly, after the using of the motion model to calculate a spatial coordinate for each end point is performed, as disclosed in
[0046] The steps performed in
[0047] In
[0048] In the topography feedback process, the GPS coordinates of the user is matched to a map, e.g. Google map, for identifying terrains of specific topographic marks, and when a user approaches any of those specific topographic marks, a remote prompting is issued for suggesting the user to alter his/her walking mode for adapting to the terrain of the approached topographic mark.
[0049] In the danger prompting process, the GPS coordinates of the user is matched to a map, e.g. Google map, for identifying dangerous locations, and when a user approaches any of those dangerous locations, a remote prompting is issued for alerting the user to cope with the coming danger.
[0050] In the falling alert and distress call process, the posture of the user is obtained using the angles relating to the upper body and the aforesaid joints of the robotic walking aid, and when the posture is determined to be abnormal, a call is made to find out the condition of the user, and if there is no response from the user, an active distress call is issued to an emergency medical unit that is located nearest to the user according to the GPS coordinates of the user.
[0051] In the exercise amount estimation process, an exercise amount is calculated and obtained using the flowing formula:
(m.sub.r+m.sub.h)gd=W.sub.r+W.sub.h;
[0052] wherein m.sub.r is the mass of the robotic walking aid; [0053] g is the gravitational acceleration; [0054] m.sub.h is the mass of the user; [0055] d is the walking distance; [0056] W.sub.r is the mechanic energy generated by the robotic walking aid; [0057] W.sub.h is the physical cost of the user, i.e. the exercise amount of the user.
[0058] It is noted that the masses of the robotic walking aid 1 and the user can be obtained by any common weight measurement device, and the walking distance can be estimated and obtained according to the information detected by the inertial sensor 60 relating to the amount of walking steps of the robotic walking aid 1. In addition, the mechanical energy consumed by the robotic walking aid 1 can be estimated according to the battery residual capacity. However, the energy conversion efficiency for converting electrical energy into mechanical energy must be identified first, and then mechanical energy consumed by the robotic walking aid 1 can be estimated according to the battery residual capacity accordingly. After obtaining the mechanical energy consumed by the robotic walking aid 1, the physiological cost of the user can be calculated by the use of the aforesaid formula. Therefore, in this embodiment, the energy conversion efficiency for converting electrical energy into mechanical energy is identified as following:
W.sub.r=W.sub.mechanical=W.sub.electrical; [0059] wherein W.sub.mechanical is the mechanical energy generated by the robotic walking aid; [0060] W.sub.electrical is the electrical energy consumed by the robotic walking aid; and is the conversion efficiency.
[0061] Moreover, the exercise amount can be estimated by the use of a vision-based motion analysis system, such as the VICON motion analysis system that is operated cooperatively with a force plate. During the estimation of the exercise amount, the overall energy consumed in the movement, including the kinetic energy and potential energy, is calculated, and a physiological cost measurement is performed by the use of a oxygen consumption measurement device, such as Cosmed K2, and thereby, an energy conversion efficiency database for the robotic walking aid under various walking conditions can be established so as to be used in the exercise amount calculation. Thus, the exercise amount can be obtained using the following formula:
W.sub.h=(m.sub.r+m.sub.h)gdW.sub.electrical
[0062] In the walking distance estimation process, a posture of the user is obtained remotely using the angles relating to the upper body and the aforesaid joints of the robotic walking aid and a step length of the user is estimated so as to be used for estimating and recording the walking distance.
[0063] In the behavior monitoring process, postures of the user are obtained remotely using the angles relating to the upper body and the aforesaid joints of the robotic walking aid, and the postures of the user are classified into different behaviors according to a classification rule to be recorded.
[0064] In the activity record process, the GPS coordinates of the user are matched to a map, e.g. Google map, for identifying and recording places where the user perform his/her daily activities.
[0065] In the rehabilitation feedback process, the postures, step length, step frequency, and exercise amount are recorded and provided remotely to a rehabilitation therapist for constructing a rehabilitation treatment accordingly.
[0066] To sum up, the present disclosure provides a method for estimating posture of a robotic walking aid, using which a safety control and instant posture adjustment mechanism for the robotic walking aid are enabled via the cooperation between inertial sensor and motor encoders; an indoor and outdoor GPS positioning can be achieved via the communication between the inertial sensors and a mobile communication device, while allowing the result of the GPS positioning to be provided to an remote service center for monitoring and behavior analysis. Consequently, the remote service center can decide whether to provide an remote service operation accordingly, and the remote service operation includes a topography feedback process, a danger prompting process, a falling alert and distress call process, an exercise amount estimation process, a walking distance estimation process, a behavior monitoring process, an activity record process, and a rehabilitation feedback process.
[0067] With respect to the above description then, it is to be realized that the optimum dimensional relationships for the parts of the disclosure, to include variations in size, materials, shape, form, function and manner of operation, assembly and use, are deemed readily apparent and obvious to one skilled in the art, and all equivalent relationships to those illustrated in the drawings and described in the specification are intended to be encompassed by the present disclosure.