Artificial Intelligence Assisted Personal Training System, Personal Training Device and Control Device
20240001196 ยท 2024-01-04
Inventors
- Yiu-Wan Joanne Yip (Hong Kong, HK)
- Ka-Wing Frances WAN (Hong Kong, CN)
- Ting Hin Alex MAK (Hong Kong, CN)
- Wai Sze CHAN (Hong Kong, CN)
- Wing Ki CHAN (Hong Kong, CN)
- Hiu Ching LUI (Hong Kong, CN)
- Yeok-Tatt CHEAH (Hong Kong, CN)
Cpc classification
A63B24/0075
HUMAN NECESSITIES
A63B24/0062
HUMAN NECESSITIES
International classification
A63B24/00
HUMAN NECESSITIES
A63B71/06
HUMAN NECESSITIES
Abstract
A personal training system assisted by artificial intelligence (AI) has a personal training device and a control device. The personal training device includes a jacket and pants, and houses sensors at positions corresponding to a user's main muscle groups for monitoring the user's movement posture and muscle activity of the main muscle groups. The control device has a data preprocessing unit for processing detected-signal data of the sensors, a training analysis device for executing an AI algorithm to conduct fatigue analysis of the user's movement based on the user profile and the detected-signal data, and to make training load recommendations. The personal training system can simultaneously monitor posture, muscle activity and muscle fatigue in real time during the exercise; and use the AI algorithm to evaluate exercise performance and provide real-time feedbacks to improve the exercise and training efficiency, and reduce the risk of injury.
Claims
1. A personal training device comprising: an upper garment part and a trousers part both for wearing by a user; and plural sensor accommodating units distributed on the upper garment part and trousers part, plural sensors being installed in the sensor accommodating units such that an individual sensor accommodating unit is equipped with one or more of the sensors, wherein positions of the sensor accommodating units on the upper garment part and trousers part respectively correspond to locations of muscles of major muscle groups of the user such that the sensors, or electrodes thereof, of the sensor accommodating units are positioned on the corresponding muscle locations of the user when the user wears the personal training device, thereby allowing a posture of the user and a muscle activity of the main muscle groups to be monitored during the user doing an exercise.
2. The personal training device of claim 1, wherein the upper garment part and trousers part are separate garment articles, are collectively formed as a one-piece garment, or are formed from plural straps, and wherein the upper garment part and trousers part are tight-fitting or skin-tight.
3. The personal training device of claim 1, wherein the upper garment part, trousers part and sensor accommodating units are made of one or more fabrics, wherein a main fabric selected among the one or more fabrics and used for forming the upper garment part and trousers part is tricot knitted, and wherein a main fabric selected among the one or more fabrics and used for forming the sensor accommodating units is warp-knitted stretch mesh.
4. The personal training device of claim 1, wherein the sensors include surface electromyography sensors and inertial measurement unit sensors, and wherein the muscles of the major muscle groups include upper trapezius, triceps, erector spinae, biceps femoris, pectoralis major, biceps, rectus abdominis, and rectus femoris.
5. The personal training device of claim 1, wherein the sensor accommodating units include 14 units for accommodating 16 sensors.
6. The personal training device of claim 1, wherein the individual sensor accommodating unit is realized as a pocket sewn, snap-attached, or affixed, to the upper garment part or the trousers part.
7. The personal training device of claim 6, wherein the pocket is a Type-1 pocket for accommodating a single sensor, the Type-1 pocket having a length and a width given by L1=(a+c)p and W1=(b+2c)p where: L1 is the length of the Type-1 pocket; W1 is the width of the Type-1 pocket; a, b and c are length, width and depth of the accommodated sensor, respectively; p is between 80% and 90% inclusively; and p is between 60% and 65% inclusively.
8. The personal training device of claim 7, wherein the Type-1 pocket includes an inner layer opening, wherein the inner layer opening is rectangular, oval or square in shape, or conforms to a shape of the accommodated sensor, and wherein the inner layer opening has a length and a width given by L3=d+s and W3=e3 where: L3 is the length of the inner layer opening; W3 is the width of the inner layer opening; d is a sum of lengths of all electrodes in the accommodated sensor; s is between 2 mm and 4 mm inclusively; and e is a common width of the electrodes.
9. The personal training device of claim 6, wherein the pocket is a Type-2 pocket for accommodating two sensors, the Type-2 pocket having a length and a width given by L2=(a+c)p and W2=[(2b+2c)+q]p where: L2 is the length of the Type-2 pocket; W2 is the width of the Type-2 pocket; a, b and c are length, width and depth of an individual accommodated sensor, respectively; p is between 80% and 90% inclusively; p is between 60% and 65% inclusively; and q is between 5 mm to 10 mm inclusively.
10. The personal training device of claim 9, wherein the Type-2 pocket includes an inner layer opening, wherein the inner layer opening is rectangular, oval or square in shape, or conforms to a shape of the individual accommodated sensor, and wherein the inner layer opening has a length and a width given by L4=d+s and W4=e3+f2 where: L4 is the length of the inner layer opening; W4 is the width of the inner layer opening; d is a sum of lengths of all electrodes in the individual accommodated sensor; s is between 2 mm and 4 mm inclusively; and e is a common width of the electrodes.
11. The personal training device of claim 6 further comprising a wire opening located on an outside part of the pocket and spaced from a sensor insertion opening of the pocket by 1 cm to 2 cm, wherein the wire opening is parallel to a side edge of the pocket or angled to a side of the pocket to facilitate placement of sensor electrodes through the wire opening.
12. A control device for processing data generated by a personal training device comprising: an input unit for receiving detected-signal data from sensors on the personal training device and inputting a user profile of a user of the personal training device; a database for storing the received detected-signal data and the user profile; a data preprocessing unit for cleaning and preprocessing the detected-signal data; a training analysis unit for executing an artificial intelligence algorithm to perform fatigue analysis on the user's movement and providing training load recommendations based on the user profile and the detected-signal data; and an output unit configured to output an estimated remaining number of repetitions of an exercise to be performed by the user, a training load suggestion given by the training analysis unit, or a number of repetitions of the exercise completed by the user.
13. The control device according to claim 12 further comprising a coaching module having a graphical user interface, the graphical user interface being used for displaying training information and real-time visual feedback of the user's movement, tutorial videos for different types of exercise as stored in the device's exercise library, as well as used for providing audio guidance and feedback on the exercise in real time.
14. The control device according to claim 12, wherein the training analysis unit comprises a first deep neural network unit and a second deep neural network unit, wherein the first neural network unit is configured to estimate the user movement according to a current muscle activation signal, and wherein the second deep neural network unit is configured to suggest an optimal training load to the user according to the current muscle activation signal and the estimated remaining number of repetitions.
15. The control device according to claim 12 further comprising a posture detection model unit and a machine learning posture classifier, wherein the posture detection model unit is configured to receive a signal of the user's human body detected from a camera input unit, and to generate a human body marker based on the detected signal of the user's human body, and wherein the machine learning gesture classifier is configured to calculate a vector representing the user's ongoing exercise program and a motion state from the human body marker generated by the posture detection model unit, whereby the control device is realized as an artificial intelligence fitness training system.
16. The control device according to claim 12, wherein the data preprocessing unit includes a signal preprocessing unit for performing one or more of the following preprocessing functions on the detected-signal data: bandpass filtering; highpass filtering; lowpass filtering; root mean square calculation; moving average calculation; mean absolute value calculation; median frequency calculation; data segmentation; data normalization; and data anomaly identification.
17. A personal training system comprising a personal training device and a control device, wherein: the personal training device comprises: an upper garment part and a trousers part both for wearing by a user; and plural sensor accommodating units distributed on the upper garment part and trousers part, plural sensors being installed in the sensor accommodating units such that an individual sensor accommodating unit is equipped with one or more of the sensors, wherein positions of the sensor accommodating units on the upper garment part and trousers part respectively correspond to locations of muscles of major muscle groups of the user such that the sensors, or electrodes thereof, of the sensor accommodating units are positioned on the corresponding muscle locations of the user when the user wears the personal training device, thereby allowing a posture of the user and a muscle activity of the main muscle groups to be monitored during the user doing an exercise; and the control device comprises: an input unit for receiving detected-signal data from sensors on the personal training device and inputting a user profile of a user of the personal training device; a database for storing the received detected-signal data and the user profile; a data preprocessing unit for cleaning and preprocessing the detected-signal data; a training analysis unit for executing an artificial intelligence algorithm to perform fatigue analysis on the user's movement and providing training load recommendations based on the user profile and the detected-signal data; and an output unit configured to output an estimated remaining number of repetitions of an exercise to be performed by the user, a training load suggestion given by the training analysis unit, or a number of repetitions of the exercise completed by the user.
18. The personal training system of claim 17 further comprising: a machine learning server for executing artificial intelligence algorithms for machine learning; an application server for storing one or more application programs of the control device, allowing the user to download the one or more application programs; and a database server for storing collected data, providing data to the artificial intelligence algorithm and supporting data analysis.
19. The personal training system of claim 17, wherein the sensors include surface electromyography sensors and inertial measurement unit sensors.
20. The personal training system according to claim 17, wherein the muscles of the major muscle groups include upper trapezius, triceps, erector spinae, biceps femoris, pectoralis major, biceps, rectus abdominis, and rectus femoris.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
[0065]
[0066]
[0067]
[0068]
[0069]
[0070]
[0071]
[0072]
[0073]
[0074] Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been depicted to scale.
DETAILED DESCRIPTION
[0075] As used herein, upper garment part means a clothing item, or a portion thereof, that is intended to be worn on a torso of a person. Examples of an upper garment part include a shirt, a sweater, a coat and a jacket, as well as an upper portion of a one-piece clinging garment that covers the person from his/her shoulder to ankles.
[0076] As used herein, trousers part means a clothing item, or a portion thereof, that is shaped like a pair of trousers and is intended to be worn below a waist of a person for covering at least a hip part of the person. Examples of a trousers part include a pair of trousers and a pair of shorts, as well as a lower portion of a one-piece clinging garment that covers the person from his/her shoulder to ankles.
[0077] Disclosed herein are a personal training device, a control device for processing data generated by the personal training device, and an AI-assisted personal training system that includes the personal training device and the control device.
[0078] The personal training device comprises an upper garment part, a trousers part, and plural sensor accommodating units. Both of the upper garment part and trousers part are used for wearing by a user. The sensor accommodating units are distributed on the upper garment part and trousers part. Plural sensors are installed in the sensor accommodating units such that an individual sensor accommodating unit is equipped with one or more of the sensors. Positions of the sensor accommodating units on the upper garment part and trousers part respectively correspond to locations of muscles of major muscle groups of the user such that the sensors, or electrodes thereof, of the sensor accommodating units are positioned on the corresponding muscle locations of the user when the user wears the personal training device. Thereby, it allows a posture of the user and a muscle activity of the main muscle groups to be monitored during the user doing an exercise.
[0079] The control device comprises an input unit, a database, a data preprocessing unit, a training analysis unit, and an output unit. The input unit is used for receiving detected-signal data from sensors on the personal training device and inputting a user profile of a user of the personal training device. The database is used for storing the received detected-signal data and the user profile. The data preprocessing unit is used for cleaning and preprocessing the detected-signal data. The training analysis unit is used for executing an artificial intelligence algorithm to perform fatigue analysis on the user's movement and providing training load recommendations based on the user profile and the detected-signal data. The output unit is configured to output an estimated remaining number of repetitions of an exercise to be performed by the user, a training load suggestion given by the training analysis unit, or a number of repetitions of the exercise completed by the user.
[0080] Specific embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.
[0081] The AI-assisted personal training system of the present invention may include the wearable personal training device, the control device, and a server.
[0082] The wearable personal training device may have the shape of a garment to facilitate donning and doffing by a user. For example, the wearable personal training device includes a top (or T-shirt) and shorts; alternatively, a plurality of straps, such as waist belts, shoulder straps, girdle straps, leggings, shin guards, etc., which can be interconnected for ease of use. The wearable personal training device includes a plurality of sensors, and the plurality of sensors can be respectively mounted on the wearable personal training device through, for example, pockets or Velcro, so that after the user wears the wearable personal training device, the, the plurality of sensors or their electrodes are respectively located at positions corresponding to different muscle parts of the user.
[0083] The control device may be implemented as a stand-alone hardware device, or as application software to be installed in a mobile phone or other portable communication device. Alternatively, the control device may be a computer program product installed in a computer with a Windows or iOS operating system. The control device may be wired to the sensor via a wire, or wirelessly connected to the sensor via WiFi or Bluetooth, or the like. When the user performs exercise or exercises after putting on the wearable personal training device, the control device can simultaneously monitor the user's posture and muscle activity during the exercise through the plurality of sensors. Preferably, the monitoring may be performed in real time. The AI algorithm module built into the control device evaluates the user's training performance based on the sensor data, and can provide real-time feedback and suggestions to the user through a GUI and/or audio feedback.
[0084] The servers may include machine learning servers, application servers, and database servers. The Inventors have developed a centralized database with multiple uses that can: store collected data; provide data to AI algorithms; and support data analysis. All data collected, used and processed are stored in a database. The data can include, for example, user credentials, training records, sEMG signal readings, and some personalization parameters optimized by AI algorithms.
[0085] The individual components of the AI-assisted personal training system of the present invention will be described in detail below with reference to the accompanying drawings.
[0086] The wearable personal training device of the present invention is based on AI-assisted sensors. One embodiment of the wearable personal training device may include a top 1 and a pair of shorts 2 (or trousers), as shown in
[0087] The top 1 and the shorts 2 each have a plurality of sensor accommodating units, such as pockets 3, to accommodate up to 16 sensors, and the installation positions of these sensors can respectively correspond to the skin of up to 16 different body parts. The tops and shorts may also be constructed as a one-piece garment comprising an upper garment part and a trousers part, or in other styles, such as multiple straps 4 for easy attachment and donning, with pockets, locks or Velcro Removably mounts the sensor and is easy to wear on the user. Alternatively, the sensor may be fixed to the personal training device rather than being detachable.
[0088] According to the invention, the personal training device is designed for the combination of sensors 5 to detect the muscle activity and body movement of the user by means of said sensors. The sensor may also be called an external sensing device, and is used to send or transmit the detected signal to an external device such as a control device. The personal training device can be designed to include men's and women's styles. See
[0089] Preferably, the personal training device is designed to be tight-fitting or skin-tight to ensure that the sensor mounted in the sensor accommodating unit 3 can be in close contact with the user's skin and that the sensor is on the skin when the user is exercising has the smallest displacement. Preferably, the personal training device can be designed as a short-sleeved t-shirt and shorts to provide maximum flexibility for the user to exercise and easily insert the sensor. There may be as many as 16 or more pockets on the personal training device, each for insertion of sensors.
[0090] The top 1 and shorts 2 of the personal training device may be made of, for example, nylon spandex fabric. For example, warp-knitted tricot fabrics have excellent stretch, providing a good fit and free body movement for fitness training, ensuring accurate and stable muscle activity and body movement detection. The fabric typically has good breathability and moisture absorption to maintain good thermophysiological and ergonomic wearing comfort when the sensor is mounted on the personal training device and the user is training.
[0091] The pockets used to accommodate the sensors are usually made of fabric that is elastic for easy insertion of the sensor and has see-through properties for monitoring the condition of the sensor. Warp-knitted powernet fabrics are an example of this requirement. Table 2 lists an example of fabric properties for suggested fabrics.
TABLE-US-00002 TABLE 2 Examples of fabric composition specifications for personal training devices of the present invention. Fabric Weight Type Construction Composition (g/m) Main fabric Warp knitted tricot 79% nylon, 180 21% Spandex Pocket Warp knitted powernet 74% nylon, 160 fabric (stretch mesh) 26% Spandex
[0092] The sEMG and inertial measurement unit (IMU) sensors on the personal training device of the present invention can be any sEMG sensor that meets the following specification requirements: (1) has a communication interface available; (2) is capable of acquiring sEMG signals at a sampling rate of >1000 Hz without notch filtering (3) capable of collecting 9-axis IMU data at a sampling rate of >200 Hz, including data from 3 accelerometers, 3 gyroscopes, and 3 magnetometers; (4) all sensor data are time-synchronized; (5)) The sensor is connected to a pair of disposable electrodes by wires, which can be between 3 and 5 inches in length. The personal training device of the present invention can use state of the art sEMG sensors, such as the Noraxon Ultium EMG sensor system, which includes a receiver and 16 wireless surface EMG sensors with an internal IMU.
[0093] The personal training device shown in
[0094] Regarding the position of the sensor accommodating unit relative to the body of the user who wears the personal training device, that is, the position of the above-mentioned sensor installed on the user's body, the Inventors have conducted long-term in-depth research and a large number of experiments, Finally, the sensor accommodating unit (that is, the sensor) is selected to be placed at the position corresponding to the above-mentioned eight pairs of muscles. The reasons mainly include: (1) The eight pairs of muscles are superficial layers that can be detected by sEMG; muscles, and (2) the eight pairs of muscles are the main muscle groups that are often trained in resistance training. Of the eight pairs of muscles, the biceps and triceps are responsible for flexion and extension of the elbow. The rectus femoris and biceps femoris are responsible for flexion and extension of the knee. The pectoralis major is responsible for flexion, adduction, and internal rotation of the arm. The rectus abdominis and erector spinae are very important postural muscles. The rectus abdominis controls trunk flexion, and the erector spinae extends and rotates the spine. The upper traps support the weight of the arms and stretch the neck. Another reason to choose a position that corresponds to the upper trapezius is that most people use it unintentionally when it should be relaxed. Therefore, according to the present invention, by placing the sensors at positions corresponding to these muscles, it is possible to more accurately detect the motion of the user and provide feedback to the user.
[0095] In contrast, the Hexoskin and Nadi X yoga pants listed in Table 1 do not measure muscle activity at all. Although the Athos training system can measure more muscles than the present invention, its performance analysis is completely different from that of the present invention. The Athos training system compares measured sEMG data, such as muscle activation levels, to reference values based on the target muscle being trained. For example, for a squat, the rectus femoris should reach 40% activation. The present invention further considers muscle fatigue by using variables in the frequency domain on top of the muscle activation level determined from the magnitude of the sEMG signal. Therefore, the detection results of the present invention are more reliable because the magnitude of the sEMG signal can be severely affected by the skin condition, especially in the presence of sweat, which is often the case when a user is exercising. Furthermore, the present invention uses a camera or camera to monitor the user's gestures and movements, improving the accuracy of motion detection compared to using wearable sensors alone.
[0096]
[0097] According to the present invention, the personal training device may comprise two types of pockets.
[0098] Type-1 designfor single sensor insertion.
[0099] Type-2 designfor dual sensor insertion.
[0100] Type-3 designfor single sensor insertion. It is actually a variant of the Type-1 design, which differs from the Type-1 design in that the mounting position and/or orientation of the electrodes 8 and the orientation of the linear openings 7 have been modified to suit different bodies or muscle areas. An example of a pocket design for a sensor for the pectoralis major is shown in
[0101] As shown in
[0102]
[0103] It is understood that the inner layer opening 6 and wire opening 7 are optional; different sensors 5 may require inner layer opening 6 and wire opening 7 of different shapes or sizes, or may not require inner layer opening 6 and wire opening 7. In addition, both the inner layer opening 6 and the wire opening 7 may be located in the inner layer of the pocket 3; alternatively, the inner layer opening 6 may be used as a wire opening, so that a separate wire opening 7 may not be required.
[0104]
[0105] In order to fix the position of the sensor during the movement of the user, the pocket 3 can generate sufficient tension or restraint force on the sensor 3 after the sensor 5 is inserted into the pocket 3. Thus, the size of the pocket may depend on the size of the sensor used.
[0106]
[0107] The opening 6 in the pocket 3 can be in common shape such as rectangle, circle, ellipse, square, etc., or the same shape as the sensor 5, so as to facilitate the manufacture and installation of the sensor 5. As shown in
[0108] One aspect of the important contribution of the personal training device of the present invention is the optimization of the positions of the various sensors on the personal training device, which are particularly advantageous for detection of specific movements or forms of exercise performed by the user.
[0109] For example, in order to detect the EMG signal of the target muscle, a pair of EMG electrodes must be mounted to the muscle belly position of the target muscle, and then connected to the EMG sensor through a pair of short wires. In order to collect more accurate and stable body part IMU data, the EMG sensor (where the IMU is located) is preferably placed parallel and/or perpendicular to the body part.
[0110] Preferably, the personal training device of the present invention allows for the simultaneous monitoring of 8 pairs of muscles in the user's body, which are the major muscle groups of the user's body.
[0111] The personal training device of the present invention can perform motion recognition and abnormality detection for the user when the user is exercising after wearing. In order to train major muscle groups, the present invention designs a whole-body resistance training program including 10 exercises.
[0112] Different exercise modes generate different muscle activation patterns for the user, and these exercise modes can be distinguished in the AI algorithm of the control device of the personal training system of the present invention, i.e, motion recognition. One of the goals of the AI algorithm is to identify the type of movement in real time. The AI algorithm can receive as input readings from 16 sEMG sensors, with or without camera feeds, and then use K-means (k-means) clustering to identify exercise patterns or exercise types. In addition to motion recognition, the algorithm is also able to deduce the current position of the user performing the motion and anomalies, such as incorrect or overuse of certain muscle groups and underuse of stabilizers (if any). A real-time warning is issued to the user if the abnormal situation may increase the risk of injury to the user. For exercises other than those shown in
[0113]
[0114] The control device of
[0115] (1) Signal Input Unit 1101
[0116] The signal input unit 1101 may receive signals input from, for example, 16 sEMG sensors, and compose time-series data from the signals reported by the sEMG. The input signals may be, for example, in the order of microvolts (V). The sEMG sensor may be the aforementioned sensor 5 located on the personal training device worn by the user. The signal input unit 1101 may be coupled to the sEMG sensor wirelessly or wired. For example, the signal input unit 1101 may receive sEMG and IMU data collected by each sensor (e.g., the sensor 5 as described above) as shown in
[0117] In addition, the signal input unit 1101 may also receive information about the user or user data, such as the user's gender, weight, height, BMI (Body Mass Index), body fat ratio, muscle mass, and exercise selected by the user to be performed, exercise type, etc. Such information or data can be inputted in a prescribed or predetermined format, and can even be directly inputted into the first deep neural network unit 1103 for further processing.
[0118] (2) Signal Preprocessing Unit 1102
[0119] The signal input unit 1101 transmits the input data to the signal preprocessing unit 1102 for preprocessing to form data in a predetermined format, which is then supplied to other units (for example, the first deep neural network unit 1103 or the second deep neural network unit 1105) for further use. For example, the raw sEMG and IMU data imported from the signal input unit 1101 are cleaned and preprocessed by the signal preprocessing unit 1102. The preprocessing may include (but is not limited to): (1) bandpass, highpass and/or lowpass filtering; (2) rms/moving average/mean absolute/median frequency calculations; (3) data segmentationwhich can be done by repetition; (4) data normalization; and (5) data anomaly identification.
[0120] (3) The First Deep Neural Network Unit 1103
[0121] The signal preprocessing unit 1102 first transmits the preprocessed data to the first deep neural network unit 1103. The first deep neural network unit 1103 is used for executing the AI algorithm of the present invention to perform fatigue analysis on the user's movement, and to estimate the remaining number of repetitions that the user can do according to the current muscle activation signal.
[0122] One of the goals of the AI algorithm of the control device is to identify the type of movement in real time. The AI algorithm can receive as input the readings of the 16 sEMG sensors from the signal input unit 1101 (which may or may not be fed with the camera input unit 110), and then use K-means (k-means) clustering to identify the exercise style or type of exercise. In addition to the recognition of the type of exercise, the AI algorithm can also use the first deep neural network unit 1103 to deduce the current position and abnormal situation of the user's exercise, such as the incorrect or overuse of certain muscle groups and the stability of the Inadequate muscle use (if any). A real-time warning is issued to the user if the abnormal situation may increase the risk of injury to the user.
[0123] (4) The First Output Unit 1104
[0124] The first output unit 1104 represents the estimated number of repetitions remaining, which is an estimate of the number of repetitions the user can complete after the current repetition. It is a positive integer, such as 6, which means the user can perform 6 more repetitions.
[0125] (5) The Second Deep Neural Network Unit 1105
[0126] The second deep neural network unit 1105 obtains the processed signal data from signal preprocessing, and obtains the output from the first output unit 1104. The second deep neural network unit is responsible for executing the AI algorithm of the present invention, suggesting to the user the optimal training load (e.g., in kilograms) based on the current muscle activation signal and the estimated number of remaining repetitions. For example, regardless of the weight of the current training load, its output could be, for example, 20 kg.
[0127] The suggested training load should ideally allow the user to complete the training set with the number of repetitions defined by the training plan of the present invention, and not perform fewer or more repetitions. The recommendations are updated after each training set, so the user is expected to change the training load between training sets if the optimal load is different.
[0128] (6) Second Output Unit 1106
[0129] The second output unit 1106 represents the user's optimal training load. The recommended training load is expressed in kilograms (kg), and the output for the example is 20 kg. The second output unit 1106 is only updated between training sets.
[0130] (7) Camera Input Unit 1107
[0131] The camera input unit 1107 represents a video input from the camera. The camera is used to capture the actions of the user, and the user should keep his body in the picture of the camera when performing training.
[0132] (8) Posture Detection Model Unit 1108
[0133] The output of the camera input unit 1107 is passed to the gesture detection model unit 1108, which receives the user body signal detected from the camera input unit 1107 and generates a body marker based on the user body signal. The gesture detection model unit 1108 may, for example, take a 3-dimensional vector (x, y, z) to output a total of 33 body markers.
[0134] (9) Machine Learning Pose Classifier 1109
[0135] The machine learning gesture classifier 1109 calculates an 18-dimensional vector (feature vector) from the human body markers output by the gesture detection model unit 1108 to represent the exercise item and the movement state that the user is performing. The vectors can be respectively shown in Table 3 below.
TABLE-US-00003 TABLE 3 Vectors representing pose classification. No. Name Description 0 Left Arm Curl The distance between the left wrist and the left shoulder. 1 Right arm curl between the right wrist and the right shoulder. 2 Left Elbow Lateral The distance between the left elbow Distance and the left hip. 3 Right Elbow Lateral The distance between the right elbow Distance and the right hip 4 Left Arm Side Raise The distance between the left wrist and the left hip. 5 Right arm lateral raise The distance between the right wrist and the left hip. 6 Elbow Distance The distance between two elbows. 7 Wrist Distance The distance between the two wrists. 8 Left Leg Curl Distance between left hip and left ankle. 9 Right Leg Curl Distance between right hip and right ankle. 10 Knee Distance The distance between two knees. 11 Ankle Distance The distance between two ankles. 12 Left Abs Crunches The distance between the left shoulder and the left knee. 13 Right Abs Crunches The distance between the right shoulder and the right knee. 14 Left Elbow Knee The distance between the left elbow and the left knee. 15 Right Elbow Knee The distance between the right elbow and the right knee. 16 Left Wrist Knee The distance between the left wrist and the left knee. 17 Right Wrist Knee The distance between the right wrist and the right knee.
[0136] Note that the number of vectors can be changed to suit the training style or sport the user is using.
[0137] The machine learning gesture classifier 1109 classifies the user's gestures by using the K-nearest neighbor algorithm based on the feature vectors calculated from the human body markers output from the gesture detection model unit 1108. The machine learning gesture classifier 1109 also calculates the number of repetitions that the user needs to continue to perform training by observing the probability of the user training. For example, if you need to count the number of repetitions a user does a bicep curl, the algorithm looks at the probability of a bicep curl (up) and a bicep curl (down). If the probability of biceps curling (downward) exceeds 80%, the algorithm marks the biceps curling as starting. When the probability of a biceps curl (up) exceeds 80% and the biceps curl is marked as started, the algorithm should mark it as done and increment the repetition counter.
[0138] (10) The Third Output Unit 1110
[0139] The third output unit 1110 displays the number of repetitions of the exercise program completed by the user. The number of repetitions of the exercise program performed by the user is a positive integer, such as 8 times.
[0140]
[0141] Similarly, the second deep neural network unit 1105 can also be formed by, for example, a deep convolutional neural network, respectively, using the AI algorithm of the present invention to suggest an optimal training load to the user according to the current muscle activation signal and the estimated number of remaining repetitions, and the user's optimal training load is given through the second output unit 1106.
[0142] In addition, the machine learning posture classifier 1109 uses the AI algorithm of the present invention to calculate an 18-dimensional vector (feature vector) from the human body markers output from the posture detection model unit 1108 to represent the user's ongoing exercise program and exercise state.
[0143] One of the main functions of the machine learning based control device of the present invention is to identify muscle fatigue and thereby suggest optimal training loads for the user. The output of the fatigue analysis is real-time identification of muscle fatigue during resistance training, providing scientific evidence for recommending optimal training loads to the user in the next step.
[0144] The personal training system of the present invention may also include a database of user and sensor signals. The database can be contained in the control device or as a separate database, e.g., in a database server.
[0145] The Inventors have developed a centralized database with various uses, see
[0146] The training software 1304 may be an application program corresponding to the AI fitness training system 1111 of
[0147] In addition, the control device of the personal training system of the present invention can also have a coaching module, which can have a GUI and can provide audio feedback, the GUI of the coaching module can be seen in
[0148] The GUI allows the user to view all necessary information when performing a resistance training exercise using the personal training device of the present invention. For example, the information may include: (1) current date and time, total training time; (2) workout name included in the current exercise routine, including sets and repetitions, suggested training load; (3) real-time muscle activation level; (4) sensor status; (5) live camera viewer; (6) tutorial video.
[0149] The user's real-time muscle activation levels and sensor conditions during exercise can be displayed on a color-coded muscle map. If the control device detects any abnormal condition, a warning will be displayed through the GUI. If a camera is connected to the control, the user can also use the viewer window to check their posture and form.
[0150]
[0151]
[0152] The Inventors have spent a lot of time in developing the above-mentioned software for the sensor-equipped personal training device and the AI algorithm of the control device. Therefore, the contributing features of the personal training device of the present invention include: the structural design of the sensor pocket to ensure stable skin contact; the optimization of the position where the sensor is inserted into the pocket; the ability of optimizing separately; making samples of various styles, and conducting wearing tests on each subject to find out design deficiencies and wearing difficulties; grading patterns suitable for men's clothing and women's clothing.
[0153] The development of AI algorithm software includes: designing and developing AI algorithms to provide more accurate biofeedback and prediction, collecting data for each subject on a six-week fitness training program, training neural networks, calculating K-means The centroids for each exercise of the clustering algorithm, integrating the neural network into the training software system.
[0154] As mentioned above, the essential or core features of the present invention include: (1) AI algorithms, including motion recognition algorithms, motion anomaly detection algorithms, and training load recommendation algorithms; (2) personal training devices with wireless sensor interfaces, including sensor pockets and opening design and optimized sensor position. The personal training system of the present invention can solve the following problems: provide a scientific and objective measure of muscle fatigue, rather than a subjective score, during the user's exercise; evaluate exercise form and muscle utilization patterns; minimize risk; and measure and display muscle activation levels during exercise in a user-friendly way.
[0155] Therefore, the personal training system of the present invention is capable of measuring and evaluating the muscle activity of the user's major muscle groups, which is not available in other current wearable technologies. The personal training device of the present invention includes garments that allow for easy installation of sensors, which is critical for ordinary users who are less familiar with muscle anatomy. The present invention can be configured to evaluate some of the most common resistance training exercises requiring only dumbbells, without the need for large exercise equipment. The present invention provides users with reliable and real-time feedback on their exercise performance, especially correctness of form and movement, muscle utilization patterns, which are not available in any prior art systems on the market. For example, the corresponding relationship between the contributing technical features of the present invention and the corresponding technical advantages is shown in Table 4 below.
TABLE-US-00004 TABLE 4 Technical features of the present invention and corresponding technical effects. Features of the Personal Training Device Advantages Derived from of the Invention the Features Using sEMG technology; an algorithm Measure muscle activity in a configured to calibrate sensor data. user-friendly way Measure muscle activity in a user- friendly way Tight-fitting garment design, pocket Simple sensor handling and design. connection Proven AI algorithms are developed Reliable evaluation and real-time based on a large amount of reliable feedback experimental data.
[0156] By collecting more experimental data to expand the training data set of the AI algorithm, the personal training device of the present invention can further improve the accuracy of the prediction result, verify the prediction result of the AI algorithm through experiments, and further develop the algorithm in the control device, includes motion recognition algorithms and muscle fatigue detection algorithms, visual and auditory feedback in the coaching module.
[0157] For example, an application scenario of the personal training system of the present invention may include an AI-assisted training device for resistance training. Moreover, the system architecture and characteristics of the clothing design of the personal training device of the present invention can be applied to other smart wearable technologies, smart wearable devices of advanced or professional training devices requiring real-time biofeedback, and other textile products.
[0158] While the present invention has been described in detail in connection with limited embodiments, it is to be understood that the invention is not limited to these disclosed embodiments. Those of ordinary skill in the art can devise other embodiments that are within the spirit and scope of the present invention, including variations, modifications, substitutions, or equivalent arrangements of parts, all of which fall within the scope of the present invention.