SYSTEM AND METHOD FOR PROVIDING AUGMENTED REALITY INFORMATION AND SPORTS PERFORMANCE DATA OVER A WIRELESS NETWORK
20210370133 · 2021-12-02
Inventors
Cpc classification
A63B2024/0009
HUMAN NECESSITIES
A63F13/65
HUMAN NECESSITIES
A63B24/0006
HUMAN NECESSITIES
A63B2024/0025
HUMAN NECESSITIES
A63F13/798
HUMAN NECESSITIES
A63B2024/0068
HUMAN NECESSITIES
A63F13/21
HUMAN NECESSITIES
A63B24/0062
HUMAN NECESSITIES
International classification
A63B24/00
HUMAN NECESSITIES
Abstract
The present invention discloses a method and system for providing sports performance data and motion data to a user. The system comprises a wireless device with a memory unit, a communication unit, and a data processing unit. The memory unit comprises a database having a plurality of pre-programmed inputs. The communication unit comprises a location identifying device for determining the location of a user. The data processing unit comprises a sensing module with sensors to measure and determine the movement of the users in accordance with sports which is then compared with a competitor over the network. A comparing module, via a processor and communication unit, receives and compares sports performance data of the users. A ranking module, via the processor calculates and ranks a user performance in a single competition or a variety of competition and provides ranking based on the common inputs received and the calculated performance obtained.
Claims
1. A system for providing sports performance and motion data of a user, the system comprising: a processor having an integrated memory unit and configured to collect and compare the following: a plurality of user input corresponding to a specific sport and a user's performance, the memory unit comprising a database with one or more performance data of the user; a communication unit comprising a location identifying device for determining the actual location of the users; a data processing unit comprising: a sensing module comprising one or more sensors to measure and determine the movement of the users in accordance to the required performance data of the sports; a comparing module to receive, via a processor and the communication unit, sports performance data of one or more other users to compare the sports performance data; a ranking module to calculate and rank the users in accordance to the received compared data from the comparing module; and an output module configured to display the rank, thereby providing the sports performance data to the users.
2. The system of claim 1, wherein activity performance data is gamified and displayed via a graphical user interface.
3. The system of claim 2, wherein gamification occurs in real-time in relation to the first user.
4. The system of claim 3, further comprising at least one device sensor in analytical communication with an activity-associated device, wherein the at least one device sensor transmits device data to the data processing unit.
5. The system of claim 4, wherein performance data is aggregated from a plurality of users within a community via the database.
6. The system of claim 5, further comprising a plurality of auxiliary devices each in analytical communication with at least one secondary activity-related device, wherein the plurality of auxiliary devices transmits performance data to the processing unit.
7. The system of claim 6, further comprising a camera, wherein the camera is used to capture the user's performance data.
8. The system of claim 7, wherein a personal electronic device is utilized to capture activity performance data.
9. The system of claim 8, further comprising an augmented or a virtual reality device in communication with the data processing unit.
10. A method of implementing an activity performance data system, the method comprising: identifying the location of the user's device for determination the actual location of the users by a communication module; measuring and determining the movement of the users using a sensing module; receiving sports performance data of one or more users using a communication module; comparing the sports performance data using a comparing module; ranking the user's sports performance from received compared data using a ranking module; and displaying the rank using an output module thereby providing a competitive sports performance data to the users.
11. The method of claim 10, further comprising: a processor having an integrated memory unit and configured to collect and compare a plurality of user input corresponding to a specific sport and a user's activity performance; a database with one or more activity performance data related to each user; a communication unit including a location identifying device for determining the actual location of each user; a data processing unit comprising at least one of the following: a sensing module in communication with one or more sensors to measure and determine the movement of the users in accordance to the required performance data of a particular activity; a comparing module to compare, via the processor, the activity performance data; a ranking module to calculate and rank, via the processor, the users in accordance to the received compared data from the comparing module; and an output module configured to display the rank, thereby providing a competitive activity performance data to the users.
12. The method of claim 11, further comprising at least one device sensor mounted to an activity-associated device, wherein at least one device sensor transmits performance data to the data processing unit.
13. The method of claim 12, further comprising a plurality of auxiliary devices each in analytical communication with at least one secondary activity-related device, wherein the plurality of auxiliary devices transmits performance data to the processing unit.
14. The method of claim 13, further comprising a camera, wherein the camera tracks the user's activity performance.
15. The method of claim 14, further comprising an augmented or virtual reality device in communication with the data processing unit.
16. The method of claim 15, wherein the output module is configured to display the rank of each user on a graphical user interface, wherein the output module utilizes a wireless network.
17. The method of claim 16, wherein the performance data is aggregated from a plurality of users within a community.
18. The method of claim 17, wherein a personal electronic device is utilized to capture the performance data.
19. The method of claim 18, wherein the plurality of users communicates and compete against one another in a common activity, via the wireless network.
20. A system for providing the gamification of an activity performance and motion data by combining real activities, augmented reality, virtual reality and video game features, the system comprising: a processor having an integrated memory unit and configured to collect and compare a plurality of user input corresponding to a pre-determined sport and a user's performance during the pre-determined sport; a database with one or more activity performance data related to each user; a communication unit including a location identifying device for determining the actual location of at least a first player and at least a second player; a data processing unit comprising at least one of the following: a sensing module in communication with one or more sensors to measure and determine the movement of the users in accordance to the required performance data of a particular activity; a comparing module to compare, via the processor, the activity performance data; a ranking module to calculate a rank, via the processor, of each of the users in accordance to the received compared data from the comparing module; and an output module configured to display the rank of each of the users, thereby providing a competitive activity performance data to the users.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0021] A more complete understanding of the present invention, and the advantages and features thereof, will be more readily understood by reference to the following detailed description when considered in conjunction with the accompanying drawings wherein:
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
DETAILED DESCRIPTION
[0030] The specific details of the single embodiment or variety of embodiments described herein are to the described system and methods of use. Any specific details of the embodiments are used for demonstration purposes only and not unnecessary limitations or inferences are to be understood therefrom.
[0031] Any reference to “invention” within this document is a reference to an embodiment of a family of inventions, with no single embodiment including features that are necessarily included in all embodiments, unless otherwise stated. Furthermore, although there may be references to “advantage's” provided by some embodiments, other embodiments may not include those same advantages, or may include different advantages. Any advantages described herein are not to be construed as limiting to any of the claims.
[0032] Before describing in detail exemplary embodiments, it is noted that the embodiments reside primarily in combinations of components related to the system. Accordingly, the system components have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present disclosure so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.
[0033] As used herein, relational terms, such as “first” and “second” and the like, may be used solely to distinguish one entity or element from another entity or element without necessarily requiring or implying any physical or logical relationship or order between such entities or elements.
[0034] In general, the invention described herein relates to a portable wireless device application that is enhanced by a portable mobile augmented reality device and motion tracking devices such as a smartwatch or smart sports equipment. The application permits a first user to engage with any number of remote users. At least one user can utilize the augmented reality device and compete against other users either in real-time, or as a pre-recorded, or pre-analyzed sporting event. This application can allow virtual teams to compete against other virtual teams from different locations. For example, a team of family members could water ski against another family team skiing on another lake somewhere else. Also, a team of kids from camp could compete virtually against another kids camps in a different country. High School players can compete against their rival school while both teams of players are playing on their home campus saving schools money and bringing back competition to schools that have eliminated school sports due to costs.
[0035] The embodiments disclose a system of providing real-world sports performances into a network ecosystem and economy. This system of digitizing sports action will allow new ways to measure, compare and compete in sports, allowing for entirely new sports games to be created by the system or by players from these unique digital patterns. In some embodiments, the system will gamify sports play by making real-world sports performances feel like users are interacting with a video game by uniquely combining augmented reality, advanced sports motion data tracking, and video game characteristics. Users will be able to have a real-world sports competition experiences while playing in separate locations and time frames using augmented reality to map the playing field and add the goal, target or object of the game to the players world virtually.
[0036] In an embodiment, a water skier can use the app to find a water skier who is able to ski against them while they are in two different locations and the scoring system will be able to equalize/handicap the competition based on weather or other condition.
[0037] In another embodiment, users can create fantasy teams from data and statistic from pro sports play combine this with the real-sports action of individual players of any level of experience in in a single or a variety of sports.
[0038] In another embodiment, the application will include a virtual sports coach. This virtual coach will be able to establish goals and encourage the user to reach their next milestone. The application will be smart through machine learning and able to give real-time coaching feedback using artificial intelligence. The application will also enable the user to communicate with a real coach via SMS or video chat to receive feedback and encouragement.
[0039] In another embodiment, the system of multiplayer and multisport connectiveness allows for connecting coaches to players for virtual coaching sessions in real-time. This provides users with access to real-time coaching while allowing coaches to continue to provide a service from a remote location. This may be especially useful for coaches and athlete to interact remotely when in-person interactions are note permitted or are not possible. The system will allow the everyday athlete to access elite coaching and reduce the cost of receiving coaching through a demand cost and rating system. The system may also facilitate shortening the timeframe to access a number of coaches. Connecting real-time coaching to real-time video and sports motion data capture provides instant access of information to the player that is training or competing and the advances sports motion data enhances the assessment capabilities of the coach.
[0040] The system will connect millions of users into a virtual collaborative sports league, allowing for players of various skill level to compete including: amateur competition, pro competition, fantasy teams and wagering on hundreds of sports that are not currently possible due to both location, access to the athletes and accuracy of data collection.
[0041] Currently, the only sports wagering at this time is available on professional and mainstream sports play. For example, a person cannot wager on a women's bobsled team while they are training in Alaska on their home course. No one can currently wager from their desk on a professional water ski tournament on a lake in another state.
[0042] In yet another example, virtual tournaments or events can be set up in order that this application would allow wagering, for example a virtual fishing tournament. A fan can challenge two fishermen to a duel. These two fishermen can be anywhere in separate locations sending in their video and motion data of their catch and a virtual tournament would occur, while a third player/fan could bet/wager on the outcome of the virtual sports duel. The artificial intelligent judge of the data would determine the winner.
[0043] Further, the system allows for the gamification of real sports play while letting players compete with anyone, anywhere at any time. The application includes player interaction of real athletes in motion with virtual or augmented reality athletic play and/or video game play. For example, a kid could be shooting a free throw shot at home using AR goggles with a virtual basketball hoop and a ball with smart tracking device competing in real time directly against a player in a real basketball game such as a player at the NBA finals who is also shooting a free throw; meanwhile fans in the stands wager on the outcome of this virtual match play while all of this virtual play is behind the scenes not interfering with the normal game play action. The system will create the largest sports motion data collection system which will feed a machine learning and artificial intelligence algorithm that can be further be used for creating more complex competition, judging, unique mixing of level of players and a variety of sports and instruction.
[0044] In some embodiments, the system will eliminate the need for subjective judging for sports competition. This system to track advanced motion data of an athlete and compute that data into a scoring system will allow for accurate comparison. This system of advanced motion data collection will allow real judges to be replaced, especially subjective judging in sports like surfing, gymnastics and wakeboarding. For example, this system will allow a gymnast wearing smart fabric to feed all their body motions and advanced sport motion data to the system where it can be comparing an analyzed through AI, giving the athlete an objective score, a real perfect 10 for one or more sports motion data criteria in one performance.
[0045] In some embodiments, the system of measuring and gamifying the individual functions of team sports allowing new ways to compete. A system of capturing sports motion data of individual players in impact sports allows for competition without impact, potentially reversing the decline of interest in football, soccer, boxing, and the like due to fear of head trauma. Sports competition based on individual athlete play captured virtually allows for competition without impact. For example, the system will allow two boxers in different locations to compete in boxing based on specific patterns of training, speed of punches, movement of feet, strategy and the power of punch using a smart glove in operable communication with the system. The same system could be used for competition in football kicking and passing. This system solves important problem's facing impact sports.
[0046]
[0047] According to an embodiment, the data processing unit 108 comprises one or more modules and may include a microprocessor or microcontroller. The data processing system 108 includes at least one sensor 114, a comparing module 116, a ranking module 118 and an output module 120. At least one sensor, (video analytics is included as a sensor) is used to track and coordinate a user's movement and in real-time in accordance to the required performance data of the sports. The comparing module 116, via a processor and the communication unit 106 receives sports performance and motion data of one or more other users, to compare the sports performance and motion data of the user. The ranking module 118, via the processor calculates and ranks the users in accordance to the received compared data from the comparing module 116. The output module 120 is configured to display the rank, thereby providing a competitive sports performance experience to the user.
[0048] In some embodiments, the system tracks advanced motion data of an athlete and computes that data into a scoring system that allows for extremely accurate comparison. The increased accuracy of the data capture using smart products or fabrics combined with artificial intelligent will allow for wagering on individual sports and non-professional sports, even when players are in different locations and/or at different times.
[0049] The user's device 102 and processor are configured to collect and store a plurality of sports-related input such as motion data, range of motion, and speed and/or acceleration, and GPS location. The data processing unit 108 serves to execute instructions for software that may be loaded into the memory unit 104. The data processing unit 108 may be a number of processors, a multi-processor core, or some other type of processor, depending on the particular implementation. Further, the data processing unit 108 may be implemented using a number of heterogeneous processor systems in which a main processor is present with secondary processors on a single chip. As another illustrative example, the data processing unit 108 may be a symmetric multi-processor system containing multiple processors of the same type. The user's physical sport movement is tracked and analyzed for updating skills data and competitive rank for the user.
[0050] According to an embodiment, the data processing unit 108 determines a physical sport movement recommendation based on a sport being played and skills data for the user based on the sport being played, and one or more objects in a sport performance area in which the user is playing. The one or more processors control user 1 device display for displaying the virtual data for assisting the user in performing the physical sport movement recommendation from a user perspective associated with the display field of view. For example, when competing in match play in golf, two different users could play head-to-head on the same course while being in two separate geographic locations. The augmented reality data is configured to adjust the dimensions of the field to accommodate the sport and number of participants.
[0051] According to an embodiment, the sensing module 114 of the data processing unit 108 having one or more sensors directly, or over a communication network, measure and determine the movement of the users for the particular sports. Some examples of the sensors include video sensors, accelerometers, altimeters, GPS systems, depth image sensors, heat sensors, IR sensors, weight sensors, motion sensors, etc. In this example, the respective sensors are used to track the user movements and provide instant feedback through the processor in comparison to the received inputs of their competitor and provide a score and ranking (i.e., virtual leaderboard).
[0052] According to one embodiment, the comparing module 116 includes the data which is compiled from details of the predetermined game with the details having comparison information with the other user 2 device, user 3 device, user 4 device . . . user N devices. The comparing module 116 receives the data from the sensing module 114 regarding the user performance data. All the received data is compared with preset/user configured standards for comparing the user's performance. Also, users could select the game from a list of games and user information is provided in the system 100 to be stored in the memory unit 104. Data stored in the database 110 include reference data for one or more physical sport movements associated with the sport, and execution criteria for one or more associated movements. The comparing module 116 compares the data of user with other performers to rate the user, and/or the score against predetermined data sets for each sport, motivating the user to compete again virtually in the sport.
[0053] According to another preferred embodiment, the ranking module 118 calculates a score for each available physical sport movement based on the respective sport objective score and the user's execution score, or the environmental conditions score. For example, in some pre-determined sports, the ranking is calculated based on the user's body movement within the augmented virtual reality game. In one embodiment, sensing module tracks performance of pre-determined locations on the user's anatomy as commonly known and employed in the match moving arts.
[0054] According to a preferred embodiment the output module 120 displays the user's ranking based on set performance criteria stored in the memory unit 104. The user may be synchronized and ranked based on their location, gender, age, height, weight, and skill level. For example, families can compete against other families, players from a state or country against each other, by collecting all the scores of the user from various groups. Also, the augmented reality features are displayed via the output module 120, by the user field of view. User motion, and path of motion of a virtual sport object may also be displayed in the output module 120.
[0055] According to the preferred embodiment, the memory unit 104 includes a memory bus with memory controller, a peripheral bus, and a local bus. The memory includes read-only memory (“ROM”) and random-access memory (“RAM”). Program modules can be stored in the memory unit 104 including one or more application programs, other programs or modules, drivers and program data. The database 110 may include a repository for storing information and include a rule engine for each sport which accesses one or more rules corresponding to a pre-determined sport. Standard parameters are stored in the database 110. Data stored in the databases 110 include reference data for one or more physical sport movements associated with the pre-determined sport and execution criteria for the one or more associated movements. Also, the database 110 stores object properties for predetermined visual guides or previously generated visual guides and rule logic.
[0056] According to one embodiment, the communication unit 106 is configured to communicate with other devices either wired or wirelessly (for e.g., WiFi, Bluetooth, infrared, an infrared personal area network, RFID transmission, wireless Universal Serial Bus (WUSB), cellular, 3G, 4G or other wireless communication means) over one or more communication networks whether located nearby or at a remote location. The communication unit 106 having the location identifying device 112 stores location data for identifying the user location such as GPS data. Also, the location identifying device 112 with one or more GPS tracked proximate objects in the location from which other relative positions of real and virtual objects can be identified. Additionally, an IP address of a WiFi hotspot or cellular station to which the user 1 device 102 has a connection can identify a location. Additionally, identifier tokens may be exchanged on a device 102 via infrared, Bluetooth, or WUSB.
[0057] In an embodiment, the system comprises a wireless device having a memory unit, a communication unit, and a data processing unit. The memory unit may comprise a database with one or more sports related data, one or more skillsets required for measuring the performance of the user, and one or more performance data of the users. In one embodiment, the communication unit comprises a location identifying device (such as a GPS) for determining the actual location of the users which may be related to geographical information corresponding to the users location. In an embodiment, the data processing unit comprises one or more modules. The one or more modules are sensing modules, comparing modules, ranking modules, and output modules. The sensing module comprises one or more sensors to measure and determine the movement of the users in accordance to the required skill to be performed, and performance data of the preferred sports or activity. The comparing module, via a processor and communication unit, receives sports performance data of one or more other users to compare the sports performance data with user's sports performance data. The ranking module, calculates and ranks the users in accordance to the received compared data from the comparing module. The output module is configured to display the rank with respect to the user performance data, thereby motivating the user to keep interacting with the system and competing.
[0058] According to the preferred embodiment, the user 1 device 102 is an augmented reality eyewear such as a near-eye augmented reality (AR) display. Virtual data is collected using the near-eye augmented reality (AR) display of the eyewear. Using the augmented reality eyewear, the goal, buoy, or other obstacle is visible through the eyewear. For example, in water skiing game, the user may view the slalom course over the water including the buoys. In golf, the golfer can play a hole of golf anywhere with visible yardage markers. A hunter can see virtual game/animals/targets to shoot and the relevant distance and winds.
[0059] According to
[0060] According to a further embodiment, the user can locate a competitor within the pre-determined sport for head-to-head competition. Alternatively, the system 100 may be used as training aid with an assigned coach or trainer who may implement a variety of workouts or drills to improve user performance and receive real-time feedback.
[0061] The system will capture the advanced sports motion data of multiple users allowing for real-time match play, team play of players not in the same location, fantasy team play of amateur and professionals on the same teams, wagering on new games and new sports, and new ways to judge and officiate sports. The system may include a means for recommending sport equipment adjustments and similar coaching information using machine learning and AI and a way to collect, value and store a lifetime of sports action digitally.
[0062] According to alternative embodiment, the system 100 captures sports performance data from a user and measures it against a set standard for purpose of attaining a sports score for competing against other players. Enhanced sports play could be achieved using augmented reality eyewear to show the user the obstacle or objects of the sports involved. The system 100 reduces the cost of travel and entry fees associated with traditional physical competitions. Users could be inspired to practice their sport or activity more often by having continuous data and feedback. The system 100 overcomes obstacles and barriers to entry that prevent more people from participating in sports by taking away the need to be in a specific location with required equipment. The system 100 motivates the user to achieve a high level of skill set by setting goals, measuring results and being inspired by competing with other players.
[0063] In some embodiments, the ranking module 118 corresponds a value to the user and to the users performances such that the user may be rewarded with a fiat currency, points, credits, or similar incentives for performing well in a sport activity. The system may motivate sports play by using operant conditioning through a variable reward system much like a video game or a slot machine. The system uniquely motivates sharing and viral growth by using a multi-level reward system for players, fans and businesses to share the application and encourage use.
[0064] The term “activity” can relate to any measurable activity that is engaged in by the users of the present invention. Examples herein include waterskiing and golf, however, it is understood that a multitude of activities can be measured, scored, and gamified over a network. Such activities can include, but are not limited to; downhill skiing, fishing, basketball, baseball, football, disc golf, surfing, wakeboarding, hunting, soccer, volleyball and most any other physical activity known.
[0065] Now referring to
[0066] A leaderboard 400 is illustrated in
[0067] In one embodiment, sensors 114 may include a handheld camera, a mounted camera, or similar video capturing device. The user may select from a menu to indicate which sensor 114 they intend to use to capture performance data 501. Optical recognition is utilized to determine how well the user executed the activity. In one example, the user engages with a waterski course while a handheld camera captures the execution thereof. A plurality of metrics, including but not limited to, speed of the user, turn initiation, acceleration, turn execution, distance, and other relevant metrics are captured using the handheld camera. Further, additional sensors may be utilized such as sensors positioned on the body of the user, on a towing device, or mounted on the waterski. These sensors may include any sensor relevant in the arts such as an accelerometer, GPS, timer, or similarly useful application.
[0068] In an embodiment, the user may target data to provide the comparing module 116 and ranking module 118 with an optimal set of performance data to achieve the highest score for a particular trial.
[0069] It is a goal of each sensor to characterize the motion of the user in a given activity. This can be accomplished in a plurality of ways including optical recognition of the user's movements, capturing data from sensors in communication with the user and/or devices utilized by the user, as well as objective data known in the arts. Performance data captured can be compared to previously stored performance data from a plurality of users who have previously engaged with the ecosystem. It is a goal of the system 100 to provide high-quality unbiased performance data. This is especially valuable in activities which currently rely on analysis from judges such as surfing and figure skating. It is also a goal to provide gamification of pre-determined sports in a variety of locations. For example, the system will allow a user to compete in a virtual golf match from any location without having to travel to a golf course or driving range.
[0070] The use of a camera with optical sensors can be useful in an activity wherein the motion of the user is generally irregular or unpredictable. This can include activities such as biking, surfing, snowboarding, skiing, skateboarding, and where scored are objectively measured. The camera, in addition to a plurality of sensors can be utilized to better analyze, compare, and rank a performance in the pre-determined sports from the user's performed movements.
[0071] In reference to
[0072]
[0073] It is a goal of the present invention to not only gamify pre-determined sports or activities, but to also allow the interaction between a plurality of users 808 in real-time. In this manner, ratings, metrics, scores, and other content can be displayed to each of the user utilizing the network 101 connected device 102.
[0074] Many different embodiments have been disclosed herein, in connection with the above description and the drawings. It will be understood that it would be unduly repetitious and obfuscating to literally describe and illustrate every combination and subcombination of these embodiments. Accordingly, all embodiments can be combined in any way and/or combination, and the present specification, including the drawings, shall be construed to constitute a complete written description of all combinations and subcombinations of the embodiments described herein, and of the manner and process of making and using them, and shall support claims to any such combination or subcombination.
[0075] It will be appreciated by persons skilled in the art that the present embodiment is not limited to what has been particularly shown and described hereinabove. A variety of modifications and variations are possible in light of the above teachings without departing from the following claims.