Video game controller using core muscles and other applications
10406434 ยท 2019-09-10
Assignee
Inventors
Cpc classification
G16H20/30
PHYSICS
A63F13/212
HUMAN NECESSITIES
A63F13/428
HUMAN NECESSITIES
G06F3/011
PHYSICS
A63F13/211
HUMAN NECESSITIES
A63B2024/0096
HUMAN NECESSITIES
A63F13/42
HUMAN NECESSITIES
A63B2225/50
HUMAN NECESSITIES
International classification
A63F13/428
HUMAN NECESSITIES
A63F13/211
HUMAN NECESSITIES
Abstract
A wearable device has a core contraction sensor and a movement sensor which transmits signals to a processor which analyzes the signals and uses the data to control aspects of a video game. The core contraction signal may determine if the user's core is contracted or relaxed. A video game may be used with the wearable device to encourage usage of the core muscles with the player getting points or rewards for engaging their core muscles and properly timing the engagement of the core muscles with body movements. The wearable device may be used in place of, or together with conventional video game control devices. Developing the habit of using the core muscles during may be beneficial in back pain rehab and prevention, fitness training and wellness, athletic performance improvement, and reducing workplace injuries in occupations involving heavy lifting.
Claims
1. A method for improvement of core muscles based support, comprising: providing a core muscle contraction sensor, a movement sensor, a video game software program running on a processor, and a display in communication with the processor and a memory coupled to the processor; detecting core contractions of the user with the core muscle contraction sensor; transmitting core contraction signals from the core muscle contraction sensor to the processor; detecting body movements of the user with the movement sensor; transmitting body movement signals from the movement sensor to the processor; determining by the processor that the body movement signals either indicate that a desired player movement has been performed or that the desired player movement has not been performed; and converting by the video game program running on the processor, the desired player movements that have been performed which include the core contraction signals into video feedback signals that are output as positive actions of a visual object on a video game on the display and the desired player movements that have not been performed into the video feedback signals that are output as negative actions of the visual object on the video game on the display.
2. The method of claim 1 further comprising: determining by the processor that the movement signals indicate a qualifying movement that benefits from the core contraction; and converting by the video game program running on the processor, the movement signals that indicate the qualifying movement into qualifying movement video feedback signals that are output on the display.
3. The method of claim 2 further comprising: detecting by the processor, a timing relationship between the qualifying movement and the core contraction signals; identifying a protected qualifying movement when the core contraction signals occur throughout the qualifying movement; and converting by the video game program running on the processor, the protected qualifying movement into protected qualifying movement video feedback signals.
4. The method of claim 3 further comprising: detecting by the processor, a timing relationship between the qualifying movement and the core contraction signals; identifying an unprotected qualifying movement when the core contraction signals does not occur throughout the qualifying movement; and converting by the video game program running on the processor, the unprotected qualifying movement into unprotected qualifying movement video feedback signals.
5. The method of claim 4 wherein the protected qualifying movement video feedback signals are movements of an avatar in a first direction on the display.
6. The method of claim 5 wherein the unprotected qualifying movement video feedback signals are movements of the avatar in a second direction on the display.
7. The method of claim 5 wherein the unprotected qualifying movement video feedback signals are stopped movements of the avatar on the display.
8. A method for improvement of core muscles based support, comprising: providing a contraction sensor, a movement sensor, a video game software program running on a processor, and a display in communication with the processor and a memory coupled to the processor; displaying a video game scenario on the display with a movable object on the display; detecting core contractions of the user with the contraction sensor; transmitting core contraction signals from the contraction sensor to the processor; detecting body movements of the user with the movement sensor; transmitting body movement signals from the movement sensor to the processor; determining by the processor that the movement signals indicate a qualifying movement that benefits from the core contraction; determining by the processor timing relationships between the core contraction signals and the body movement signals; detecting by the processor, a timing relationship between the qualifying movement and the core contraction signals; identifying by the processor, a protected qualifying movement when the core contraction signals occur during the qualifying movement and an unprotected qualifying movement when the core contraction signals does not occur during the qualifying movement; and converting by the video game program running on the processor, the protected qualifying movement into a positive video feedback output signal when the core contraction signals occur throughout the qualifying movement that are output on the display; and converting by the video game program running on the processor, the unprotected qualifying movement into a negative video feedback output signal that are output on the display.
9. The method of claim 8 wherein the positive video feedback output signal is translational or rotational movements of the movable object on the display.
10. The method of claim 8 wherein the negative video feedback output signal is a stopped movement of the movable object in the video game scenario on the display.
11. The method of claim 8 wherein the movable object is an avatar, the positive video feedback signal results in the avatar avoiding a hazard object in the video game scenario and the negative video feedback output signal results in the avatar colliding with the hazard object in the video game scenario.
12. The method of claim 8 wherein the positive video feedback signal results in the object moving faster in the video game scenario and the negative video feedback output signal results in the object moving slower in the video game scenario.
13. The method of claim 8 wherein the object is a the positive video feedback signal results in the object moving faster in the video game scenario and the negative video feedback output signal results in the object moving slower in the video game scenario.
14. A method for improvement of core muscles based support, comprising: providing a wearable device having a contraction sensor, a movement sensor and a transmitter coupled to the contraction sensor and the movement sensor; providing a computing device having a receiver in communication with the transmitter, a video game software program running on a processor, a display in communication with the processor and a memory coupled to the processor; detecting core contractions of the user with the contraction sensor; transmitting core contraction signals from the transmitter of the wearable device to the receiver of the computing device; detecting body movements of the user with the movement sensor; transmitting body movement signals from the transmitter of the wearable device to the receiver of the computing device; determining by the processor that the body movement signals either indicate that a desired player movement has been performed or that the desired player movement has not been performed; and converting by the video game program running on the processor, the desired player movements that have been performed which include the core contraction signals into video feedback signals that are output as positive actions of a visual object on a video game on the display and the desired player movements that have not been performed into the video feedback signals that are output as negative actions of the visual object on the video game on the display.
15. The method of claim 14 further comprising: determining by the processor that the movement signals indicate a qualifying movement that benefits from the core contraction; and converting by the video game program running on the processor, the movement signals that indicate the qualifying movement into qualifying movement video feedback signals that are output on the display.
16. The method of claim 15 further comprising: detecting by the processor, a timing relationship between the qualifying movement and the core contraction signals; identifying a protected qualifying movement when the core contraction signals occur throughout the qualifying movement; and converting by the video game program running on the processor, the protected qualifying movement into protected qualifying movement video feedback signals.
17. The method of claim 16 further comprising: detecting by the processor, a timing relationship between the qualifying movement and the core contraction signals; identifying an unprotected qualifying movement when the core contraction signals does not occur throughout the qualifying movement; and converting by the video game program running on the processor, the unprotected qualifying movement into unprotected qualifying movement video feedback signals.
18. The method of claim 17 wherein the protected qualifying movement video feedback signals are movements of an avatar in a first direction on the display.
19. The method of claim 18 wherein the unprotected qualifying movement video feedback signals are movements of the avatar in a second direction on the display.
20. The method of claim 18 wherein the unprotected qualifying movement video feedback signals are stopped movements of the avatar on the display.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Other objects and features of the present invention will become apparent from the following detailed description considered in connection with the accompanying drawings which disclose several embodiments of the present invention. It should be understood, however, that the drawings are designed for the purpose of illustration only and not as a definition of the limits of the invention.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
DETAILED DESCRIPTION
(24) In U.S. Pat. No. 9,226,706, an inventive device and system is described, one embodiment of which enables real-time tracking of the core muscles by tracking core muscle contraction with a core contraction sensor and body movements with a movement sensor. The inventive device and system encourage the development of procedural memory for usage of the core muscles. The core contractions can then be used during Qualifying Movements (QMs) which are defined as movements for which contraction of the core muscles may be beneficial in supporting the lumbosacral junction and lumbar spine. In an application, when a QM is identified by the system, the system determines whether or not the QM is protected or not protected based on the status of the user's core before, during, and after the QM. The wearable device and system may be used to develop a sequenced core, that is core muscle engagement that is deliberate and coordinated with other body movements.
(25) In this current description, an inventive system is described to utilize the wearable device as an input controller to video games for the purpose of encouraging and teaching a user-player of the video game system to use their core muscles more effectively and in a coordinated manner with movements of their body. The system may also be beneficially used for teaching preferred ways to perform specific movements that may have benefit for reducing stress on the spine and other parts of the body.
(26) There are a wide variety of controllers used to control athletic equipment, avatars, weapons, vehicles, people and other objects in video games today. Joysticks were used predominantly in the early days of video games back in the 1970's and they are still widely used today. Moving an object or avatar left or right in one-dimensional control; left, right, forward, backward, and in combination for two-dimensional control is what a joystick has been used for since the early days of video gaming. With an additional joystick, the control of up and down can be added to the two-dimensional controller for control in three-dimensions.
(27) Recently introduced video game platforms such as Xbox Kinect by Microsoft Corporation have popularized video sensing where the body movements of a player are tracked and used to control avatars or other objects. The Microsoft Corporation Xbox Kinect uses video images and an infrared sensor to resolve distance allowing it to identify and track body movements and body positioning. Players simply stand in front of the specialized camera, move their bodies, and their movements are converted to data that can be used to control an avatar or other object in a video game. The Sony Playstation Move Controller uses a wand-like device that may be moved in 3-D space by a player's hand and the movements are tracked using inertial navigation with sensors including accelerometers, gyros, and a magnetometer. The sensor movements are then sent wirelessly to a controller box which converts the player's movements into the movement of an avatar or other objects in a video game. The use of inertial navigation using low-cost sensors has become widely used in video gaming.
(28) User body movements for controlling an avatar or object in a video game has brought on a new generation of games and ways of playing and interacting with games. Players are able to get exercise with the controllers that utilize body movements. 3-D glasses are enabling yet another approach to present video games to players. 3-D glasses in video gaming is still being improved but promises to allow players to interact with game environments in new and even more lifelike ways.
(29) Video games are generally played by players for entertainment. Some games provide additional utility by encouraging players to perform body movements resulting in players receiving the benefit of exercise. Some of these games are used in physical therapy to encourage patients to move in specific and beneficial ways.
(30) The inventive system described in U.S. Pat. No. 9,226,706 enables real time tracking of the inner core muscles. Furthermore, it encourages the development of procedural memory for support of a user's lumbosacral junction and lumbar spine by encouraging a user to contract their core muscles before and during performing Qualifying Movements.
(31) There are no games available today that encourage a player of a video game to deliberately contract their core muscles before or in combination with body movements as a training or development tool for improved health and usage of core muscles. This current invention brings the motivational and entertainment value of video games into the learning process of using the core muscles more effectively. Different timing models of core contraction and body movements may be encouraged. For example, a user or player of the game may be encouraged to contract their core before and during movements, during movements, and before, during and after movements. Players may be encouraged to contract their core for some movements and not others. The preferred contraction patterns may also be conditional, depending on the magnitude of a movement or the speed of the movement. In the following, the terms user and player will be used interchangeably.
(32) A user may be encouraged to use their core in conjunction with specific movements by receiving points for performing certain combinations of core contraction and movements and by not receiving points for performing certain combinations of core contraction and movements. The avatar or object under control may move when the core is contracted during a movement of the player's body and not move when the player's core is not contracted in a specific preferred way. For example, an object in a video game may move to the right when a standing user slides to their right or the object may move to the left when a standing user slides to their left only when the player contracts their core prior to sliding to the right or left throughout the duration of the slide. In another embodiment, the object may slide if the player contracts their core during a substantial portion of the duration of the slide. Timing requirements of the core contraction in relation to a movement of a player's body enabling movement of an object in a video game may be modified in software. The magnitude that the object in the video game moves to the left or right may be substantially proportional to the distance that the player slides to the left or right with their core appropriately contracted.
(33) The concepts presented describe using body movements of a user wearing the wearable device converted to similar movements of an avatar or object in a video game when the user's core is contracted appropriately. This concept is very general and may be applied to many types of video games. The invention can be beneficial to most users who want to learn to more effectively utilize their core muscles. The invention may also be beneficial for those in therapy for back pain. Video game content, player movements and core usage may be designed for therapeutic and rehabilitation applications, as well as building muscle memory or neural patterning for core usage in health and fitness, wellness, athletic performance improvement, and workplace injury reduction.
(34) Referring to
(35) The game device 503 may be a PC or processor-based controller with a built-in or external monitor, smart phone or other handheld or countertop device containing a processor and a display. The display 505 may show an avatar or object that moves in response to the signal received from the Movement Sensing Device 501 in response to user 101 movements. In some video games, the surroundings of the avatar or object move relative to a stationary avatar or object creating the illusion that the avatar or object is moving. Processor 507 communicates with movement sensing device 501 and runs the software to execute the game. Communication blocks exist on both the Game Interface 501 and Game Device 503 but are not shown explicitly. These communication blocks may be wired or wireless.
(36) An embodiment of the inventive system is shown in
(37) The addition of wearable device 103 may enable new learning features in video games. Core contraction sensor data and movement sensor data from the wearable 103 may be converted to video signals. In some embodiments, video signals may include video game scenarios that may be devised to encourage or elicit specific physical responses or actions by a player. The player may be encouraged to respond with certain movements or combinations of movements including appropriately timed core contractions. The core contraction sensor on the wearable 103 may be utilized to combine core contraction and core contraction timing with body movements in the video game. Some aspects of conventional Game Interface 501 may be utilized for control data in the video game. In some applications, only data from the wearable device 103 may be used. In other applications, data from the core contraction sensors on the wearable device 103 may be used with data from the Game Interface 501. In other applications, data from the movement sensors on the wearable device 103 may be used with data from the Game Interface 501.
(38) In some applications, video game software may be written specifically to encourage core muscle usage and the development of a sequenced core. In such specific video games, the games may be written exclusively for wearable device 103. In these specific video games, wearable device 103 may be the exclusive source of player 101 control data or provide partial control data that may be combined with Game Interface 501 control data. These specific video games may emphasize core contractions and timing core contractions with body movements.
(39) In other applications, the wearable device may be used partially or exclusively as the Game Interface 501 to games that were not written specifically for wearable device 103. In such non-specific video game applications, an Application Program Interface (API) may be utilized. An API is a set of tools for building software applications and may facilitate interfacing wearable device 103 with non-specific video games. An API may facilitate the development of a software driver that may run on processor 507 to translate player 101 actions detected by the wearable device 103 sensors into commands for the non-specific video games. At a basic level of abstraction, the core contraction sensor may for example send out data to the system informing when the player's 101 core muscles transition firstly from relaxed to engaged, and secondly from engaged to relaxed. This may be defined in an API for the wearable device 103 to facilitate interfacing the wearable device 103 to non-specific video games. In an embodiment where a non-specific video game is designed to perform a function upon a mouse click, a software driver may be used to perform the function when wearable device 103 detects a transition from a relaxed to engaged core. The API may also be used to facilitate enabling any programmer to write a specific video game software to work with the wearable device 103.
(40) An embodiment of the inventive system is shown in
(41) With reference to
(42) The wearable device 103 may be used to control a video game in different ways. In one embodiment called Movement Criteria Mode, Movement Criteria are evaluated for each movement using body movement sensor data and core contraction sensor data. In an embodiment, the timing relationship between core contraction and body movements and other parameters of the movement data may be evaluated against Movement Criteria. If Movement Criteria are met, the player's movement may be translated into something favorable in the video game. If Movement Criteria are not met, the player's movement may result in no movement or something unfavorable in the video game.
(43) In another embodiment, the wearable device 103 provides additional player 101 control data directly, without evaluating timing relationships between the contraction sensor data and the movement sensor data. This is called Direct Movement Mode and data from the wearable device 103 may add to or replace the Game Interface to allow the player 101 to interact with the video game via the wearable device 103.
(44) In Direct Movement Mode, as the player 101 moves their body, the wearable 103 will move. The movements may be detected by the movement sensor and translated into position changes in three dimensions. Depending on the avatar or object being controlled in the video game, this may be translated on the display as an equivalent change of the avatar or object in one, two, or three dimensions. The change in position may be proportional or non-linear, depending on the application. In a proportional change, if the player 101 moves to the right by one inch, the avatar or object may move equivalently to the right by one unit of distance. If the player 101 moves to the right by two inches, the avatar or object will move equivalently to the right by approximately two units of distance. In a non-linear change in position of the avatar or object, if the player 101 moves to the right by two inches, the avatar or object may move equivalently to the right by substantially less than two units of distance, for example one-and-a-half units of distance, or substantially more than two units of distance, for example three units of distance.
(45) A flow diagram of Movement Criteria Mode is shown in
(46) Examples of Movement Criteria which may be combined or used in isolation depending on the application include but are not limited to:
(47) A. The user must move from one position to a second position, and pause for a minimum duration of time, for example 250 msec before moving to a third position;
(48) B. The discrete movements in A with pauses in between must be appropriately protected with contraction of the core muscles prior to the movements;
(49) C. Only protected qualifying movements move the avatar or object correctly; or
(50) D. Protected qualifying movements may require the core contraction begin before and throughout the entire movement;
(51) The parameters and content of Movement Criteria tests 605 may be modified based on a number of factors. Examples of factors that may change or adjust Movement Criteria include a player's performance during a game or series of games, a player's pain condition, and a player's skill level in using their core muscles.
(52) When one or more Movement Criteria are not met by a player's 101 body movements and core contraction during a movement during a game, a Ramification 609 may occur. A number of Ramifications 609 are possible. Ramifications 609 may occur in isolation or in combination. Examples of Ramifications 609 include no movement of the avatar or object in response to the movement of the player, partial or incorrect movement of the avatar or object in response to the movement of the player, negative points added to the player's score, demerits added to the player's score, or modifications to the content or parameters of the Movement Criteria.
(53) In some embodiments, the data from the wearable device 103 may be converted to video signals that are output on a video display wherein the video signals include game scenarios, player movements, and Favorables and Ramifications in numerous and varied ways. A few such embodiments are shown in the table of
(54) An avatar may include blocks, squares, rectangles, balls, circles, triangles, food objects, animals, plants, insects, fantasy objects like magic wands or unicorns, or other objects. This table is an example of a video game objective, a player's required movement to achieve the objective, and the results of the player performing the movement correctly or incorrectly. Many applications and game scenarios are possible.
(55) An example of a ping pong game is illustrated in
(56) An embodiment of the system is now described. An example of a player's 101 movement resulting in movement of the wearable 103 in the left and right direction as a function of time is shown in
(57) Referring to
(58) Referring to
(59) Referring to
(60) In U.S. Pat. No. 9,226,706 and U.S. patent application Ser. Nos. 14/132,808, 14/789,136, 14/652,542, 14/817,964, 61/739,160, and 62/154,626, various approaches may be utilized to implement the core contraction sensor.
(61) Referring to
(62) Referring to
(63) Referring to
(64) In an embodiment, the height of the unifier cap 194 may be increased using unifier cap extender 621 as shown in
(65) Referring to
(66) In applications where two or more bumpers are used and FSRs are used as force sensors, separate FSRs may be used and placed beneath the bumpers and the outputs of the FSRs may be sensed independently. In another application, a custom FSR with multiple sensors placed beneath each bumper may be used. Electrically, each of the sensors in the multiple sensor FSR may be in parallel. Other configurations and FSR structures may be utilized. Optimizing the FSR shape and design with placement of the bumpers with similar shapes to optimally couple the FSR to the bumpers may be desirable for some applications.
(67) In some applications, more than one wearable device may be simultaneously utilized. Multiple devices may allow more than one muscle to be monitored simultaneously. Multiple devices may allow the core muscles to be monitored in different positions simultaneously. The use of multiple wearable devices may reduce the likelihood of missing the detection of a core contraction or a muscle contraction. An embodiment employing two wearable devices 103 is shown in
(68) The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms a, an and the are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms comprises and/or comprising, when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
(69) Some embodiments of the invention are implemented as a program product for use with an embedded processor. The program(s) of the program product defines functions of the embodiments (including the methods described herein) and can be contained on a variety of signal-bearing media. Illustrative signal-bearing media include, but are not limited to: (i) information permanently stored on non-writable storage media; (ii) alterable information stored on writable storage media; and (iii) information conveyed to a computer by a communications medium, such as through a computer or telephone network, including wireless communications. The latter embodiment specifically includes information downloaded from the Internet and other networks. Such signal-bearing media, when carrying computer-readable instructions that direct the functions of the present invention, represent embodiments of the present invention.
(70) In general, the routines executed to implement the embodiments of the invention, may be part of an operating system or a specific application, component, program, module, object, or sequence of instructions. The computer program of the present invention typically is comprised of a multitude of instructions that will be translated by the native computer into a machine-accessible format and hence executable instructions. Also, programs are comprised of variables and data structures that either reside locally to the program or are found in memory or on storage devices. In addition, various programs described hereinafter may be identified based upon the application for which they are implemented in a specific embodiment of the invention. However, it should be appreciated that any particular program nomenclature that follows is used merely for convenience, and thus the invention should not be limited to use solely in any specific application identified and/or implied by such nomenclature.
(71) The present invention and some of its advantages have been described in detail for some embodiments. It should be understood that although the process is described with reference to a device, system, and method for developing core contraction procedural memory, the process may be used in other contexts as well. It should also be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims. An embodiment of the invention may achieve multiple objectives, but not every embodiment falling within the scope of the attached claims will achieve every objective. Moreover, the scope of the present application is not intended to be limited to the particular embodiments of the process, machine, manufacture, composition of matter, means, methods and steps described in the specification. A person having ordinary skill in the art will readily appreciate from the disclosure of the present invention that processes, machines, manufacture, compositions of matter, means, methods, or steps, presently existing or later to be developed are equivalent to, and fall within the scope of, what is claimed. Accordingly, the appended claims are intended to include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or steps.