APPARATUS AND METHOD FOR BREATHING AND CORE MUSCLE TRAINING
20180272189 ยท 2018-09-27
Inventors
Cpc classification
A63B2220/70
HUMAN NECESSITIES
A63B2071/0638
HUMAN NECESSITIES
G06F3/011
PHYSICS
G06F3/0346
PHYSICS
A63B2230/00
HUMAN NECESSITIES
A63B2225/50
HUMAN NECESSITIES
A63B2071/0666
HUMAN NECESSITIES
A63B2071/0677
HUMAN NECESSITIES
International classification
A63B24/00
HUMAN NECESSITIES
Abstract
Systems and methods for breathing and core muscle training with sensors and multi-sensory output are disclosed. A particular embodiment includes: an input unit including a plurality of sensors; an output unit including a plurality of multi-sensory output devices; and a processing unit, in data communication with the input unit and the output unit, the processing unit being configured to: determine a prompted movement of a training program and use the output unit to prompt the user to perform the prompted movement; receive sensor data from the input unit, the sensor data corresponding to the user's physical movements and biomedical condition; configure the output unit to render a simulation of the user's physical movements in a virtual environment; score the user's physical movements relative to the prompted movement; and determine a next prompted movement of the training program and use the output unit to prompt the user to perform the next prompted movement until the training program is complete.
Claims
1. A system comprising: an input unit including a plurality of sensors; an output unit including a plurality of multi-sensory output devices; and a processing unit, in data communication with the input unit and the output unit, the processing unit being configured to: determine a prompted movement of a training program and use the output unit to prompt the user to perform the prompted movement; receive sensor data from the input unit, the sensor data corresponding to the user's physical movements and biomedical condition; configure the output unit to render a simulation of the user's physical movements in a virtual environment; score the user's physical movements relative to the prompted movement; and determine a next prompted movement of the training program and use the output unit to prompt the user to perform the next prompted movement until the training program is complete.
2. The system of claim 1 wherein the plurality of sensors includes sensors of a type from the group consisting of: gyroscopes, accelerometers, magnetometers, position and orientation detection trackers, devices for measuring one or more of a variety of environmental conditions, and devices for measuring one or more of a variety of biomedical conditions.
3. The system of claim 1 wherein the plurality of multi-sensory output devices includes devices of a type from the group consisting of: three dimensional (3D) virtual reality (VR) or augmented reality (AR) headset displays, computer displays, tablet displays, mobile device or smartphone displays, projection displays, display panels, monitors, televisions, projectors, video game station/systems, 3D VR/AR headset speakers, earbuds, ear phones, computer speakers, tablet speakers, mobile device or smartphone speakers, external speakers, vibrators, mild electric shock devices, haptic output devices, and motor/servo output devices.
4. The system of claim 1 wherein the processing unit further includes devices of a type from the group consisting of: data processors or central processing units (CPUs), data storage device, a memory, and a wireless data transmitter and receiver (transceiver).
5. The system of claim 1 wherein the training program is of a type from the group consisting of: breath monitoring with a breath sensor, breath monitoring with posture tracking, full body muscle training with gesture tracking, and muscle training with head gaze tracking.
6. The system of claim 1 wherein scoring the user's physical movements relative to the prompted movement includes measuring the user's head movement relative to a plane corresponding to a neutral gazing position.
7. The system of claim 1 wherein scoring the user's physical movements relative to the prompted movement includes measuring the user's head movement during a breathing cycle.
8. The system of claim 1 wherein scoring the user's physical movements relative to the prompted movement includes measuring the user's body movement to determine if the user's muscle movements were performed as prompted.
9. The system of claim 1 including displaying a plurality of pointing targets to focus the user's gaze during inhaling and exhaling breathing cycles.
10. A method comprising: providing an input unit including a plurality of sensors; providing an output unit including a plurality of multi-sensory output devices; and using a processing unit, in data communication with the input unit and the output unit, for: determining a prompted movement of a training program and using the output unit to prompt the user to perform the prompted movement; receiving sensor data from the input unit, the sensor data corresponding to the user's physical movements and biomedical condition; configuring the output unit to render a simulation of the user's physical movements in a virtual environment; scoring the user's physical movements relative to the prompted movement; and determining a next prompted movement of the training program and using the output unit to prompt the user to perform the next prompted movement until the training program is complete.
11. The method of claim 10 wherein the plurality of sensors includes sensors of a type from the group consisting of: gyroscopes, accelerometers, magnetometers, position and orientation detection trackers, devices for measuring one or more of a variety of environmental conditions, and devices for measuring one or more of a variety of biomedical conditions.
12. The method of claim 10 wherein the plurality of multi-sensory output devices includes devices of a type from the group consisting of: three dimensional (3D) virtual reality (VR) or augmented reality (AR) headset displays, computer displays, tablet displays, mobile device or smartphone displays, projection displays, display panels, monitors, televisions, projectors, video game station/systems, 3D VR/AR headset speakers, earbuds, ear phones, computer speakers, tablet speakers, mobile device or smartphone speakers, external speakers, vibrators, mild electric shock devices, haptic output devices, and motor/servo output devices.
13. The method of claim 10 wherein the processing unit further includes devices of a type from the group consisting of: data processors or central processing units (CPUs), data storage device, a memory, and a wireless data transmitter and receiver (transceiver).
14. The method of claim 10 wherein the training program is of a type from the group consisting of: breath monitoring with a breath sensor, breath monitoring with posture tracking, full body muscle training with gesture tracking, and muscle training with head gaze tracking.
15. The method of claim 10 wherein scoring the user's physical movements relative to the prompted movement includes measuring the user's head movement relative to a plane corresponding to a neutral gazing position.
16. The method of claim 10 wherein scoring the user's physical movements relative to the prompted movement includes measuring the user's head movement during a breathing cycle.
17. The method of claim 10 wherein scoring the user's physical movements relative to the prompted movement includes measuring the user's body movement to determine if the user's muscle movements were performed as prompted.
18. The method of claim 10 including displaying a plurality of pointing targets to focus the user's gaze during inhaling and exhaling breathing cycles.
19. A non-transitory machine-useable storage medium embodying instructions which, when executed by a machine, cause the machine to: determine a prompted movement of a training program and use an output unit to prompt a user to perform the prompted movement; receive sensor data from an input unit, the sensor data corresponding to the user's physical movements and biomedical condition; configure the output unit to render a simulation of the user's physical movements in a virtual environment; score the user's physical movements relative to the prompted movement; and determine a next prompted movement of the training program and use the output unit to prompt the user to perform the next prompted movement until the training program is complete.
20. The instructions embodied in the machine-useable storage medium of claim 19 wherein the training program is of a type from the group consisting of: breath monitoring with a breath sensor, breath monitoring with posture tracking, full body muscle training with gesture tracking, and muscle training with head gaze tracking.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0023] For a better understanding of the example embodiments, reference should be made to the following detailed description taken in conjunction with the accompanying drawings, in which:
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
DETAILED DESCRIPTION
[0035] Reference will now be made in detail to the example embodiments illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
[0036] Apparatus and methods disclosed herein in various example embodiments address the above described needs. For example, apparatus and methods disclosed herein can provide and facilitate breathing and core muscle training with sensors and multi-sensory output. The disclosed apparatus and methods can be implemented on low power mobile devices and/or three-dimensional (3D) display devices. The apparatus and methods can also enable real-life avatar control. The virtual world may include a visual environment provided to the user, and may be based on either augmented reality or virtual reality.
[0037]
[0038] In an example embodiment, the processing unit 120 can include one or more of a data processor or central processing unit (CPU) 121, a data storage device or memory 122, a wireless data transmitter and receiver (transceiver) 123, which may include an interface for a standard mobile device, such an a smartphone. The processing unit 120 can further include one or more of a clock or timer 125, a set of interfaces or receivers for the various sensors of the input unit 110, and a set of interfaces or drivers for the various output devices of the output unit 130. It will be apparent to those of ordinary skill in the art in view of the disclosure herein that the various data processing and control devices of the processing unit 120 are separately available in the art.
[0039] The control system 100, and the processing unit 120 integrated therein, can be operatively connected to a network or any type of communication link that allows the transfer of data from one component to another via the wireless transceiver 123. The network may include Local Area Networks (LANs), Wide Area Networks (WANs), Bluetooth, and/or Near Field Communication (NFC) technologies, and may be wireless, wired, or a combination thereof. Memory 122 can be any type of storage medium capable of storing binary data, processing instructions, audio data, and imaging data, such as video or still images. The video or still images may be displayed in a virtual world rendered via the output unit 130.
[0040] In an example embodiment, the output unit 130 can include one or more of a visual output unit 132, an audio output unit 134, and a tactile output unit 136. In the example embodiment, the visual output unit 132 can include one or more of a 3D VR/AR headset display, a computer display, a tablet display, a mobile device or smartphone display, a projection display, and the like. Visual output unit 132 can further include various types of other display devices such as, for example, a display panel, monitor, television, projector, or any other display device. In some embodiments, visual output unit 132 can include, for example, a display or image rendering device on a cell phone or smartphone, personal digital assistant (PDA), computer, laptop, desktop, a tablet PC, media content player, set-top box, television set including a broadcast tuner, video game station/system, or any electronic device capable of accessing a data network and/or receiving imaging data. In the example embodiment, the audio output unit 134 can include one or more of a set of 3D VR/AR headset speakers, earbuds, ear phones, computer speakers, tablet speakers, mobile device or smartphone speakers, external speakers, and the like. In the example embodiment, the tactile output unit 136 can include one or more of a vibrator, mild electric shock device, haptic output device, motor/servo output, and the like. The various output devices of the output unit 130 of an example embodiment provide a multi-sensory output device for the control device 100. It will be apparent to those of ordinary skill in the art in view of the disclosure herein that the various output devices of the output unit 130 are separately available in the art.
[0041] It will also be apparent to those of ordinary skill in the art in view of the disclosure herein that the control system 100 can be implemented in whole or in part in a standard computing or communication device, such as a computer, a laptop, a tablet personal computer (PC), a cell phone or smartphone, a personal digital assistant (PDA), a media content player, a video game station/system, or any electronic device capable of capturing data, processing data and generating processed information, and rendering related output. In the example embodiments described herein, processing logic can be implemented as a software program executed by a processor and/or as hardware that converts analog data to an action in a virtual world based on physical input from a user. The action in the virtual world can be depicted in one of video frames or still images in a 2D or 3D format, can be real-life and/or animated, can be in color, black/white, or grayscale, and can be in any color space.
[0042]
[0043]
[0052]
Breath Tracking with a Breath Sensor
[0053]
Breath Monitoring with Posture Tracking
[0054] Referring again to
Full Body Muscle Training with Gesture Tracking
[0055]
Muscle Training with Head Gaze Tracking
[0056] In a basic form according to an example embodiment, user muscle training can be monitored and directed by the user wearable system 300 wherein sensor inputs are used to monitor and direct user hand movements. Initially, the user wearable system 300 can estimate the user's core muscle status (e.g., breathing status) using the sensors of the input unit 110 of the user wearable system 300. In many cases, most of the sensors are installed in the headset 310. For implementations where most of the sensors are installed in the headset 310, a process for estimating the user's core muscle status can be based on the user's head orientation (e.g., how the user's head is oriented for gazing).
[0057]
[0058]
[0059]
[0060]
[0061] In another example embodiment, the user wearable system 300 can monitor and track a user's breathing patterns by enabling the user to press a button or activate an input device to mark the beginning and/or ending of each inhale and exhale breathing cycle. In this manner, the user can provide explicit input used to identify and track a user's breathing patterns.
[0062] In each of the training methods described herein, multi-sensory feedback is provided for the user to guide the user through each of the movements of the training program. The example embodiment can generate various displayed images, audio prompts, and other signals from the multi-sensory output devices of output unit 130 to create a positive feedback loop to guide the user's muscle movements. For example, the user wearable system 300 of an example embodiment can: [0063] Use the multi-sensory output devices of output unit 130 to present a visual simulated image and corresponding audio of air being inhaled and exhaled from a user's avatar in the virtual environment; [0064] Use the multi-sensory output device of output unit 130 to present the user's influence or effect on the virtual environment. For example, the simulated tree leaves in the virtual environment can be moved when the user inhales and exhales; [0065] Use the multi-sensory output device of output unit 130 to present positive energy or messages when the user performs the prompted movements correctly and vice versa; and [0066] Use the multi-sensory output device of output unit 130 to present stronger influences as the user progresses in performance (e.g., longer duration, more consistent movements, more accurate movements, etc.).
[0067] Referring now to
[0068]
[0069] The example mobile computing and/or communication system 700 includes a data processor 702 (e.g., a System-on-a-Chip [SoC], general processing core, graphics core, and optionally other processing logic) and a memory 704, which can communicate with each other via a bus or other data transfer system 706. The mobile computing and/or communication system 700 may further include various input/output (I/O) devices and/or interfaces 710, such as a touchscreen display, an audio jack, and optionally a network interface 712. In an example embodiment, the network interface 712 can include one or more radio transceivers configured for compatibility with any one or more standard wireless and/or cellular protocols or access technologies (e.g., 2nd (2G), 2.5, 3rd (3G), 4th (4G) generation, and future generation radio access for cellular systems, Global System for Mobile communication (GSM), General Packet Radio Services (GPRS), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (WCDMA), LTE, CDMA2000, WLAN, Wireless Router (WR) mesh, and the like). Network interface 712 may also be configured for use with various other wired and/or wireless communication protocols, including TCP/IP, UDP, SIP, SMS, RTP, WAP, CDMA, TDMA, UMTS, UWB, WiFi, WiMax, Bluetooth, IEEE 802.11x, and the like. In essence, network interface 712 may include or support virtually any wired and/or wireless communication mechanisms by which information may travel between the mobile computing and/or communication system 700 and another computing or communication system via network 714.
[0070] The memory 704 can represent a machine-readable medium on which is stored one or more sets of instructions, software, firmware, or other processing logic (e.g., logic 708) embodying any one or more of the methodologies or functions described and/or claimed herein. The logic 708, or a portion thereof, may also reside, completely or at least partially within the processor 702 during execution thereof by the mobile computing and/or communication system 700. As such, the memory 704 and the processor 702 may also constitute machine-readable media. The logic 708, or a portion thereof, may also be configured as processing logic or logic, at least a portion of which is partially implemented in hardware. The logic 708, or a portion thereof, may further be transmitted or received over a network 714 via the network interface 712. While the machine-readable medium of an example embodiment can be a single medium, the term machine-readable medium should be taken to include a single non-transitory medium or multiple non-transitory media (e.g., a centralized or distributed database, and/or associated caches and computing systems) that store the one or more sets of instructions. The term machine-readable medium can also be taken to include any non-transitory medium that is capable of storing, encoding or carrying a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the various embodiments, or that is capable of storing, encoding or carrying data structures utilized by or associated with such a set of instructions. The term machine-readable medium can accordingly be taken to include, but not be limited to, solid-state memories, optical media, and magnetic media.
[0071] The methods disclosed herein may be implemented as a computer program product, i.e., a computer program tangibly embodied in a non-transitory information carrier, e.g., in a machine-readable storage device, or a tangible non-transitory computer-readable medium, for execution by, or to control the operation of, data processing apparatus, e.g., a programmable processor, a computer, or multiple computers. A computer program may be written in any form of programming language, including compiled or interpreted languages, and it may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program may be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a communication network. A portion or all of the systems disclosed herein may also be implemented by an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), a printed circuit board (PCB), a digital signal processor (DSP), a combination of programmable logic components and programmable interconnects, a single central processing unit (CPU) chip, a CPU chip combined on a motherboard, a general purpose computer, or any other combination of devices or modules capable of processing optical image data and generating actions in a virtual world based on the methods disclosed herein. It is understood that the above-described example embodiments are for illustrative purposes only and are not restrictive of the claimed subject matter. Certain parts of the system can be deleted, combined, or rearranged, and additional parts can be added to the system. It will, however, be evident that various modifications and changes may be made without departing from the broader spirit and scope of the claimed subject matter as set forth in the claims that follow. The specification and drawings are accordingly to be regarded as illustrative rather than restrictive. Other embodiments of the claimed subject matter may be apparent to those of ordinary skill in the art from consideration of the specification and practice of the claimed subject matter disclosed herein.
[0072] With general reference to notations and nomenclature used herein, the description presented herein may be disclosed in terms of program procedures executed on a computer or a network of computers. These procedural descriptions and representations may be used by those of ordinary skill in the art to convey their work to others of ordinary skill in the art.
[0073] A procedure is generally conceived to be a self-consistent sequence of operations performed on electrical, magnetic, or optical signals capable of being stored, transferred, combined, compared, and otherwise manipulated. These signals may be referred to as bits, values, elements, symbols, characters, terms, numbers, or the like. It should be noted, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to those quantities. Further, the manipulations performed are often referred to in terms such as adding or comparing, which operations may be executed by one or more machines. Useful machines for performing operations of various embodiments may include general-purpose digital computers or similar devices. Various embodiments also relate to apparatus or systems for performing these operations. This apparatus may be specially constructed for a purpose, or it may include a general-purpose computer as selectively activated or reconfigured by a computer program stored in the computer. The procedures presented herein are not inherently related to a particular computer or other apparatus. Various general-purpose machines may be used with programs written in accordance with teachings herein, or it may prove convenient to construct more specialized apparatus to perform methods described herein.
[0074] The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment.