SYSTEMS AND METHODS FOR PROVIDING SENSORY FEEDBACK DURING EXERCISE
20220192584 · 2022-06-23
Inventors
- Jana Maureen Rieger (Edmonton, CA)
- Gabriela Constantinescu (Edmonton, CA)
- Mark James Redmond (Edmonton, CA)
- Dylan Kyle Scott (St. Albert, CA)
- Benjamin Ronald King (Beaumont, CA)
- Mark Vernon FEDORAK (Edmonton, CA)
- Herman LUNDGREN (Goteborg, SE)
Cpc classification
G16H20/30
PHYSICS
G16H50/20
PHYSICS
A61B2560/0223
HUMAN NECESSITIES
A61B5/7225
HUMAN NECESSITIES
A61B5/42
HUMAN NECESSITIES
A61B5/4833
HUMAN NECESSITIES
A61B5/228
HUMAN NECESSITIES
A61B5/22
HUMAN NECESSITIES
International classification
A61B5/00
HUMAN NECESSITIES
A61B5/22
HUMAN NECESSITIES
Abstract
Devices and methods for providing sensory feedback during an exercise are disclosed. An exertion target is set, for a user performing the exercise, based on a self-calibration that estimates the user's ability using signal amplitudes of surface electromyography (sEMG) data, wherein the exertion target includes a target signal amplitude of muscle contractions to be reached during the exercise. sEMG data are received from a measurement device attached to the user as the user performs the exercise. Upon processing the sEMG data, sensory feedback is generated at a computing device operated by the user, wherein the sensory feedback has an intensity proportional to the user's exertion level as the user performs the exercise, and wherein the sensory feedback changes over a course of the exercise in dependence on a duration that the user maintains a muscle contraction at or above the target signal amplitude, and the change in sensory feedback is configured to encourage the user to prolong the duration.
Claims
1. A method of providing sensory feedback during an exercise, the method comprising: setting an exertion target, for a user performing the exercise, based on a self-calibration that estimates the user's ability using signal amplitudes of surface electromyography (sEMG) data, wherein the exertion target includes a target signal amplitude of muscle contractions to be reached during the exercise; receiving sEMG data from a measurement device attached to the user as the user performs the exercise; and upon processing the sEMG data, generating sensory feedback at a computing device operated by the user, wherein the sensory feedback has an intensity proportional to the user's exertion level as the user performs the exercise, and wherein the sensory feedback changes over a course of the exercise in dependence on a duration that the user maintains a muscle contraction at or above the target signal amplitude, and the change in sensory feedback is configured to encourage the user to prolong the duration.
2. The method of claim 1, wherein the sensory feedback is responsive to the duration that a muscle contraction is maintained at or above a pre-defined quantum higher than the target signal amplitude.
3. The method of claim 1, wherein the sensory feedback includes audible feedback.
4. The method of claim 1, wherein the sensory feedback includes visual feedback.
5. The method of claim 4, further comprising: generating a graphical user interface for presentation of the visual feedback.
6. The method of claim 1, wherein the sensory feedback provides an indication of the muscle contraction to the user.
7. The method of claim 6, wherein the indication includes an indication of a duration of the muscle contraction.
8. The method of claim 1, wherein the sensory feedback is presented in a form of a game playable by the user.
9. The method of claim 8, further comprising: controlling functions of the game based on said processing the sEMG data.
10. The method of claim 1, further comprising: computing an average and a range of the signal amplitudes received for the self-calibration.
11. The method of claim 1, wherein the self-calibration estimates the patient's ability for a particular day to set at least one of the exertion targets for the exercises of the particular day.
12. The method of claim 1, wherein the self-calibration estimates the patient's ability for a particular exercise session to set at least one of the exertion targets for the exercises of the particular exercise session.
13. A computer-implemented device for providing sensory feedback during an exercise, the device including: a communication interface; at least one processor; memory in communication with the at least one processor, and software code stored in the memory, which when executed by the at least one processor causes the device to: set an exertion target, for a user performing the exercise, based on a self-calibration that estimates the user's ability using signal amplitudes of surface electromyography (sEMG) data, wherein the exertion target includes a target signal amplitude of muscle contractions to be reached during the exercise; receive, via the communication interface, sEMG data from a measurement device attached to the user as the user performs the exercise; and upon processing the sEMG data, generate sensory feedback that has an intensity proportional to the user's exertion level as the user performs the exercise, and wherein the sensory feedback changes over a course of the exercise in dependence on a duration that the user maintains a muscle contraction at or above the target signal amplitude, and the change in sensory feedback is configured to encourage the user to prolong the duration.
14. The computer-implemented device of claim 13, wherein the communication interface is configured for wireless communication with the measurement device.
15. The computer-implemented device of claim 13, wherein the wireless communication includes Bluetooth communication.
16. The computer-implemented device of claim 13, wherein the sensory feedback is responsive to the duration that a muscle contraction is maintained at or above a pre-defined quantum higher than the target signal amplitude.
17. The computer-implemented device of claim 13, wherein the sensory feedback includes audible feedback.
18. The computer-implemented device of claim 13, wherein the sensory feedback includes visual feedback.
19. The computer-implemented device of claim 13, wherein the device is a portable computing device.
20. A non-transitory computer-readable medium having stored thereon machine interpretable instructions which, when executed by a processor, cause the processor to perform a computer implemented method for providing sensory feedback during an exercise, the method including: setting an exertion target, for a user performing the exercise, based on a self-calibration that estimates the user's ability using signal amplitudes of surface electromyography (sEMG) data, wherein the exertion target includes a target signal amplitude of muscle contractions to be reached during the exercise; receiving sEMG data from a measurement device attached to the user as the user performs the exercise; and upon processing the sEMG data, generating sensory feedback that has an intensity proportional to the user's exertion level as the user performs the exercise, and wherein the sensory feedback changes over a course of the exercise in dependence on a duration that the user maintains a muscle contraction at or above the target signal amplitude, and the change in sensory feedback is configured to encourage the user to prolong the duration.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
DETAILED DESCRIPTION
[0058] In general, this disclosure describes a system for use in diagnosing and treating swallowing disorders.
[0059] In some embodiments, the devices described herein, unlike current in-clinic technology, can be portable and relatively inexpensive and can allow a patient to complete therapy at home, and can allow a clinician to monitor a patient's activity remotely through access to a data warehouse and/or an online portal. Further, in some embodiments, unlike current technology, applications described herein can provide meaningful feedback to a patient about what their swallowing muscles are doing. This can be done by incorporating game concepts and design, such as goal setting, patient position relative to goal, creation and personalization, connections and ways to share results, practice reminders and progress bars into the application. In some embodiments, de-identified home practice data can be sent instantaneously to a central server so that the clinician can monitor progress and change the course of therapy. In addition, uploaded data can be used to create an evidence-base for this type of treatment that will ultimately guide clinical decision-making. Further, in one example, devices described herein can incorporate feedback from additional clinicians outside the core clinical or research group, as well as patients and health administrators. The mobile health devices described herein can be used to: improve quality of life in patients with swallowing difficulties by providing more consistent, motivating and accessible swallowing therapy; address an unmet clinical need in the health system; and provide an effective technological solution to reduce the burden of costs on patients, and the health care system.
[0060]
[0061] Components of system 100 can comprise and be implemented as any of a variety of suitable hardware and software, such as one or more microprocessors, microcontrollers, digital signal processors (“DSPs”), application specific integrated circuits (“ASICs”), field programmable gate arrays (“FPGAs”), discrete logic, analog circuitry, software, software modules, hardware, firmware or any combinations thereof as well known to those skilled in the art. System 100 can comprise software modules operating on one or more servers. Software modules can be stored in a memory and executed by a processor. Servers can comprise one or more processors and a plurality of internal and/or external memory devices. Examples of memory devices can comprise file servers, FTP servers, network attached storage (“NAS”) devices, a local disk drive or any other type of device or storage medium capable of storing data as well known to those skilled in the art. Storage medium can comprise Blu-ray discs, DVDs, CD-ROMs, flash memory or any other suitable digital storage media as well known to those skilled in the art. When the techniques described herein are implemented partially in software, a device can store instructions for the software in a suitable, non-transitory computer-readable medium and execute the instructions in hardware using one or more processors.
[0062] In some embodiments as illustrated in
[0063]
[0064] Device 206 can further comprise silicone hand grip 215 configured to releasably attach to casing halves 211 and 213 when assembled together. In some embodiments, device 206 can comprise USB 223 connector disposed on casing half 213 and operatively connected to printed circuit board 221 for connecting to an external computing device (not shown). Device 206 can also comprise connector jack 225 operatively connected to printed circuit board 221 for providing a connection between chin attachment 202 and printed circuit board 221. Device 206 can also comprise chin attachment 202 configured to house a sEMG sensor or a MMG sensor and to attach to the chin of a patient, wherein chin attachment sensor 202 is operatively connected to printed circuit board 221 via electrical wires or cables disposed in rubber wiring enclosure 204 disposed between casing half 213 and chin attachment 202. In some embodiments, chin attachment 202 can be a universal fit device or can be custom-fitted to the patient.
[0065]
[0066] In some embodiments, device 207 can comprise top casing half 218, wireless transceiver module 220, battery 222 for providing electrical power to the electronics disposed in device 207, cradle 224 for housing battery 222 and module 220, printed circuit board 226, lower casing half 228 and sensor pad 230. In some embodiments, transceiver module 220 can be a Bluetooth™ transceiver. In some embodiments, casing half 218 can comprise tangs 219 to releasably attach to tang recesses 229 disposed in casing half 228 to enable easy disassembly of device 207 for repairs as necessary. In some embodiments, lower casing half 228 can comprise slidable button 234 to operate switch 235 disposed on circuit board 226 when installed in casing half 228. In some embodiments, lower casing half 228 can comprise opening 236 to provide access to electrical connector 238 disposed on circuit board 226 when installed in casing half 226. In some embodiments, sensor pad 230 can comprise electrodes 232 for connection to circuit board 226. In some embodiments, casing halves 218 and 228 can be approximately 50 mm in diameter, and can be comprised of materials that are easy to clean with hospital disinfectants, as well known to those skilled in the art.
[0067] In some embodiments, the enclosure can be designed to house battery 222, and circuit board 226 that can comprise charging circuitry, analog conditioning circuitry, connection to a plurality of electrodes 232 that can further comprise sEMG or MMG sensors, an onboard microcontroller unit, wireless transceiver module 220 that can comprise a wireless connection method such as, but not limited to, Bluetooth™ or Zigbee™, which can be all on one or more printed circuit board(s) 226. In some embodiments, the device can comprise all analog electronics necessary for signal acquisition and conditioning, as well as all digital electronics necessary for signal digitization and wireless data transfer. Some embodiments can comprise, located on the housing, a button or switch to turn the device off and on or indicate some other functionality to the internal electronics such as wake up or to change the current operational mode. In some embodiments, the device can comprise one or more indicators 216 which can comprise one or more of the following: light emitting diodes, a small screen, an audio indicator such as a speaker or piezo-electric indicator, a vibratory device and a haptic indicator, all of which can be used to indicate such things as whether the device is off or on, if it is charging or finished charging, if the wireless module is connected, battery charge level, if the device is taking a reading, as well as if the device is properly aligned on the individual.
[0068] Referring to
[0069]
[0070]
[0071]
[0072]
[0073] Referring again to
[0074]
[0075] In some embodiments, processor(s) 302 can be configured to implement functionality and/or process instructions for execution in computing device 300. In some embodiments, processor(s) 302 can be capable of retrieving and processing instructions, code, and/or data structures for implementing one or more of the techniques described herein. Instructions can be stored on a computer readable medium, such as memory 304. In some embodiments, processor(s) 302 can comprise digital signal processors (“DSPs”), general purpose microprocessors, application specific integrated circuits (“ASICs”), field programmable logic arrays (“FPGAs”) or other equivalent integrated or discrete logic circuitry as well known to those skilled in the art.
[0076] In some embodiments, memory 304 can be configured to store information that can be used by computing device 300 during operation. Memory 304 can comprise a non-transitory or tangible computer-readable storage medium. In some embodiments, memory 304 can provide temporary memory and/or long-term storage. In some embodiments, memory 304 or portion thereof can comprise volatile memory, that is, in some cases; memory 304 may not maintain stored contents when computing device 300 is powered down. Examples of volatile memories can include random access memories (“RAM”), dynamic random access memories (“DRAM”) and static random access memories (“SRAM”). Memory 304 can be comprised as internal or external memory and, in some embodiments, can comprise non-volatile storage elements. Examples of such non-volatile storage elements can include magnetic hard discs, optical discs, floppy discs, flash memories, forms of electrically programmable memories (“EPROM”) or electrically erasable and programmable (“EEPROM”) memories and other non-volatile storage elements as well known to those skilled in the art.
[0077] In some embodiments, input device(s) 306 can be configured to receive input from user operating computing device 300. Input from a user can be generated as part of the user running one or more software applications, such as swallowing diagnosis and treatment application 316. In some embodiments, input device(s) 306 can comprise a touch-sensitive screen, a track pad, a track point, a mouse, a keyboard, a microphone, a video camera, or any other type of device configured to receive input from a user as well known to those skilled in the art.
[0078] In some embodiments, output device(s) 308 can be configured to provide output to user operating computing device 300. Output can comprise tactile, audio or visual output generated as part of a user running one or more software applications, such as swallowing diagnosis and treatment application 316. In some embodiments, output device(s) 308 can comprise a touch-sensitive screen, sound card, a video graphics adapter card or any other type of device for converting a signal into an appropriate form understandable to humans or machines as well known to those skilled in the art. Additional examples of output device(s) 308 can comprise a speaker, a cathode ray tube (“CRT”) monitor, a liquid crystal display (“LCD”) or any other type of device that can provide audio or visual output to a user as well known to those skilled in the art. In some embodiments where computing device 300 comprises a mobile device, output device(s) 308 can comprise an LCD or organic light emitting diode (“OLED”) display configured to receive user touch inputs, such as, for example, taps, drags and pinches as well known to those skilled in the art.
[0079] In some embodiments, network interface 310 can be configured to enable computing device 300 to communicate with external devices via one or more networks, such as communications network 400. Network interface 310 can comprise a network interface card, such as an Ethernet card, an optical transceiver, a radio frequency transceiver or any other type of device that can send and receive information as well known to those skilled in the art. In some embodiments, network interface 310 can be configured to operate according to one or more of the communication protocols described above with respect to communications network 400. In some embodiments, network interface 310 can enable a patient computing device running swallowing diagnostic and treatment application 316 to transmit information to clinical site 600 or to data warehouse and online clinician portal 500. In some embodiments, clinical site 600 can comprise a server. In some embodiments, the data can be disposed in the data warehouse and online clinician portal 500 with the clinician at the clinical site 600 accessing a patient's data using a web browser through the World Wide Web. In some embodiments, wireless transceiver 311 can comprise a wireless transceiver configured to send and receive data to and/or from measurement device 200. In some embodiments, wireless transceiver 311 and network interface 310 can be integrated. In some embodiments, the data can be encrypted before transmission to clinical site 600 or to data warehouse and online clinician portal 500. This encryption can comprise use any number of different encryption technologies such as, but not limited to, Advance Encryption Standard (“AES”), Transport Layer Security (“TLS”) or its predecessor, Secure Sockets Layer (“SSL”), RSA, Secure Shell (“SSH”), Data Encryption Standard (“DES”) and any other equivalent encryption technology as well known to those skilled in the art. The encryption and decryption of data can be done by swallowing diagnostic and treatment application 316, by operating system 312 or by integrated circuits and processor(s) 302 at a hardware level that compose computing device 300.
[0080] In some embodiments, operating system 312 can be configured to facilitate the interaction of applications, such as applications 314 and swallowing diagnosis and treatment application 316, with processor(s) 302, memory 304, input device(s) 306, output device(s) 308, network interface 310, and wireless transceiver 311 of computing device 300. In some embodiments, operating system 312 can be an operating system designed to be installed on laptops and desktops. For example, operating system 312 can comprise a Windows™ operating system, Linux® or Mac OS™. In embodiments where computing device 300 comprises a mobile device, such as a smartphone or a tablet, operating system 312 can be one of Android™, iOS™ and Windows™ mobile operating system.
[0081] In some embodiments, applications 314 can comprise any applications implemented within or executed by computing device 300 and can be implemented or contained within, operable by, executed by, and/or be operatively/communicatively coupled to components of computing device 300. In some embodiments, applications 314 can comprise instructions that can cause processor(s) 302 of computing device 300 to perform particular functions. In some embodiments, applications 314 can comprise algorithms that are expressed in computer programming statements, such as: for loops, while-loops, if-statements, do-loops, etc. In some embodiments, applications can be developed using a programming language. Examples of programming languages can comprise Hypertext Markup Language (“HTML”), Dynamic HTML, Extensible Markup Language (“XML”), Extensible Stylesheet Language (“XSL”), Document Style Semantics and Specification Language (“DSSSL”), Cascading Style Sheets (“CSS”), Synchronized Multimedia Integration Language (“SMIL”), Wireless Markup Language (“WML”), Java™, Jini™, C, C++, Objective C, C#, Perin®, Python™, UNIX™ Shell, Visual Basic™ or Visual Basic™ Script, Virtual Reality Markup Language (“VRML”) and ColdFusion™ as well as other compilers, assemblers and interpreters as well known to those skilled in the art.
[0082] In some embodiments, swallowing diagnosis and treatment application 316 can comprise an application configured to diagnose and treat a swallowing disorder according to the techniques described herein.
[0083]
[0084] In some embodiments, transmission module 360 can be configured to transmit data to either clinical site 600 or to data warehouse and online clinician portal 500. In some embodiments, anonymized or one way identifiable home practice data can be sent to a central server so that the clinician can monitor progress and change the course of therapy, if necessary. In some embodiments, one or more of the following metrics can be collected and saved at clinical site: (1) time of log-in; (2) duration of session; (3) length of time since last session; (4) session's target amplitude (μV); (5) type of exercise practiced and number of trials; (6) amplitude (μV) and duration (s) for each trial; (7) average (μV); duration (s) average and range for each type of exercise; (8) comments made by patient; (9) outputs of the swallowing detection and characterization algorithm 362; and (10) daily percent of trials completed from those prescribed, as a metric of adherence. These measurements can be communicated to the clinician at the end of each practice; as well, longitudinal analysis over multiple sessions can enable assessment of patient progress over time.
[0085] In some embodiments, at the start of every session, a calibration step can take place where rest and normal swallows are recorded. The software can then calculate the average and range signal amplitude across an initial number of normal swallows. In some embodiments, this initial calibration step can yield the daily targets for the practice following. In some embodiments, the training software can be gamified, meaning that game concepts and design can be used to engage patients and achieve maximal effort. In some embodiments, game concepts can comprise realistic graphics instead of childish ones, levels denoting progress to singular tasks, and feedback relevant to swallowing rather than to the game goals. In some embodiments, swallowing diagnosis and treatment application 316 comprise practice reminders and progress bars as goal setting.
[0086] In some embodiments, the application can connect to the scheduler or notification section of computing device (300) and can further schedule an alarm, notification or message to trigger on their device when the patient is to do their exercises. In some embodiments, the alarm, message or notification can be scheduled using an external device, server or third party service to provide the trigger for the patient to do their exercises.
[0087] In some embodiments, swallowing diagnosis and treatment application 316 can comprise a fishing game where the depth travelled by the lure is contingent on the duration of submental muscle contraction at or above 30% of the daily target amplitude. The longer the contraction, the deeper the lure travels and the more fish the player is likely to catch. In some embodiments, swallowing diagnosis and treatment application 316 can comprise providing feedback based on auditory or visual stimulus that gets more intense as the patient exerts energy to complete the exercise and then returns to a steady state when the patient completes the exercise. The intensity of this stimulus can be proportional to the intensity of the patient's exertion. In some embodiments, swallowing diagnosis and treatment application 316 can use various aspects of the feedback data to accomplish a progressive task that builds on the last task or on many of the tasks before it to provide an interesting experience for the user.
[0088] In some embodiments, swallowing diagnosis and treatment application 316 can calibrate the practice targets according to the patient's daily swallowing ability, thereby avoiding frustration if an arbitrary target is not met. Further, in some embodiments, patients can practice with regular swallows if swallowing exercises are too difficult or contra-indicated. In some embodiments, trials can be summarized at the end of practice, displayed and compared to previous sessions. This way, the patient can receive quick feedback on whether or not he/she is improving in their practice. In some embodiments, swallowing diagnosis and treatment application 316 can walk patients through device set-up, thereby providing another level of assurance. Further, a clinician may spend the first therapy session in the clinic, training the patient on the use of the device and application, prior to home treatment. The clinician then will remotely-monitor home practice.
[0089] In some embodiments, the functions described can be implemented in hardware, software, firmware or any combination thereof as well known to those skilled in the art. If implemented in software, the functions can be stored on, or transmitted over, as one or more instructions or code, a computer-readable medium and executed by a hardware-based processing unit. In some embodiments, computer-readable media can comprise computer-readable storage media, which corresponds to a tangible medium such as data storage media or communication media including any medium that facilitates transfer of a computer program from one place to another, e.g., according to a communication protocol as well known to those skilled in the art. In this manner, computer-readable media generally can correspond to: (1) tangible computer-readable storage media which is non-transitory; or (2) a communication medium such as a signal or carrier wave. Data storage media can comprise any available media that can be accessed by one or more computers or one or more processors to retrieve instructions, code and/or data structures for implementation of the techniques described in this disclosure as well known to those skilled in the art. A computer program product can comprise a computer-readable medium.
[0090] By way of example, and not limitation, in some embodiments, such computer-readable storage media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage, or other magnetic storage devices, flash memory or any other medium that can be used to store desired program code in the form of instructions or data structures and that can be accessed by a computer as well known to those skilled in the art. Also, any connection can be properly termed a computer-readable medium. In some embodiments, if instructions are transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (“DSL”) or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave can be included in the definition of medium. It should be understood, however, that computer-readable storage media and data storage media do not include connections, carrier waves, signals, or other transient media, but are instead directed to non-transient, tangible storage media. Disk and disc, as used herein, includes compact disc (“CD”), laser disc, optical disc, digital versatile disc (“DVD”), floppy disk and Blu-ray disc, where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
[0091] In some embodiments, instructions can be executed by one or more processors, such as one or more digital signal processors (“DSPs”), general purpose microprocessors, application specific integrated circuits (“ASICs”), field programmable logic arrays (“FPGAs”) or other equivalent integrated or discrete logic circuitry as well known to those skilled in the art. Accordingly, the term “processor,” as used herein can refer to any of the foregoing structure or any other structure suitable for implementation of the techniques described herein. In addition, in some embodiments, the functionality described herein can be provided within dedicated hardware and/or software modules as well known to those skilled in the art. Also, the techniques can be fully implemented in one or more circuits or logic elements.
[0092] In some embodiments, the techniques of this disclosure can be implemented in a wide variety of devices or apparatuses, including a wireless handset, an integrated circuit (“IC”) or a set of ICs (e.g., a chip set). Various components, modules or units as described in this disclosure emphasize functional aspects of devices configured to perform the disclosed techniques, but do not necessarily require realization by different hardware units. Rather, as described above, various units can be combined in a codec hardware unit or can be provided by a collection of inter-operative hardware units, including one or more processors as described above, in conjunction with suitable software and/or firmware as well known to those skilled in the art.
[0093] Although a few embodiments have been shown and described, it will be appreciated by those skilled in the art that various changes and modifications can be made to these embodiments without changing or departing from their scope, intent or functionality. The terms and expressions used in the preceding specification have been used herein as terms of description and not of limitation, and there is no intention in the use of such terms and expressions of excluding equivalents of the features shown and described or portions thereof, it being recognized that the invention is defined and limited only by the claims that follow.