Matching Physical Rehabilitation Motions with a Gaming Experience Using Computer Vision on Mobile Phones

Abstract

A physical rehabilitation tool has a personal electronic device with a processor, a camera and a display screen. The processor is programed to illustrate a game module on the display screen. The game module includes at least a first feature and a second feature. The camera is configured to superimpose an image of a body part over the game module. Movement of the image of the body part from the first feature to the second feature requires the body part to traverse a desired range of motion.

Claims

1. A physical rehabilitation tool, comprising: a personal electronic device having a processor, a camera and a display screen; the processor programed to illustrate a game module on the display screen, the game module including at least a first feature and a second feature; and the camera configured to superimpose an image of a body part over the game module; wherein movement of the image of the body part from the first feature to the second feature requires the body part to traverse a desired range of motion.

Description

IN THE DRAWINGS

[0004] FIG. 1. illustrates a structure for an application disclosed herein.

[0005] FIG. 2 illustrates how a module, in particular a game, is built.

[0006] FIG. 3 illustrates one embodiment of detection algorithms to detect the medically correct motions for Range of Motion exercises.

[0007] FIG. 4 illustrates types of motion utilized by patients playing a game in accordance with the disclosure in bar graph format.

[0008] FIG. 5 illustrates the types of motion illustrated in FIG. 4 presented in pie chart format.

DETAILED DESCRIPTION

[0009] As shown in FIG. 1, the platform has three main parts: [0010] 1) The Plan of Care is a list of activities chosen by an occupational therapist (OT) who is following the patient. The activities are what the OT deems to be relevant modules for this patient: games, measurement tools, educational experiences. These modules are mainly for the patient to do on their own at home. [0011] 2) Communication with OT is where the patient talks to the OT via video (synchronous) or chat (asynchronous). Modules from the Plan of Care can be used during video chat for live assessment and feedback. [0012] 3) The Patient Profile is where the data from games and measurement tools is gathered. Both the patient and the therapist have access to it to follow the progress. The therapist may use this data to adjust the Plan of Care as they see fit.

Game Design and Engineering

[0013] FIG. 2 illustrates how modules, and in particular games, are built. The output of this design and engineering process is a “Game Module.” A Game Module is an activity that a patient can “play” for their rehab, if their therapist thinks it relevant. Other types of modules, such as “Educational Experiences” or “Measurement Tools” are built in a similar way but may not be full games.

Detection Algorithms

[0014] The detection algorithms are designed to detect medically correct motions for Range of Motion exercises. FIG. 3 illustrates one embodiment of detection algorithms for a Candy Game.

Therapist Control

[0015] To tailor the patient's experience to their rehab progression, the platform enables the therapist to adjust the experience settings. In particular, the therapist may: [0016] Enable/Disable specific games and specific motions within games; and [0017] Set the angle threshold needed to complete a given motion.

[0018] As the patient's capabilities and range of motion improves, the therapist opens up new experiences and increases the difficulty of the experiences, when the patient is deemed ready.

Data Collection

[0019] The application disclosed herein may collect data on patient performance in the game. Over an exemplary three months period of time, the activity of users in the Candy Game was as illustrated in FIGS. 4 and 5.

[0020] Additional features include collecting data on the patient's performance outside of the games, for example, including a virtual goniometer, a pain scale, and a QuickDASH questionnaire to monitor patients on their Range of Motion, Pain and Functional Capabilities.