An arrangement for the conversion of at least one detected force from the movement of a sensing unit into an auditory signal. The arrangement includes at least one sensor for generating a force signal from the at least one detected force. A processing unit is configured for converting the force signal into a digital auditory signal. An output unit for converting the digital auditory signal into an auditory signal is further included wherein the digital auditory signal includes in formation of acceleration, strength and duration of a single detected force. The present method is used for converting at least one detected force affecting an object into auditory signal, as well as the use of an arrangement according to the present invention for various entertainment and/or therapeutic purposes.

A system measures performance activity of a user using a motion capture device, such as one or more knee sleeves each a plurality of inertial-measurement unit. Captured motion characteristic data is classified against previously captured data and then mapped to particular audio effects, which are then altered in different ways depending on the classification and provided the user. The audio feedback works to improve the user's performance of the activity by changing between negative and positive feedback depending on the user's performance. The system regularly measures the motion capture data, altering audio effects provided to the user, until the user reaches an improvement goal.

A system and method for generating wireless signals from the physical movement of a person utilizing a movement detection mechanism attached to the person wherein the system allows a person to manipulate the generated wireless signals to selectively control digital responses which may be in the form of sensory-perceivable outputs such as sounds and/or visual effects, for example, through the person's physical movement. Movement sensors attached to the person (e.g., on one foot or both feet) communicate with other system components such as microprocessors, transmitters and/or tactile interface controls, for example, to wirelessly send signal pulses from a person to a computer or mobile device and allow the person wearing the sensors and/or another person to selectively control the dynamics of the digital responses so to create a unique sensory output.

Various systems and methods for air gesture-based composition and instruction systems are described herein. A composition system for composing gesture-based performances may receive an indication of an air gesture performed by a user; reference a mapping of air gestures to air gesture notations to identify an air gesture notation corresponding to the air gesture; and store an indication of the air gesture notation in a memory of the computerized composition system. Another system used for instruction may present a plurality of air gesture notations in a musical arrangement; receive an indication of an air gesture performed by a user; reference a mapping of air gestures to air gesture notations to identify an air gesture notation corresponding to the air gesture; and guide the user through the musical arrangement by sequentially highlighting the air gesture notations in the musical arrangement based on the mapping of air gestures to air gesture notations.

Systems, devices, media, and methods are described for presenting a tutorial in augmented reality on the display of a smart eyewear device. The system includes a marker registration utility for setting a marker on a musical instrument, a localization utility, a virtual object rendering utility for presenting virtual tutorial objects on the display near the instrument, and a hand tracking utility for tracking the performer's finger locations in real time. The virtual tutorial objects, in one example, includes graphical elements presented on a virtual scroll that appears to move toward the instrument at a speed correlated with the song tempo. The hand tracking utility calculates a set of expected fingertip coordinates based on a detected hand shape.

Methods and systems are disclosed to facilitate creating the sensation of vibrotactile movement on the body of a user. Vibratory motors are used to generate a haptic language for music or other stimuli that is integrated into wearable technology. The disclosed system in certain embodiments enables the creation of a family of devices that allow people such as those with hearing impairments to experience sounds such as music or other input to the system. For example, a sound vest or other wearable array transforms musical input to haptic signals so that users can experience their favorite music in a unique way, and can also recognize auditory or other cues in the user's real or virtual reality environment and convey this information to the user using haptic signals.

One or more accelerometers embedded with an earbud and/or a set of earphones are able to sense a moving pace of a user. Based on a moving pace of the user, a signal is sent to a remotely connected electronic device. The electronic device is able to separately increase and decrease a beat or rhythm of the audio from the electronic device based on a pace of the user. In some embodiments, an audio alert is sent to the user to inform the user of pace and whether the user has increased or decreased their pace. Additionally, in some embodiments, a program stored on the electronic device is used to compare the user's current progress and/or speed based on past runs and workouts.

A wearable sensor system is disclosed that provides a measurable magnetic field that changes horizontally within the range of motion of human limbs. The wearable sensor system includes a magnetic sensing device, and one or more magnet devices that provide the measurable magnetic field with a strength exceeding the Earth's magnetic field. To this end, the magnetic sensing system provides a personal magnetic field about a user, with that magnetic field traveling with the user and overpowering adjacent interfering fields. The wearable sensor system may include a sensor arrangement that measures a strength of the personal magnetic field and field direction to perform horizontal localization, and may send a representation of a same to a remote computing device to cause an action to occur. Some such actions include output of pre-recorded or synthesized musical notes, for example.

A system measures performance activity of a user using a motion capture device, such as one or more knee sleeves each a plurality of inertial-measurement unit. Captured motion characteristic data is classified against previously captured data and then mapped to particular audio effects, which are then altered in different ways depending on the classification and provided the user. The audio feedback works to improve the user's performance of the activity by changing between negative and positive feedback depending on the user's performance. The system regularly measures the motion capture data, altering audio effects provided to the user, until the user reaches an improvement goal.

A system and method for generating wireless signals from the physical movement of a person utilizing a movement detection mechanism attached to the person wherein the system allows a person to manipulate the generated wireless signals to selectively control digital responses which may be in the form of sensory-perceivable outputs such as sounds and/or visual effects, for example, through the person's physical movement. Movement sensors attached to the person (e.g., on one foot or both feet) communicate with other system components such as microprocessors, transmitters and/or tactile interface controls, for example, to wirelessly send signal pulses from a person to a computer or mobile device and allow the person wearing the sensors and/or another person to selectively control the dynamics of the digital responses so to create a unique sensory output.