Gesture-controlled virtual reality systems and methods of controlling the same are disclosed herein. An example apparatus includes an on-body sensor to output first signals associated with at least one of movement of a body part of a user or a position of the body part relative to a virtual object and an off-body sensor to output second signals associated with at least one of the movement or the position relative to the virtual object. The apparatus also includes at least one processor to generate gesture data based on at least one of the first or second signals, generate position data based on at least one of the first or second signals, determine an intended action of the user relative to the virtual object based on the position data and the gesture data, and generate an output of the virtual object in response to the intended action.

A reproduction control method realized by a computer includes analyzing an actual performance of an actual performer, controlling a reproduction of a performance sound of a musical piece represented by music data in accordance with a result of the analyzing of the actual performance, and outputting a message relating to the actual performance in accordance with the result of the analyzing of the actual performance.

A method includes receiving a non-linguistic input associated with an input musical content. The method also includes, using a model that embeds multiple musical features describing different musical content and relationships between the different musical content in a latent space, identifying one or more embeddings based on the input musical content. The method further includes at least one of: (i) identifying stored musical content based on the one or more identified embeddings or (ii) generating derived musical content based on the one or more identified embeddings. In addition, the method includes presenting at least one of: the stored musical content or the derived musical content. The model is generated by training a machine learning system having one or more first neural network components and one or more second neural network components such that embeddings of the musical features in the latent space have a predefined distribution.

One or more accelerometers embedded with an earbud and/or a set of earphones are able to sense a moving pace of a user. Based on a moving pace of the user, a signal is sent to a remotely connected electronic device. The electronic device is able to separately increase and decrease a beat or rhythm of the audio from the electronic device based on a pace of the user. In some embodiments, an audio alert is sent to the user to inform the user of pace and whether the user has increased or decreased their pace. Additionally, in some embodiments, a program stored on the electronic device is used to compare the user's current progress and/or speed based on past runs and workouts.

A method for adapting auditory biofeedback cues to adjust a user's gait includes receiving a series of respective first signals from each sensor of an integrated sensor system and converting the series of respective first signals into a series of respective second signals. Each respective second signal within the series of respective second signals can be quantized as an audio biofeedback cue and modified so the timing of each respective second signal is aligned to a pre-selected temporal or musical grid. The user's gait is then analyzed as a function of the audio biofeedback cues and the pre-selected temporal or musical grid can be adapted to adjust entrainment of the user's gait.

Systems, devices, media, and methods are presented for playing audio sounds, such as music, on a portable electronic device using a digital color image of a note matrix on a map. A computer vision engine, in an example implementation, includes a mapping module, a color detection module, and a music playback module. The camera captures a color image of the map, including a marker and a note matrix. Based on the color image, the computer vision engine detects a token color value associated with each field. Each token color value is associated with a sound sample from a specific musical instrument. A global state map is stored in memory, including the token color value and location of each field in the note matrix. The music playback module, for each column, in order, plays the notes associated with one or more the rows, using the corresponding sound sample, according to the global state map.

A connector device for electronic musical instruments. The connector device comprising input electrical connector means that receives electrical signals generated by pickup means for an instrument. The instrument being played and a vibration transducer mechanically attached to the input electrical connector means or provided as an integral part of the input electrical connector means, such that vibrations from the instrument are transferred to the vibration transducer. The vibration transducer generates an electrical output signal based on the vibrations. The connector device comprises electrical output connector means that receives the electrical signals generated by the pickup means and the electrical output signal from the vibration transducer and provides these signals to equipment. The connector device further comprises a mixer that combines the signals v.sub.g(t) from the pickup means and the signal v.sub.vib(t) from the vibration transducer. The mixer provides output signal v.sub.o(t) that is a weighted combination of the input signals.

An electronic device may comprise audio processing circuitry, pace tracking circuitry, and positioning circuitry. The pace tracking circuitry may be operable to selects a tempo of songs for playback, by the audio processing circuitry based on position data generated by the positioning circuitry, a desired tempo, and whether the songs are stored locally or network-accessible. The position data may indicate the pace of a runner during a preceding, determined time interval. The pace tracking circuitry may control the song selection and/or time stretching based on a runner profile data stored in memory of the music device. The profile data may include runner's distance-per-stride data. The electronic device may include sensors operable to function as a pedometer. The pace tracking circuitry may update the distance-per-stride data based on the position data and based on data output by the one or more sensors.

Techniques for providing acoustic feedback are disclosed. Several audio clips (21-23) have a synchronized beat. A sensor signal (16) received from a sensor has a sensor signal range divided by first and second thresholds (11, 12) into at least three sensor signal sub-ranges (13-15). An audio signal is output in response to the received sensor signal (16), the output audio signal comprising one or more of the audio clips. If the received sensor signal (16) exceeds the first threshold (11), at least one (21) of the one or more audio clips is discontinued and/or at least one additional audio clip (22) of the audio clips is initiated in synchronization with the one or more audio clips (21). If the received sensor signal (16) falls below the second threshold (12), at least one (21) of the one or more audio clips is discontinued and/or at least one additional audio clip (23) of the audio clips is initiated in synchronization with the one or more audio clips (21).

An adjustment of an audio signal based on an orientation variation amount is carried out according to a surrounding audio condition. An audio signal processing device includes an audio signal analysis unit, an orientation variation analysis unit, and an audio signal adjustment unit. The audio signal analysis unit acquires an audio signal and sets a target value for an audio adjustment on the basis of the audio signal. The orientation variation analysis unit acquires orientation information and generates an orientation variation amount on the basis of the orientation information. The audio signal adjustment unit adjusts the audio signal toward the target value according to the orientation variation amount.