A circumambient configuration of sensor pods is disclosed, focusing on a percussionist or other musical performer, to effect desired sound effects. The configuration is ergonomically and/or ergodynamically advantageous as proximate to performer as each sensor pod is within a natural reach of the performer performing conventionally on associated instruments, if any.

Gesture-controlled virtual reality systems and methods of controlling the same are disclosed herein. An example apparatus includes at least two of an on-body sensor, an off-body sensor, and an RF local triangulation system to detect at least one of a position or a movement of a body part of a user relative to a virtual instrument. The example apparatus includes a processor to generate an audio output of the virtual instrument in response to the at least one of the position or the movement.

Motion control data is received from one or more sensors. A first parameter value associated with a music composition is received from a digital audio workstation. A second parameter value associated with the music composition is received from the digital audio workstation. The motion control data is converted to one or more manipulations of one or more virtual objects. The one or more manipulations of the one or more virtual objects are mapped to at least a first command that adjusts the first parameter value and a second command that adjusts the second parameter value. The first command is sent to the digital audio workstation using a first audio input protocol recognized by the digital audio workstation. The second command is sent to the digital audio workstation using a second audio input protocol recognized by the digital audio workstation.

In some implementations, a method includes: obtaining user movement information, wherein the user movement information characterizes real-world body pose and trajectory information of the user; generating, from real-world user movement information and a predetermined placement of the virtual instrument in the computer generated reality (CGR) environment, a predicted virtual instrument interaction time for a virtual instrument interaction prior to the virtual instrument interaction occurring; determining whether or not the predicted virtual instrument interaction time falls within an acceptable temporal range around one of a plurality of temporal sound markers; and in response to determining that the predicted virtual instrument interaction time falls within the acceptable temporal range around a particular temporal sound marker of the plurality of temporal sound markers, quantizing the virtual instrument interaction by presenting play of the virtual instrument to match the particular temporal sound marker of the plurality of temporal sound markers.

Percussive interactive device characterized in that it is composed of an external polyhedric case of deformable material and of an internal case housing an electronic device, whose purpose is to detect external forces applied on said device and to transmit the data collected, once converted into electronic data for audio applications, to an external device used to process and emit sound.

A system enabling the performance of sensory stimulating content including music and video using gaining in a cyber reality environment, such as using a virtual reality headset. This disclosure includes a system and method through which a performer can virtually trigger and control a presentation of pre-packaged sensory stimulating content including musical programs through gaming. A theme for the performer is that the pre-packaged sensory stimulating content is preferably chosen such that, even where the performer is a novice, the sensory stimulating data is presented in a pleasing and sympathetic manner and scoring is provided as a function of the performer's ability to provide a gesture in association with a displayed virtual trigger.

Systems, methods and computer readable media are disclosed for gesture input beyond skeletal. A user's movement or body position is captured by a capture device of a system. Further, non-user-position data is received by the system, such as controller input by the user, an item that the user is wearing, a prop under the control of the user, or a second user's movement or body position. The system incorporates both the user-position data and the non-user-position data to determine one or more inputs the user made to the system.

Motion control data is received from one or more sensors. A first parameter value associated with a music composition is received from a digital audio workstation. A second parameter value associated with the music composition is received from the digital audio workstation. The motion control data is converted to one or more manipulations of one or more virtual objects. The one or more manipulations of the one or more virtual objects are mapped to at least a first command that adjusts the first parameter value and a second command that adjusts the second parameter value. The first command is sent to the digital audio workstation using a first audio input protocol recognized by the digital audio workstation. The second command is sent to the digital audio workstation using a second audio input protocol recognized by the digital audio workstation.

Various examples of the present invention relate to a wearable electronic device, comprising: a communication circuit for implementing communication; a sensor circuit for sensing a movement of the wearable electronic device; and a processor electrically connected to the communication circuit and the sensor circuit, wherein the processor transmits, through the communication circuit to the electronic device, movement data of the wearable electronic device acquired through the sensor circuit, and the transmitted movement data of the wearable electronic device enables the electronic device to control a loop application being executed in the electronic device. In addition, other examples, which can be identified through the description, are possible.

The present invention relates to a removable electronic device for emulating at least one sound of a drum-type percussion instrument, said device being intended to instrumentalise a striking element. A defining means defines a striking area on a tangible support. An allocating means allocates a drum element associated with a predetermined sound to the striking area, in a database. At least one sensor generates a stroke signal having at least one piece of stroke information on a stroke of a user with the striking element in the striking area. A computer processing means implements a processing algorithm configured to process the stroke signal to spatially locate said stroke in order to detect the area struck and to determine the drum element corresponding to this area struck. A generating means is configured to generate a sound signal comprising information on the sound virtually generated by said stroke of the striking element in said area struck.