A system enabling the performance of sensory stimulating content including music and video using gaming in a cyber reality environment, such as using a virtual reality headset. This disclosure includes a system and method through which a performer can virtually trigger and control a presentation of pre-packaged sensory stimulating content including musical programs through gaming. A theme for the performer is that the pre-packaged sensory stimulating content is preferably chosen such that, even where the performer is a novice, the sensory stimulating data is presented in a pleasing and sympathetic manner and scoring is provided as a function of the performer's ability to provide a gesture in association with a displayed virtual trigger.

A signal processing system, machine and method of use to dynamically change the parameters of an audio-visual signal processing circuit without making physical contact.

An isolated guitar string audio capture and visual string indication and chord-finger number overlay process and system that provides a visual way to show what strings are being pressed and played during a guitar instruction video is disclosed. The isolated guitar string audio capture and visual string indication and chord-finger number overlay process and system visibly shows the student what strings are being pressed and played in a given chord by the guitar instructor in the video, all from one camera angle.

The Fingerless Digital Musical Effects Controller Glove is a glove-mounted wearable device that includes a flex sensor placed to record the movement of a wearer's wrist, an accelerometer, and a flexible pressure sensor or switch on the palm of the glove. The device transmits data wirelessly to digital audio software running on an external personal computer, laptop, or smartphone, allowing users to control various parameters of the resultant sound or performance. The Fingerless Digital Musical Effects Controller Glove is so configured as to be perceived by the external computer as a MIDI or audio device, making it compatible with existing digital audio software. The glove is lightweight, flexible, and fingerless, allowing for unencumbered movement of the user's fingersthus freely allowing simultaneous use of a musical instrument or other musical equipment.

In the preset invention, in an initial stationary state of a drumstick section, a CPU stores each axis component of geomagnetism obtained by a magnetic sensor in a RAM, and obtains each axis component of geomagnetism obtained by the magnetic sensor which is changed by a motion provided to the drumstick section at every predetermined timing. Then, the CPU accumulates each axis component of geomagnetism obtained at every predetermined timing, for each predetermined interval, and conforms each axis component of geomagnetism accumulated thereby to each axis component of geomagnetism stored in the RAM.

In the preset invention, in an initial stationary state of a drumstick section, a CPU stores acceleration that occurs due to gravity and is obtained by an acceleration sensor in a RAM, obtains, at every predetermined timing, acceleration that occurs due to a motion provided to the drumstick section and is obtained by the acceleration sensor at a predetermined timing, accumulates the accelerations each obtained at the predetermined timing for each predetermined interval, and conforms the accelerations obtained by accumulation to the acceleration stored in the RAM.

A percussion device includes a drumstick assembly. The drumstick assembly includes a drumstick having a base and a tip end, and a drumstick tip secured to the tip end of the drumstick, the drumstick tip including a sensor. The drumstick including the base thereof, and includes at least one control button, a communication element, and a processor in communication with the at least one control button, the drumstick tip and the communication element. The processor is configured to receive a signal from the drumstick tip and to generate output to the communication element. The output so generated includes a signal that specifies a sound file selected by operation of the at least one control button.

An electronic device is provided. The electronic device includes an image sensor configured to sense a motion of a bow to the string instrument, a vibration sensor configured to sense a vibration generated by the string instrument, and a control module configured to determine a fingering position of a user with respect to the string instrument using the motion of the bow and the vibration.

A method comprises: capturing images of a movable object in a scene and tracking movement of the object in the scene based on the images, to produce movement parameters that define the movement; generating for display an extended reality (XR) visualization of the physical object in the scene and changing the XR visualization responsive to changing ones of the movement parameters, such that the XR visualization visually reflects the tracked movement; displaying the XR visualization; and converting the movement parameters to control messages configured to control one or more of sound and light, and transmitting the control messages.

The present disclosure relates to a virtual drum kit device. The virtual drum kit device includes a motion capture device and a drum sound processing device separated from each other; where, the motion capture device includes at least two drumsticks, the drumstick including a first cover body, as well as a first battery, a first control printed circuit board assembly (PCBA) board and a vibration motor which are arranged in the first cover body, the first control PCBA board being connected to the battery and the vibration motor separately, and being capable of transmitting an RF signal to the drum sound processing device according to a motion instruction captured by the drumstick, the drum sound processing device includes a second cover body, as well as a second battery and a second control PCBA board which are arranged in the second cover body.