A system is described for an enhanced bow piece of a stringed musical instrument. The enhancement includes a visual display element attached to the bow. The appearance of the display changes in response to bow motion, bow position, and one or more user-supplied inputs (e.g. buttons). The system can be entirely self-contained and used as a normal instrument bow, providing a light-up/responsive effect while the user plays their instrument in an otherwise normal way. There is some capability for multiple self-contained units to be locally synchronized, providing group-based visualizations. Alternatively, these devices can be monitored and controlled by an external control system.

A method for generating an audio output is described. Image inputs of interactive movements by a user captured by an image sensor are received. The interactive movements are mapped to a sequence of audio element identifiers. The sequence of audio element identifiers are processed to generate a musical sequence by performing music theory rule enforcement on the sequence of audio element identifiers. An audio output that represents the musical sequence is generated.

Provided are a method and device for processing a music file, a terminal and a storage medium. The method comprises: in response to a received sound effect adjustment instruction, acquiring a music file, the adjustment of which is indicated by the sound effect adjustment instruction; carrying out vocals and accompaniment separation on the music file to obtain vocal data and accompaniment data in the music file; carrying out first sound effect processing on the vocal data to obtain target vocal data, and carrying out second sound effect processing on the accompaniment data to obtain target accompaniment data; and synthesizing the target vocal data and the target accompaniment data to obtain a target music file.

A hand-held controller (100) for a computer is disclosed. The controller is substantially U-shaped and has front and IN rear sections (110, 130) spaced apart by a link section (140). The controller fits onto the user's hand in use so that the rear section (130) lies over the back of the hand and the front section (110) lies in the palm of the hand. The front section includes a user interface, such as a keypad, touchpad or touch area (120), to receive inputs from the user's fingers. The controller may also include a gyroscope and an accelerometer to determine the orientation and movement of the controller. The controller further comprises a transmitter for transmitting data relating to the user inputs to the computer, the data causing the computer system to carry out one or more pre-assigned actions. The pre-assigned action may comprise playing or altering an audio sound, or changing the key, pitch, tone, sound quality or volume of the audio sound. A control system for a computer comprising two hand-held controllers is also disclosed. The hand-held controllers may be the same, or one may be configured to receive only orientation and movement user inputs. A computer system comprising two hand-held controllers and a computer is also disclosed. In preferred embodiments, the computer system is a musical instrument emulator.

Finger-tracking systems and methods for virtual instruments playback. The described system tracks the position of user's ten fingers on a projection surface and can be used to play virtual instruments such as virtual piano, drums, and bells. The system tracks the movement of user's ten fingers while keeping them free of encumbrance or excessive postural constraints. More specifically, in one or more embodiments, a coded light based projector is used to send out location signal onto a flat surface, and ten light sensors are mounted on user's fingers to receive these signals and locate user's fingers. Based on their locations and relative distance to a fixed point, a printed music instrument can be used for virtual instrument music playback. With the described tracking system, various embodiments of virtual music instruments may be implemented, including a system and method for virtual piano playing as well as virtual Chinese bell playing on printed keyboard and printed Chinese bell set.

The present disclosure relates to systems, methods, and devices for music simulation. The methods may include determining one or more simulation actions based on data associated with one or more simulation actions acquired by at least one sensor. The methods may further include determining, based on at least one of the one or more simulation actions and a mapping relationship between simulation actions and corresponding musical instruments, a simulation musical instrument that matches with the one or more simulation actions. The methods may further include determining, based on the one or more simulation actions, one or more first features associated with the simulation musical instrument. The methods may further include playing music based on the one or more first features.

An electronic musical instrument for generating a plurality of audio signals can include an attitude measuring unit that is configured to measure one or more changes in an attitude of the musical instrument with respect to a reference frame in a multi-dimensional space. The musical instrument can also include a processor that is configured to generate one or more signals based on the measured changes in the attitude of the musical instrument. The musical instrument can also include an audio synthesizer that is configured to generate the plurality of audio signals based on the generated signals.

Methods and apparatus to use predicted actions in VR environments are disclosed. An example method includes predicting a predicted time of a predicted virtual contact of a virtual reality controller with a virtual musical instrument, determining, based on at least one parameter of the predicted virtual contact, a characteristic of a virtual sound the musical instrument would make in response to the virtual contact, and initiating producing the sound before the predicted time of the virtual contact of the controller with the musical instrument.

An arrangement for the conversion of at least one detected force from the movement of a sensing unit into an auditory signal. The arrangement includes at least one sensor for generating a force signal from the at least one detected force. A processing unit is configured for converting the force signal into a digital auditory signal. An output unit for converting the digital auditory signal into an auditory signal is further included wherein the digital auditory signal includes in formation of acceleration, strength and duration of a single detected force. The present method is used for converting at least one detected force affecting an object into auditory signal, as well as the use of an arrangement according to the present invention for various entertainment and/or therapeutic purposes.

A handheld musical instrument for playing a variety of audio program, the handheld musical instrument includes a main body portion with one or more sensors, a handle portion engaged with said main body portion, wherein said handle portion includes one or more control buttons to select a type of program to be played by said handheld musical instrument and a gesture detection module for detecting gestures associated with said handheld musical instrument and controlling a tempo associated with said program played by said handheld musical instrument based on said detected gestures.