A digital multi-media device provides features for a user unskilled in musical arts or sound handling techniques that provides automatic musical score composition in accordance with contained composition instructions. Stored sound samples and interfaces for obtaining external signals provide signals for merger with visual and sound presentations to obtain altered presentations either time shifted or in real time. In this fashion the user can create simulated radio stations for playback of prearranged and composed audio material. Further, the automatically composed musical score may be mixed with synthesized, digitized signals from the stored sound samples and external signals obtained through the device interfaces.

A method for generating music is provided, the method comprising receiving, on a capacitive touch sensitive interface such as a keyboard, multi-finger gesture inputs having a first component and a second component, wherein the second component has a temporal evolution such as speed; determining the onset of an audio signal, such as a tone, based on the first component, analyzing the temporal evolution of the second component to determine MIDI or Open Sound Control OSC instructions; modifying the audio signal based on the instructions, in particular by decoupling the temporal relationship between specific gesture inputs (e.g. at key onset, during a note and upon key release), thus mapping gesture and motion inputs, to thus obtain previously unachievable musical effects with music synthesizers.

An electronic musical instrument includes a performance operator and at least one processor. In accordance with pitch data associated with the performance operator operated by a user, the at least one processor digitally synthesizes and outputs inferential musical sound data including inferential performance technique of a player. The inferential performance technique of the player is based on acoustic feature data output by a trained acoustic model obtained by performing machine learning on: a training score data set including training pitch data; and a training performance data set obtained by the player playing a musical instrument and is not played in the user operation of the performance operator.

A system and method for operating and performing a remotely networked virtual musical instrument. A client transmits musical control data to a remote server over the network, encompassing a digital music engine and digitally sampled virtual musical instruments. In return, the client consumes, synchronizes, and mixes the combined server playback stream from the network of the fully expressive and interactive musical performance with zero audible latency.

The disclosure can provide a method, an electronic device, and a storage medium for generating a vocal file. The method can include the following. A recording control is displayed on a playing interface in response to a video played on the playing interface being a first type. A recording interface is displayed in response to the recording control being triggered. A user audio is recorded on the recording interface based on a target song. The vocal file is generated based on the user audio and the target song.

A computer-implemented sound signal synthesis method includes: generating, based on first control data representative of a plurality of conditions of a sound signal to be generated, (i) first data representative of a sound source spectrum of the sound signal, and (ii) second data representative of a spectral envelope of the sound signal; and synthesizing the sound signal based on the sound source spectrum indicated by the first data and the spectral envelope indicated by the second data.

A device is provided for capturing vibrations produced by an object such as a musical instrument such as a drum head of a drum kit. The device comprises a detectable element, such as a ferromagnetic element, such as a metal shim and a sensor spaced apart from and located relative to the musical instrument. The detectable element is located between the sensor and the musical instrument. When the musical instrument vibrates, the sensor remains stationary and the detectable element is vibrated relative to the sensor by the musical instrument.

Methods, systems, and computer program products for network-based processing and distribution of multimedia content of a live performance are disclosed. In some implementations, recording devices can be configured to record a multimedia event (e.g., a musical performance). The recording devices can provide the recordings to a server while the event is ongoing. The server automatically synchronizes, mixes and masters the recordings. The server performs the automatic mixing and mastering using reference audio data previously captured during a rehearsal. The server streams the mastered recording to multiple end users through the Internet or other public or private network. The streaming can be live streaming.

Methods, systems, and computer program products for network-based processing and distribution of multimedia content of a live performance are disclosed. In some implementations, recording devices can be configured to record a multimedia event (e.g., a musical performance). The recording devices can provide the recordings to a server while the event is ongoing. The server automatically synchronizes, mixes and masters the recordings. The server performs the automatic mixing and mastering using reference audio data previously captured during a rehearsal. The server streams the mastered recording to multiple end users through the Internet or other public or private network. The streaming can be live streaming.

A sound synthesizing method according to one aspect of the present disclosure relates to a sound synthesizing method that is realized by a computer, including receiving musical score data and acoustic data via a user interface; and generating, based on respective one of the musical score data and the acoustic data, acoustic features of a sound waveform having a desired timbre.