A platform for audio and electronic music applications where the electronics are implemented as modules, and the modules mount in a cabinet with a common power supply and infrastructure. The platform addresses problems in electrical, mechanical, usability, and power distribution areas, and is suitable for guitar effects, synthesizers, studio equipment, and DJ gear.

The disclosure provides a method for synthesizing a song multimedia, an electronic device and a storage medium. Material obtaining modes are provided based on a song multimedia synthesis request. User audios provided by a user are obtained based on a selected material obtaining mode. A user timbre output by a timbre extraction model is obtained by inputting the user audios into the timbre extraction model. Lyrics to be synthesized and a tune to be synthesized provided by the user are obtained based on the selected material obtaining mode, and a synthesized song multimedia is obtained by inputting the user timbre, the lyrics to be synthesized and the tune to be synthesized into a song synthesis model.

A sound signal synthesis method includes generating first data representing a deterministic component of a sound signal based on second control data representing conditions of the sound signal, generating, using a first generation model, second data representing a stochastic component of the sound signal based on the first data and first control data representing conditions of the sound signal, and combining the deterministic component represented by the first data and the stochastic component represented by the second data and thereby generating the sound signal.

A computer-implemented sound signal synthesis method generates control data including pitch notation data indicative of a pitch name of a pitch of a sound signal to be synthesized and octave data indicative of an octave of the pitch of the sound signal to be synthesized; and estimates output data indicative of the sound signal to be synthesized by inputting the generated control data into a generative model that has learned a relationship between training control data including training pitch notation data indicative of a pitch name of a pitch of a reference signal and training octave data indicative of an octave of the pitch of the reference signal; and training output data indicative of the reference signal.

A method generates first pitch data indicating a pitch of a first sound signal to be synthesized; and uses a generative model to estimate output data indicative of the first sound signal based on the generated first pitch data. The generative model has been trained to learn a relationship between second pitch data indicating a pitch of a second sound signal and the second sound signal. The first pitch data includes a first plurality of pieces of pitch notation data corresponding to pitch names, and is generated by setting, from among the first plurality of pieces of pitch notation data, a first piece of pitch notation data that corresponds to the pitch of the first sound signal as a hot value based on a difference between a reference pitch of a pitch name corresponding to the first piece of pitch notation data and the pitch of the first sound signal.

Various methods for representing audio suitable for use in variational audio encoding are disclosed. A method comprises maintaining, by a computing system, state information for multiple resonator models with different resonant frequencies. The method further comprises iteratively performing a number of different operations, by the computing system for multiple respective samples in a set of audio samples in the time domain. These operations include updating the state information for the multiple resonator models based on the sample amplitude. The operations also include determining respective resonator amplitudes and phases for the updated multiple resonator models and storing, respective resonator amplitude and change-in-phase information for the sample.

The technology can use a music generation platform to ingest raw audio to generate multi-level music (i.e., multiple streams corresponding to different instruments) based on user steerings, such as genre, artist, style, etc. Implementations can apply an encoder to take the raw audio and generate a sequence of discrete representations. Implementations can then input the sequence of discrete representations to an embedding layer that converts the sequence of discrete representations to sequences of embeddings in the same dimensionality, which are summed together to form a single sequence. The sequence of summed embeddings can be provided to a neural network that produces sequences of predicted embeddings for multiple instruments, which are then used by a coder layer to generate instrument-specific code sequences. Implementations can input the instrument-specific code sequences to a decoder, which can also receive the user steerings, and convert them into Mel spectrograms, then instrument-specific audio waveforms.

A data sonification system for representing a plurality of channels of numerical information is described wherein the rate of the periodic modulation is itself used as a vehicle for carrying information of at least one component of the multidimensional numerical data. The data sonification system includes a plurality of audio waveform generator elements. Each of the audio waveform generator elements generates an associated audio frequency waveform. Each audio frequency waveform has an audio frequency parameter and at least one timbre modulation parameter having a settable value. The timbre modulation parameter affects the timbre of the audio waveform. The data sonification system includes a mapping element for associating aspects of multidimensional numerical data with the timbre modulation parameter of each audio frequency waveform. The mapping element sets the value of the timbre modulation parameter in response to multidimensional numerical data and/or periodic modulation.

Calculation is performed to provide a delay and attenuated oscillation to a blowing pressure detected by a blowing pressure sensor which detects blowing pressure, and a musical sound is generated based on the blowing pressure subjected to the calculation. As a result, for example, a blowing feeling of an electronic wind instrument can be made closer to a blowing feeling of a natural musical instrument.

A data sonification system for representing a plurality of channels of numerical information is described wherein the rate of the periodic modulation is itself used as a vehicle for carrying information of at least one component of the multidimensional numerical data. The data sonification system includes a plurality of audio waveform generator elements. Each of the audio waveform generator elements generates an associated audio frequency waveform. Each audio frequency waveform has an audio frequency parameter and at least one timbre modulation parameter having a settable value. The timbre modulation parameter affects the timbre of the audio waveform. The data sonification system includes a mapping element for associating aspects of multidimensional numerical data with the timbre modulation parameter of each audio frequency waveform. The mapping element sets the value of the timbre modulation parameter in response to multidimensional numerical data and/or periodic modulation.