A method and system for automatically generating a video stream synchronized with and reactive to an input audio stream uses one or more still or video images as a source of imagery. The system learns a latent representation of the source imagery and generates a visualization synchronized to, and reactive with, the input audio. A computer divides the audio stream into successive audio frames each characterized by a spectrogram. The computer generates a series of graphics of such latent representation according to the spectrogram of each audio frame. The computer pairs each audio frame with its corresponding graphic to generate an ordered series of graphics. The series of generated graphics can be displayed to accompany the audio in real-time or coupled with the audio stream to provide an audiovisual work that can be transmitted or digitally stored.

An electronic device and a method for controlling the electronic device, the method including receiving an input of a command to reproduce music contents, determining audio characteristics information on the music contents and situation information on an environment where the music contents are being reproduced; and displaying a visualization effect of visualizing the music contents using the audio characteristics information and the situation information, and reproducing the music contents.

An electronic-drum module for connection to one or more electronic-drum pads is provided. The module includes an electronic display, a memory storing audio files for playback when the playback is triggered by a signal received from a pad, and one or more processors coupled to the electronic display and the memory. The processors are configured to play a portion of the audio files when the playback is triggered by the signal received from the one or more electronic-drum pads. The processors are also configured to display, on the display, a user interface for an application, which includes a waveform associated with recorded audio. The processors are also configured to display, on the display, tempo gridlines with a tempo-gridline spacing over the waveform. The module includes a control for adjusting the tempo-gridline spacing. The control is a wheel and is actuated by a rotation of the wheel.

The present invention relates to a method and apparatus to synchronise audio and video data. More particularly, the present invention relates to a loop-based audio-visual mixing apparatus and method for synchronising a plurality of videos and their corresponding audio streams to create audio-visual compositions. According to one aspect, there is provided a method for creating a synchronised lineal sequence from multiple inputs of audio and video data, comprising the steps of: providing a first input, comprising audio and video data; providing one or more subsequent inputs, comprising audio and video data; determining at least one rhythm metric unit for each input; queueing the or each subsequent inputs such that the or each subsequent input is triggered at a beginning of a next said rhythm metric unit of a determined input.

The disclosure can provide a method, an electronic device, and a storage medium for generating a vocal file. The method can include the following. A recording control is displayed on a playing interface in response to a video played on the playing interface being a first type. A recording interface is displayed in response to the recording control being triggered. A user audio is recorded on the recording interface based on a target song. The vocal file is generated based on the user audio and the target song.

In some embodiments, a method of combining two or more songs to present one or more campaigns to a plurality of audience members is provided. The method can include combining a first music selection, a second music selection, and one or more videos into a campaign video. The method can further comprise providing the campaign video for playback to the plurality of audience members and receiving a vote from the plurality of audience members, the vote reflecting a preference for the first selection or the second selection.

A system for platform-independent visualization of audio content, in particular audio tracks utilizing a central computer system in communication with user devices via a computer network. The central system utilizes various algorithms to identify spoken content from audio tracks and identifies “great moments” and/or selects visual assets associated with the identified content. Audio tracks, for example Podcasts, may be segmented into topical audio segments based upon themes or topics, with segments from disparate podcasts combined into a single listening experience, based upon certain criteria, e.g., topics, themes, keywords, and the like.

Methods, systems, and computer program products for network-based processing and distribution of multimedia content of a live performance are disclosed. In some implementations, recording devices can be configured to record a multimedia event (e.g., a musical performance). The recording devices can provide the recordings to a server while the event is ongoing. The server automatically synchronizes, mixes and masters the recordings. The server performs the automatic mixing and mastering using reference audio data previously captured during a rehearsal. The server streams the mastered recording to multiple end users through the Internet or other public or private network. The streaming can be live streaming.

A signal processing device includes an electronic controller including at least one processor. The electronic controller is configured to execute a reception unit, a generation unit, and a processing unit. The reception unit is configured to receive first time-series data that include sound data, and second time-series data that are generated based on the first time-series data and that include at least data indicating a timing of a human action. The generation unit is configured to generate, based on the second time-series data, third time-series data notifying of the timing of the human action. The processing unit is configured to synchronize and output an output signal based on the first time-series data and an output signal based on the third time-series data, such that the timing of the human action for the first time-series data and the timing of the human action for the third time-series data match.

Systems and methods for musical performance are provided. In some embodiments, a system for musical performance includes a processing device to: receive performance information related to a first performance of a piece of music on a first musical instrument; generate at least one control signal based on the performance information; and produce a second performance based on the control signal, wherein to produce the second performance, the processing device is further to: control at least one tone generating device of a second musical instrument to perform the music using the control signal.