According to embodiments of the present disclosure, systems, methods, and computer program products for audio- and video-editing are provided. A reference file comprising a visual representation (e.g., musical score) of a final video/audio product is read and displayed to a user. A plurality of sections (e.g., measures) and a plurality of symbols (e.g., notes) are determined. A plurality of audio/video recordings are read where each recording corresponding to at least a portion of the visual representation. For each of the plurality of sections, a corresponding segment of at least one of the plurality of audio/video recordings is determined. First selections of a section of the plurality of sections are received from the user. For each of the first selections, a listing of the plurality of audio/video recordings in which at least a portion of the selected section occurs is displayed to the user. For each of the first selections, a second selection of an audio/video recording from the listing is received from the user thereby linking the selected section to the corresponding segment of the selected audio/video recording. An audio/video file is generated by combining each of the linked segments.

A method for online music learning of playing a musical instrument, that may be a string instrument, a woodwind instrument, a brass instrument, a percussion instrument, or vocal (singing) is described. A client device, such as a smartphone or a tablet notifies a person, such as visually by a display or audibly by a sounder, of a sequence of musical symbols that may be part of a musical piece to be played on the musical instrument. The pace or tempo of the notified sequence is adapted according to a stored skill level value of the person and the pace or tempo associated with the musical piece. The client device, monitors, using a microphone(s) in the client device, the errors in the playing of the sequence, and using a predefined accordingly updates the stored skill level value, and accordingly changes the arrangement, pace and/or tempo of the next sequence of musical symbols.

Techniques are disclosed relating to implementing audio techniques for real-time audio generation. For example, a music generator system may generate new music content from playback music content based on different parameter representations of an audio signal. In some cases, an audio signal can be represented by both a graph of the signal (e.g., an audio signal graph) relative to time and a graph of the signal relative to beats (e.g., a signal graph). The signal graph is invariant to tempo, which allows for tempo invariant modification of audio parameters of the music content in addition to tempo variant modifications based on the audio signal graph.

Methods and systems are described that are utilized for remotely controlling a musical instrument. A first digital record comprising musical instrument digital commands from a first electronic instrument for a first item of music is accessed. The first digital record is transmitted over a network using a network interface to a remote, second electronic instrument for playback to a first user. Optionally, video data is streamed to a display device of a user while the first digital record is played back by the second electronic instrument. A key change command is transmitted over the network using the network interface to the second electronic instrument to cause the second electronic instrument to playback the first digital record for the first item of music in accordance with the key change command. The key change command may be transmitted during the streaming of the video data.

A real-time music generation engine for an interactive system includes a Musical Rule Set (MRS AND/OR CA AND/OR PCU) unit configured to combine predefined composer input with a real-time control signal into a music signal; a Constructor Automaton (CA) configured to generate a fluid piece of music based on rule definitions defined by the predefined composer input within the MRS AND/OR CA AND/OR PCU unit by musical handlers; and a Performance Cluster Unit (PCU) configured to convert the fluid piece of music from the CA into a corresponding music control signal for real-time playback by the interactive system.

A method of operating a UI for controlling a virtual musical instrument can include receiving a first input corresponding to a selection of an array of cells within a cell matrix, each array of the cell matrix assigned to audio sample data stored in a computer-readable medium that, when triggered, causes the audio sample data to output corresponding audio, and each cell within its particular array of the cell matrix, in response to being selected for playback and upon being triggered to begin playback, causes the audio sample data corresponding to the cell's particular array to be played. The method can further include receiving a second input corresponding to a changing of a number of cells within the particular selected array; and changing the number of cells within the selected array based on the second input and maintaining a number of cells in other arrays within the cell matrix.

A system and method for synchronizing an audio or MIDI file with a video file are provided. The method includes receiving a first audio or MIDI file, receiving a video file, and operating an audio synchronization module to perform steps of synchronizing the first audio or MIDI file with the video file, marking an event in the video file at a point on a timeline, detecting a first musical key for the event, retrieving a musical stinger or swell from a library, in which the musical stinger or swell is a second audio or MIDI file and is tagged with a second musical key, and the second musical key is relevant to the first musical key, and placing the musical stinger or swell at the point of the timeline marked for the event.

A system and method for synchronizing an audio or MIDI file with a video file are provided. The method includes receiving a first audio or MIDI file, receiving a video file, and operating an audio synchronization module to perform steps of synchronizing the first audio or MIDI file with the video file, marking an event in the video file at a point on a timeline, detecting a first musical key for the event, retrieving a musical stinger or swell from a library, in which the musical stinger or swell is a second audio or MIDI file and is tagged with a second musical key, and the second musical key is relevant to the first musical key, and placing the musical stinger or swell at the point of the timeline marked for the event.

Techniques are provided for generating an output file. One technique involves the steps of generating audio or MIDI content blocks from one or more musical performances; receiving an input file having audio or MIDI music content; generating a harmonic chord map for the input file; using the harmonic chord map to automatically select a subset of the audio or MIDI content blocks, and generating the output file by combining the selected subset of content blocks and the input file. This technique may enable the creation of unique and new musical accompaniments by re-purposing audio or MIDI content from back catalogs and/or out-takes of musical works. The new arrangement may be provided in multiple music styles, genres, or moods and may contain performances from multiple musical instruments, which may be pre-recorded from live instrument performances and/or of MIDI generated musical content.

Techniques are provided for generating an output file. One technique involves the steps of generating audio or MIDI content blocks from one or more musical performances; receiving an input file having audio or MIDI music content; generating a harmonic chord map for the input file; using the harmonic chord map to automatically select a subset of the audio or MIDI content blocks, and generating the output file by combining the selected subset of content blocks and the input file. This technique may enable the creation of unique and new musical accompaniments by re-purposing audio or MIDI content from back catalogs and/or out-takes of musical works. The new arrangement may be provided in multiple music styles, genres, or moods and may contain performances from multiple musical instruments, which may be pre-recorded from live instrument performances and/or of MIDI generated musical content.