A digital audio workstation organizes musical information in a visually consistent manner, such that it is easier for the user to see and to manipulate the content in a song. The organization includes a multitrack music stream, which depicts multiple adjacent streams (or tracks) of musical content playing in parallel; a Play Bar, which is a visual plane intersecting the music stream; and two or more data layers, which are spatially aligned with the underlying musical stream, but each of which contains a specific type of musical data which can be viewed and manipulated in isolation. This approach to visual organization of music information has some major benefits to the user. Many different kinds of musical content and transformations can be depicted in a clear and consistent manner, making it easier for the user to see and manipulate the song.

Augmented reality is used to visualize virtual objects and their relationship such as musical notes or groups of musical notes using for example a display proximate a user's eyes, for example where images in the display appear to be in a space in front of or around the user, for example where the images in the display are for manipulation by an augmented reality controller, for example where the augmented reality controller is held by the user.

An apparatus, method, and computer-readable storage medium that generate a harmonized musical piece. The method includes receiving a chord selection including a musical key and a scale selection, generating, within a digital audio work session, a chord progression sequence based on the received chord selection, in response to a detected chord selection change, modifying the chord progression sequence to include a chord progression corresponding to the chord selection change, setting the chord progression sequence as a master sequence, in response to detecting a second progression sequence within the digital audio work session, transmitting an identifier to the second progression sequence setting it as a slave sequence, and establishing a synchronized communication link between the master and the slave sequences such that changes made in the master sequence are automatically effectuated in the slave sequence, and combining the master sequence and the slave sequence to form a composed musical piece.

An automatic performance system includes a sign detector configured to detect a sign action of a performer performing a musical piece, a performance analyzer configured to sequentially estimates a performance position in the musical piece by analyzing an acoustic signal representing performed sound in parallel with the performance, and a performance controller configured to control an automatic performance device to carry out an automatic performance of the musical piece so that the automatic performance is synchronized with the sign action detected by the sign detector and a progress of the performance position estimated by the performance analyzer.

An apparatus, method, and computer-readable storage medium that generate a harmonized musical piece. The method includes receiving a chord selection including a musical key and a scale selection, generating, within a digital audio work session, a chord progression sequence based on the received chord selection, in response to a detected chord selection change, modifying the chord progression sequence to include a chord progression corresponding to the chord selection change, setting the chord progression sequence as a master sequence, in response to detecting a second progression sequence within the digital audio work session, transmitting an identifier to the second progression sequence setting it as a slave sequence, and establishing a synchronized communication link between the master and the slave sequences such that changes made in the master sequence are automatically effectuated in the slave sequence, and combining the master sequence and the slave sequence to form a composed musical piece.

A music composition, editing, and playback system and method provides a user interface design based on geometric interpretation of music theory replacing traditional modern music notation with geometric shapes including chords represented by polygons that are colored with colors or hues.

Apparatus configured to, based on visual and audio content captured of a scene comprising at least one audio source and the content including at least two audio tracks, each audio track comprising audio captured by a respective one of at least two audio capture devices located at different locations in the scene, and audio-capture-direction information indicative of at least the direction towards each of the audio capture devices; provide for display of a user selectable audio-capture-location graphic for each of the audio tracks, wherein each audio-capture-location graphic is associated with one of the audio tracks and visually associated with the audio source wherein the form or position of the audio-capture-location graphics is indicative of the direction towards the audio source capture device and wherein based on selection of one of the audio-capture-location graphics, provide for audible presentation of the audio track associated therewith.

Embodiments of the present invention relate to automatically identifying structures of a music stream. A segment structure may be generated that visually indicates repeating segments of a music stream. To generate a segment structure, a feature that corresponds to a music attribute from a waveform corresponding to the music stream is extracted from a waveform, such as an input signal. Utilizing a signal segmentation algorithm, such as a Variable Markov Oracle (VMO) algorithm, a symbolized signal, such as a VMO structure, is generated. From the symbolized signal, a matrix is generated. The matrix may be, for instance, a VMO-SSM. A segment structure is then generated from the matrix. The segment structure illustrates a segmentation of the music stream and the segments that are repetitive.

A musical instrument performance solution is described. Labels with visual indicators provide a reference to performers such that a proper combination of instrument inputs may be selected at the appropriate time. The visual indicators include colors and/or shapes. The visual indicators may be presented using differently-colored lyrical text, where each color corresponds to a set of notes. Each set of notes may for a chordal group such as a triad. The visual indicators may be associated with labels that are able to be adhered to various instrument inputs such as keys of a keyboard or piano.

Provided are a mobile device, a method for operating the same, and a non-transitory computer readable storage medium. The mobile device includes a touch display configured to sense a user input; a memory; and a processor configured to examine, upon receiving the user input for generating an audio file from the touch display, characteristics of the user input and characteristics of a first audio included in first audio data stored in the memory, generate melody data based on the characteristics of the user input and the characteristics of the first audio, generate a second audio based on the melody data and chord information included in the first audio data, and generate the audio file by combining the generated second audio with the first audio.