The present invention is designed to allow easy synchronization of the movement of a computer graphics (CG) model with sound data. The data structure according to an embodiment of the present invention presents a data structure that relates to a computer graphics (CG) model, including first time-series information for designating the coordinates of the components of the CG model on a per beat basis, and the first time-series information is used on a computer to process the CG model.

Digital signal processing and machine learning techniques can be employed in a vocal capture and performance social network to computationally generate vocal pitch tracks from a collection of vocal performances captured against a common temporal baseline such as a backing track or an original performance by a popularizing artist. In this way, crowd-sourced pitch tracks may be generated and distributed for use in subsequent karaoke-style vocal audio captures or other applications. Large numbers of performances of a song can be used to generate a pitch track. Computationally determined pitch trackings from individual audio signal encodings of the crowd-sourced vocal performance set are aggregated and processed as an observation sequence of a trained Hidden Markov Model (HMM) or other statistical model to produce an output pitch track.

A pedal device receives a connection signal transmitted from headphone to establish first communication that is communication with the headphone. Then, in a case where the first communication has been established, the pedal device transmits the connection signal including information indicating that communication with the headphone has been established. By receiving the connection signal from the pedal device, a portable terminal establishes second communication that is communication with the pedal device. In a case where the received connection signal includes information that the communication with the headphone has been established, the portable terminal may determine that communication establishment between the pedal device and the headphone has been completed.

A method for analyzing one or more notes in a musical composition, comprising for each note: getting a note, a chord and a scale. computing note properties using the note's value and the chord and the scale. A method for transforming one or more input notes into one or more new notes, comprising for each input note: getting an input note and its note properties, getting a new chord and a new scale for the input note, getting a list of notes candidates, computing distances between the input note and every note in the list, using input note's value, input note's note properties, candidate note's value and candidate note's note properties, finding the candidate that has the minimal distance, and setting a new note value using a note value of the candidate with the minimal distance.

A tool is needed for music instrument learners to get feedbacks on the correctness of their performances of a particular piece of music. The invention disclosed here is such a tool that can provide music instrument players instant feedback on note pitch and rhythms accuracy based on sheet music. This is accomplished through audio signal processing, sheet music image processing, and conversion of both analogue images and audio signals into standard digital music representation so a comparison can be done and hence a feedback can be presented to the player. An advanced feature will allow users to save the data to the cloud and retrieve later for comparison of progress. It also will allow user to participate an online competition with other players of the same piece of music.

Provided are systems and methods for transforming a digital score file into one or more of a plurality of levels of simplified visualization outputs. Methods of the present invention may be computer implemented. Systems of the present invention may include at least one display device, a non-transitory memory having instructions embedded thereon, and a processor in communication with the non-transitory memory and the at least one display device. Systems and methods of the present invention may be configured to receive at least one digital score file, upon which one or more simplification rules are executed, resulting in at least one simplified visualization output. Simplification rules may include, but are not limited to, song length, tempo adjustment, tie, rhythm, harmonic rhythm, and chord. One or more simplified visualization outputs are then provided.

A music production system comprises: a computer interface comprising at least one input for receiving an external request for a piece of music and at least one output for transmitting a response to the external request which comprises or indicates a piece of music incorporating first music data; a first music production component configured to process second music data according to at least a first input setting so as to generate the first music data; a second music production component configured to receive via the computer interface an internal request, and provide the second music data based on at least a second input setting denoted by the internal request; and a controller configured to determine in response to the external request the first and second input settings, and instigate the internal request via the computer interface.

Techniques are disclosed relating to implementing audio techniques for real-time audio generation. For example, a music generator system may generate new music content from playback music content based on different parameter representations of an audio signal. In some cases, an audio signal can be represented by both a graph of the signal (e.g., an audio signal graph) relative to time and a graph of the signal relative to beats (e.g., a signal graph). The signal graph is invariant to tempo, which allows for tempo invariant modification of audio parameters of the music content in addition to tempo variant modifications based on the audio signal graph.

The invention generates progressive music in real-time for video games using random, seeded random, and manually input variables to affect melody, phrase length, harmonic chords and complexity, and percussive accompaniment. As the game is played, variables may be passed in that change the music to increase or decrease complexity and tension levels and to interpolate between styles. The generated music then progresses from stable, simple, and consonant to more tense, dissonant, and complex melodies, harmonies and rhythms, and back to the original stage as a musical resolution. Through variables controlling musical parameters, music may progressively change from the atonal region where there is no clear resolution or stability, to tonal, where there is only consonance and stability, and anywhere in between. These variables are assigned through a middleware or a game-engine setup that uses the current device as an audio source plugin, or manually coded into the individual video game.

An electronic device segments a first and second MIDI files into pluralities of source segments and target segments. For each of a plurality of consecutive pairs of first and second target segments, the electronic device identifies a first source segment corresponding to the first target segment of the consecutive pair and identifies a second source segment corresponding to the second target segment of the consecutive pair, where the first and second source segments are identified by determining that the first and second source segments are harmonically conformant to the corresponding first and second target segments, and determining that a transition between the first and second source segments is graphically conformant to a transition between a consecutive pair of source segments. The electronic device generates a third MIDI file using the identified first and second source segments for each of the plurality of consecutive pairs of first and second target segments.