The present invention relates to the field of audio recognition, in particular to computer implemented note recognition methods in a gaming application. Furthermore, the present invention relates to improving latency of such audio recognition methods. One of the embodiments of the invention described herein is a method for note recognition of an audio source. The method includes: dividing an audio input into a plurality of frames, each frame having a pre-determined length, conducting a frequency analysis of at least a set of the plurality of frames, based on the frequency analysis, determining if a frame is a transient frame with a frequency change between the beginning and end of the frame, comparing the frequency analysis of each said transient frame to the frequency analysis of an immediately preceding frame and, based on said comparison, determining at least one probable pitch present at the end of each transient frame, and for each transient frame, outputting pitch data indicative of the probable pitch present at the end of the transient frame.

A musical composition in broken down by instrument or channels within the composition. The composition is further broken down by time period. Each distinct block of time by instrument is a discrete block within the musical composition for which a visualization is created based on the sound produced. These blocks are then scrambled, at least partially, by instrument and time and displayed on a grid where each block or instrument can be played by selecting same. The blocks are also movable with a goal of placing the blocks in order by time and instrument so that the entirety of the musical composition can again be played aurally.

The present invention relates to the field of audio recognition, in particular to computer implemented note recognition methods in a gaming application. Furthermore, the present invention relates to improving latency of such audio recognition methods. One of the embodiments of the invention described herein is a method for note recognition of an audio source. The method includes: dividing an audio input into a plurality of frames, each frame having a pre-determined length, conducting a frequency analysis of at least a set of the plurality of frames, based on the frequency analysis, determining if a frame is a transient frame with a frequency change between the beginning and end of the frame, comparing the frequency analysis of each said transient frame to the frequency analysis of an immediately preceding frame and, based on said comparison, determining at least one probable pitch present at the end of each transient frame, and for each transient frame, outputting pitch data indicative of the probable pitch present at the end of the transient frame.

The teachings described herein are generally directed to a system, method, and apparatus for separating and mixing tracks within music. The system can have a video that is synchronized with the variations in the musical tempo through a variable timing reference track designed and provided for a user of the preselected piece of music that was prerecorded, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the preselected piece of music.

Notwithstanding practical limitations imposed by mobile device platforms and applications, truly captivating musical instruments may be synthesized in ways that allow musically expressive performances to be captured and rendered in real-time. In some cases, synthetic musical instruments can provide a game, grading or instructional mode in which one or more qualities of a user's performance are assessed relative to a musical score. By constantly adapting to such modes to actual performance characteristics and, in some cases, to the level of a given user musician's skill, user interactions with synthetic musical instruments can be made more engaging and may capture user interest and economic opportunities (e.g., for in-app purchase and/or social networking) over generally longer periods of time.

The present disclosure is directed at methods and systems for implementing and scoring a vocal improvisation feature in a music video game. This feature can allow players of music video games to sing improvised harmonies for a song using a microphone controller. The improvised harmonies can be musically consonant with a pre-authored melody track programmed into the music video game. The improvised harmonies can comprise pre-authored notes programmed into the pre-authored melody track, or can be generated by the music video game during run-time based on the pre-authored melody track. The music video game can also display guidelines visually showing permissible harmony tracks in relation to the pre-authored melody track.

The present disclosure is directed at systems, methods, and apparatus for implementing a rhythm-action game having an improvisational fill feature. The rhythm-action game can provide a musical track having at least one section that can be varied. The rhythm-action game can also provide a database having a plurality of fills, wherein each fill includes a soundtrack and a set of cues. During run-time, the rhythm-action game can select, for each section in the musical track that can be varied, a fill from the plurality of fills. In some embodiments, this selection can be based on various characterizing parameters to ensure that the fill is a good fit for the musical track. The rhythm-action game can also display a set of visual cues associated with the selected fill, and to evaluate whether received user input substantially corresponds to the displayed cues.

An information processing apparatus is provided which includes a metadata extraction unit for analyzing an audio signal in which a plurality of instrument sounds are present in a mixed manner and for extracting, as a feature quantity of the audio signal, metadata changing along with passing of a playing time, and a player parameter determination unit for determining, based on the metadata extracted by the metadata extraction unit, a player parameter for controlling a movement of a player object corresponding to each instrument sound.

The teachings described herein are generally directed to a system, method, and apparatus for separating and mixing tracks within music. The system can have a video that is synchronized with the variations in the musical tempo through a variable timing reference track designed and provided for a user of the preselected performance that was prerecorded, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the preselected performance.

A playback system is provided for altering the frame rate of streaming digital movie data for synchronizing with audio data recording to create a synchronized audiovisual work. The system can have a video that is synchronized with the variations in the tempo of the audio data through a variable timing reference track designed and provided for a user, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the audio data.