A music based video game provides a user directed sound generation feature. In some embodiments, the user is provided a video game controller simulating a musical instrument, which the user may operate similarly to its real musical instrument counterpart. A free play feature is provided for users to operate the video game controller, where a processor of a video game console receives input signals from the video game controller and outputs audio samples based on the received input signals. During the free play feature, multiple suggestions as to how to operate the video game controller are simultaneously provided to give users some guidance as to what to play using the video game controller.

The teachings described herein are generally directed to a system, method, and apparatus for separating and mixing tracks within music. The system can have a video that is synchronized with the variations in the musical tempo through a variable timing reference track designed and provided for a user of the preselected piece of music that was prerecorded, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the preselected piece of music.

A video game includes an audio-video stream combined with game graphics and game sounds. The game graphics are overlaid on the video stream and updated in synchronization with the stream. Update of the game graphics and sounds depends on inputs received from a game player. The game player may provide input using a game controller coupled to the video game by an adapter. The video game may play on a Blu-ray player.

A system enabling the performance of sensory stimulating content including music and video using gaming in a cyber reality environment, such as using a virtual reality headset. This disclosure includes a system and method through which a performer can virtually trigger and control a presentation of pre-packaged sensory stimulating content including musical programs through gaming. A theme for the performer is that the pre-packaged sensory stimulating content is preferably chosen such that, even where the performer is a novice, the sensory stimulating data is presented in a pleasing and sympathetic manner and scoring is provided as a function of the performer's ability to provide a gesture in association with a displayed virtual trigger.

The teachings described herein are generally directed to a system, method, and apparatus for separating and mixing tracks within music. The system can have a video that is synchronized with the variations in the musical tempo through a variable timing reference track designed and provided for a user of the preselected piece of music that was prerecorded, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the preselected piece of music.

System, process and device configurations are provided for customized audio spectrum generation of gaming music. A method includes detecting at least one audio spectrum input for gaming music and updating a parameter for dynamic music generation based on the at least one audio spectrum input. The method also includes generating gaming music for the gaming system dynamically to include at least one musical motif determined based on the parameter, and output of gaming music. Frequency or tonalities of dynamic generated music that interfere with gameplay sound effects may be adjusted to improve gameplay. In some cases volume of sound elements may be shifted in volume or pitch to indicate presence of gaming elements or opportunities during gameplay. Similarly, frequency ranges may be customized to avoid one or more frequencies, such as a frequency range identified as being associated with hearing loss or with causing a disturbance, such as vibration.

A method of generating audio assets, comprising the steps of: receiving an input audio asset having a first duration, generating an input image representative of the input audio asset, training a generative model on the input image and implementing the trained generative model to generate an output image representative of an output audio asset having a second duration different to the first duration, and generating the output audio asset based on the output image.

The present invention relates to the field of audio recognition, in particular to computer implemented note recognition methods in a gaming application. Furthermore, the present invention relates to improving latency of such audio recognition methods. One of the embodiments of the invention described herein is a method for note recognition of an audio source. The method includes: dividing an audio input into a plurality of frames, each frame having a pre-determined length, conducting a frequency analysis of at least a set of the plurality of frames, based on the frequency analysis, determining if a frame is a transient frame with a frequency change between the beginning and end of the frame, comparing the frequency analysis of each said transient frame to the frequency analysis of an immediately preceding frame and, based on said comparison, determining at least one probable pitch present at the end of each transient frame, and for each transient frame, outputting pitch data indicative of the probable pitch present at the end of the transient frame.

The present disclosure is directed at systems, methods, and apparatus for implementing a rhythm-action game having an improvisational fill feature. The rhythm-action game can provide a musical track having at least one section that can be varied. The rhythm-action game can also provide a database having a plurality of fills, wherein each fill includes a soundtrack and a set of cues. During run-time, the rhythm-action game can select, for each section in the musical track that can be varied, a fill from the plurality of fills. In some embodiments, this selection can be based on various characterizing parameters to ensure that the fill is a good fit for the musical track. The rhythm-action game can also display a set of visual cues associated with the selected fill, and to evaluate whether received user input substantially corresponds to the displayed cues.

The present disclosure is directed at methods and systems for implementing and scoring a vocal improvisation feature in a music video game. This feature can allow players of music video games to sing improvised harmonies for a song using a microphone controller. The improvised harmonies can be musically consonant with a pre-authored melody track programmed into the music video game. The improvised harmonies can comprise pre-authored notes programmed into the pre-authored melody track, or can be generated by the music video game during run-time based on the pre-authored melody track. The music video game can also display guidelines visually showing permissible harmony tracks in relation to the pre-authored melody track.