A virtual instrument for real-time musical generation includes a musical rule set unit for defining musical rules, a time constrained pitch generator for synchronizing generated music, an audio generator for generating audio signals, wherein the rule definitions describe real-time morphable music parameters, and said morphable music parameters are controllable directly by the real-time control signal. With this virtual instrument, the user can create new musical content in a simple and interactive way regardless of the level of musical training obtained before using the instrument.

A method, system, and processor-readable storage medium for providing audio playback are disclosed to enable users to replace a background music in a computer or video game with music of user choice, while preserving other in-game sounds. An example method comprises receiving a game music stream from a gaming application of a user which includes a game background soundtrack and in-game sounds, extracting audio parameters of the game background soundtrack, determining an emotional classification of the game background soundtrack based on the audio parameters of the game background soundtrack, selecting a user soundtrack from a user music library that matches the emotional classification of game background soundtrack, replacing at least a part of the game background soundtrack with the user soundtrack, and providing a replacement game music stream to the user, the replacement game music including the user soundtrack and the in-game sounds.

A method and system for dynamic music creation is disclosed. An emotion is assigned to one or more musical motifs according to type of character, musical composition component, or scene and a game vector is associated with the emotion. The group of one or more musical motifs is mapped to the game vector based on the emotion. A musical composition is generated based on the game vector and desired emotions.

A music generation apparatus for generating information indicative of a musical score for a game, the apparatus including communication circuitry to communicate with an entertainment device, the communication circuitry being configured to receive a request to generate a musical score for a game, and to receive one or more keywords output by the entertainment device during processing of the game, the one or more keywords being indicative of one or more of an action and/or a condition associated with a user playing the game and the game state. The music generation apparatus also comprises music generation circuitry responsive to the request and each of the one or more keywords to generate the information indicative of the musical score in dependence on that keyword. An entertainment device is also provided, as well as a system, methods and computer programs.

A metaverse application performs an audio rollback of a local game state by receiving user input from a user during gameplay of a virtual experience. The metaverse application renders a first game state of gameplay of the virtual experience on the user device based on the user input. The metaverse application receives information about a second game state of gameplay of the virtual experience from a server. The metaverse application determines that there is a discrepancy between the first game state and the second game state. The metaverse application determines an audio gap in the first game state where a modification to game audio is to be inserted. The metaverse application generates replacement audio, wherein a duration of the replacement audio matches a duration of the audio gap. The metaverse application renders a corrected game state on the user device that includes the replacement audio.

A video game includes an audio-video stream combined with game graphics and game sounds. The game graphics are overlaid on the video stream and updated in synchronization with the stream. Update of the game graphics and sounds depends on inputs received from a game player. The game player may provide input using a game controller coupled to the video game by an adapter. The video game may play on a Blu-ray player.

Techniques for generating a virtual music experience. The techniques include source separating an arbitrary digital audio input into a plurality of source-separated tracks. Sets of music features are determined from the plurality of source-separated tracks and provided to a video presentation system at a video frame rate of the video presentation system. The providing the sets of music features to the video presentation system causes the video presentation system to animate one or more graphical assets based on the provided sets of music features.

Techniques described herein enable administrative control features for hosted game applications. A user with appropriate credentials can override an administrator of a game application to control and view all aspects of a game session from a companion application operating on a remote computing device. The techniques disclosed herein enable a remote user with appropriate credentials to control and modify aspects of a game application or a game session. The features can include, but are not limited to, the ability to shape a 3D virtual environment, add players, remove players, modify possessions of players, call players to a beacon, modify attributes of an environment, locate items, and listen to player communication.

A musical game system and associated methods configured to allow for unguided, free-form group-based musical expressivity during generation of a collaborative digital music track (or song). The musical game system is designed to provide a hardware and software pipeline that functions to record, quantize, and loop multiple (e.g., 1 to 15 or more) users' inputs (e.g., via a piezoelectric MIDI (Musical Instrument Digital Interface) controllers or triggered instruments or other user input devices) in a dynamic playback space. The musical game system further functions to provide volume attenuation and localization of playback to enable participants to express themselves with their user inputs with complete agency while simultaneously adding to an overarching, collaborative musical composition generated using their user inputs and other participants' user inputs. The collaborative musical composition is created by the system so as to maintain coherence and tonality regardless of the user inputs the system receives and processes.

The invention generates progressive music in real-time for video games using random, seeded random, and manually input variables to affect melody, phrase length, harmonic chords and complexity, and percussive accompaniment. As the game is played, variables may be passed in that change the music to increase or decrease complexity and tension levels and to interpolate between styles. The generated music then progresses from stable, simple, and consonant to more tense, dissonant, and complex melodies, harmonies and rhythms, and back to the original stage as a musical resolution. Through variables controlling musical parameters, music may progressively change from the atonal region where there is no clear resolution or stability, to tonal, where there is only consonance and stability, and anywhere in between. These variables are assigned through a middleware or a game-engine setup that uses the current device as an audio source plugin, or manually coded into the individual video game.