The invention generates progressive music in real-time for video games using random, seeded random, and manually input variables to affect melody, phrase length, harmonic chords and complexity, and percussive accompaniment. As the game is played, variables may be passed in that change the music to increase or decrease complexity and tension levels and to interpolate between styles. The generated music then progresses from stable, simple, and consonant to more tense, dissonant, and complex melodies, harmonies and rhythms, and back to the original stage as a musical resolution. Through variables controlling musical parameters, music may progressively change from the atonal region where there is no clear resolution or stability, to tonal, where there is only consonance and stability, and anywhere in between. These variables are assigned through a middleware or a game-engine setup that uses the current device as an audio source plugin, or manually coded into the individual video game.

The techniques disclosed herein enable a user of a host computer or a user of a remote computer to locate, view, control, and modify objects of a virtual environment. Embodiments disclosed herein can include the generation of a graphical user interface providing a two-dimensional display showing objects at a predetermined elevation of a three-dimensional virtual environment. User interface controls are provided for changing the elevation of the two-dimensional display. The two-dimensional display can be updated to show different elevations as the controls are used to select a new elevation. In some embodiments, the two-dimensional display enables users to move objects of a virtual reality environment. The display can bring highlight to select objects enabling users to readily locate desired objects and locations. The features disclosed herein can be utilized by a computer hosting a virtual reality session or a remote computer operating a companion application.

According to the present invention, in response to the change of the menu hierarchy, it is possible to diversify the BGM easily. First, BGM 1, BGM 2, and BGM 3 (hereinafter the BGM 1, 2, and 3) that are the same piece of music performed with different sounds are played back simultaneously. Only the volume of the BGM 1 is turned up and the volume of the BGM 2 and 3 are turned down to mute. Next, in response to the change of the menu hierarchy, the volume of the BGM 1 is muted and the volume of one of the muted BGM 2 or 3 is turned up.

A video game includes an audio-video stream combined with game graphics and game sounds. The game graphics are overlaid on the video stream and updated in synchronization with the stream. Update of the game graphics and sounds depends on inputs received from a game player. The game player may provide input using a game controller coupled to the video game by an adapter. The video game may play on a Blu-ray player.

A method for electronic music generation comprising electronically applying one or more functions that change one or more compositional elements of a musical input in a first tonality or other musical representation to generate a musical output in a second tonality or other musical representation and recording data corresponding to the musical output in a recording medium or rendering such musical Transformations to a reproductive medium such as an amplifier and speakers or headphones.

A real-time music generation engine for an interactive system includes a Musical Rule Set (MRS AND/OR CA AND/OR PCU) unit configured to combine predefined composer input with a real-time control signal into a music signal; a Constructor Automaton (CA) configured to generate a fluid piece of music based on rule definitions defined by the predefined composer input within the MRS AND/OR CA AND/OR PCU unit by musical handlers; and a Performance Cluster Unit (PCU) configured to convert the fluid piece of music from the CA into a corresponding music control signal for real-time playback by the interactive system.

Music may be generated by electronically applying one or more functions that change a compositional nature of a musical input in a first tonality to generate a musical output in a second tonality in response to an event in a videogame. Data corresponding to the output melody may be recorded in a recording medium.

A virtual instrument for real-time musical generation includes a musical rule set unit for defining musical rules, a time constrained pitch generator for synchronizing generated music, an audio generator for generating audio signals, wherein the rule definitions describe real-time morphable music parameters, and said morphable music parameters are controllable directly by the real-time control signal. With this virtual instrument, the user can create new musical content in a simple and interactive way regardless of the level of musical training obtained before using the instrument.

Sequence predictors may be used to predict one or more entries in a musical sequence. The predicted entries in the musical sequence enable a virtual musician to continue playing a musical score based on the predicted entries when the occurrence of latency causes a first computing system hosting a first virtual musician to not receive entries or timing information for entries being performed in the musical sequence by a second computing system hosting a second virtual musician. The sequence predictors may be generated using a machine learning model generation system that uses historical performances of musical scores to generate the sequence predictor. Alternatively, or in addition, earlier portions of a musical score may be used to train the model generation system to obtain a prediction model that can predict later portions of the musical score.

Sequence predictors may be used to predict one or more entries in a musical sequence. The predicted entries in the musical sequence enable a virtual musician to continue playing a musical score based on the predicted entries when the occurrence of latency causes a first computing system hosting a first virtual musician to not receive entries or timing information for entries being performed in the musical sequence by a second computing system hosting a second virtual musician. The sequence predictors may be generated using a machine learning model generation system that uses historical performances of musical scores to generate the sequence predictor. Alternatively, or in addition, earlier portions of a musical score may be used to train the model generation system to obtain a prediction model that can predict later portions of the musical score.