Systems and methods are provided for enhanced real-time audio generation via a virtualized orchestra. An example method includes receiving, from a user device, a request to generate output associated with a musical score. Actions associated with virtual musicians with respect to respective instruments are simulated based on one or more machine learning models, with the simulated actions being associated with a virtual musician and indicative of an expected playing style during performance of the musical score. Output audio to be provided to the user device is generated, with the output audio being generated based on the simulated actions.

The teachings described herein are generally directed to a system, method, and apparatus for separating and mixing tracks within music. The system can have a video that is synchronized with the variations in the musical tempo through a variable timing reference track designed and provided for a user of the preselected performance that was prerecorded, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the preselected performance.

A system enabling the performance of sensory stimulating content including music and video using gaining in a cyber reality environment, such as using a virtual reality headset. This disclosure includes a system and method through which a performer can virtually trigger and control a presentation of pre-packaged sensory stimulating content including musical programs through gaming. A theme for the performer is that the pre-packaged sensory stimulating content is preferably chosen such that, even where the performer is a novice, the sensory stimulating data is presented in a pleasing and sympathetic manner and scoring is provided as a function of the performer's ability to provide a gesture in association with a displayed virtual trigger.

Systems and methods are provided for enhanced real-time audio generation via a virtualized orchestra. An example method includes receiving, from a user device, a request to generate output associated with a musical score. Actions associated with virtual musicians with respect to respective instruments are simulated based on one or more machine learning models, with the simulated actions being associated with a virtual musician and indicative of an expected playing style during performance of the musical score. Output audio to be provided to the user device is generated, with the output audio being generated based on the simulated actions.

The teachings described herein are generally directed to a system, method, and apparatus for separating and mixing tracks within music. The system can have a video that is synchronized with the variations in the musical tempo through a variable timing reference track designed and provided for a user of the preselected performance that was prerecorded, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the preselected performance.

A mobile terminal includes a display, a communicator configured to perform communication with a plurality of music bots, and a controller configured to extract sound source characteristic information from each of a plurality of previously divided sound source tracks configuring music, generate a plurality of control commands for controlling operation of the plurality of music bots using the extracted sound source characteristic information, and transmit each of the plurality of generated control commands to each of the plurality of music bots through the communicator.

A system enabling the performance of sensory stimulating content including music and video using gaming in a cyber reality environment, such as using a virtual reality headset. This disclosure includes a system and method through which a performer can virtually trigger and control a presentation of pre-packaged sensory stimulating content including musical programs through gaming. A theme for the performer is that the pre-packaged sensory stimulating content is preferably chosen such that, even where the performer is a novice, the sensory stimulating data is presented in a pleasing and sympathetic manner and scoring is provided as a function of the performer's ability to provide a gesture in association with a displayed virtual trigger.

System, process and device configurations are provided for customized audio spectrum generation of gaming music. A method includes detecting at least one audio spectrum input for gaming music and updating a parameter for dynamic music generation based on the at least one audio spectrum input. The method also includes generating gaming music for the gaming system dynamically to include at least one musical motif determined based on the parameter, and output of gaming music. Frequency or tonalities of dynamic generated music that interfere with gameplay sound effects may be adjusted to improve gameplay. In some cases volume of sound elements may be shifted in volume or pitch to indicate presence of gaming elements or opportunities during gameplay. Similarly, frequency ranges may be customized to avoid one or more frequencies, such as a frequency range identified as being associated with hearing loss or with causing a disturbance, such as vibration.

System, process and device configurations are provided for customized generation of gaming music. A method includes detecting at least one user interaction with a gaming system directed to generated music, and updating a parameter for music generation based on the at least one user interaction. The method also includes generating gaming music based on the parameter and a game state dynamically. Musical interactions with the gaming system may be collected during gameplay to train and retrain a dynamic music generator. Retraining may be performed for dynamic music generation interfering with output of sound effects of the electronic game. Inputs may be provided by sensors of the gaming system to detect interactions and control of dynamic music during gameplay. Inputs may include detecting presence of viewers and user environment to modify at least one output characteristic of dynamically generated music.

A system enabling the performance of sensory stimulating content including music and video using gaming in a cyber reality environment, such as using a virtual reality headset. This disclosure includes a system and method through which a performer can virtually trigger and control a presentation of pre-packaged sensory stimulating content including musical programs through gaming. A theme for the performer is that the pre-packaged sensory stimulating content is preferably chosen such that, even where the performer is a novice, the sensory stimulating data is presented in a pleasing and sympathetic manner and scoring is provided as a function of the performer's ability to provide a gesture in association with a displayed virtual trigger.