A display control method includes causing a display device to display a processing image in which a first image representing a note corresponding to a synthesized sound and a second image representing a sound effect are arranged in an area, in which a pitch axis and a time axis are set, in accordance with synthesis data that specify the synthesized sound generated by sound synthesis and the sound effect added to the synthesized sound.

A method is disclosed, the method comprising the steps of identifying a first real object in a mixed reality environment, the mixed reality environment having a user; identifying a second real object in the mixed reality environment; generating, in the mixed reality environment, a first virtual object corresponding to the second real object; identifying, in the mixed reality environment, a collision between the first real object and the first virtual object; determining a first attribute associated with the collision; determining, based on the first attribute, a first audio signal corresponding to the collision; and presenting to the user, via one or more speakers, the first audio signal.

A feedback system may play back, to a user, an altered version of the user's voice in real time, in order to reduce stuttering by the user. The system may operate in different feedback modes at different times. For instance, the system may detect when the severity of a user's stuttering increases, which is indicative of the user habituating to the current feedback mode. The system may then switch to a different feedback mode. In some cases, the feedback modes include at least a Whisper mode, a Reverb mode, and a Harmony mode. In Whisper mode, the user's voice may be transformed to sound as if it were whispering in the user's ears. In Harmony mode, the user's voice may be altered as if the user were harmonizing with himself or herself. In Reverb mode, the user's voice may be altered so that it reverberates.

To generate a melody, one or more machine-readable constraints are accepted from a user through a user interface. The constraints include rhythm constraints and pitch constraints. A sequence of musical elements is generated based on the constraints, each of the musical elements specifying, in machine-readable data, a musical pitch or silence and a duration of the musical pitch or silence. The pitch constraints prescribe pitches in the sequence of musical elements and the rhythm constraints prescribe rhythm of the sequence of musical elements. The sequence of musical elements is rendered in human-perceivable form as a melody.

Disclosed are a system and a method for singing expression transplantation. A singing expression transplantation method performed by a singing expression transplantation system according to an embodiment may comprise the steps of: synchronizing each of a first sound source and a second sound source, which include different pieces of voice information with regard to an identical song; modifying the pitch of the first sound source on the basis of pitch information extracted from each of the first sound source and the second sound source, which have been synchronized; and extracting volume information from each of the first sound source and the second sound source and adjusting the magnitude of the volume regarding the first sound source, the pitch of which has been modified, according to each piece of extracted volume information.

The implementation of modal processors, which involve the parallel combination resonant filters, may be costly for applications such as artificial reverberation that can require thousands of modes. In one embodiment, the input signal is decomposed into a plurality of subbands, the outputs of which are downsampled. In each downsampled band, resonant filters are applied at the downsampled sampling rate, and their output is upsampled and filtered to form the band output.

An electronic musical instrument in one aspect of the disclosure includes a keyboard, a processor and a memory that stores musical piece data that includes data of a vocal part, the vocal part including at least first and second notes together with associated first and second lyric parts that are to be successively played at the first and second timings, respectively, wherein if while a digitally synthesized first signing voice corresponding to the first note is being output, a user specifies, via keyboard, a third pitch that is different from the first and second notes prior to the arrival of the second timing, the at least one processor synthesizes a modified first singing voice having the third pitch in accordance with the data of the first lyric part, and causes the digitally synthesized modified first singing voice to be audibly output at the third timing.

Digital signal processing and machine learning techniques can be employed in a vocal capture and performance social network to computationally generate vocal pitch tracks from a collection of vocal performances captured against a common temporal baseline such as a backing track or an original performance by a popularizing artist. In this way, crowd-sourced pitch tracks may be generated and distributed for use in subsequent karaoke-style vocal audio captures or other applications. Large numbers of performances of a song can be used to generate a pitch track. Computationally determined pitch trackings from individual audio signal encodings of the crowd-sourced vocal performance set are aggregated and processed as an observation sequence of a trained Hidden Markov Model (HMM) or other statistical model to produce an output pitch track.

Disclosed are a system and a method for singing expression transplantation. A singing expression transplantation method performed by a singing expression transplantation system according to an embodiment may comprise the steps of: synchronizing each of a first sound source and a second sound source, which include different pieces of voice information with regard to an identical song; modifying the pitch of the first sound source on the basis of pitch information extracted from each of the first sound source and the second sound source, which have been synchronized; and extracting volume information from each of the first sound source and the second sound source and adjusting the magnitude of the volume regarding the first sound source, the pitch of which has been modified, according to each piece of extracted volume information.

To generate a melody, one or more machine-readable constraints are accepted from a user through a user interface. The constraints include rhythm constraints and pitch constraints. A sequence of musical elements is generated based on the constraints, each of the musical elements specifying, in machine-readable data, a musical pitch or silence and a duration of the musical pitch or silence. The pitch constraints prescribe pitches in the sequence of musical elements and the rhythm constraints prescribe rhythm of the sequence of musical elements. The sequence of musical elements is rendered in human-perceivable form as a melody.