Systems and methods are disclosed for generating color sets based on musical concepts of pitch intervals and harmony. Color sets are derived via a music-to-hue process which analyzes musical pitch data associated with musical input to determine pitch intervals included in the music. Pitch interval angles associated with the pitch intervals are applied to a tuned hue index to identify hue note ordered within the index which are separated by a hue interval angle similar to the pitch angle associated with the analyzed pitch data. The systems and methods provide for the creation of color sets which are analogous to musical chords in that they include multiple hue notes selected based on hue interval angles derived from musical interval angles associated with the received musical input.

Vocal audio of a user together with performance synchronized video is captured and coordinated with audiovisual contributions of other users to form composite duet-style or glee club-style or window-paned music video-style audiovisual performances. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for presentation, at any given time along a given performance timeline, performance synchronized video of one or more of the contributors. Selections are in accord with a visual progression that codes a sequence of visual layouts in correspondence with other coded aspects of a performance score such as pitch tracks, backing audio, lyrics, sections and/or vocal parts.

A video display device for displaying a video of distributed content and an avatar, which is a computer-generated image, on a display screen to overlap each other, includes: a communication processing unit connected to a network; an avatar generation processing unit that generates an avatar of another person from avatar information received through the communication processing unit; a movement information detection processing unit that detects movement information of a continuous movement associated with the video of the content received through the communication processing unit; a display unit that displays the content received through the communication processing unit; and a control unit. The avatar generation processing unit generates an avatar by adding the movement information detected by the movement information detection processing unit to a movement of the generated avatar. The control unit displays the avatar generated by the avatar generation processing unit on the display unit to overlap the content.

An audio processing method obtains observed envelopes of picked-up sound signals including a first observed envelope representing a contour of a first sound signal including a first target sound from a first sound source and a second spill sound from a second sound source and a second observed envelope representing a contour of a second sound signal including a second target sound from the second sound source and a first spill sound from the first sound source; and generates, based on the observed envelopes, output envelopes including a first output envelope representing a contour of the first target sound in the first observed envelope and a second output envelope representing a contour of the second target sound in the second observed envelope, using a mix matrix including a mix proportion of the second spill sound in the first sound signal and a mix proportion of the first spill sound in the second sound signal.

An embodiment of the present disclosure provides a portable electronic musical instilment, including a press module, a control module, an angle detection module, and an audio play module; the press module is arranged above the control module; the angle detection module and the audio play module are respectively connected to the control module; the angle detection module is configured to detect a rotating angle of a portable electronic musical instrument body; the control module is configured to adjust, according to the rotating angle detected by the angle detection module, different registers; the press module is configured to receive a press event of a user; and the audio play module is controlled by the control module to play tones of different musical scales.

A multi-stringed musical instrument, such as a guitar, having a neck with a partially hollow interior containing a number of linear actuators, each connected to a fret which projects proud of the neck and is in contact with a taught string, wherein the linear actuators are controlled by means of a user-selected input signal via functional communication with a small control panel, tablet, smartphone, computer or laptop.

A method implemented by a processor includes receiving performance data including pitch data; determining, based on the pitch data that is included in the received performance data, a key among a plurality of keys; selecting, based on the determined key and the pitch data, a first-type image from among a plurality of first-type images; and displaying the selected first-type image.

An electronic musical instrument includes: a plurality of keys that include at least first keys corresponding to a first pitch range and second keys corresponding to a second pitch range; and at least one processor, configured to perform the following: causing a syllable position in a phrase that is digitally synthesized for output to be not advanced no matter how the second keys in the second pitch range are operated while a key operation in the first pitch range is being continuously maintained; and causing the syllable position to advance every time a key operation in the second pitch rang is performed while none of the first keys in the first pitch range are being operated.

Vocal audio of a user together with performance synchronized video is captured and coordinated with audiovisual contributions of other users to form composite duet-style or glee club-style or window-paned music video-style audiovisual performances. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for presentation, at any given time along a given performance timeline, performance synchronized video of one or more of the contributors. Selections are in accord with a visual progression that codes a sequence of visual layouts in correspondence with other coded aspects of a performance score such as pitch tracks, backing audio, lyrics, sections and/or vocal parts.

A method and system for visualizing music using a perceptually conformal mapping system are provided. A music source file is input into a processor configured to carry out a series of steps on audio cues identified within the music and ultimately generate a simultaneous visual representation on a display device. The series of steps include application of one or more perceptually conformal mapping systems that essentially induce a synesthetic experience in which a person can experience music both acoustically and visually at the same time. The device extracts cues from the music that are designed to specifically capture fundamentals of human appreciation, maps them into visual cues, then presents those visual cues synchronized with the source music.