Aspects of embodiments pertain to systems and methods for providing a user with information relating to the playing of a musical instrument. The systems and methods comprise presenting the user with instrument playing instructions to be executed by at least one user; identifying, of the at least one user, at least one object expected to operably engage with the musical instrument for executing the instrument playing instructions; tracking movement of the identified at least one object; and displaying to the user at least one assistive symbol at least partly in correspondence with the presented instrument playing instructions.

Techniques have been developed to facilitate the livestreaming of group audiovisual performances. Audiovisual performances including vocal music are captured and coordinated with performances of other users in ways that can create compelling user and listener experiences. For example, in some cases or embodiments, duets with a host performer may be supported in a sing-with-the-artist style audiovisual livestream in which aspiring vocalists request or queue particular songs for a live radio show entertainment format. The developed techniques provide a communications latency-tolerant mechanism for synchronizing vocal performances captured at geographically-separated devices (e.g., at globally-distributed, but network-connected mobile phones or tablets or at audiovisual capture devices geographically separated from a live studio).

Measures (for example, methods, systems and computer programs) are provided to evaluate a percussive performance. Percussive performance data captured by one or more sensors is received. The percussive performance data represents one or more impact waveforms of one or more hits on a performance surface. The one or more impact waveforms are analysed. The analysing comprises: (i) identifying one or more characteristics of the one or more impact waveforms; (ii) classifying the one or more hits as one or more percussive hit-types based on the one or more characteristics; and (iii) evaluating the one or more percussive hit-types against performance target data. Performance evaluation data is output based on said evaluating.

In a musical performance support system including a sensor device that is attached to a musical instrument and an operation device that is able to perform wireless communication mutually with the sensor device and is able to perform communication with an instructor terminal of an instructor via a server, the sensor device transmits a detection signal detected by an acceleration sensor that has at least to detection axes to the operation device, the operation device generates practice result information of musical performance of a user using the musical instrument and transmits the practice result information to the server, and the operation device receives guidance information in response to the practice result information from the instructor terminal through the server and causes display means to display the guidance information.

The musical instrument tuner includes: a sensor device that is attached to a musical instrument; and an operation device that is able to perform wireless communication mutually with the sensor device, in which the sensor device includes an acceleration sensor that has at least two detection axes, frequency detection means for detecting, as a detected frequency, a frequency of a vibration of musical sound generated through an operation of the musical instrument based on an output from the acceleration sensor, and sensor-side communication means for transmitting transmission information including information regarding the detected frequency to the operation device, and the operation device includes operation-side communication means for receiving the transmission information transmitted from the sensor device, display means, and control means for generating tuning information of the musical instrument and causing the display means to display the tuning information based on the transmission information received from the sensor device.

Playback, recording, and analysis of music scales via software configuration. In an embodiment, a graphical user interface is generated with staff and keyboard canvases, visually representing a music staff and keyboard, respectively, a scale input, parameter input(s), and a play input. In response to selection of a scale, the staff canvas is updated to visually represent the notes in the scale. In response to the selection of a musical parameter, the staff canvas and/or keyboard canvas are updated to reflect the musical parameter. In response to selection of the play input, a soundtrack of the scale is output, while simultaneously highlighting the note, being played, on the staff canvas and the key, associated with the note being played, on the keyboard canvas.

A music based video game provides a user directed sound generation feature. In some embodiments, the user is provided a video game controller simulating a musical instrument, which the user may operate similarly to its real musical instrument counterpart. A free play feature is provided for users to operate the video game controller, where a processor of a video game console receives input signals from the video game controller and outputs audio samples based on the received input signals. During the free play feature, multiple suggestions as to how to operate the video game controller are simultaneously provided to give users some guidance as to what to play using the video game controller.

Disclosed herein are methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a musical work adaptation quality evaluation model. One of the methods includes: obtaining a plurality of adapted musical work samples; separating audio tracks of each of the plurality of adapted musical work samples; determining instrument information identifying instruments played in each of the audio tracks; performing originality analysis on each of the audio tracks to obtain an originality value corresponding to each audio track; for each of the audio tracks, using a combination of the instrument information and the originality value corresponding to the particular audio track of the adapted musical work samples as a sample feature; and training a musical work adaptation quality evaluation model by using sample features of corresponding adapted musical work samples as input, and a predetermined evaluation score of the corresponding adapted musical work sample as output.

The present disclosure relates to an information processing apparatus that can provide an information processing apparatus capable of accurately synchronizing and handling sensing data in a mixture of forms and available for assisting in learning of a performance.

The present disclosure provides the information processing apparatus including a conversion section that converts a plurality of pieces of sensing data in different forms obtained from a plurality of sensors each sensing a state related to a performance by a motion of a user, an information processing section that processes the sensing data converted by the conversion section, and an information output section that outputs feedback information to the user on the basis of a processing result of the information processing section. The conversion section includes an analog-digital signal conversion section that converts the sensing data in an analog form from the sensors into sensing data in a digital form and outputs the sensing data in the digital form to the information processing section, and a digital-analog signal conversion section that converts the sensing data in the digital form from the sensors into sensing data in the analog form and outputs the sensing data in the analog form to the analog-digital signal conversion section.

Measures (for example, methods, systems and computer programs) are provided to evaluate a percussive performance. Percussive performance data captured by one or more sensors is received. The percussive performance data represents one or more impact waveforms of one or more hits on a performance surface. The one or more impact waveforms are analysed. The analysing comprises: (i) identifying one or more characteristics of the one or more impact waveforms; (ii) classifying the one or more hits as one or more percussive hit-types based on the one or more characteristics; and (iii) evaluating the one or more percussive hit-types against performance target data. Performance evaluation data is output based on said evaluating.