Disclosed embodiments include systems and methods to teach and analyze a student's progress in learning to play a musical instrument, sing or perform other musical endeavors. Embodiments include the production of an AI score or music AI score which may be an extraction of performance parameters such as a student's tone, speed, rhythm, pitch loudness and other metrics. A musical AI score may also track changes in measured performance while playing a piece of music. Such changes within a piece of music or over time in performing various pieces of music can be valuable is a student's self-assessment or a music teacher's approach tailored to the particular student. A music or signing AI score can help a student to select and to prioritize their music repertoire, focus performance efforts, optimize time schedule, improve appreciation for music, improve the overall quality of music performance and instructor relationship.

A chord information extraction device includes a character group extractor, a determiner and a corrector. The character group extractor extracts a character group corresponding to chord information from score image data representing a music score. The determiner determines whether the character group extracted by the character group extractor follows a predetermined chord notation rule. In a case where the character group extracted by the character group extractor does not follow the chord notation rule, the corrector corrects the extracted character group to follow the chord notation rule.

A chord information extraction device includes an acquirer, a score type determiner, an extraction region determiner and a chord information extractor. The acquirer acquires score image data representing a reference score. The score type determiner determines a score type of the reference score from among a plurality of predetermined score types based on the acquired score image data. The extraction region determiner determines a chord extraction region in the reference score based on extraction region information that defines a relationship between a plurality of score types and a chord extraction region from which chord information is to be extracted. The chord information extractor extracts the chord information from the acquired score image data based on the determined chord extraction region.

An approach is provided for converting color data into one or more musical notes. The approach involves reading, using a color-reading device, respective colors applied to a canvas by a plurality of drawing instruments as color data, wherein each of the plurality of drawing instruments is configured to draw in respective colors of a color palette, and wherein the respective colors of the color palette correspond respectively to a set of musical notes. The approach also involves processing, using a color processing module, the color data to generate a composition of the one or more musical notes from the color data based on a set of musical notes that correspond to the respective colors in the color data.

A method and an information processing apparatus to generate a digital score file of a song are described. The information processing apparatus includes processing circuitry. The processing circuitry is configured to obtain a candidate audio file satisfying a first condition from audio files of unaccompanied singing of the song without instrumental accompaniment. The processing circuitry is configured to divide the candidate audio file into valid audio segments based on timing information of the song, and extract pieces of music note information from the valid audio segments. Each of the pieces of music note information includes at least one data set of a music note in the song. The data set includes an onset time, a duration, and a music note value of the music note. The processing circuitry is configured to generate the digital score file based on the pieces of music note information.

Systems, devices, media, and methods are presented for converting sounds in an audio stream. The systems and methods receive an audio conversion request initiating conversion of one or more sound characteristics of an audio stream from a first state to a second state. The systems and methods access an audio conversion model associated with an audio signature for the second state. The audio stream is converted based on the audio conversion model and an audio construct is compiled from the converted audio stream and a base audio segment. The compiled audio construct is presented at a client device.

A chord information extraction device includes an acquirer, a score type determiner, an extraction region determiner and a chord information extractor. The acquirer acquires score image data representing a reference score. The score type determiner determines a score type of the reference score from among a plurality of predetermined score types based on the acquired score image data. The extraction region determiner determines a chord extraction region in the reference score based on extraction region information that defines a relationship between a plurality of score types and a chord extraction region from which chord information is to be extracted. The chord information extractor extracts the chord information from the acquired score image data based on the determined chord extraction region.

A chord information extraction device includes a character group extractor, a determiner and a corrector. The character group extractor extracts a character group corresponding to chord information from score image data representing a music score. The determiner determines whether the character group extracted by the character group extractor follows a predetermined chord notation rule. In a case where the character group extracted by the character group extractor does not follow the chord notation rule, the corrector corrects the extracted character group to follow the chord notation rule.

A method and an information processing apparatus to generate a digital score file of a song are described. The information processing apparatus includes processing circuitry. The processing circuitry is configured to obtain a candidate audio file satisfying a first condition from audio files of unaccompanied singing of the song without instrumental accompaniment. The processing circuitry is configured to divide the candidate audio file into valid audio segments based on timing information of the song, and extract pieces of music note information from the valid audio segments. Each of the pieces of music note information includes at least one data set of a music note in the song. The data set includes an onset time, a duration, and a music note value of the music note. The processing circuitry is configured to generate the digital score file based on the pieces of music note information.