Mobile App riteTune to provide music instrument players instant feedback on note pitch and rhythms accuracy based on sheet music

Abstract

A tool is needed for music instrument learners to get feedbacks on the correctness of their performances of a particular piece of music. The invention disclosed here is such a tool that can provide music instrument players instant feedback on note pitch and rhythms accuracy based on sheet music. This is accomplished through audio signal processing, sheet music image processing, and conversion of both analogue images and audio signals into standard digital music representation so a comparison can be done and hence a feedback can be presented to the player. An advanced feature will allow users to save the data to the cloud and retrieve later for comparison of progress. It also will allow user to participate an online competition with other players of the same piece of music.

Claims

1. A method to acquire Violin audio signal through microphone built-in or attached to device like phone or PC where violin audio signal is acquired in varying sampling speed depending on music speed and the audio frequencies and timestamp and is further analyzed based on pitch and rhythm, compared to AI models, obtained from machine learning based on stored standard scores, to produce instantaneous musical notes in MusicXML, then recorded on the device for later usage of the application as depicted in diagram one point one.

2. A method to convert scanned or uploaded sheet music in image file to MusicXML using Optical Music Recognition (OMR) technology based on machine learning as depicted in diagram one point one.

3. A method to compare and display overlaid scores of music, with one from sheet music, and the other from recorded audio signal transcribed, to detect differences of two scores and highlight of differences by rhythm and pitch on the overlaid displays of musical scores, which, in advanced features, can include other differences in other musical features, like tempo, dynamics, as depicted in diagrams in the diagram file, based on a rating system using machine learning with data collected from all users, in which, solo sound tracks are extracted from an audio track of a performance with music accompaniment, using machine learning algorithm, that can produce a music accompaniment for playing along or Karaoke to practice against or play/sing along with.

Description

BRIEF DESCRIPTION OF DIAGRAMS

[0023] FIG. 1 in the diagrams document shows how data processing flows through the application. It shows how sheet music can be uploaded or scanned into the system and converted to MusicMXL format, while user's playing based on the sheet music can be uploaded or recorded to the system and also converted to MusicXML format, and then the two can be compared and displayed to the user for learning and evaluation purposes.

[0024] FIG. 2 in the diagrams document shows four (4) user interface screens of the application. It includes Login screen, Comparison, Music scan/upload and Music recording.

STATEMENT ON THIS SUBSTITUTE SPECIFICATION

[0025] The substitute specification contains no new matter