A piano system with key assisted user input may include one or more execution devices, one or more sensors, at least one signal processing circuit, a processor and a display. The one or more sensors may be configured to detect a signal indicating a status change of at least one of the one or more execution devices. The at least one signal processing circuit may be configured to generate a control signal for controlling an input of a computer device in response to the signal detected by the one or more sensors. The processor may be configured to process the control signal to determine content to be displayed on a user interface. The display may be configured to display the determined content on the user interface.

The present invention provides a new display system, display method, program, and recording medium that can easily learn the motion of a target over time. A display system 10 of the present invention includes: a storage unit 11 containing motion information of a target over time; an acquisition unit 121 that acquires predetermined n types of motions X.sub.n and execution times T.sub.Xn of the motions X.sub.n in a time axis from the motion information of the target over time; a conversion unit 122 that converts the motion X.sub.n into a corresponding marker x.sub.n; a note creation unit 123 that creates a note in which the marker x.sub.n is placed at the execution time T.sub.Xn in the time axis; and a display unit 13 that displays the note.

A data generation device includes: an acquisition part configured to acquire measurement data that corresponds to measurement values, obtained in chronological order, corresponding to a behavior of a key or a member coordinating with the key for each of a plurality of keys; and a data generation part configured to generate display data for displaying a screen showing the measurement values corresponding to each of the plurality of keys along a time axis based on the acquired measurement data.

A data generation device includes: an acquisition part configured to acquire measurement data that corresponds to measurement values, obtained in chronological order, corresponding to a behavior of a key or a member coordinating with the key for each of a plurality of keys; and a data generation part configured to generate display data for displaying a screen showing the measurement values corresponding to each of the plurality of keys along a time axis based on the acquired measurement data.

A performance control method includes estimating a performance position in a musical piece by analyzing a performance of the musical piece by a performer, causing a performance device to execute an automatic performance in accordance with performance data designating the performance content of the musical piece so as to be synchronized with the progress of the performance position, and controlling the relationship between the progress of the performance position and the automatic performance in accordance with control data that is independent of the performance data.

A performance control method includes estimating a performance position in a musical piece by analyzing a performance of the musical piece by a performer, causing a performance device to execute an automatic performance in accordance with performance data designating the performance content of the musical piece so as to be synchronized with the progress of the performance position, and controlling the relationship between the progress of the performance position and the automatic performance in accordance with control data that is independent of the performance data.

A timing prediction method includes updating a state variable relating to the timing of a next sound generation event in a performance using a plurality of observation values relating to a timing of sound generation in a performance, and outputting an updated state variable that has been updated.

A timing prediction method includes updating a state variable relating to the timing of a next sound generation event in a performance using a plurality of observation values relating to a timing of sound generation in a performance, and outputting an updated state variable that has been updated.

A chord information extraction device includes an acquirer, a score type determiner, an extraction region determiner and a chord information extractor. The acquirer acquires score image data representing a reference score. The score type determiner determines a score type of the reference score from among a plurality of predetermined score types based on the acquired score image data. The extraction region determiner determines a chord extraction region in the reference score based on extraction region information that defines a relationship between a plurality of score types and a chord extraction region from which chord information is to be extracted. The chord information extractor extracts the chord information from the acquired score image data based on the determined chord extraction region.

A chord information extraction device includes an acquirer, a score type determiner, an extraction region determiner and a chord information extractor. The acquirer acquires score image data representing a reference score. The score type determiner determines a score type of the reference score from among a plurality of predetermined score types based on the acquired score image data. The extraction region determiner determines a chord extraction region in the reference score based on extraction region information that defines a relationship between a plurality of score types and a chord extraction region from which chord information is to be extracted. The chord information extractor extracts the chord information from the acquired score image data based on the determined chord extraction region.