Audio processing method and audio processing apparatus, and training method are described. According to embodiments of the application, an accent identifier is used to identify accent frames from a plurality of audio frames, resulting in an accent sequence comprised of probability scores of accent and/or non-accent decisions with respect to the plurality of audio frames. Then a tempo estimator is used to estimate a tempo sequence of the plurality of audio frames based on the accent sequence. The embodiments can be well adaptive to the change of tempo, and can be further used to tracking beats properly.

Audio processing method and audio processing apparatus, and training method are described. According to embodiments of the application, an accent identifier is used to identify accent frames from a plurality of audio frames, resulting in an accent sequence comprised of probability scores of accent and/or non-accent decisions with respect to the plurality of audio frames. Then a tempo estimator is used to estimate a tempo sequence of the plurality of audio frames based on the accent sequence. The embodiments can be well adaptive to the change of tempo, and can be further used to tracking beats properly.

Systems, devices, media, and methods are presented for playing audio sounds, such as music, on a portable electronic device using a digital color image of a note matrix on a map. A computer vision engine, in an example implementation, includes a mapping module, a color detection module, and a music playback module. The camera captures a color image of the map, including a marker and a note matrix. Based on the color image, the computer vision engine detects a token color value associated with each field. Each token color value is associated with a sound sample from a specific musical instrument. A global state map is stored in memory, including the token color value and location of each field in the note matrix. The music playback module, for each column, in order, plays the notes associated with one or more the rows, using the corresponding sound sample, according to the global state map.

A method for processing music audio data, including providing input audio data representing a first piece of music comprising a mixture of musical timbres. The method also includes decomposing the input audio data to generate at least first-timbre decomposed data representing a first timbre selected from the musical timbres of the first piece of music, and second-timbre decomposed data representing a second timbre selected from the musical timbres of the first piece of music. The method also includes applying a transport control to obtain transport controlled first-timbre decomposed data. The method also includes recombining audio data obtained from the transport controlled first-timbre decomposed data with audio data obtained from the second-timbre decomposed data to obtain recombined audio data.

An apparatus, method, and computer-readable storage medium that compensate for latency in a musical collaboration. The method includes, setting a tempo for a first client device to follow, receiving a musical piece from the first client device, transmitting the musical piece to a second client device, and instructing the second client device, via an instruction transmitted along with the musical piece, to delay playback of the musical piece a predetermined amount of time to compensate for latency in the musical collaboration, the predetermined amount of time being associated with a measure or a fraction of a measure.

An apparatus, method, and computer-readable storage medium that compensate for latency in a musical collaboration. The method includes, setting a tempo for a first client device to follow, receiving a musical piece from the first client device, transmitting the musical piece to a second client device, and instructing the second client device, via an instruction transmitted along with the musical piece, to delay playback of the musical piece a predetermined amount of time to compensate for latency in the musical collaboration, the predetermined amount of time being associated with a measure or a fraction of a measure.

A timing unit and method useable with a computer and user input includes a circuit and a timer. The timer establishes a reference signal having periodic occurrence and receives a trigger signal from the user input. The circuit generates information that represents the periodic occurrences of the reference signal and response timing data representing a relationship between the trigger signal and one of the occurrences. A communication channel is provided between the circuit and the computer.

A timing unit and method useable with a computer and user input includes a circuit and a timer. The timer establishes a reference signal having periodic occurrence and receives a trigger signal from the user input. The circuit generates information that represents the periodic occurrences of the reference signal and response timing data representing a relationship between the trigger signal and one of the occurrences. A communication channel is provided between the circuit and the computer.

A derivation unit (240) determines, as a specified rhythm component of a musical piece, a rhythm component detected within a predetermined time range including a time of reception of tap timing information TAP and derives a first frequency band the spectrum intensity of which is equal to or greater than a predetermined value. The derivation unit (240) also determines, as an unspecified rhythm component, a rhythm component detected outside the predetermined time range including the time of reception of the tap timing information TAP and derives a second frequency band the spectrum intensity of which is equal to or greater than the predetermined value. Thereafter, a calculation unit (250) calculates a third frequency band, which is included in the first frequency band and which does not include the second frequency band, and then transmits, to a filter unit (260), a passed-frequency designation BPC that designates the third frequency band. The filter unit (260) then subjects a musical piece signal MUD to a filtering process using the designated frequencies as a signal pass band. Subsequently, a vibration signal generation unit (270) generates a vibration signal VIS on the basis of a signal FTD having passed through the filter unit (260).

A derivation unit (240) determines, as a specified rhythm component of a musical piece, a rhythm component detected within a predetermined time range including a time of reception of tap timing information TAP and derives a first frequency band the spectrum intensity of which is equal to or greater than a predetermined value. The derivation unit (240) also determines, as an unspecified rhythm component, a rhythm component detected outside the predetermined time range including the time of reception of the tap timing information TAP and derives a second frequency band the spectrum intensity of which is equal to or greater than the predetermined value. Thereafter, a calculation unit (250) calculates a third frequency band, which is included in the first frequency band and which does not include the second frequency band, and then transmits, to a filter unit (260), a passed-frequency designation BPC that designates the third frequency band. The filter unit (260) then subjects a musical piece signal MUD to a filtering process using the designated frequencies as a signal pass band. Subsequently, a vibration signal generation unit (270) generates a vibration signal VIS on the basis of a signal FTD having passed through the filter unit (260).