A sound capture device is affixed to an acoustic instrument to capture the natural sound output of the instrument. The captured sound signal is routed to an electronic sound augmentation system that is configured to augment the captured sound with spatial sound effects such as reverb, echo, delay, etc. The processed and augmented sound is then reproduced via a vibrating driver that has been affixed to the body of the acoustic instrument. This creates a situation where the body of the musical instrument, responding to a series of vibrations produced by the vibrating driver, acts as a speaker component, reproducing a rich augmented sound output that comprises the sum of the sound produced by the original sound production capabilities of the acoustical instrument plus the added augmented or enhanced sound effects.

As part of a system, a device is provided as part of a system, the device being for capturing vibrations produced by an object such as a musical instrument. The device has a first sensor placed in contact with a surface of the drum, such as a rim of the drum, and a second sensor placed at a fixed location relative to the drum, but not touching the drum. A method may be provided for interpreting the output of the sensors within the system, the method comprising identifying the onset of an audio event in audio data, selecting a window in the data for analysis, applying transforms to generate a representation of the audio event, and comparing that representation to expected representations in a model.

A performance analysis method is realized by a computer and includes acquiring a time series of input data representing played pitch that is played, inputting the acquired time series of input data into an estimation model that has learned a relationship between a plurality of items of training input data representing pitch and a plurality of items of training output data representing an acoustic effect to be added to sound having the pitch, and generating a time series of output data for controlling an acoustic effect to be added to sound having the played pitch represented by the acquired time series of input data.

Systems and methods directed to combining audio tracks are provided. More specifically, a first audio track and a second audio track are received. The first audio track is separated into a vocal component and one or more accompaniment components. The second audio track is separated into a vocal component and one or more accompaniment components. A structure of the first audio track and a structure of the second audio track are determined. The first audio track and the second audio track are aligned based on the determined structures of the tracks. The vocal component of the first audio track is stretched to match a tempo of the second audio track. The stretched vocal component of the first audio track is added to the one or more accompaniment components of the second audio track.

In various applications, the system provides a method for processing audio signals, including: receiving, by a processor, a digital audio signal from a recorded audio file; analyzing, by the processor, the digital audio signal to identify pitch distortion caused by changes in momentary sound level; determining, by the processor, an amount of compensation of the audio signal to correct the identified pitch distortion; dynamically adjusting, by the processor, the digital audio signal by the compensation amount to correct the identified pitch distortion; and outputting, by the processor, the digital audio signal to an audio transducer device of a listener to improve a listening experience for the listener of the recorded audio file.

A musical synthesizer produces an audio signal using a set including hundreds or thousands of resonators. The resonators can be based on analysis of any acoustic space such as an acoustic instrument, room, studio, or concert hall A machine learning network is trained to learn the characteristics of a musical sound. The characteristic may be whether the sound is pleasing to the human ear. The network produces audio effects applied to selected frequencies in the spectrum. An input or excitation signal is provided to the network, which processes the input through a trained model of a target audio source and configures the set of resonators to produce an output audio signal based on the input signal. The network may be expanded to create novel impulse responses creating tones and timbre unique to existing audio sources, the input signal may include musical tones or include vocal inputs.

In various applications, the system provides a method for processing audio signals, including: receiving, by a processor, a digital audio signal from a recorded audio file; analyzing, by the processor, the digital audio signal to identify pitch distortion caused by changes in momentary sound level; determining, by the processor, an amount of compensation of the audio signal to correct the identified pitch distortion; dynamically adjusting, by the processor, the digital audio signal by the compensation amount to correct the identified pitch distortion; and outputting, by the processor, the digital audio signal to an audio transducer device of a listener to improve a listening experience for the listener of the recorded audio file.