Patent classifications
G10H2210/215
Method for controlling effect applying device for applying acoustic effect to sound signal
Provided is a device 1 including: a signal processing unit 40 that applies a rotary speaker effect corresponding to a rotation speed value to a sound signal and control a tone color of the sound signal; and a control unit 10 that gradually changes, in response to a change command of the rotation speed value, the rotation speed value from a first speed to a second speed higher than the first speed with a first change curve having a first delay, and gradually changes control of the tone color from a first characteristic to a second characteristic that is stronger in the high frequency range than the first characteristic with a second change curve having a second delay shorter than the first delay.
TIME-VARYING AND NONLINEAR AUDIO PROCESSING USING DEEP NEURAL NETWORKS
A computer-implemented method of processing audio data, the method comprising receiving input audio data (x) comprising a time-series of amplitude values; transforming the input audio data (x) into an input frequency band decomposition (X1) of the input audio data (x); transforming the input frequency band decomposition (X1) into a first latent representation (Z); processing the first latent representation (Z) by a first deep neural network to obtain a second latent representation (Z{circumflex over ( )}, Z1{circumflex over ( )}); transforming the second latent representation (Z{circumflex over ( )}, Z1{circumflex over ( )}) to obtain a discrete approximation (X3{circumflex over ( )}); element-wise multiplying the discrete approximation (X3{circumflex over ( )}) and a residual feature map (R, X5{circumflex over ( )}) to obtain a modified feature map, wherein the residual feature map (R, X5{circumflex over ( )}) is derived from the input frequency band decomposition (X1); processing a pre-shaped frequency band decomposition by a waveshaping unit to obtain a waveshaped frequency band decomposition (X1{circumflex over ( )}, X1.2{circumflex over ( )}), wherein the pre-shaped frequency band decomposition is derived from the input frequency band decomposition (X1), wherein the waveshaping unit comprises a second deep neural network; summing the waveshaped frequency band decomposition (X1{circumflex over ( )}, X1.2{circumflex over ( )}) and a modified frequency band decomposition (X2{circumflex over ( )}, X1.1{circumflex over ( )}) to obtain a summation output (X0{circumflex over ( )}), wherein the modified frequency band decomposition (X2{circumflex over ( )}, X1.1{circumflex over ( )}) is derived from the modified feature map; and transforming the summation output (X0{circumflex over ( )}) to obtain target audio data (y{circumflex over ( )}).
Rotating speaker array
A speaker system includes one or more rotating speakers (or speakers with rotating reflectors) that are synchronized in absolute angular position to another rotating speaker or synchronized to audio effects to generated by a signal processing system driving a stationary or rotary speaker. Knowledge of absolute angular position in a multi-rotor speaker array or signal processing system allows for control of rotary position to accomplish acoustic effects otherwise not possible, such as matched-velocity profiles with differential phase control and motion profiles that are not based on simple rotation.
EFFECT ADDING APPARATUS, METHOD, AND ELECTRONIC MUSICAL INSTRUMENT
An effect adding apparatus includes: at least one first operation element on which a first user operation is performed; a plurality of second operation elements on which a second user operation is performed after the first user operation; and at least one processor, in which the at least one processor determines two or more effects including at least a first effect and a second effect, from a plurality of effects in which each of the effects is associated with a plurality of parameters, based on the first user operation on the at least one first operation element, and determines a parameter associated with each of the plurality of second operation elements, based on data indicating significance of each of a plurality of first parameters associated with the first effect determined and data indicating significance of each of a plurality of second parameters associated with the second effect determined.
Effect adding apparatus, method, and electronic musical instrument
An effect adding apparatus includes: at least one first operation element on which a first user operation is performed; a plurality of second operation elements on which a second user operation is performed after the first user operation; and at least one processor, in which the at least one processor determines two or more effects including at least a first effect and a second effect, from a plurality of effects in which each of the effects is associated with a plurality of parameters, based on the first user operation on the at least one first operation element, and determines a parameter associated with each of the plurality of second operation elements, based on data indicating significance of each of a plurality of first parameters associated with the first effect determined and data indicating significance of each of a plurality of second parameters associated with the second effect determined.
METHOD FOR CONTROLLING EFFECT APPLYING DEVICE FOR APPLYING ACOUSTIC EFFECT TO SOUND SIGNAL
Provided is a device 1 including: a signal processing unit 40 that applies a rotary speaker effect corresponding to a rotation speed value to a sound signal and control a tone color of the sound signal; and a control unit 10 that gradually changes, in response to a change command of the rotation speed value, the rotation speed value from a first speed to a second speed higher than the first speed with a first change curve having a first delay, and gradually changes control of the tone color from a first characteristic to a second characteristic that is stronger in the high frequency range than the first characteristic with a second change curve having a second delay shorter than the first delay.
EFFECT ADDING APPARATUS, METHOD, AND ELECTRONIC MUSICAL INSTRUMENT
An effect adding apparatus includes: at least one first operation element on which a first user operation is performed; a plurality of second operation elements on which a second user operation is performed after the first user operation; and at least one processor, in which the at least one processor determines two or more effects including at least a first effect and a second effect, from a plurality of effects in which each of the effects is associated with a plurality of parameters, based on the first user operation on the at least one first operation element, and determines a parameter associated with each of the plurality of second operation elements, based on data indicating significance of each of a plurality of first parameters associated with the first effect determined and data indicating significance of each of a plurality of second parameters associated with the second effect determined.
Rotating speaker array
A speaker system includes one or more rotating speakers (or speakers with rotating reflectors) that are synchronized in absolute angular position to another rotating speaker or synchronized to audio effects to generated by a signal processing system driving a stationary or rotary speaker. Knowledge of absolute angular position in a multi-rotor speaker array or signal processing system allows for control of rotary position to accomplish acoustic effects otherwise not possible, such as matched-velocity profiles with differential phase control and motion profiles that are not based on simple rotation.
Dynamic Audio Signal Processing System
A dynamic audio signal processing system for dynamically and continuously applying effects to an audio signal in real-time based on detected audio signal attributes. The dynamic audio signal processing system generally includes a signal processor including an input for receiving an audio signal, such as from an instrument. The signal processor may include an input analyzer adapted to detect one or more attributes of the audio signal continuously and in real-time. The signal processor may also include one or more signal conditioners in parallel with the input analyzer; each of the signal conditioners being adapted to dynamically apply one or more effects to the audio signal based on the one or more attributes detected by the input analyzer. The signal processor may include a selector for selecting which, if any, of the signal conditioners to apply effects to the audio signal based on detected attributes.
ROTATING SPEAKER ARRAY
A speaker system includes one or more rotating speakers (or speakers with rotating reflectors) that are synchronized in absolute angular position to another rotating speaker or synchronized to audio effects to generated by a signal processing system driving a stationary or rotary speaker. Knowledge of absolute angular position in a multi-rotor speaker array or signal processing system allows for control of rotary position to accomplish acoustic effects otherwise not possible, such as matched-velocity profiles with differential phase control and motion profiles that are not based on simple rotation.