The present technology relates to a signal processing apparatus and method, an acoustic reproduction apparatus, and a program that can achieve more realistic acoustic presentation.

The signal processing apparatus includes an acoustic transfer characteristic convolution processing unit that convolves an acoustic transfer characteristic according to a current position of a presentation destination of a virtual sound source among the acoustic transfer characteristic associated with each position in a space and virtual sound source data of the virtual sound source. The present technology can be applied to an acoustic reproduction system.

An audio signal processing method, includes acquiring a first distance between a current position and an initial position of a mobile device, and a second distance between the current position of the mobile device and a wearable device. Determining a first deflection angle according to the first distance, the second distance and the initial distance between the mobile device and the wearable device. Acquiring a second deflection angle of the wearable device reflecting a posture change. Determining relative position information between the mobile device and the wearable device according to the first deflection angle, the second deflection angle and the second distance and processing an audio signal based on the relative position information to obtain a playing audio played by the wearable device.

A method and a system for instrument separating and reproducing for a mixture audio source is provided. The method and/or the system includes inputting selected music into an instrument separation model for extracting features therefrom, determining audio source signals of multiple channels for the separation of all instruments, each channel containing sound of one instrument, and transmitting the signals of the different channels to multiple speakers placed at designated positions for playing, which can reproduce or recreate an immersive sound field listening experience for users.

One or more embodiments include techniques for generating immersive audio for an acoustic system. The techniques include determining an apparent location associated with a portion of audio; calculating, for each speaker included in a plurality of speakers of the acoustic system, a perceptual distance between the speaker and the apparent location; selecting a subset of speakers included in the plurality of speakers based on the perceptual distances between the plurality of speakers and the apparent location; generating a set of filters based on the subset of speakers and one or more target characteristics of the acoustic system; and generating, for each speaker included in the subset of speakers, a speaker signal using one or more filters included in the set of filters.

This disclosure provides methods, devices, and systems for videoconferencing. The present implementations more specifically relate to audio signal processing techniques that can be used to identify speakers in a videoconference. In some aspects, an audio signal processor may map each speaker in a videoconference to a respective spatial direction and transform the audio signals received from each speaker using one or more transfer functions associated with the spatial direction to which the speaker is mapped. The audio signal processor may further transmit the transformed audio signals to an audio output device that emits sounds waves having a directionality associated with the transformation. For example, the audio signal processor may apply one or more head-related transfer functions to the audio signals received from a particular speaker so that the sound waves emitted by the audio output device are perceived as originating from the spatial direction to which the speaker is mapped.

Embodiments relate to binaural spatialization of more than two sound sources on two audio channels of an audio system. Sound signals each emitted from a corresponding sound source are collected, and a respective virtual position within an angular range of a sound scene is assigned to each sound source. Multi-source audio signals are generated by panning each sound signal according to the respective virtual position. A first multi-source audio signal is spatialized to a first direction to generate a first left signal and a first right signal. A second multi-source audio signal is spatialized to a second direction to generate a second left signal and a second right signal. A binaural signal is generated using the first left signal, the second left signal, the first right signal, and the second right signal. The binaural signal is such that each sound source appears to originate from its respective virtual position.

An audio providing apparatus and method are provided. The audio providing apparatus includes: an object renderer configured to render an object audio signal based on geometric information regarding the object audio signal; a channel renderer configured to render an audio signal having a first channel number into an audio signal having a second channel number; and a mixer configured to mix the rendered object audio signal with the audio signal having the second channel number.

An apparatus comprising at least one processor and at least one memory, the memory comprising machine-readable instructions, that when executed cause the apparatus to: store in a non-volatile memory multiple sets of predetermined spatial audio processing parameters for differently moving sound sources; provide in a man machine interface an option for a user to select one of the stored multiple sets of predetermined spatial audio processing parameters for differently moving sound sources; and in response to the user selecting one of the stored multiple sets of predetermined spatial audio processing parameters for differently moving sound sources, the apparatus is further caused to use the selected one of the stored multiple sets of predetermined spatial audio processing parameters to spatially process audio from one or more sound sources.

A method and corresponding system for correcting for deviations in a performance that includes a plurality of audio sources, the method comprising detecting a parameter relating to an audio source, determining if the parameter deviates from a predetermined characteristic and in response to it being determined that the parameter deviates from the predetermined characteristic, causing display of a user interface configured to control the parameter, to allow a user to correct the deviation.

Apparatus is configured to associate each of one or more spatially-distributed audio sources in a virtual space, each audio source providing one or more audio signals representing audio for playback through a user device, with a respective fade-in profile which defines how audio volume for the audio source is gradually increased from a minimum level to a target volume level as a function of time. It is configured also to identify, based on user position, a current field-of-view within a virtual space and, in response to detecting that one or more new audio sources have a predetermined relationship with respect to the current field-of-view, fading-in the audio from the or each new audio source according to the fade-in profile for the respective audio source so as to increase their volume gradually towards the target volume level defined by the fade-in profile.