In some embodiments, virtualization methods for generating a binaural signal in response to channels of a multi-channel audio signal, which apply a binaural room impulse response (BRIR) to each channel including by using at least one feedback delay network (FDN) to apply a common late reverberation to a downmix of the channels. In some embodiments, input signal channels are processed in a first processing path to apply to each channel a direct response and early reflection portion of a single-channel BRIR for the channel, and the downmix of the channels is processed in a second processing path including at least one FDN which applies the common late reverberation. Typically, the common late reverberation emulates collective macro attributes of late reverberation portions of at least some of the single-channel BRIRs. Other aspects are headphone virtualizers configured to perform any embodiment of the method.

According to one embodiment, a method, computer system, and computer program product for modulating external sounds to reflect the acoustic effects of virtual objects in a mixed-reality environment is provided. The present invention may include creating a knowledge corpus, recording a sound effect occurring externally to a mixed-reality environment experienced by a user operating the mixed-reality device; identifying one or more objects within the mixed-reality environment, including at least one virtual object; modulating the sound effect based on the knowledge corpus to simulate one or more acoustic effects of the one or more objects within the MR environment; and playing the modulated sound effect to the user.

A method and corresponding system for correcting for deviations in a performance that includes a plurality of audio sources, the method comprising detecting a parameter relating to an audio source, determining if the parameter deviates from a predetermined characteristic and in response to it being determined that the parameter deviates from the predetermined characteristic, causing display of a user interface configured to control the parameter, to allow a user to correct the deviation.

A reproduction device includes: an acquisition unit configured to acquire sound source information about a sound source; a determination unit configured to determine an output characteristic of the sound source with a virtual speaker arranged in a virtual space, based on a positional relationship between the virtual speaker and a virtual listener arranged in the virtual space; and a reproduction unit configured to reproduce the sound source with a real speaker arranged in a real space, based on the output characteristic determined by the determination unit.

Disclosed herein are systems and methods for storing, organizing, and maintaining acoustic data for mixed reality systems. A system may include one or more sensors of a head-wearable device, a speaker of the head-wearable device, and one or more processors. A method performed by the one or more processors may include receiving a request to present an audio signal. An environment may be identified via the one or more sensors of the head-wearable device. One or more audio model components associated with the environment may be retrieved. A first audio model may be generated based on the audio model components. A second audio model may be generated based on the first audio model. A modified audio signal may be determined based on the second audio model and based on the request to present an audio signal. The modified audio signal may be presented via the speaker of the head-wearable device.

A method of presenting an audio signal to a user of a mixed reality environment is disclosed, the method comprising the steps of detecting a first audio signal in the mixed reality environment, where the first audio signal is a real audio signal; identifying a virtual object intersected by the first audio signal in the mixed reality environment; identifying a listener coordinate associated with the user; determining, using the virtual object and the listener coordinate, a transfer function; applying the transfer function to the first audio signal to produce a second audio signal; and presenting, to the user, the second audio signal.

Techniques for calibrating listening devices are disclosed herein. The techniques include emitting a predetermined audio signal using an outward-facing transducer located on a first portion of a head-mounted device worn by the user, receiving the predetermined audio signal at a microphone located on a second portion of the head-mounted device, the second portion being different from the first portion, determining a transfer function for the user based on the received predetermined audio signal, and applying the transfer function to audio signals transmitted to the user.

An apparatus for rendering an audio scene comprising an audio source at an audio source position and a plurality of diffracting objects, comprises: a diffraction path provider for providing a plurality of intermediate diffraction paths through the plurality of diffracting objects, an intermediate diffraction path having a starting point and an output edge of the plurality of diffracting objects and an associated filter information for the intermediate diffraction path; a renderer for rendering the audio source at a listener position, wherein the renderer is configured for determining, based on the output edges of the intermediate diffraction paths and the listener position, one or more valid intermediate diffraction paths from the audio source position to the listener position, determining, for each valid intermediate diffraction path of the one or more valid intermediate diffraction paths, a filter representation for a full diffraction path, and calculating audio output signals for the audio scene using an audio signal associated to the audio source and the filter representation for each full diffraction path.

During an electronic call between two individuals, a sound localization point simulates a location in empty space from where an origin of a voice of one individual occurs for the other individual.

An audio communication device includes: a sound position determiner that determines sound localization positions for N audio signals in a virtual space having first and second walls; N sound localizers each performing sound localization processing to localize sound in the sound localization position determined by the sound position determiner, and outputting localized sound signals; an adder that sums the N localized sound signals, and outputs a summed localized sound signal. Each sound localizer performs the processing using: a first head-related transfer function (HRTF) assuming that a sound wave emitted from the sound localization position of the sound localizer determined by the sound position determiner directly reaches each ear of a hearer virtually present at the hearer position; and a second HRTF assuming that the sound wave emitted from the sound localization position reaches each ear of the hearer after being reflected by closer one of the first and second walls.