Electronic glasses track head movement of a user with respect to a location in empty space on top of a physical object. One or more processors process sound that externally localizes as binaural sound to the location in empty space on top of the physical object. Speakers in the electronic glasses provide the binaural sound to the user.

A method of presenting an audio signal to a user of a mixed reality environment is disclosed, the method comprising the steps of detecting a first audio signal in the mixed reality environment, where the first audio signal is a real audio signal; identifying a virtual object intersected by the first audio signal in the mixed reality environment; identifying a listener coordinate associated with the user; determining, using the virtual object and the listener coordinate, a transfer function; applying the transfer function to the first audio signal to produce a second audio signal; and presenting, to the user, the second audio signal.

Determination of a composite acoustic parameter value for a headset is presented herein. A directionally enhanced audio signal is generated based on audio signals from an acoustic sensor array and a spatial signal enhancement filter that is directed for enhancement of a sound source. A SNR improvement value is determined based on a SNR value of the directionally enhanced audio signal and a SNR value of an audio signal from an acoustic sensor of the acoustic sensor array. The SNR improvement value is input into a model that maps SNR improvement values to spatial acoustic parameters to determine a spatial acoustic parameter. A temporal acoustic parameter is determined based on the audio signals. The composite acoustic parameter value is determined based on the spatial acoustic parameter and a temporal acoustic parameter value. Audio content presented to a user is adjusted based in part on the composite acoustic parameter value.

Methods and apparatus assist listeners in distinguishing between electronically generated binaural sound and physical environment sound while the listener wears a wearable electronic device that provides the binaural sound to the listener. The wearable electronic device generates a visual alert or audio alert when the electronically generated binaural sound occurs.

An apparatus is disclosed, configured to receive, from first and second spatial audio capture apparatuses, respective first and second composite audio signals comprising components derived from one or more sound sources in a capture space. The apparatus is further configured to identify a position of a user device corresponding to one of first and second areas respectively associated with the positions of the first and second spatial audio capture apparatuses, and to render audio representing the one or more sound sources to the user device, the rendering being performed differently dependent on, for the spatial audio capture apparatus associated with the identified first or second area, whether or not individual audio signals from each of the one or more sound sources can be successfully separated from its composite signal.

A system is provided. The system includes an analyzer for determining a plurality of binaural room impulse responses, and a loudspeaker signal generator for generating at least two loudspeaker signals depending on the plurality of binaural room impulse responses and depending on the audio source signal of at least one audio source. The analyzer is configured to determine the plurality of the binaural room impulse responses such that each of the plurality of the binaural room impulse responses considers an effect that results from a headphone being worn by a user.

A new real-time spatial audio rendering system includes a real-time spatial audio rendering computer software application adapted to run on a communication device. The application renders stereo audio from mono audio sources in a virtual room of a listener. The listener can be mobile. The stereo audio is rendered for each listener within the room. The real-time spatial audio rendering system has two different modes, with and without reverberation. Reverberation can provide the sense of the dimensions of the room, First, the anechoic processing module produces the anechoic stereo audio that provides the sense of direction and distance of spatial audio. When reverberation is desired, the reverberation processing module is also performed to provide the sense of the room's dimensions by the spatial audio.

An apparatus for generating a spatialized audio output based on a listener position, the apparatus including circuitry configured to: obtain two or more audio signal sets; obtain a listener position within an audio environment, wherein the audio environment includes one or more area having one or more inside and outside regions in relation to the respective audio signal set positions; obtain metadata based on a processing of the at least two audio signals; determine, for the listener position within an audio environment outside the inside region, a second listener position; determine modified metadata for the second listener position based on the metadata; determine at least two modified audio signals for the second listener position based on the at least two audio signals; determine spatial metadata for the listener position; and output the at least two modified audio signals and the spatial metadata.

The description relates to modeling acoustic effects in scenes with dynamic portals. One implementation includes obtaining a representation of a scene having a plurality of portals and simulating sound travel in the scene using a plurality of probes deployed in the scene. The implementation also includes determining acoustic parameters for initial sound traveling between respective probes based at least on the simulating. The implementation also includes identifying one or more intercepted portals in the scene that are intercepted by a particular initial sound path from a particular source location to a particular listener location, using particular acoustic parameters for the particular source location and the particular listener location.

An audio rendering system includes a processor that combines audio input signals with personalized spatial audio transfer functions having room responses. The personalized spatial audio transfer functions are selected from a database having a plurality of candidate transfer functions derived from in-ear microphone measurements for a plurality of individuals. Alternatively, the personalized transfer functions are derived from actual in-ear measurements of the listener. A room modification module allows the user to modify the personalized spatial audio transfer functions to substitute a different room or to modify the characteristics of the selected room without requiring additional in ear measurements. The module segments the selected transfer function into regions including one or more of direct; head and torso influenced; early reflection, and late reverberation regions. Extraction and modification operations are performed on one or more of the regions to alter the perceived sound.