An audio system and method of using the audio system to augment spatial audio rendition is described. The audio system can include a device to receive user inputs designating positions on an augmented reality view of a listening environment. Sound source icons can be presented in the augmented reality view at the designated positions. The sound source icons can visually represent sound sources at locations in the listening environment that correspond to, but are different than, the positions. One or more processors of the audio system can apply head-related transfer functions, which correspond to the locations in the listening environment, to audio input signals to generate binaural audio signals. The audio system can include a headset that uses the binaural audio signals to render spatialized audio localizing sounds to the locations in the listening environment. Other aspects are also described and claimed.

Methods and systems for designing binaural room impulse responses (BRIRs) for use in headphone virtualizers, and methods and systems for generating a binaural signal in response to a set of channels of a multi-channel audio signal, including by applying a BRIR to each channel of the set, thereby generating filtered signals, and combining the filtered signals to generate the binaural signal, where each BRIR has been designed in accordance with an embodiment of the design method. Other aspects are audio processing units configured to perform any embodiment of the inventive method. In accordance with some embodiments, BRIR design is formulated as a numerical optimization problem based on a simulation model (which generates candidate BRIRs) and at least one objective function (which evaluates each candidate BRIR), and includes identification of a best one of the candidate BRIRs as indicated by performance metrics determined for the candidate BRIRs by each objective function.

A loudspeaker device includes at least one loudspeaker, a loudspeaker holder holding the at least one loudspeaker in a reference range away from the ear of a user by a reference distance, a first microphone collecting an environmental sound and outputting an electrical signal, a second microphone attached to a position where a sound output from the at least one loudspeaker is collected, the second microphone collecting a synthetic sound synthesized from the sound output from the at least one loudspeaker and the environmental sound and outputting an electrical signal, and a processor controlling the at least one loudspeaker so as to output a sound for reducing the environmental sound based on the electrical signals representing the sounds collected by the first microphone and the second microphone.

An audio reproduction device and method for audio control based on room-correction (RC) and head related transfer function (HRTF) are provided. The audio reproduction device includes a speaker that reproduces a first audio signal. The audio reproduction device receives a plurality of second audio signals indicative of frequency responses captured based on the first audio signal and captured by a plurality of audio capturing devices positioned on a head wearable device of a user present within an enclosed physical space. The audio reproduction device determines RC preset for one or more RC filters associated with the speaker, based on the captured frequency responses. The audio reproduction device further determines HRTF associated with the user based on the captured frequency responses, and user-specific information of the user. The audio reproduction device further controls audio reproduction of the speaker based on the determined RC preset and the determined HRTF.

Methods and apparatus assist listeners in distinguishing between electronically generated binaural sound and physical environment sound while the listener wears a wearable electronic device that provides the binaural sound to the listener. The wearable electronic device generates a visual alert or audio alert when the electronically generated binaural sound occurs.

A method comprises generating a first environment representation for rendering a video representation of a virtual environment; and generating a second environment representation for rendering an audio output at a virtual listening position within the virtual environment in response to sounds generated by one or more virtual sound sources within the virtual environment; in which the first and second environment representations comprise respective different geometrical representations of the virtual environment; in which the step of generating the second environment representation comprises: generating a starting version of the second environment representation; and modifying the starting version of the second environment representation.

Provided are a method and device for processing a music file, a terminal and a storage medium. The method comprises: in response to a received sound effect adjustment instruction, acquiring a music file, the adjustment of which is indicated by the sound effect adjustment instruction; carrying out vocals and accompaniment separation on the music file to obtain vocal data and accompaniment data in the music file; carrying out first sound effect processing on the vocal data to obtain target vocal data, and carrying out second sound effect processing on the accompaniment data to obtain target accompaniment data; and synthesizing the target vocal data and the target accompaniment data to obtain a target music file.

Embodiments relate to an audio system that performs equalization of audio signals based on one or more diffuse field head-related transfer functions (HRTFs) and device-specific data. User-specific data and device-specific data (i.e., transducer-specific data) are applied to an acoustic model to predict an acoustic response for a user. An equalization filter is then determined using the acoustic response and the one or more diffuse field HRTFs. The equalization filter is applied to a processed version of an audio signal to create a modified version of the audio signal. The modified version of the audio signal is presented to the user via a transducer array of the audio system. The audio system can further include a microphone assembly that reduces the Helmholtz resonance effect.

An audio signal processing apparatus including a receiving unit receiving an input audio signal, a processor generating an output audio signal reproducing a virtual sound source corresponding to the input audio signal in a virtual space, and an output unit outputting an output audio signal generated by the processor is disclosed. The processor may obtain spatial information related to the virtual space including a virtual sound source corresponding to the input audio signal and a listener, filter the input audio signal based on a location of the virtual sound source and the spatial information to generate at least one reflected sound corresponding to each of at least one mirror plane in the virtual space, obtain a relative location of a virtual reflect sound source with respect to a location and a view-point of the listener, based on information of the view-point of the listener and a location of the virtual reflect sound source corresponding to each of the at least one reflected sound, and binaural render the at least one reflected sound, based on the relative location of the virtual reflect sound source corresponding to each of the at least one reflected sound.

A method for localizing sound when enabling participation in a live event, including establishing a multi-player gaming session of a gaming application that generates an interactive gaming world, the live event being a real-world venue where players playing the gaming application are present. A live view of the venue is generated based on captured video streams, and generated for a physical POV anchored to a physical location in the venue. Audio is generated for the live event, and modified to reflect acoustics of the real-world venue for the physical location. The modified audio is synchronized to the live view. The live view and synchronized audio are streamed to an HMD of a remote user located outside the venue, and presents an augmented reality view of the live event.