Certain aspects of the technology disclosed herein include generating a virtual sound field based on data from an ambisonic recording device. The ambisonic device records sound of a surrounding environment using at least four microphones having a tetrahedral orientation. An omnidirectional microphone having an audio-isolated portion can be used to isolate sound from a particular direction. Sound received from the plurality of microphones can be used to generate a virtual sound field. The virtual sound field include a dataset indicating a pressure signal and a plurality of velocity vectors. The ambisonic recording device can include a wide angle camera and generate wide angle video corresponding to the virtual sound field.

Apparatus including a processor configured to: obtain at least two microphone audio signals; determine spatial metadata transmit and/or store the spatial metadata and at least one of: at least one of the at least two microphone audio signals, at least one microphone audio signal from at least one second microphone configured to capture at least part of a same sound scene captured with the at least one first microphone, or at least one signal based, at least partially, on the at least two microphone audio signals, wherein the transmitting and/or storing is configured to enable synthesis of a plurality of spherical harmonic audio signals.

Methods and systems are provided for enhanced audio experiences in VR/AR applications. The apparatuses of this disclosure are adapted to record multiple binaural stereo pairs and play back select binaural pairs corresponding to users' head positions. A substantially spherical microarray is utilized in various embodiments for recording multiple binaural stereo pairs. A VR/AR headset is further adapted to track a user's head positions and dynamically play back binaural sound pairs corresponding to the head positions.

A sound field coding system and method that provides flexible capture, distribution, and reproduction of immersive audio recordings encoded in a generic digital audio format compatible with standard two-channel or multi-channel reproduction systems. This end-to-end system and method mitigates any impractical need for standard multi-channel microphone array configurations in consumer mobile devices such as smart phones or cameras. The system and method capture and spatially encode two-channel or multi-channel immersive audio signals that are compatible with legacy playback systems from flexible multi-channel microphone array configurations.

An audio processor for providing loudspeaker signals on the basis of input signals, like channel signals and/or object signals, obtains an information about the position of a listener and an information about the position of a plurality of loudspeakers, or sound transducers. The audio processor selects one or more loudspeakers for a rendering of the objects and/or of the channel objects and/or of the adapted signals, derived from the input signals. The selection depends on the information about the position of the listener and about the positions of the loudspeakers and takes into consideration the information about one or more acoustic obstacles. The audio signal processor renders the objects/channel objects/adapted signals derived from the input signals, in dependence on the information about the position of the listener and about positions of the loudspeakers, in order to obtain the loudspeaker signals, such that a rendered sound follows a listener.

Provided are methods, systems, and apparatuses for recording a three-dimensional (3D) sound field using a vertically-oriented cylindrical array with multiple circular arrays at different heights. The design of the cylindrical array is well-suited to providing a high-resolution in azimuth and a reduced resolution in elevation, and offers improved performance over existing 3D sound reproduction systems. The methods, systems, and apparatuses provide a larger vertical aperture than horizontal aperture, as opposed to a spherical array, which has the same aperture for all dimensions, and further provides an alternative format to mixed-order spherical decomposition.

In a particular aspect, an audio processing device includes a position predictor configured to determine predicted position data based on position data. The audio processing device further includes a processor configured to generate an output spatialized audio signal based on the predicted position data.

A system comprising a video source, one or more audio sources and a computing device. The video source may be configured to generate a video signal. The audio sources may be configured to generate audio streams. The computing device may comprise one or more processors configured to (i) transmit a display signal that provides a representation of the video signal to be displayed to a user, (ii) receive a plurality of commands from the user while the user observes the representation of the video signal and (iii) adjust the audio streams in response to the commands. The commands may identify a location of the audio sources in the representation of the video signal. The representation of the video signal may be used as a frame of reference for the location of the audio sources.

Methods, systems, and computer readable media for utilizing parallel adaptive rectangular decomposition (ARD) to perform acoustic simulations are disclosed herein. According to one method, the method includes assigning, to each of a plurality of processors in a central processing unit (CPU) cluster, ARD processing responsibilities associated with one or more of a plurality of partitions of an acoustic space and determining, by each processor, pressure field data corresponding to the one or more assigned partitions. The method further includes transferring, by each processor, the pressure field data to at least one remote processor that is assigned to a partition that shares an interface with at least one partition assigned to the transferring processor and receiving, by each processor from the at least one remote processor, forcing term values that have been derived by the at least one remote processor using the pressure field data.

Systems, methods, and apparatus for backward-compatible coding of a set of basis function coefficients that describe a sound field are presented.