During an electronic call between two individuals, a sound localization point simulates a location in empty space from where an origin of a voice of one individual occurs for the other individual.

Disclosed herein are systems and methods for presenting an audio signal associated with presentation of a virtual object colliding with a surface. The virtual object and the surface may be associated with a mixed reality environment. Generation of the audio signal may be based on at least one of an audio stream from a microphone and a video stream form a sensor. In some embodiments, the collision between the virtual object and the surface is associated with a footstep on the surface.

A virtual reality (VR), augmented reality (AR) and/or mixed reality (MR) system in a physical environment with a plurality of loudspeakers includes a user-worn head mounted display (HMD), a VR/AR/MR processor, and a VR/AR/MR user tracking processor. The HMD includes a microphone and a user tracking device configured to track a user orientation and position. The VR/AR/MR processor delivers a digital video signal to the head-mounted display, and a digital control signal and a digital audio signal to a receiver/preamplifier. The VR/AR/MR user tracking processor receives user tracking data from the HMD user tracking device and provides a digital user tracking data signal to the receiver preamplifier. the receiver/preamplifier receives the digital user tracking data signal, the digital control signal, the digitized microphone signal, and the digital audio signal, and provides a processed audio signal to the amplifier. An amplifier receives the processed audio signal and provides amplified audio signals.

The present document describes a method (700) for encoding a multi-channel input signal (201). The method (700) comprises determining (701) a plurality of downmix channel signals (203) from the multi-channel input signal (201) and performing (702) energy compaction of the plurality of downmix channel signals (203) to provide a plurality of compacted channel signals (404). Furthermore, the method (700) comprises determining (703) joint coding metadata (205) based on the plurality of compacted channel signals (404) and based on the multi-channel input signal (201), wherein the joint coding metadata (205) is such that it allows upmixing of the plurality of compacted channel signals (404) to an approximation of the multi-channel input signal (201). In addition, the method (700) comprises encoding (704) the plurality of compacted channel signals (404) and the joint coding metadata (205).

The present document relates to a method of layered encoding of a compressed sound representation of a sound or sound field. The compressed sound representation comprises a basic compressed sound representation comprising a plurality of components, basic side information for decoding the basic compressed sound representation to a basic reconstructed sound representation of the sound or sound field, and enhancement side information including parameters for improving the basic reconstructed sound representation. The method comprises sub-dividing the plurality of components into a plurality of groups of components and assigning each of the plurality of groups to a respective one of a plurality of hierarchical layers, the number of groups corresponding to the number of layers, and the plurality of layers including a base layer and one or more hierarchical enhancement layers, adding the basic side information to the base layer, and determining a plurality of portions of enhancement side information from the enhancement side information and assigning each of the plurality of portions of enhancement side information to a respective one of the plurality of layers, wherein each portion of enhancement side information includes parameters for improving a reconstructed sound representation obtainable from data included in the respective layer and any layers lower than the respective layer. The document further relates to a method of decoding a compressed sound representation of a sound or sound field, wherein the compressed sound representation is encoded in a plurality of hierarchical layers that include a base layer and one or more hierarchical enhancement layers, as well as to an encoder and a decoder for layered coding of a compressed sound representation.

Example embodiments may include one or more of receiving sound emissions signals from channels via sound emitters, controlling the sound emission signals, via relay circuits, and one of the relay circuits is configured to interrupt one of the sound emission signals associated with one of the sound emitters while the other sound emissions signals pass to the other corresponding sound emitters, and receiving, via a sound detection circuit, an electrical ambient sound signal based on ambient sound sensed by the one of the sound emitters responsive to the interrupted one of the sound emission signals.

An electronic device is provided. The electronic device includes a plurality of audio output devices and at least one processor operatively connected to the plurality of audio output devices, wherein the at least one processor may be configured to identify orientation information of the electronic device, based on detecting an output of audio data, transmit, to each audio output device, channel information of audio data to be output by each of the plurality of audio output devices, based on the orientation information of the electronic device, and control the plurality of audio output devices so that each audio output device selects a channel and outputs audio data of the selected channel, based on the channel information.

A display apparatus is disclosed. The display apparatus includes a display, a speaker, and a processor configured to acquire location information of the display apparatus inside a modular display apparatus including a plurality of display apparatuses, change an output set value of the speaker based on the location information, and control the speaker to output a sound signal received from an external apparatus based on the changed output set value, wherein the external apparatus includes at least one of another display apparatus adjacent to the display apparatus among the plurality of display apparatuses or a source apparatus.

Implementations of the subject technology provide for audio integration of portable electronic devices into enclosed environments. A portable electronic device may be carried, by a user, into an enclosed environment, such as into an enclosure of a building, a room, or other apparatus. One or more remote speakers may be disposed in the enclosed environment. The remote speaker(s) may be operated in cooperation with the portable electronic device to spatially coordinate audio output from the remote speaker(s) with video content displayed by the portable electronic device.

In a reliable multi-cast, a concealment scheme may be applied to recover or conceal lost or otherwise corrupted packets of audio information for one channel based on the audio information of other channels in the reliable multi-cast. The concealment scheme may employ correction factors for channels derived from the channel relationships.