An apparatus including circuitry configured for causing audio processing to a spatial audio-visual representation of an image and sound apparatus, the spatial audio-visual representation being live or reproduced from recording; and modifying the audio processing applied to an audio-visually manipulated spatial section of the spatial audio-visual representation in response to information a prior audio-visual manipulation with data processing in the audio-visually manipulated spatial section.

The present technology relates to a signal processing device, a method, and a program that make it possible for a user to obtain a higher realistic feeling. The signal processing device includes: an audio generation unit that generates a sound source signal according to a type of a sound source on the basis of a recorded signal obtained by sound collection by a microphone attached to a moving object; a correction information generation unit that generates position correction information indicating a distance between the microphone and the sound source; and a position information generation unit that generates sound source position information indicating a position of the sound source in a target space on the basis of microphone position information indicating a position of the microphone in the target space and the position correction information. The present technology can be applied to a recording/transmission/reproduction system.

A method and apparatus for rendering a volume sound source are disclosed. The method of rendering a volume sound source may include identifying information about a listener and information about the volume sound source, determining a corresponding area in which a source element is disposed in the volume sound source in consideration of the information about the listener, determining an angle between the listener and the corresponding area based on the information about the listener and the information about the volume sound source, determining a number of source elements disposed in the corresponding area according to the angle, determining a position and a gain of the source element using i) the number of source elements and ii) a distance between the listener and the volume sound source, and rendering the volume sound source according to the position and the gain of the source element.

Audiovisual presentations, such as film recordings, may have been originally created having an audio soundtrack with multiple audio tracks mixed for a surround sound system that includes a set of speakers physically surrounding a user. The present disclosure presents systems and methods to remix these soundtracks into 3D audio that when presented to the ears of a user can be perceived as a virtual surround sound system that mimics the physical system. What is more, the disclosed systems and methods can enhance the virtual surround sound system by adjusting virtual speakers of the virtual surround sound system according to video content of the audiovisual presentation. Further enhancement may be possible by adjusting the virtual speakers of the virtual surround sound system according to a sensed position of a user.

In at least one embodiment, an audio system is provided. At least one controller is programmed to encode a first and second audio component and to generate a first and a second encoded audio component. The at least one controller is programmed to apply a first gain to at least one of the first encoded audio component and the second encoded audio component to generate at least one of a first and second increased encoded audio component and to decode the at least one of the first and the second increased encoded audio component to generate at least one of a first and second decoded audio component. The at least one controller is further programmed to amplitude pan the at least one of the first and the second decoded audio component to increase a stereo width for an audio output transmitted by a first loudspeaker and a second loudspeaker.

Embodiments are described for an adaptive audio system that processes audio data comprising a number of independent monophonic audio streams. One or more of the streams has associated with it metadata that specifies whether the stream is a channel-based or object-based stream. Channel-based streams have rendering information encoded by means of channel name; and the object-based streams have location information encoded through location expressions encoded in the associated metadata. A codec packages the independent audio streams into a single serial bitstream that contains all of the audio data. This configuration allows for the sound to be rendered according to an allocentric frame of reference, in which the rendering location of a sound is based on the characteristics of the playback environment (e.g., room size, shape, etc.) to correspond to the mixer's intent. The object position metadata contains the appropriate allocentric frame of reference information required to play the sound correctly using the available speaker positions in a room that is set up to play the adaptive audio content.

The technology disclosed relates to a motion sensory and imaging device capable of acquiring imaging information of the scene and providing at least a near real time pass-through of imaging information to a user. The sensory and imaging device can be used stand-alone or coupled to a wearable or portable device to create a wearable sensory system capable of presenting to the wearer the imaging information augmented with virtualized or created presentations of information.

An apparatus, electronic device, method and computer program wherein the apparatus includes: processing circuitry; and memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, enable the apparatus to perform: obtaining spatial information relating to a captured sound field from a first set of microphones; obtaining one or more signals from a second set of microphones where the one or more signals relate to the captured sound field; and using the obtained spatial information from the first set of microphones to process the one or more signals obtained from the second set of microphones; wherein the first set of microphones is provided within an electronic device and the second set of microphones is provided external to the electronic device.

Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. According to an example method, a source location corresponding to the audio signal is identified. For each of the respective left and right ear of the user, a virtual speaker position, of a virtual speaker array, is determined, the virtual speaker position collinear with the source location and with a position of the respective ear. For each of the respective left and right ear of the user, a head-related transfer function (HRTF) corresponding to the virtual speaker position and to the respective ear is determined; and the output audio signal is presented to the respective ear of the user via one or more speakers associated with the wearable head device. Processing the audio signal includes applying the HRTF to the audio signal.

An apparatus (101) for enabling reproduction of spatial audio signals. The apparatus comprises means for obtaining (401) audio signals (501) comprising one or more channels and obtaining (403) spatial metadata (503) relating to the audio signals (501). The spatial metadata (503) comprises information that indicates how to spatially reproduce the audio signals. The apparatus also comprises means for obtaining (405) information relating to a field of view of video (505) wherein the video is for display on a display (205) of a rendering device (201) and wherein the video is associated with the audio signals (501). The apparatus also comprises means for aligning (407) spatial reproduction of the audio signals based, at least in part, on the obtained spatial metadata (503), with objects (309A, 309B) in the video according to the obtained information relating to the field of view of video; and enabling (409) reproduction of the audio signals based on the aligning (407).