One example method includes generating sound information regarding sound sources in an environment. The sound information is generated by separating and localizing the sound sources. The sound information is then presented as guidance to a user. The guidance may be presented graphically in a user interface, haptically, or in another manner.

A system may provide for the generation of spatial audio for audiovisual conferences, video conferences, etc. (referred to herein simply as “conferences”). Spatial audio may include audio encoding and/or decoding techniques in which a sound source may be specified at a location, such as on a two-dimensional plane and/or within a three-dimensional field, and/or in which a direction or target for a given sound source may be specified. A conference participant's position within a conference user interface (“UI”) may be set as the source of sound associated with the conference participant, such that different conference participants may be associated with different sound source positions within the conference UI.

A method (S100) for optimizing speech pickup in a speakerphone system, wherein the speakerphone system comprises a microphone system placed in a specific configuration, wherein the method comprising receiving (S10) acoustic input signals (12) by the microphone system, processing (S20) said acoustic input signals (12) by using an algorithm (100) for focusing and steering a selected target sound signal towards a desired direction, and transmitting (S30) an output signal (13) based on said processing.

An apparatus comprising means for: providing a user interface for enabling a user to select audio content, comprising an arrangement of multiple user-selectable visual elements at positions in the user interface that are indicative of different orientations from a user and have an appearance dependent upon audio content for the respective orientations; and responding to selection of a user-selectable visual element at a position in the user interface indicative of an orientation from the user to select, for processing, audio content for the orientation.

There is provided an imaging apparatus including: a sound processing unit that performs processing with respect to a sound signal input through a microphone; and a control unit that separately controls a parameter related to processing of the sound signal at a time of recording of a captured image when the sound data processed by the sound processing unit is recorded together with image data obtained by imaging through an imaging unit and a time of recording a sound memo when the sound data processed by the sound processing unit is recorded as the sound memo.

An information processing method includes, in response to determining that an application is in a video mode, acquiring a video image in real time through a camera group of an electronic device and acquiring a video sound in real time through a microphone group of the electronic device; displaying the video image; mapping an audio manipulation area that includes an operation response area of a sound source in an acquisition area of the camera group; obtaining an input operation for the operation response area; and, in response to the input operation, adjusting a sound collection effect of the sound source corresponding to the operation response area.

An apparatus is disclosed, configured to receive, from first and second spatial audio capture apparatuses, respective first and second composite audio signals comprising components derived from one or more sound sources in a capture space. The apparatus is further configured to identify a position of a user device corresponding to one of first and second areas respectively associated with the positions of the first and second spatial audio capture apparatuses, and to render audio representing the one or more sound sources to the user device, the rendering being performed differently dependent on, for the spatial audio capture apparatus associated with the identified first or second area, whether or not individual audio signals from each of the one or more sound sources can be successfully separated from its composite signal.

A recording device records a video and an imaging time, and a voice. Based on the voice, a sound parameter calculator calculates a sound parameter for specifying magnitude of the voice in a monitoring area at the imaging time for each of pixels and for each of certain times. A sound parameter storage unit stores the sound parameter. A sound parameter display controller superimposes a voice heat map on a captured image of the monitoring area and displays the superimposed image on a monitor. At this time, the sound parameter display controller displays the voice heat map based on a cumulative time value of magnitude of the voice, according to designation of a time range.

A separate virtual (e.g. aural) location for one or more interaction or telephony call participants may provide an indication or clue for at least one of the call participants of who is speaking at any one time, reducing errors and misunderstandings during the call. Auditory localization may be used so that participants are heard from separate virtual locations. An audible user interface (AUI) may be produced such that audio presented to the listening user is location-specific, the location being relevant to the user, just as information presented in a graphical user interface (GUI) might be relevant. For example, a plurality of audio streams which are part of an interaction between communicating parties may be accepted, and based on the audio streams, a plurality of audio outputs may be provided, each located at a different location in three-dimensional space.

An electronic device identifies a location of a physical object that is away from a listener. The electronic device convolves sound so the sound externally localizes as binaural sound to the physical object. The sound plays to the listener through earphones so the listener hears the sound as emanating from the physical object.