H04S7/00

VIDEO PROCESSING DEVICE AND METHOD

A video processing apparatus includes a memory storing instructions, and at least one processor configured to execute the instructions to generate a plurality of feature information by analyzing a video signal comprising a plurality of images based on a first DNN, extract a first altitude component and a first planar component corresponding to a movement of an object in a video from the video signal based on a second DNN, extract a second planar component corresponding to a movement of a sound source in audio from a first audio signal based on a third DNN, generate a second altitude component based on the first altitude component, the first planar component, and the second planar component, output a second audio signal comprising the second altitude component based on the feature information, and synchronize the second audio signal with the video signal and output the synchronized second audio signal and video signal.

Multichannel audio system, acoustic profile information generating device, wireless recording playback device, program, and method for generating acoustic profile information
20230007422 · 2023-01-05 ·

[Problem] To generate acoustic profile information using a simple operation and without increasing the cost of a multichannel audio device. [Solution] A wireless recording playback terminal 5 is positioned at a listening point of a multichannel audio device 2 as a measuring microphone. The wireless recording playback terminal 5 records, as channel playback data in accordance with a test signal playback command received from the multichannel audio device 2, a test signal outputted from a speaker 3 that corresponds to the channel designated by the command. The wireless recording playback terminal 5 also plays back the sound source of the test signal and records the played-back sound source as sound source playback data without being outputted to the outside from the speaker. An acoustic profile information generation server 4 compares these playback data to measure the delay time and attenuation rate of the channel playback data with respect to the sound source playback data, generates the acoustic profile information of the designated channel on the basis of the result of this measurement, and sets the generated acoustic profile information to the multichannel audio device 2.

SIGNAL PROCESSING DEVICE, SIGNAL PROCESSING METHOD, AND PROGRAM
20230007430 · 2023-01-05 ·

The present technology relates to a signal processing device, a signal processing method, and a program that allow for prevention of distortion of a sound space. The signal processing device includes: a relative azimuth prediction unit configured to predict, on the basis of a delay time in accordance with a distance from a virtual sound source to a listener, a relative azimuth of the virtual sound source when a sound of the virtual sound source reaches the listener; and a BRIR generation unit configured to acquire a head-related transfer function of the relative azimuth for each one of a plurality of the virtual sound sources and generate a BRIR on the basis of a plurality of the acquired head-related transfer functions. The present technology can be applied to the signal processing device.

INFORMATION PROCESSING DEVICE AND INFORMATION PROCESSING METHOD
20230007232 · 2023-01-05 ·

Provided is an information processing device that performs processing on a content. An information processing device is provided with an estimation unit that estimates sounding coordinates at which a sound image is generated on the basis of a video stream and an audio stream, a video output control unit that controls an output of the video stream, and an audio output control unit that controls an output of the audio stream so as to generate the sound image at the sounding coordinates. A discrimination unit that discriminates a gazing point of a user who views video and audio is further provided, in which the estimation unit estimates the sounding coordinates at which the sound image of the object gazed by the user is generated on the basis of a discrimination result.

SIGNAL PROCESSING DEVICE, METHOD, AND PROGRAM
20230007423 · 2023-01-05 ·

The present technology relates to a signal processing device, a method, and a program capable of improving transmission efficiency and efficiency in the data processing amount. A signal processing device includes: an acquisition unit that acquires polar coordinate position information indicating a position of a first object expressed by polar coordinates, audio data of the first object, absolute coordinate position information indicating a position of a second object expressed by absolute coordinates, and audio data of the second object; a coordinate conversion unit that converts the absolute coordinate position information into polar coordinate position information indicating a position of the second object; and a rendering processing unit that performs rendering processing on the basis of the polar coordinate position information and the audio data of the first object and the polar coordinate position information and the audio data of the second object. The present technology can be applied to a content reproduction system.

CONTROL APPARATUS, SIGNAL PROCESSING METHOD, AND SPEAKER APPARATUS

A control apparatus according to an embodiment of the present technology includes an audio control section and a vibration control section.

The audio control section generates audio control signals of a plurality of channels with audio signals of the plurality of channels as input signals, the audio signals each including a first audio component and a second audio component different from the first audio component. The vibration control section generates a vibration control signal for vibration presentation by taking a difference between audio signals of two channels among the plurality of channels.

INFORMATION PROCESSING DEVICE, CONTROL METHOD, AND NON-TRANSITORY COMPUTER-READABLE MEDIUM

An information processing apparatus, a control method, and a control program capable of providing an experience close to one experienced in a real space to a user are provided. An information processing apparatus includes: an acquisition unit configured to acquire terminal position information of a communication terminal; a holding unit configured to hold a predetermined area and acoustic-image localization position information of an audio content to be output to the communication terminal while associating them with each other; a generation unit configured to generate acoustic-image localization information based on the acoustic-image localization position information and the terminal position information when the terminal position information is included in the predetermined area; and an output unit configured to output the acoustic-image localization information.

SCALABLE PARALLAX SYSTEM FOR RENDERING DISTANT AVATARS, ENVIRONMENTS, AND DYNAMIC OBJECTS
20230237731 · 2023-07-27 ·

Methods, systems, and storage media for rendering digital environments are disclosed. Exemplary implementations may: receive a data stream at an area rendering server; render, by the area rendering server, a global digital environment based at least in part on the received data stream; generate a parallax rendering data stream based at least in part on the received data stream; receive the parallax rendering data stream at a composition server; combine, by the composition server, the received parallax rendering data stream into a new parallax rendering data stream; render, by one or more client platforms, a local digital environment based at least in part on the new parallax rendering data stream; and cause display of the local digital environment through an output of the one or more client platforms.

LOUDSPEAKER CONTROL
20230007424 · 2023-01-05 ·

There is provided a computer-implemented method of generating audio signals for an array of loudspeakers, the method comprising: receiving a plurality of input audio signals, wherein a respective one of the plurality of input audio signals is to be reproduced, by the array, at each of a plurality of control points in an acoustic environment, and wherein each of the plurality of control points is associated with a respective one of a plurality of loudspeaker groups; receiving an estimate of a position of each of the plurality of control points; assigning, using the received estimate of the position of each of the plurality of control points, each of the loudspeakers in the array to at least one of the plurality of loudspeaker groups, wherein the assigning of a particular loudspeaker to a particular loudspeaker group is based on a relative position of the particular loudspeaker with respect to one or more of the at least one control points associated with the particular loudspeaker group; and generating a respective output audio signal for each of the loudspeakers in the array by applying a set of filters to the plurality of input audio signals, the output audio signal for a particular loudspeaker being generated according to the at least one loudspeaker group to which the particular loudspeaker is assigned.

ACOUSTIC REPRODUCTION METHOD, ACOUSTIC REPRODUCTION DEVICE, AND RECORDING MEDIUM
20230007432 · 2023-01-05 ·

An acoustic reproduction method includes: localizing a first sound image at a first position in a target space in which a user is present; and localizing, at a second position in the target space, a second sound image that represents an anchor sound for indicating a reference position.