The present disclosure relates to an image processing device and an image processing method for instantaneously displaying an image of a user's field of view.

An encoder encodes a celestial sphere image of a cube formed by images of multiple planes generated from omnidirectional images, the encoding being performed plane by plane at a high resolution, to generate a high-resolution encoded stream corresponding to each of the planes. The encoder further encodes, at a low resolution, the celestial sphere image to generate a low-resolution encoded stream. The present disclosure may be applied, for example, to image display systems that generate a celestial sphere image so as to display an image of the user's field of view derived therefrom.

A method, apparatus and computer program product are provided to define the location of a center point associated with each frame within a stream of image data. Metadata associated with the orientation, such as the pitch and yaw, of a camera is synchronized on a frame-by-frame basis with a related stream of image data. In connection with receiving the image data and the orientation data, the method defines a center point associated with a video frame images and transmits a control signal causing the reorientation of at least a subset of video image frames. In some example implementations, arising in the context of 360° video streams, the rotation of the head of a viewer of virtual reality content or other 360° video streams may be taken into account when defining the location of a center point.

A decoder (100) receives (30) a set of N compressed segments of a first picture, and a set of M compressed segments for a second picture that follows the first picture in a decoding order. Based on the set of N compressed segments, the decoder constructs a decodable picture for the first picture and decodes (32) the decodable picture. Based on the set of M compressed segments, the decoder constructs a decodable second picture in the compressed domain, in which each of the segments of the first picture are placed at the same spatial position as that of a corresponding segment in the second picture, and decodes (52) the decodable second picture. Additionally, at least one Intra coded segment is placed at one of the M spatial positions in the compressed domain in which there is no segment of the N segments.

A device implementing a system for estimating device location includes at least one processor configured to receive a first estimated position of the device at a first time. The at least one processor is further configured to capture, using an image sensor of the device, images during a time period defined by the first time and a second time, and determine, based on the images, a second estimated position of the device, the second estimated position being relative to the first estimated position. The at least one processor is further configured to receive a third estimated position of the device at the second time, and estimate a location of the device based on the second estimated position and the third estimated position.

The present technology relates to an image processing apparatus and a file generation apparatus that make it possible to appropriately reproduce a BV content. An image processing apparatus includes: a file acquisition unit that acquires a file having a management region where information for management of a 3D object content is stored and a data region where a track in which streams included in the 3D object content are stored is stored, group information for selection, from a plurality of the streams included in the 3D object content, of the stream appropriate for reproduction of the 3D object content being stored in the management region; and a file processor that selects a plurality of the streams to be used for reproduction of the 3D object content on the basis of the group information. The present technology is applicable to a client apparatus.

The disclosure relates to a method of delivering a video frame. One implementation may involve spatially partitioning a video frame into a plurality of blocks, encoding at least one of the plurality of blocks of the video frame, and transmitting the at least one of the plurality of blocks of the video frame.

The disclosure relates to a 5th Generation (5G) or 6th Generation (6G) communication system for supporting a higher data transmission rate. The method of a first entity performing a media resource function (MRF) includes transmitting, to a second entity, a session description protocol (SDP) offer message for an SDP negotiation associated with a conference providing a plurality of 360-degree videos, and receiving, from the second entity, an SDP answer message. Wherein the SDP offer message includes a plurality of media descriptions for the plurality of 360-degree videos, and wherein, in case that a first 360-degree video of the plurality of 360-degree videos is originated from one of a plurality of sources at a conference location of the conference, a first media description for the first 360-degree video includes a content attribute for identifying a source from which the first 360-degree video is originated.

Disclosed are a theme video generation method and apparatus, an electronic device and a readable storage medium. method includes: after acquiring a selection triggering operation on a target theme, sending a theme resource package acquisition request to a corresponding resource server; receiving the corresponding theme resource package that is fed back by the resource server in response to the theme resource package acquisition request, acquiring at least one target picture from a local album based on the at least one target picture label; and generating a corresponding theme video based on the least one target picture.

A method of presenting an audio signal to a user of a mixed reality environment is disclosed, the method comprising the steps of detecting a first audio signal in the mixed reality environment, where the first audio signal is a real audio signal; identifying a virtual object intersected by the first audio signal in the mixed reality environment; identifying a listener coordinate associated with the user; determining, using the virtual object and the listener coordinate, a transfer function; applying the transfer function to the first audio signal to produce a second audio signal; and presenting, to the user, the second audio signal.

A method and an apparatus for decoding a volumetric video are disclosed. Such a method comprises receiving a data stream representative of a file comprising information for selecting, according to a rendering viewpoint, at least one atlas comprising color and depth data patches associated with a viewpoint in said volumetric video, said color and depth data patches being generated with respect to depth and color reference data acquired from a reference viewpoint in said volumetric video.