A communication apparatus is provided and receives a communication packet, acquires a timestamp of a reception of the communication packet, analyzes a type of the received communication packet, transfers the received communication packet to a predetermined memory based on information indicating an analyzed type of the communication packet, and associates the analyzed type of the communication packet with the acquired timestamp.

Systems and methods for identifying certain objects within 360-degree content for user interaction. Objects within 360-degree content may be identified, and the corresponding segments of 360-degree content may be assigned a score according to how likely they may be to meet certain criteria, such as the likelihood that the user may interact with the object or its segment. Scores may be assigned in any manner, such as with reference to retrieved user information. In highly scored segments, users may be encouraged to pause the content at that segment, and interact with its objects. Encouragement may take any form, such as highlighting the segment or some component thereof. Likewise, interaction may also take any form, such as the allowing the user to alter the appearance of one or more segment objects in some way. In this manner, increased user interaction with 360-degree video is allowed, increasing viewer interest and engagement.

An apparatus configured to: receive a spatial media file comprising a plurality of viewpoints; determine a viewpoint from the plurality of viewpoints for a user consuming the spatial media file; receive an audio stream associated with the viewpoint; receive an augmentation audio stream, wherein the augmentation audio stream is at least partially different from the audio stream; control an audio rendering of the audio stream based, at least partially, on metadata associated with the augmentation audio stream; and provide the audio rendering of the audio stream for mixing with a rendering of the augmentation audio stream.

An image data encoding method and apparatus (60) and an electronic device (80) are provided. The method includes: obtaining three-dimensional picture information of a first scene (101); and encoding the three-dimensional picture information of the first scene according to a preset file format, where the encoded three-dimensional picture information of the first scene includes file header information, index information, and data information, the index information is used to record reference point data corresponding to the three-dimensional picture information of the first scene, and the data information is used to record three-dimensional point data in the three-dimensional picture information of the first scene (102).

Methods and apparatuses are disclosed for providing virtual content based on user context. An example apparatus comprises means providing a plurality of virtual content data sets for transmission to a remote user device, the data sets representing virtual content in relation to a common scene and each covering a different respective region of said scene. The apparatus may also comprise means for transmitting one or more of the data sets to the remote user device for consumption. The apparatus may also comprise means for transmitting to the remote user device auxiliary data, the auxiliary data being usable to cause the remote user device to switch from consuming a current data set representing a current region of said scene to a different set of virtual content data representing a different region of said scene, the switching being based at least partly on a determined context of the remote user device.

A method and a device provide for transmitting information representing a viewpoint in a 3D scene represented with a set of volumetric video contents; receiving a first volumetric video content of the set, the first volumetric video content being according to a range of points of view comprising the viewpoint, the first volumetric video content being represented with a set of first patches, each of which corresponds to a 2D parametrization of a first group of points in a 3D part of the 3D scene associated with the first volumetric video content, and at least one first patch refers to an area of a second patch corresponding to a 2D parametrization of a second group of points in another 3D part of the 3D scene associated with a second volumetric video content of the set of volumetric video contents.

Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.

Disclosed are methods, systems, and non-transitory computer-readable medium for transition-coded media, measuring engagement of transition-coded media, and distribution of components of transition-coded media. For instance, the method may include: obtaining a media file; determining whether the media file includes transition-coded media; in response to determining the media file includes the transition-coded media, setting up a dynamic media environment; detecting whether a user is interacting with the transition-coded media; and in response to detecting the user is interacting with the transition-coded media, executing the transition-coded media with the dynamic media environment.

Embodiments for video processing, including video coding, video decoding and video transcoding are described. One example method includes performing a conversion between a video comprising one or more video pictures comprising one or more subpictures and a bitstream of the video, wherein the conversion conforms to a rule that specifies that one or more parameters for a scaling window applicable to a subpicture are determined from one or more syntax elements during a subpicture sub-bitstream extraction process.

The present disclosure relates to a server, an electronic device and their methods of transmitting or receiving image content. In one embodiment, a method performed by the server includes obtaining sensor information including orientation information detected by the electronic device connected to the server; obtaining state information regarding the server and the electronic device; identifying a size of a first partial image and a position of the first partial image, based on the sensor information and the state information; generating a first frame by encoding the first partial image, based on the identified size of the first partial image or identified position of the first partial image; and transmitting the generated first frame to the electronic device.