An example device for processing extended reality (XR) data includes a processors configured to: parse entry point data of an XR scene to extract information about one or more required virtual objects for the XR scene, the required virtual objects including a number of dynamic virtual objects equal to or greater than one, each of the dynamic virtual objects including at least one dynamic media component for which media data is to be retrieved; initialize a number of streaming sessions equal to or greater than the number of dynamic virtual objects using the entry point data; configure quality of service (QoS) and charging information for the streaming sessions; retrieve media data for the dynamic virtual objects via the streaming sessions; and send the retrieved media data to a rendering unit to render the XR scene to include the retrieved media data at corresponding locations within the XR scene.

A method, apparatus and computer program product enable multiple timeline support in playback of omnidirectional media content with overlay. The method, apparatus and computer program product receive a visual overlay configured to be rendered as a multi-layer visual content with an omnidirectional media content file (30). The omnidirectional media content file is associated with a first presentation timeline. The visual overlay is associated with a second presentation timeline. The method, apparatus and computer program product construct an overlay behavior definition file associated with the visual overlay (32). The overlay behavior definition file indicates a behavior of the second presentation timeline with respect to the first presentation in an instance that a pre-defined user interaction switch occurs during a playback of the omnidirectional media content file.

The techniques described herein relate to methods, apparatus, and computer readable media configured to perform media processing tasks. A media processing entity includes a processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the processor, cause the processor to perform receiving, from a remote computing device, multi-view multimedia data comprising a hierarchical track structure comprising at least a first track comprising first media data at a first level of the hierarchical track structure, and a second track comprising task instruction data at a second level in the hierarchical track structure that is different than the first level of the first track. The instructions further cause the processor to perform processing the first media data of the first track based on the task instruction data of the second track to generate modified media data and an output track that includes the modified media data.

Methods and Systems are disclosed for displaying objects between disparate devices connected to an electronic network. One method comprises detecting, by a multimedia device connected to an electronic network, an object in a multimedia stream; determining an identifier associated with the detected object; detecting a mobile device connected to the electronic network, the mobile device being a device other than the multimedia device; and generating a display of the detected object at the detected mobile device.

This patent discloses a method record imagery in a way that is larger than a user could visualize. Then, allow the user to view naturally via head tracking and eye tracking to allow one to see and inspect a scene as if one were naturally there viewing it in real time. A smart system of analyzing the viewing parameters of a user and streaming of customized image to be displayed is also taught herein.

The present disclosure relates to a method and device for transmitting and receiving video content including three-dimensional (3D) data. The method of transmitting video content through a plurality of assets includes identifying whether content transmitted through an asset is a sub-picture; when the content transmitted through the asset is the sub-picture, generating sub-picture asset information comprising information about other sub-pictures constituting a composition picture together with the sub-picture; and transmitting the sub-picture asset information and the content.

The present teaching relates to method, system, medium, and implementations for augmenting data via data crowd sourcing. Local data are acquired by one or more sensors deployed on a first device. Augmented data are obtained where such augmented data are generated based on the local data and remote data from at least one second device and are rendered on the first device.

A method, computer program, and computer system is provided for splitting viewport bitstreams. A first coded video bitstream is at least partially encoded using a first Group-of-Pictures (GOP) structure at a first resolution. A second coded video bitstream structured into a plurality of tiles is encoded using a second GOP structure at a second resolution, whereby the second GOP structure includes fewer coded pictures than the first GOP structure. A streaming bitstream for decoding or rendering is created using the first coded video bitstream and the second coded bitstream.

A method, a system and an apparatus are employed in a virtual reality (VR) environment. The method of building a virtual reality (VR) environment includes building the VR environment as formatted video content; defining at least one interactive overlay; and providing the at least one interactive overlay with a position information on a viewpoint of the VR environment.

Provided are a method and device for video coding, video decoding and storage medium. The video coding method includes: classifying video frames into independent frames and dependent frames, which comprise a first type of the dependent frames; generating region wise packing (RWP) coding configuration of each of the independent frames by coding parameters of the respective one of the independent frames, wherein the RWP coding configuration of the independent frames comprises the parameters to be unpacked to restore the video; and for each of the first type of the dependent frames, generating RWP coding configuration of the dependent frame by coding parameters of the dependent frame based on difference and dependency between the parameters of the dependent frame and the parameters of an independent frame used as a reference for the coding of the dependent frame.