One embodiment of the invention includes one or more computer processors executing computer-readable instructions to: distribute a co-performing video including a first character object generated based on motions of a first user and a second character object generated based on motions of a second user; in response to reception of a first display request for a first gift from a viewer user viewing the co-performing video, display a display instruction object on at least one of a first user device used by the first user and a second user device used by the second user; and in response to an operation on the display instruction object, display the first gift in association with at least one of the first character object and the second character object in the co-performing video.

Various embodiments include systems and methods for providing an immersive three-dimensional group session. Various embodiments include methods and devices for signaling a description of a scene with media components potentially coming from different parties. In various aspects, a scene graph may be signaled through a session description protocol (SDP) during a session initiation protocol (SIP) session setup. In various embodiments, the scene graph may include respective graphical output nodes assigned to be controlled by each of the plurality of participant computing devices in an immersive three-dimensional group session.

A method for transmitting scene composition information from an apparatus therefor in a multimedia communication system is provided. The method includes generating scene composition information comprising media attributes information and temporal information, and transmitting the scene composition information, wherein the media attributes information and temporal information is separated into different formats.

A recorder receives designation of a video which is desired to be reproduced from a user. If designation of one or more designated locations where sound is emphasized on a screen of a display which displays the video is received by the recorder from the user via an operation unit during reproduction or temporary stopping of the video, a signal processing unit performs an emphasis process on audio data, that is, the signal processing unit emphasizes audio data in directions directed toward positions corresponding to the designated locations from a microphone array by using audio data recorded in the recorder. A reproducing device reproduces the emphasis-processed audio data and video data in synchronization with each other.

The present disclosure discloses a data transmission method and apparatus. User equipment (UE) measures and transmits a transmission delay to a group communication service application server (GCS AS), or the GCS AS itself determines a transmission delay, so that the GCS AS may determine, according to the transmission delay, a time of sending a packet on a multicast path or a unicast path. Therefore, a problem of out of order of packets or a loss of a packet due to a transmission delay is resolved, and continuity of a communication service is maintained.

According to an embodiment, a reproduction device includes an acquirer, a decoder, and a synthesizer. The acquirer is configured to acquire transmission information including first and second coded data. The first and second coded data are generated by encoding first and second image data, respectively. At least one of the first and the second image data is lossy encoded. The first and second image data being generated by performing conversion processes different from each other on original image data. The decoder is configured to decode the first and second coded data to generate first and second decoded data. The synthesizer is configured to synthesize the first and the second decoded data with adjusting pixel positions of the first and the second decoded data so that the pixel positions of the first and the second decoded data are identical to each other to generate reproduction image data.

An interactive video/multimedia application (IVM application) may specify one or more media assets for playback. The IVM application may define the rendering, composition, and interactivity of one or more the assets, such as video. Video multimedia application data (IVMA data may) be used to define the behavior of the IVM application. The IVMA data may be embodied as a standalone file in a text or binary, compressed format. Alternatively, the IVMA data may be embedded within other media content. A video asset used in the IVM application may include embedded, content-aware metadata that is tightly coupled to the asset. The IVM application may reference the content-aware metadata embedded within the asset to define the rendering and composition of application display elements and user-interactivity features. The interactive video/multimedia application (defined by the video and multimedia application data) may be presented to a viewer in a player application.

The present disclosure relates to information processing apparatus and method that allow robustness of content reproduction to be improved.

Metadata regarding content is generated, the content expressing a three-dimensional object in a three-dimensional space and enabling a line-of-sight direction and a view-point position to be freely set at a time of reproduction, and the metadata including information enabling a bit rate to be selected at a time of distribution of the content. Metadata that includes, for example, as the above-described information, access information for a control file controlling reproduction of the content, is generated. The present disclosure may be applied to, for example, an image processing apparatus, an image encoding apparatus, or an image decoding apparatus.

A method for executing computer instructions for presenting an interactive environment in a head-mounted display (HMD) is described. The method includes identifying content associated with the interactive environment to be presented on the HMD for a user and determining whether an interactive object within the identified content satisfies a threshold for presentation to the user. The method includes augmenting the interactive object with augmentation data. The augmented data acts to change a characteristic of the interactive object. The operation of augmenting the interactive object is performed after determining that the interactive object does not satisfy the threshold for presentation to the user. The augmentation data modifies the interactive object to conform the interactive object to be within the threshold.

Techniques for rendering a scene are disclosed. In some embodiments, a scene definition is modified to generate a modified scene definition based at least in part on a current state of a local database at a device. The modified scene definition is constrained to include references to objects locally available in the local database, and at least one object referenced in the scene definition is substituted with a different object in the modified scene definition that is locally available in the local database. The scene is rendered at the device according to the modified scene definition.