An information processing apparatus (2000) includes a summarizing unit (2040) and a display control unit (2060). The summarizing unit (2040) obtains a video (30) generated by each of a plurality of cameras (10). Furthermore, the summarizing unit (2040) performs a summarizing process on the video (30) and generates summary information of the video (30). The display control unit (2060) causes a display system (20) to display the video (30). Here, the display control unit (2060) causes the display system (20) to display the summary information of the video (30) in response to that a change in a display state of the video (30) in the display system (20) satisfies a predetermined condition.

Provided are a method and an apparatus for streaming a multi-view 360 degree video, and a method for streaming a 360 degree video according to an embodiment of the present disclosure includes: encoding a multi-view video to a bitstream of a base layer and a bitstream of a tile layer constituted by at least one tile; selecting a tile included in a user view video in the encoded bitstream of the tile layer by using user view information received from a 360 degree video rendering apparatus, and video information of the multi-view video; extracting tile data included in the selected user view video from the encoded bitstream of the tile layer, and generating a tile bitstream corresponding to the extracted tile data; and transmitting the encoded bitstream of the base layer and the generated tile bitstream to the 360 degree video rendering apparatus.

A system and method for providing quality control in immersive video during pausing of a video streaming session. In one embodiment, a paused video frame may comprise a plurality of mixed quality video tiles depending on user gaze vector information. Under pause control, the video quality of all tiles of the paused video frame is equalized such that it is of same value for all the video tiles, which may be the video quality of the tiles presented in a viewport of the client device. The paused video frame having the same quality tiles throughout is used as a replacement video frame, which is presented to the client device player for decoding and displaying instead of the mixed quality video frame while the streaming session is paused.

A method for sharing a point-of-interest across a plurality of video feeds from a plurality of optical imaging devices includes receiving an indication of the point-of-interest associated with a first video feed of the plurality of video feeds, the first video feed provided by a first optical imaging device of the plurality of optical imaging devices; determining a geo-location of an object associated with the point-of-interest; determining a position of a second optical imaging device relative to the determined geo-location of the point-of-interest; and overlaying the point-of-interest on a second video feed, the second video feed provided by the second optical imaging device.

In one aspect, the present disclosure relates to a live streaming performance platform comprising: a main central screen showing a main act; surrounded by scrollable smaller screens containing live feeds of other acts; and audience cams, feeds from other computers, mobile devices, or televisions, wherein the scrollable smaller screens can be accessed and interjected onto the main screen as or with the main act, wherein a user can interact with the main screen, and wherein a user can independently view and interact with other audience members. The platform may authenticate a user, The platform may further receive content from the authenticated user and metadata associated with the content. The platform may organize the content based on the received metadata to form an organized content feed, and transmit the organized content feed to one or more users for display.

A method and a system for virtual reality, augmented reality, mixed reality, or 360-degree Video environment is disclosed. The system receives Video Streams associated to audio and video scenes to be reproduced and Audio Streams associated to audio and video scenes to be reproduced. There are provided a Video decoder which decodes signal from the Video Stream for the representation of the audio and video scene; an Audio decoder which decodes signal from the Audio Stream for the representation of the audio and video scene to the user; and a region of interest processor deciding, based e.g. on the user's viewport, head orientation, movement data, or metadata, whether an Audio information message is to be reproduced. At the decision, the reproduction of the Audio information message is caused.

This application provides a media file encapsulating method, a media file decapsulating method, and related devices. The media file encapsulating method includes: acquiring a media stream of a target media content in a corresponding application scenario; encapsulating the media stream to generate an encapsulation file of the media stream, the encapsulation file including a first application scenario type field, the first application scenario type field being used for indicating the application scenario corresponding to the media stream; and transmitting the encapsulation file to a first device for the first device to determine the application scenario corresponding to the media stream according to the first application scenario type field and determine at least one of a decoding method and a rendering method of the media stream according to the application scenario corresponding to the media stream. This method can distinguish different application scenarios in the encapsulation of media files.

Systems and methods described herein provide for rendering and quality monitoring of rendering of a 360-degree video, where the video has a plurality of representations with different levels of quality in different regions. In an exemplary method, a client device tracks a position of a viewport with respect to the 360-degree video and renders to the viewport a selected set of the representations. The client adaptively adds and removes representations from the selected set based on the viewport position. The client also measures and reports a viewport switching latency. In some embodiments, the latency for a viewport switch is a comparable-quality viewport switch latency that represents the time it takes after a viewport switch to return to a quality comparable to the pre-switch viewport quality.

One embodiment provides a method, including: obtaining, from each of two more panoramic cameras, panoramic video, wherein each of the two or more panoramic cameras are located at different physical locations within an event environment; compositing the panoramic video obtained from the two or more panoramic cameras into a single video; and streaming the composited panoramic video to one or more end users, wherein each of the one or more end users provide commands to manipulate the streamed composited panoramic video resulting in viewing of a different view of the streamed composited panoramic video for the corresponding end user based on the provided commands.

A system and method for providing quality control in immersive video during pausing of a video streaming session. In one embodiment, a paused video frame may comprise a plurality of mixed quality video tiles depending on user gaze vector information. Under pause control, the video quality of all tiles of the paused video frame is equalized such that it is of same value for all the video tiles, which may be the video quality of the tiles presented in a viewport of the client device. The paused video frame having the same quality tiles throughout is used as a replacement video frame, which is presented to the client device player for decoding and displaying instead of the mixed quality video frame while the streaming session is paused.