Provided are a method and an apparatus for streaming a multi-view 360 degree video, and a method for streaming a 360 degree video according to an embodiment of the present disclosure includes: encoding a multi-view video to a bitstream of a base layer and a bitstream of a tile layer constituted by at least one tile; selecting a tile included in a user view video in the encoded bitstream of the tile layer by using user view information received from a 360 degree video rendering apparatus, and video information of the multi-view video; extracting tile data included in the selected user view video from the encoded bitstream of the tile layer, and generating a tile bitstream corresponding to the extracted tile data; and transmitting the encoded bitstream of the base layer and the generated tile bitstream to the 360 degree video rendering apparatus.

Provided are a method and an apparatus for streaming a multi-view 360 degree video, and a method for streaming a 360 degree video according to an embodiment of the present disclosure includes: encoding a multi-view video to a bitstream of a base layer and a bitstream of a tile layer constituted by at least one tile; selecting a tile included in a user view video in the encoded bitstream of the tile layer by using user view information received from a 360 degree video rendering apparatus, and video information of the multi-view video; extracting tile data included in the selected user view video from the encoded bitstream of the tile layer, and generating a tile bitstream corresponding to the extracted tile data; and transmitting the encoded bitstream of the base layer and the generated tile bitstream to the 360 degree video rendering apparatus.

An apparatus includes a memory and a processor circuit. The memory may be configured to store one or more frames of image pixel data. Each of the frames generally comprises red (R) samples, green (G) samples, blue (B) samples, and infrared (IR) samples. The processor circuit may be configured to generate an infrared image for each frame. The infrared image generally has a number of infrared (IR) pixels greater than the number of the infrared (IR) samples of each frame. The processor circuit generally performs interpolation utilizing the infrared (IR) samples and one or more of the red (R) samples, the green (G) samples, and the blue (B) samples of each frame in generating the infrared image for each frame.

An apparatus includes a memory and a processor circuit. The memory may be configured to store one or more frames of image pixel data. Each of the frames generally comprises red (R) samples, green (G) samples, blue (B) samples, and infrared (IR) samples. The processor circuit may be configured to generate an infrared image for each frame. The infrared image generally has a number of infrared (IR) pixels greater than the number of the infrared (IR) samples of each frame. The processor circuit generally performs interpolation utilizing the infrared (IR) samples and one or more of the red (R) samples, the green (G) samples, and the blue (B) samples of each frame in generating the infrared image for each frame.

Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for input videos; extracting patches from the input videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, the metadata may include information on a priority order of pruning among input videos.

Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for input videos; extracting patches from the input videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, the metadata may include information on a priority order of pruning among input videos.

Methods of encoding and decoding immersive video are provided. In an encoding method, source video data comprising a plurality of source views is encoded into a video bitstream. At least one of the source views is down-sampled prior to encoding. A metadata bitstream associated with the video stream comprises metadata describing a configuration of the down-sampling, to assist a decoder to decode the video bitstream. It is believed that the use of down-sampled views may help to reduce coding artifacts, compared with a patch-based encoding approach. Also provided are an encoder and a decoder for immersive video, and an immersive video bitstream.

A data processing method includes: acquiring a free-view information data box corresponding to an i.sup.th track of immersive media, the free-view information data box including view information corresponding to the i.sup.th track, i being an integer greater than or equal to 1 and less than or equal to M; and decoding images encapsulated in the i.sup.th track according to the view information in the free-view information data box, where the immersive media are formed by images taken by N cameras from different views, the immersive media is encapsulated into M tracks, and images from at least one camera are encapsulated in one track. N and M are integers greater than 1.

A data processing method includes: acquiring a free-view information data box corresponding to an i.sup.th track of immersive media, the free-view information data box including view information corresponding to the i.sup.th track, i being an integer greater than or equal to 1 and less than or equal to M; and decoding images encapsulated in the i.sup.th track according to the view information in the free-view information data box, where the immersive media are formed by images taken by N cameras from different views, the immersive media is encapsulated into M tracks, and images from at least one camera are encapsulated in one track. N and M are integers greater than 1.

Aspects of the present disclosure relate to distributed virtual reality. In examples, a depth buffer and a color buffer are generated at a presenter device as part of rendering a virtual environment. The virtual environment may be perceived by a user in three dimensions (3D), for example via a virtual reality (VR) headset. Virtual environment information comprising the depth buffer and the color buffer may be transmitted to a viewer device, where it is used to render the virtual environment for display to a viewer. For example, the viewer may similarly view the virtual environment in 3D via a VR headset. A viewer perspective (e.g., from which the virtual environment is generated for the viewer) may differ from a presenter perspective and may be manipulated by the viewer, thereby decoupling the viewer's perception of the virtual environment from that of the presenter.