Methods, devices and stream for encoding, decoding and transmitting a multi-views frame are disclosed. A non-pruned MVD frame is obtained and an acyclic graph representing pruning precedence relations between views is determined. The MVD is pruned by using these precedence relations. The pruned MVD and data representative of the graph are encoded in the data stream. At the decoding, the contribution of each view for a pixel of a viewport frame to generate is determined as a function of the decoded pruning graph.

A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.

A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.

Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for input videos; extracting patches from the input videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, the metadata may include information on a priority order of pruning among input videos.

A method for obtaining video chunks of a video sphere for display on a head-mounted display connected to a video server is described, the video chunks being spatially split into a plurality of tiles that can be encoded on at least two different quality levels, including a high quality level and a low quality level, and a display window includes a video sphere portion that is to be displayed at a particular display time. Prior to the display time, the display window is predicted, tiles covering the estimated display window are estimated, and assigned a high quality level, and tiles adjoining those tiles are estimated and assigned a low quality level. A request is sent to a video server to obtain an encoded tile at the associated quality level. The tiles are received from the video server, the display window is determined, and the tiles corresponding to the determined display window are decoded and displayed.

A method for obtaining video chunks of a video sphere for display on a head-mounted display connected to a video server is described, the video chunks being spatially split into a plurality of tiles that can be encoded on at least two different quality levels, including a high quality level and a low quality level, and a display window includes a video sphere portion that is to be displayed at a particular display time. Prior to the display time, the display window is predicted, tiles covering the estimated display window are estimated, and assigned a high quality level, and tiles adjoining those tiles are estimated and assigned a low quality level. A request is sent to a video server to obtain an encoded tile at the associated quality level. The tiles are received from the video server, the display window is determined, and the tiles corresponding to the determined display window are decoded and displayed.

A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.

A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.

Embodiments of this application provide a video transmission method, apparatus, and system, to reduce an end-to-end transmission delay of video data. The method includes: A transmit end obtains a first frame of image of the video data, where the first frame of image includes a plurality of sub-images, and the plurality sub-images include a first sub-image and a second sub-image; the transmit end performs layered encoding on the first sub-image to obtain a plurality of layers of bitstreams of the first sub-image; the transmit end sends the plurality of layers of bitstreams of the first sub-image to a receive end; the receive end decodes the plurality of layers of bitstreams of the first sub-image to obtain the first sub-image.

This disclosure is directed to systems and methods of data partitioning in image encoding. A video encoder may receive a single stream of video data that includes multiple layers. The video encoder may encode the one or more layers utilizing multiple counters for each component within the layers. The multiple counters may correspond to the header bits, luma bits, and chroma bits within each slice layer. The encoded layers may then be assembled into a single slice before it is sent to a decoder for decoding of image frame.