A video coding mechanism for viewpoint dependent video coding is disclosed. The mechanism includes mapping a spherical video sequence into a plurality of sub-picture video sequences. The mechanism further includes encoding the plurality of sub-picture video sequences as sub-picture bitstreams to support merging of the plurality of sub-picture bitstreams, the encoding ensuring that each sub-picture bitstream is self-referenced and two or more of the sub-picture bitstreams can be merged to generate a single video bitstream using a lightweight bitstream rewriting process that does not involve changing of any block-level coding results. A mergable indication is encoded to indicate that the sub-picture bitstream containing the indication is compatible with a multi-bitstream merge function for reconstruction of the spherical video sequence. A set of the sub-picture bitstreams and the mergable indication are transmitted toward the decoder to support decoding and displaying a virtual reality video viewport.

Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.

Described are methods, apparatuses and computer program products for signaling and storing compressed point clouds. Sub-sample entries associated with sequences of sub-samples within sequences of samples may indicate whether sequences of sub-samples were encapsulated alone in a track, without other sub-samples or additional header data. Sub-sample entry types can be indexed at track-level sub-sample description boxes. Point cloud compression coded bitstream component types may be signaled by including respective point cloud unit header information in a codec-specific parameters-related field of track level sub-sample description boxes. Sub-sample information boxes may indicate sub-sample entry indices for respective sub-samples. A flag in such information boxes may indicate the presence of sub-sample description entry indexes. Description index boxes can contain sub-sample description entry indexes in the same container as sub-sample information boxes. Track fragment header boxes can include sub-sample description entry indices that apply to samples of a track fragment.

The present disclosure provides a communication method, and an electronic device. The method includes: obtaining, by an electronic device, a plurality of 2D images and/or a plurality of depth maps for a current scene, the plurality of 2D images and/or the plurality of depth maps being aligned in time; and transmitting, by the electronic device, the plurality of 2D images and/or the plurality of depth maps to the server by means of wireless communication.

A method for point cloud decoding includes receiving a bitstream. The method also includes decoding the bitstream into multiple frames that include pixels. Certain pixels of the multiple frames correspond to points of a three-dimensional (3D) point cloud. The multiple frames include a first set of frames that represent locations of the points of the 3D point cloud and a second set of frames that represent attribute information for the points of the 3D point cloud. The method further includes reconstructing the 3D point cloud based on the first set of frames. Additionally, the method includes identifying a first portion of the points of the reconstructed 3D point cloud based at least in part on a property associated with the multiple frames. The method also includes modifying a portion of the attribute information. The portion of the attribute information that is modified corresponds to the first portion of the points.

Techniques to facilitate compression of depth data and real-time reconstruction of high-quality light fields. A parameter space of values for a line, pairs of endpoints on different sides of the line, and a palette index for each pixel of a pixel tile of a depth image is sampled. Values for the line, the pairs of endpoints, and the palette index that minimize an error are determined and stored.

Techniques to facilitate compression of depth data and real-time reconstruction of high-quality light fields. A parameter space of values for a line, pairs of endpoints on different sides of the line, and a palette index for each pixel of a pixel tile of a depth image is sampled. Values for the line, the pairs of endpoints, and the palette index that minimize an error are determined and stored.

A video decoding method that includes: receiving information for deriving motion information of a current block; deriving the motion information of the current block based on the received information for deriving the motion information; and performing prediction to generate predicted pixels of the current block based on the motion information of the current block, wherein the motion information of the current block is determined by using motion information of a reference block, wherein the reference block is determined based on a specific disparity vector, wherein the specific disparity vector is determined for an area in a picture to which the current block belongs, wherein the area which the specific disparity vector is determined is split based on a quad tree structure, and wherein the current block is a block of a texture picture and the reference block is a block in a reference view is disclosed.

A video decoding method that includes: receiving information for deriving motion information of a current block; deriving the motion information of the current block based on the received information for deriving the motion information; and performing prediction to generate predicted pixels of the current block based on the motion information of the current block, wherein the motion information of the current block is determined by using motion information of a reference block, wherein the reference block is determined based on a specific disparity vector, wherein the specific disparity vector is determined for an area in a picture to which the current block belongs, wherein the area which the specific disparity vector is determined is split based on a quad tree structure, and wherein the current block is a block of a texture picture and the reference block is a block in a reference view is disclosed.

Provided is an inter-layer video decoding method including obtaining a disparity vector of a current block included in a first layer image; determining a block of a second layer image corresponding to the current block by using the obtained disparity vector; determining a reference block including a sample that contacts a boundary of the block; obtaining a motion vector of the reference block; and determining a motion vector of the current block included in the first layer image by using the obtained motion vector.