A Scalable Video Coding (SVC) process is provided for scalable video coding that takes into account color gamut primaries along with spatial resolution. The process provides for re-sampling using video color data obtained from an encoder or decoder process of a base layer (BL) in a multi-layer system to enable improved encoding and decoding in an enhancement layer (EL) or higher layers taking into account color conversion between layers. Examples of applicable SVC include MPEG-4 Advanced Video Coding (AVC) and High Efficiency Video Coding (HEVC). With the SVC process, video data expressed in one color gamut space can be used for prediction in encoding with a possibly different color space, and accommodation for different spatial resolution and bit-depth can be made as well.

A Scalable Video Coding (SVC) process is provided for scalable video coding that takes into account color gamut primaries along with spatial resolution. The process provides for re-sampling using video color data obtained from an encoder or decoder process of a base layer (BL) in a multi-layer system to enable improved encoding and decoding in an enhancement layer (EL) or higher layers taking into account color conversion between layers. Examples of applicable SVC include MPEG-4 Advanced Video Coding (AVC) and High Efficiency Video Coding (HEVC). With the SVC process, video data expressed in one color gamut space can be used for prediction in encoding with a possibly different color space, and accommodation for different spatial resolution and bit-depth can be made as well.

The invention concerns scaling color difference components prior to encoding in order to extend the dynamic range. In one embodiment the color difference components are encoded prior to quantisation. In another embodiment the color difference components are encoded after quantisation. A decoder is configured to process data representative of the gain factor for a decoding process.

The invention concerns scaling color difference components prior to encoding in order to extend the dynamic range. In one embodiment the color difference components are encoded prior to quantisation. In another embodiment the color difference components are encoded after quantisation. A decoder is configured to process data representative of the gain factor for a decoding process.

A method and apparatus provide the ability to code signals in a layered manner for compression and networking applications. The solution involves a relaxed hierarchical structure of layers, wherein only an optimal subset of information from lower quality levels is transmitted to higher level decoders. This framework is complemented with a design method to optimize system parameters. Specialization may include techniques for employing irregular quantizers and/or estimation theoretic optimal parameter selection and/or content specific optimization (e.g., exploiting harmonic structure in audio, adaptive transform coding and enhanced motion compensated prediction for video) and/or optimization of the structure of the layers, where the potential of exploiting all the common information is realized to improve overall system performance for that application. One specific technique provides improved compression of signals with multiple quality levels with or without prediction. Another specific technique provides improved compression of signals with multiple heterogeneous quality-levels with or without prediction.

A processor requests a first stream encoded by irreversible encoding from an encoding device, decodes the first stream, generates a first decoded image from a first encoded image obtained by encoding one image, and outputs the first decoded image. Then, the processor requests a second stream from the encoding device. The second stream includes a second encoded image obtained by applying inter-prediction to the one image and by encoding a prediction error by reversible encoding, the inter-prediction using a locally decoded image obtained by decoding the first encoded image as a reference image and using a motion vector for which a magnitude is 0. The processor decodes the second stream, generates a second decoded image from the second encoded image, generates a third decoded image that corresponds to the first decoded image by using a result of adding the first and second decoded images, and outputs the third decoded image.

Innovations are provided for encoding and/or decoding video and/or image content using transform coefficient level gradual updating. Transform coefficient level gradual updating can be applied by encoding (or decoding) different subsets of the transform coefficients for the blocks, macroblocks, or other coding unit for each of a sequence of pictures. For example, a first subset of the transform coefficients of the blocks of a first picture can be encoded with the first picture, a second subset of the transform coefficients of the blocks of a second picture can be encoded with the second picture, and so on. A decoder can reconstruct pictures with increasing quality by receiving additional subsets of the transform coefficients.

Innovations are provided for encoding and/or decoding video and/or image content using transform coefficient level gradual updating. Transform coefficient level gradual updating can be applied by encoding (or decoding) different subsets of the transform coefficients for the blocks, macroblocks, or other coding unit for each of a sequence of pictures. For example, a first subset of the transform coefficients of the blocks of a first picture can be encoded with the first picture, a second subset of the transform coefficients of the blocks of a second picture can be encoded with the second picture, and so on. A decoder can reconstruct pictures with increasing quality by receiving additional subsets of the transform coefficients.

For each image in a set of images, a representation of the image at a first level of quality is derived using a first representation of the image at a second, higher level of quality and is output for processing by a decoder. Configuration data is output for processing by the decoder to enable the decoder to detect whether or not the first representation of a given image in the set of images is to be reconstructed using residual data for the given image, the residual data: (i) being useable to reconstruct the first representation using a second representation of the image at the second level of quality, the second representation being based on the representation of the image at the first level of quality, and (ii) being derived based on the first representation and the second representation.

For each image in a set of images, a representation of the image at a first level of quality is derived using a first representation of the image at a second, higher level of quality and is output for processing by a decoder. Configuration data is output for processing by the decoder to enable the decoder to detect whether or not the first representation of a given image in the set of images is to be reconstructed using residual data for the given image, the residual data: (i) being useable to reconstruct the first representation using a second representation of the image at the second level of quality, the second representation being based on the representation of the image at the first level of quality, and (ii) being derived based on the first representation and the second representation.