A scalable video decoder is described which is configured to reconstruct a base layer signal from a coded data stream to obtain a reconstructed base layer signal; and reconstruct an enhancement layer signal including spatially or temporally predicting a portion of an enhancement layer signal, currently to be reconstructed, from an already reconstructed portion of the enhancement layer signal to obtain an enhancement layer internal prediction signal; forming, at the portion currently to be reconstructed, a weighted average of an inter-layer prediction signal obtained from the reconstructed base layer signal, and the enhancement layer internal prediction signal to obtain an enhancement layer prediction signal such that a weighting between the inter-layer prediction signal and the enhancement layer internal prediction signal varies over different spatial frequency components; and predictively reconstructing the enhancement layer signal using the enhancement layer prediction signal.

Systems and methods for hinting an encoder are disclosed in which a server monitors for information related to changes in frame rendering, calculates tolerance boundaries, rolling average frame time and/or short-term trends in frame time, and uses those calculations to identify a frame time peak. The server then hints a codec (encoder) to modulate the quality settings of frame output in proportion to the size of the frame time peak. In certain embodiments, a renderer records one or more playthroughs in a game environment, sorts a plurality of frames from one or more playthroughs into a plurality of cells on a heatmap, and collects the list of sorted frames. A codec may then encode one or more frames from the list of sorted frames to calculate an average encoded frame size for each cell in the heatmap, and associate each average encoded frame size with a per-cell normalized encoder quality setting.

Methods, articles, and systems of denoising for video coding using content-adaptive temporal and spatial filtering.

The encoding/decoding method and apparatus according to the present invention derives a residual coefficient of a residual block, calculates a quantization parameter for a residual block, performs dequantization on a residual coefficient using a quantization parameter, and performs inverse transform on a dequantized residual coefficient to reconstruct a residual sample of a residual block.

A device configured to encode video data is discussed. The device includes a generator configured to generate a prediction block of a current prediction unit using a reference index and a motion vector of the current prediction unit, and a residual block using a difference between the current prediction unit and the prediction block; a transformer configured to transform the residual block to generate a transform block; a quantizer configured to quantize coefficients of the transform block to generate a quantization block using a quantization parameter. Further, the quantizer generates the quantization block by selecting two effective quantization parameters that are available and exist among left, upper, and previous quantization parameters according to an order of priority levels set for the left, upper, and previous quantization parameters and using an average of the two effective quantization parameters; and an entropy-coder configured to entropy-code the quantization block using a scan pattern.

A decoding device configured to decode video data, the device including a motion compensation predictor configured to generate a prediction block of a current prediction unit using a reference index and a motion vector of the current prediction unit; an entropy decoder configured to entropy decode a bitstream to generate a quantized coefficient sequence; an inverse quantizer/inverse transformer configured to generate a quantized block using the quantized coefficient sequence and inversely quantize the quantized block to generate a transformed block using a quantization parameter, and inversely transform the transformed block to generate a residual block, wherein the inverse quantizer/inverse transformer generates the quantization block by selecting two effective quantization parameters that are available and exist among left, upper, and previous quantization parameters according to an order of priority levels set for the left, upper, and previous quantization parameters and by using an average of the two effective quantization parameters; and an adder configured to a reconstructed block using the prediction block and the residual block, wherein the motion vector is derived using a motion vector predictor which is set equal to one of an effective spatial motion vector candidate and an effective temporal motion vector candidate.

A multimedia file and methods of generating, distributing and using the multimedia file are described. Multimedia files in accordance with embodiments of the present invention can contain multiple video tracks, multiple audio tracks, multiple subtitle tracks, a complete index that can be used to locate each data chunk in each of these tracks and an abridged index that can enable the location of a subset of the data chunks in each track, data that can be used to generate a menu interface to access the contents of the file and ‘meta data’ concerning the contents of the file. Multimedia files in accordance with several embodiments of the present invention also include references to video tracks, audio tracks, subtitle tracks and ‘meta data’ external to the file.

A method of processing video signal according to a present invention comprises determining a transform set for a current block comprising a plurality of transform type candidates, determining a transform type of the current block from the plurality of transform type candidates and performing an inverse transform for the current block based on the transform type of the current block.

An apparatus for decoding an image can include an inverse scanning module for generating a quantized block by applying an inverse scan pattern to significant flags, coefficient sign and coefficient levels respectively; an inverse quantization module for generating a quantization parameter predictor, adding the quantization parameter predictor to a differential quantization parameter to generate a quantization parameter and inversely quantizing the quantized block using the quantization parameter; an inverse transform module for inversely transforming the inversely quantized block to restore a residual block; an intra prediction module for generating a prediction block; an adder for generating a reconstructed block using the residual block and the prediction block, in which certain types of scans are used based on a size of a transform unit and various parameters are set according to availability conditions.

A video encoding device (2) includes a side information determination section (21) and a side information encoding section (22). The side information determination section (21) sets a quantization parameter for each macroblock in such a manner that a difference between quantization parameters for each pair of macroblocks with successive encoding orders is equal to one of n difference values, and transforms the difference into one of n indices with respect to each pair. The side information encoding section (22) generates a binary sequence having a length corresponding to the size of the absolute value of the index. The total of absolute values of the n indices is smaller than the total of absolute values of the n difference values.