Provided is an encoder including: circuitry; and memory coupled to the circuitry. In operation, the circuitry: performs a mapping process of Luma Mapping with Chroma Scaling (LMCS) for transforming a first pixel value space applied to a luma display image signal into a second pixel value space applied to a luma encoding process signal, using line segments forming a transform curve, each of which corresponds to a different one of sections obtained by partitioning the first pixel value space; and encodes an image, and in the performing of the LMCS, the circuitry determines the transform curve so that among boundary values in the second pixel value space, a first value obtained by dividing a boundary value by a base width defined according to a bit depth of the image is not equal to a second value obtained by dividing another boundary value by the base width.

Provided is an encoder including: circuitry; and memory coupled to the circuitry. In operation, the circuitry: performs a mapping process of Luma Mapping with Chroma Scaling (LMCS) for transforming a first pixel value space applied to a luma display image signal into a second pixel value space applied to a luma encoding process signal, using line segments forming a transform curve, each of which corresponds to a different one of sections obtained by partitioning the first pixel value space; and encodes an image, and in the performing of the LMCS, the circuitry determines the transform curve so that among boundary values in the second pixel value space, a first value obtained by dividing a boundary value by a base width defined according to a bit depth of the image is not equal to a second value obtained by dividing another boundary value by the base width.

A modulator has a first grating pattern, and a second grating pattern having a phase shifted from the first grating pattern; a sensor processor receives a first image signal outputted by the first grating pattern, and a second image signal outputted by the second grating pattern; a difference processor calculates a difference between the first image signal and the second image signal; and a compression processor 3005 contains information that indicates a range of the difference to first compression image data. Those make it possible to reduce a data amount of images capable of focus adjustment etc. from later, and to lead to reduction in costs of a storage apparatus.

Processing methods and apparatuses for video data comprise receiving input data associated with a current transform block in a current video picture, determining if a size of the current transform block is a power of 4, determining a normalized quantization or dequantization scaling factor, generating transform coefficient levels by applying a quantization processing to scaled transform coefficients in the current transform block or generating scaled transform coefficients by applying an inverse quantization processing to transform coefficient levels in the current transform block, and encoding or decoding the current transform block. The quantization processing comprises scaling the scaled transform coefficients by the normalized quantization scaling factor and the inverse quantization processing comprises scaling the transform coefficient levels by the normalized dequantization scaling factor.

Sample data and metadata related to spatial regions in images may be received from a coded video signal. It is determined whether specific spatial regions in the images correspond to a specific region of luminance levels. In response to determining the specific spatial regions correspond to the specific region of luminance levels, signal processing and video compression operations are performed on sets of samples in the specific spatial regions. The signal processing and video compression operations are at least partially dependent on the specific region of luminance levels.

A video coding or decoding method using inter-image prediction to encode input video data in which each chrominance component has 1/Mth of the horizontal resolution and 1/Nth of the vertical resolution of the luminance component, where M and N are integers equal to 1 or more, including storing one or more images preceding a current image, interpolating a higher resolution version of prediction units of the stored images so that the luminance component has a horizontal resolution P times that of the corresponding portion of the stored image and a vertical resolution Q times that of the corresponding portion of the stored image, detecting inter-image motion between a current image and the one or more interpolated stored images so as to generate motion vectors between a prediction unit of the current image and areas of the one or more preceding images, and generating a motion compensated prediction.

Techniques are described in which a decoder is configured to receive an input data block and apply an inverse non-separable transform to at least part of the input data block to generate an inverse non-separable transform output coefficient block. The applying the inverse non-separable transform comprises assigning a window, assigning a weight for each position inside the assigned window, and determining the inverse non-separable transform output coefficient block based on the assigned weights. The decoder is further configured to forming a decoded video block based on the determined inverse non-separable transform output coefficient block, wherein forming the decoded video block comprises summing the residual video block with one or more predictive blocks.

A modulator 2501 has a first grating pattern, and a second grating pattern having a phase shifted from the first grating pattern; a sensor processer 3002 receives a first image signal outputted by the first grating pattern, and a second image signal outputted by the second grating pattern; a difference processer calculates a difference between the first image signal and the second image signal; and a compression processer 3005 contains information that indicates a range of the difference to first compression image data. Those make it possible to reduce a data amount of images capable of focus adjustment etc. from later, and to lead to reduction in costs of a storage apparatus.

Disclosed herein are related to a system and a method of remotely rendering an image. In one approach, a console device generates an image according to a gaze direction of a user of a head mounted display (HMD). In one aspect, the image includes a first area and a second area disposed along an axis, where the second area is located farther away from a foveated area of the image than the first area. In one aspect, the foveated area corresponds to the gaze direction of the user of the HMD. In one aspect, the console device compresses the image according to the axis, where the second area is compressed at a higher level than the first area. In one aspect, the compressed image is transmitted to the HMD. The HMD may decompress the compressed image according to the axis, and render the decompressed image.

A video coding method and an apparatus using arbitrary block partitioning are disclosed. The video coding method and apparatus perform a transform and an inverse transform on residual signals of arbitrary partitioned blocks when predicting a current block by using arbitrary block. Alternatively, the video coding method and the video coding apparatus perform a transform and an inverse transform on residual signals corresponding to some pixels adjacent to a partitioning boundary after an arbitrary partitioning of the current block.