There are provided a method and apparatus for illumination and color compensation for multi-view video coding. A video encoder includes an encoder for encoding a picture by enabling color compensation of at least one color component in a prediction of the picture based upon a correlation factor relating to color data between the picture and another picture. The picture and the other picture have different view points and both corresponding to multi-view content for a same or similar scene.

An image processing apparatus is provided, that is configured to: extract a first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image, at a target pixel position from image data having the first pixel value; extract second and third luminance values corresponding to second and third viewpoints that are different from the first viewpoint, at the target pixel position from luminance image data having the second and third luminance values; and calculate at least any of second and third pixel values of the second and third viewpoints such that a relational expression between the second or third pixel value and the first pixel value extracted by the pixel value extracting unit remains correlated with a relational expression defined by the second and third luminance values.

Methods and graphics processing modules for rendering a stereoscopic image including left and right images of a three-dimensional scene. Geometry is processed in the scene to generate left data for use in displaying the left image and right data for use in displaying the right image. Disparity is determined between the left and right data by comparing the generated left data and the generated right data used in displaying the stereoscopic image. In response to identifying at least a portion of the left data and the right data as non-disparate, a corresponding portion of the left image and the right image is commonly processed (e.g. commonly rendered or commonly stored). In response to identifying at least a portion of the left data and the right data as disparate, a corresponding portion of the left image and the right image is separately processed (e.g. separately rendered or separately stored).

A captured scene captured of a live action scene while a display wall is positioned to be part of the live action scene may be processed. To perform the processing, image data of the live action scene having a live actor and the display wall displaying a first rendering of a precursor image is received. Further, precursor metadata for the precursor image displayed on the display wall and display wall metadata for the display wall is determined. An image matte is accessed, where the image matte indicates a first portion associated with the live actor and a second portion associated with the precursor image on the display wall Image quality levels for display wall portions of the display wall in the image data is determined, and pixels associated with the display wall in the image data are adjusted to the image quality levels.

A captured scene captured of a live action scene while a display wall is positioned to be part of the live action scene may be processed. To perform the processing, image data of the live action scene having a live actor and the display wall displaying a first rendering of a precursor image is received. Further, precursor metadata for the precursor image displayed on the display wall and display wall metadata for the display wall is determined. An image matte is accessed, where the image matte indicates a first portion associated with the live actor and a second portion associated with the precursor image on the display wall Image quality levels for display wall portions of the display wall in the image data is determined, and pixels associated with the display wall in the image data are adjusted to the image quality levels.

An image sensor captures a subject image of a partial luminous flux passed through different regions from among a total luminous flux through one optical system. The image sensor is configured from a pixel arrangement in which a plurality of each of at least three types of pixels are arranged, including non-parallax pixels which comprise an aperture mask that produces a viewpoint in a reference direction, first parallax pixels which comprise an aperture mask that produces a viewpoint in a first direction different from the reference direction and second parallax pixels which comprise an aperture mask that produces a viewpoint in a second direction different from the reference direction, wherein each of the aperture mask of the first parallax pixels and the aperture mask of the second parallax pixels has a width of a greater-than-half-aperture aperture area in the direction of change of the viewpoint.

An information processing apparatus (IP1) includes a depth information extraction unit (DIE1) and a processing unit (IMP). The depth information extraction unit (DIE1) can extract depth information from a plurality of pieces of infrared image information included in a plurality of pieces of image data. The plurality of pieces of image data is image data captured from a plurality of viewpoints. Each of the plurality of pieces of image data includes visible light image information and infrared image information. Based on the depth information, the processing unit (IMP) processes the visible light image generated using the visible light image information included in at least one piece of image data among the plurality of pieces of image data.

An information processing apparatus (IP1) includes a depth information extraction unit (DIE1) and a processing unit (IMP). The depth information extraction unit (DIE1) can extract depth information from a plurality of pieces of infrared image information included in a plurality of pieces of image data. The plurality of pieces of image data is image data captured from a plurality of viewpoints. Each of the plurality of pieces of image data includes visible light image information and infrared image information. Based on the depth information, the processing unit (IMP) processes the visible light image generated using the visible light image information included in at least one piece of image data among the plurality of pieces of image data.

Methods, apparatus, devices, and systems for three-dimensional (3D) displaying objects are provided. In one aspect, a method includes obtaining data including respective primitive data for primitives corresponding to an object, determining an electromagnetic (EM) field contribution to each element of a display for each of the primitives by calculating an EM field propagation from the primitive to the element, generating a sum of the EM field contributions from the primitives for each of the elements, transmitting to each of the elements a respective control signal for modulating at least one property of the element based on the sum of the EM field contributions, and transmitting a timing control signal to an illuminator to activate the illuminator to illuminate light on the display, such that the light is caused by the modulated elements of the display to form a volumetric light field corresponding to the object.

Methods, apparatus, devices, and systems for three-dimensional (3D) displaying objects are provided. In one aspect, a method includes obtaining data including respective primitive data for primitives corresponding to an object, determining an electromagnetic (EM) field contribution to each element of a display for each of the primitives by calculating an EM field propagation from the primitive to the element, generating a sum of the EM field contributions from the primitives for each of the elements, transmitting to each of the elements a respective control signal for modulating at least one property of the element based on the sum of the EM field contributions, and transmitting a timing control signal to an illuminator to activate the illuminator to illuminate light on the display, such that the light is caused by the modulated elements of the display to form a volumetric light field corresponding to the object.