Techniques for efficiently generating and displaying light-field data are disclosed. In one particular embodiment, the techniques may be realized as a method for generating light-field data, the method comprising receiving input image data, synthesizing a first plurality of viewpoints based on the input image data, synthesizing a second plurality of viewpoints based on cached image data, combining the first and second plurality of viewpoints, yielding a plurality of blended viewpoints, displaying the plurality of blended viewpoints, and caching image data associated with the plurality of blended viewpoints.

Techniques for efficiently generating and displaying light-field data are disclosed. In one particular embodiment, the techniques may be realized as a method for generating light-field data, the method comprising receiving input image data, synthesizing a first plurality of viewpoints based on the input image data, synthesizing a second plurality of viewpoints based on cached image data, combining the first and second plurality of viewpoints, yielding a plurality of blended viewpoints, displaying the plurality of blended viewpoints, and caching image data associated with the plurality of blended viewpoints.

An image processing apparatus is coupled to a plurality of image capturing devices. The image processing apparatus reduces a noise in an epi-polar image while generating a three-dimensional image from a multi view image. The image processing apparatus divides the multi view image into a flat region and a non-flat region, generates the epi-polar image from the multi view image, replaces an epi-polar line in the epi-polar image corresponding to the flat region with an average pixel value of the multi-view image, and replaces an epi-polar line in the epi-polar image corresponding to the non-flat region with a pixel value of a center-view image obtained from a centrally located image capturing device among the plurality of image capturing devices.

An image processing apparatus is coupled to a plurality of image capturing devices. The image processing apparatus reduces a noise in an epi-polar image while generating a three-dimensional image from a multi view image. The image processing apparatus divides the multi view image into a flat region and a non-flat region, generates the epi-polar image from the multi view image, replaces an epi-polar line in the epi-polar image corresponding to the flat region with an average pixel value of the multi-view image, and replaces an epi-polar line in the epi-polar image corresponding to the non-flat region with a pixel value of a center-view image obtained from a centrally located image capturing device among the plurality of image capturing devices.

A method of synthesizing intermediate views of a light field includes selecting a configuration of specific input views of a light field collected by a light field acquiring device, specifying coordinates of intermediate views to be synthesized and inputting the specified coordinates to a neural network, and synthesizing intermediate views based on a scene disparity, a selected configuration of the specific input views, and the specified coordinates of the intermediate views, using a neural network.

A method of synthesizing intermediate views of a light field includes selecting a configuration of specific input views of a light field collected by a light field acquiring device, specifying coordinates of intermediate views to be synthesized and inputting the specified coordinates to a neural network, and synthesizing intermediate views based on a scene disparity, a selected configuration of the specific input views, and the specified coordinates of the intermediate views, using a neural network.

State information indicating states of a plurality of imaging apparatuses 100-x used for generating a virtual viewpoint image is acquired. At least one image type is determined from a plurality of image types indicating display formats of displaying the states of the plurality of imaging apparatuses 100-x based on the state information. Based on the determined image type, the states of the plurality of imaging apparatuses 100-x are displayed.

State information indicating states of a plurality of imaging apparatuses 100-x used for generating a virtual viewpoint image is acquired. At least one image type is determined from a plurality of image types indicating display formats of displaying the states of the plurality of imaging apparatuses 100-x based on the state information. Based on the determined image type, the states of the plurality of imaging apparatuses 100-x are displayed.

An image processing apparatus for generating a virtual viewpoint image that acquires a parameter for identifying a position and orientation of a first imaging device, acquires three-dimensional shape data of an object that is generated based on a plurality of images acquired by a plurality of second imaging devices different from the first imaging device, and corrects a pixel value of a pixel included in a region corresponding to the object in an image acquired by the first imaging device, based on the position and orientation of the first imaging device identified based on the acquired parameter and the acquired three-dimensional shape data of the object.

An image processing apparatus for generating a virtual viewpoint image that acquires a parameter for identifying a position and orientation of a first imaging device, acquires three-dimensional shape data of an object that is generated based on a plurality of images acquired by a plurality of second imaging devices different from the first imaging device, and corrects a pixel value of a pixel included in a region corresponding to the object in an image acquired by the first imaging device, based on the position and orientation of the first imaging device identified based on the acquired parameter and the acquired three-dimensional shape data of the object.