In some aspects, the techniques described herein relate to systems, methods, and computer readable media for data pre-processing for stereo-temporal image sequences to improve three-dimensional data reconstruction. In some aspects, the techniques described herein relate to systems, methods, and computer readable media for improved correspondence refinement for image areas affected by oversaturation. In some aspects, the techniques described herein relate to systems, methods, and computer readable media configured to fill missing correspondences to improve three-dimensional (3-D) reconstruction. The techniques include identifying image points without correspondences, using existing correspondences and/or other information to generate approximated correspondences, and cross-checking the approximated correspondences to determine whether the approximated correspondences should be used for the image processing.

Methods and apparatus for synchronizing a peripheral device with display images frames are disclosed. Image frame data for a sequence of display image frames is generated, the image frame data comprising color values for a plurality of display picture elements (pixels). Synchronization data is embedded in a predetermined set of pixels within the image frame data for each display image frame of the sequence of display image frames. The image frame data, including the synchronization data, is transmitted to a display device. The synchronization data is extracted from the image frame data. A synchronization signal is generated based on the extracted synchronization data. The peripheral device performs actions synchronized with the display image frames in response to the synchronization signal.

Image sensors are provided. An image sensor includes a substrate that includes a pixel region, a first surface, and a second surface that is opposite the first surface. The image sensor includes first and second photogates that are on the first surface and are configured to generate electric charge responsive to incident light in the pixel region. Moreover, the image sensor includes first and second lenses that are on the second surface and are configured to pass the incident light toward the first and second photogates.

A photographing device includes a first image sensor, a first filter area, a second image sensor, a first distance calculating unit, and a second distance calculating unit. The first image sensor includes a first sensor receiving light of a first wavelength band and outputting a target image, and a second sensor receiving light of a second wavelength band and outputting a reference image. The first filter area transmits a first light of a third wavelength band, which includes at least part of the first wavelength band, the first light being a part of light incident on the first image sensor. The second image sensor outputs a first image. The first distance calculating unit calculates a first distance to an object captured in the target image and the reference image. The second distance calculating unit calculates a second distance to an object captured in the reference image and the first image.

A light-field display with pixel to micro-lens spatial alignment adapted color or brightness. In one embodiment, a first pixel is read from memory. A map is accessed to read a first index that is mapped to a first position of a first emitter in an array of emitters. A first correction data mapped to the first index is read. The first pixel is adjusted using the first correction data. The first emitter emits light based on the adjusted first pixel.

The present technique relates to an image processing apparatus and an image processing method capable of generating a color image of a display viewpoint using a color image and a depth image of a predetermined viewpoint. The viewpoint generation information generation unit generates viewpoint generation information used to generate a color image of a display viewpoint in accordance with a generation method of the color image of the display viewpoint obtained by performing warping processing using multi-viewpoint corrected color images and multi-viewpoint depth images. The multi-viewpoint image encoding unit encodes the multi-viewpoint corrected color images and the multi-viewpoint depth images, and transmits them with the viewpoint generation information. The present technique can be applied to, for example, a multi-viewpoint image processing apparatus.

An image display method includes determining a first position and a second position in a target interface and transforming a display position of a target element in the target interface from the first position to the second position. The target interface is a stereoscopic interface perceived by a viewer through one or more images, and the first position and the second position have different depth values. During a transformation process, the target element has an intermediate display position, and a depth value of the intermediate display position is between a depth value of the first position and a depth value of the second position.

Methods, devices and stream are disclosed for encoding, transporting and decoding a 3D scene prepared to be viewed from the inside of a viewing zone. A central view comprising texture and depth information is encoded by projected points of the 3D scene visible from a central point of view onto an image plane. Patches are generated to encode small parts of the 3D scene not visible from the central point of view. At the rendering, a viewport image is generated for the current point of view. Holes, that is dis-occluded areas, of the viewport are filled using a patch based inpainting algorithm adapted to take the patches, warped according to the rotation and translation between virtual camera used for capturing the patch and the current virtual camera.

A 3D depth image acquiring method and apparatus, and an image acquisition device are provided. The method is applied to an image acquisition device comprising a VIS-NIR picture sensor and an infrared structured light projection component. The VIS-NIR picture sensor comprises a plurality of dot matrix units each having a blue light photosensitive component, a green light photosensitive component, a red light photosensitive component and an NIR photosensitive component distributed thereon. The method comprises: controlling the blue light photosensitive component, the green light photosensitive component, the red light photosensitive component, the NIR photosensitive component and the infrared structured light projection component to operate, to obtain an optimum NIR image and an optimum VIS image; and processing the optimum VIS image and a depth image which is obtained by performing calculation on the optimum NIR image using a 3D depth mode, to obtain a 3D depth image.

A processing apparatus includes a luminance information obtainer that obtains luminance information for each color in each of a plurality of images, each of which is imaged respectively when a light source arranged at mutually different positions sequentially irradiates an object with light, and a color setter that sets a color to use in obtaining surface normal information for each region of an image on the basis of the luminance information.