An image sensor includes: first lines transferring a first clock having the same phase as that of modulated light in a first phase and a third clock having a phase difference of a ½ cycle from the phase of the modulated light in a second phase; second lines transferring the third clock in the first phase and the first clock in the second phase; third lines transferring a second clock having a phase difference of a ¼ cycle from the phase of the modulated light in the first phase and a fourth clock having a phase difference of a ¾ cycle from the phase of the modulated light in the second phase; fourth lines transferring the fourth clock in the first phase and the second clock in the second phase; and a pixel array including first pixels and second pixels that are alternately arranged in row and column directions.

The invention relates to post-processing of a digital photo to correct perspective distortion in the photo. The correction applies a digital photo of a scene and a depth map associated with the photo and comprising, for each pixel in the photo, a depth being a distance between a part of the scene in that pixel and a position of the camera at the time of acquisition. The correction is performed locally, so that the correction of any pixel in the photo depends on the depth of that pixel. The correction can be implemented as a transformation of each pixel in the original photo into a new position in a corrected photo. Afterwards, pixel values has to be calculated for the pixels in the corrected photo using the original pixel values and their new positions. The invention is particularly relevant for photos where objects or scenes involves a large magnification variation, such as selfies, close up photos, and photos when the extension of a large, object is not orthogonal to the optical axis of the camera (low/high angle shots).

An apparatus comprises an input interface for receiving a color image of at least an object and a low resolution depth image of at least the object. The apparatus further comprises an image processing module configured to produce data for generating a three-dimensional color image based on a first color pixel image data of a first color pixel and a first derived depth pixel image data of a first derived depth pixel. The image processing module is configured to calculate the first derived depth pixel image data based on a measured depth pixel image data of a measured depth pixel and a weighting factor. The weighting factor is based on a color edge magnitude summation value of a path between the first color pixel and the reference color pixel. The apparatus further comprises an output interface for providing the generated three-dimensional color image.

An image processing apparatus and a camera module using the same are provided, the camera module comprises first and second sensor units each outputting left and right images, and an image processing unit configured to simultaneously encoding a depth image and a color image generated from the left and right images.

Transmission of stereo image data may be performed between devices, where a source device receives E-EDID from a sink device via DDC of an HDMI cable. This E-EDID contains information on 3D image data transmission modes supportable by the sink device. Based on information on 3D image data transmission modes from the sink device, the source device selects a predetermined transmission mode from among the 3D image data transmission modes supportable by the sink device. The source device transmits 3D image data in the selected transmission mode to the sink device. The source device transmits information on the transmission mode for the 3D image data, to the sink device by using an AVI InfoFrame packet or the like. The sink device processes the 3D image data received from the source device in accordance with its transmission mode, thereby obtaining left and right eye image data.

The usual coding order according to which the reference view is coded prior to the dependent view, and within each view, a depth map is coded subsequent to the respective picture, may be maintained and does lead to a sacrifice of efficiency in performing inter-view redundancy removal by, for example, predicting motion data of the current picture of the dependent view from motion data of the current picture of the reference view. Rather, a depth map estimate of the current picture of the dependent view is obtained by warping the depth map of the current picture of the reference view into the dependent view, thereby enabling various methods of inter-view redundancy reduction more efficiently by bridging the gap between the views. According to another aspect, the following discovery is exploited: the overhead associated with an enlarged list of motion predictor candidates for a block of a picture of a dependent view is comparatively low compared to a gain in motion vector prediction quality resulting from an adding of a motion vector candidate which is determined from an, in disparity-compensated sense, co-located block of a reference view.

An apparatus for reducing the visibility of disparity estimation errors at edges, and in particular at overlays. The apparatus comprises a receiver (401) for receiving a three dimensional image represented by at least image values (brightness/contrast values) and a disparity value. A subset selector (403) evaluates an image property criterion for the image value for a group of pixels and determines a subset of pixels of the group of pixels for which the image property criterion is met. The criterion may for example reflect whether the pixel belongs to an image object edge. A distribution evaluator (405) generates a frequency distribution for disparity values of the subset of pixels and an analyzer (407) determines a shape property for the frequency distribution (the presence of a peak). An adaptor (409) determining a disparity remapping in response to the shape property and a remapper (411) modifies disparity values of the three dimensional image by applying the disparity remapping. The approach may e.g. reduce image depth when overlay graphics is likely to be present.

A method and corresponding system for reconstructing the surface geometry of a three-dimensional object is disclosed. The system comprises a cluster of heterogeneous sensors, including a two-dimensional high-resolution camera and a three-dimensional depth camera, and a turntable operable to rotate incrementally. In operation, the turntable is rotated to first and second positions and two-dimensional and three-dimensional data sets are obtained using the two-dimensional high-resolution camera and the three-dimensional depth camera. Corresponding features from the two-dimensional data sets are identified and used to identify the same corresponding features in the three-dimensional data sets. The three-dimensional corresponding features are used to calculate a three-dimensional homography, which is used to align the three-dimensional data sets. Following alignment, a three-dimensional mesh is generated from the aligned data sets.

A method for generating a stereoscopic video stream (101) having composite images (C) that include information about a right image (R) and a left image (L), as well as at least one depth map includes pixels from the right image (R) and from the left image (L), and then entering the selected pixels into a composite image (C) of the stereoscopic video stream. The method also provides for entering all the pixels of the right image (R) and all the pixels of the left image (L) into the composite image (C) by leaving one of said two images unchanged and breaking up the other one into regions (R1, R2, R3) having a plurality of pixels. The pixels of the depth map(s) are then entered into that region of the composite image which is not occupied by pixels of the right and left images.

According to one embodiment, a basic format for a 3D signal having a first area to arrange main video data, a second area to arrange graphic data, a third area to arrange depth information of pixels of the main video data, and a fourth area to arrange depth information of pixels of the graphic data are defined. When depth information of pixels of the main video data is generated, a 3D processing module can select whether to use a first pattern obtained by inserting the graphic data into the main video data and a second pattern obtained by not inserting the graphic data into the main video data. A 3D related controller decides on the first or second pattern to be used by the 3D processing module.