The invalid pixel detection unit 32 detects an invalid pixel from a non-polarized image and a plurality of polarized images for different polarization directions obtained by performing image pickup using the polarization image pickup unit 20. For example, the invalid pixel detection unit 32 detects a saturated pixel having a pixel value larger than a preset saturation detection threshold and a black-crushed pixel having a pixel value smaller than a preset black crushing detection threshold as invalid pixels from a non-polarized image. The polarization information generation unit 33 performs processing of generating polarization information on the basis of the non-polarized image and polarized images and switches the processing of generating the polarization information depending on the detection result of the invalid pixels in the invalid pixel detection unit 32, so as to generate the polarization information without using the invalid pixels. Correct polarization information can be acquired.

According to certain embodiments, an image sensor including a pixel, the pixel including a micro lens, a plurality of photodiodes, and a color filter disposed between the plurality of photodiodes and the micro lens; a processor operatively connected to the image sensor; and a memory operatively connected to the processor, wherein the memory stores one or more instructions that, when executed by the image sensor, cause the image sensor to perform a plurality of operations, the plurality of operations comprising: determining whether the image sensor is in a high-resolution mode; when the image sensor is in the high-resolution mode, calculating a disparity based on signals detected from the plurality of photodiodes; when the disparity is not greater than a threshold value, applying a first remosaic algorithm to the signals; and when the disparity is greater than the threshold value, applying a second remosaic algorithm to the signals.

According to certain embodiments, an image sensor including a pixel, the pixel including a micro lens, a plurality of photodiodes, and a color filter disposed between the plurality of photodiodes and the micro lens; a processor operatively connected to the image sensor; and a memory operatively connected to the processor, wherein the memory stores one or more instructions that, when executed by the image sensor, cause the image sensor to perform a plurality of operations, the plurality of operations comprising: determining whether the image sensor is in a high-resolution mode; when the image sensor is in the high-resolution mode, calculating a disparity based on signals detected from the plurality of photodiodes; when the disparity is not greater than a threshold value, applying a first remosaic algorithm to the signals; and when the disparity is greater than the threshold value, applying a second remosaic algorithm to the signals.

A method for processing image or video data is performed in an image processing pipeline. Color filtered mosaiced raw image or video data is received. A one-level wavelet transform of subbands of the color filtered mosaiced raw image or video data to provide LL, HH, LH and HL subbands. The LH and HL subbands are de-correlated by summing and difference operations to provide decorrelated sum and difference subbands. Additional n-level wavelet transformation on the sum and difference subbands and the LL and HH subbands to provide sparsified subbands for encoding. LL and HH and sum subbands are recombined into standard color images e.g., red, green, and blue color components, which are subsequently processed by color correction, white balance, and gamma correction. The sparsified subbands are encoded.

The present disclosure relates to methods and devices for performing depth estimation on image data. In one example, a device performs depth estimation on first and second images captured using one or more cameras having a color filter array. Each, image of the first and second images comprises multiple color channels. Each color channel of the multiple color channels corresponds to a respective color channel of the color filter array.sub.. The, device performs the depth estimation by estimating disparity from the color channels of the first and second images.

A CMOS image sensor with an imaging array of pixels containing selected pixels wherein illumination is blocked and light scattered from an adjacent pixel is collected. The signal from the selected pixels is resilient against saturation and thereby contributes to increased dynamic range of the imaging signal. The image sensor may be incorporated within a digital camera.

Methods, systems, and devices for techniques for phase detection autofocus (PDAF) are described. A device may receive a set of PDAF pixels and may rearrange the set of PDAF pixels into a first subset of pixels in a first line buffer and a second subset of pixels in a second line buffer. As part of a first output operation, the device may perform a uniformity correction on the first subset of pixels, output the first subset of pixels to a left, center, right (LCR) processing path, and write-back the corrected first subset of pixels to the first line buffer. As part of a second output operation, the device may perform a uniformity correction on the second subset of pixels, output the second subset of pixels to an LCR processing path and an interleaver, and pull the corrected first subset of pixels from the first line buffer to the interleaver.

The present disclosure relates to a solid-state image pickup device and an electronic apparatus by which a phase-difference detection pixel that avoids defects such as lowering of sensitivity to incident light and lowering of phase-difference detection accuracy can be realized. A solid-state image pickup device as a first aspect of the present disclosure is a solid-state image pickup device in which a normal pixel that generates a pixel signal of an image and a phase-difference detection pixel that generates a pixel signal used in calculation of a phase-difference signal for controlling an image-surface phase difference AF function are arranged in a mixed manner, in which, in the phase-difference detection pixel, a shared on-chip lens for condensing incident light to a photoelectric converter that generates a pixel signal used in calculation of the phase-difference signal is formed for every plurality of adjacent phase-difference detection pixels. The present disclosure is applicable to a backside illumination CMOS image sensor and an electronic apparatus equipped with the same.

A light detecting device is provided with: a filter array including filters arranged two-dimensionally, each of the filters having a light-incident surface and a light-emitting surface, the filters including multiple types of filters having mutually different transmission spectra; and an image sensor having a light-detecting surface facing the light-emitting surface, the image sensor being provided with light-detecting elements arranged two-dimensionally on the light-detecting surface, wherein the distance between the light-emitting surface and the light-detecting surface is different for each of the filters.

An imaging element of an imaging unit 24 divides the exit pupil of an imaging optical system 21 into a plurality of regions and generates a pixel signal for each region. An optical axis position adjustment unit 23 adjusts the optical axis position of the imaging optical system with respect to the imaging element. A control unit 26 calculates a parallax on the basis of the pixel signal for each region after the pupil division and performs focus control of the imaging optical system 21. The control unit 26 also moves the optical axis position using the optical axis position adjustment unit 23, and generates, using the imaging element, pixel signals indicating the same subject region in the plurality of regions after the pupil division. An image processing unit 25 performs binning of a plurality of pixel signals indicating the same subject region generated by moving the optical axis position to generate a high-resolution captured image. Calculation of the parallax and acquisition of a high-resolution captured image can be performed.