Image data obtained by imaging of an imaging element capable of imaging a subject with sensitivity to a wavelength band of visible light and a wavelength band of near-infrared light via an optical system is acquired. A point image restoration process using a common restoration filter is performed on the image data of the subject captured with sensitivity to the wavelength band of the visible light by the imaging element and the image data of the subject captured with sensitivity to the wavelength band of the near-infrared light by the imaging element. The common restoration filter is calculated on the basis of average optical characteristics of the optical system obtained by performing weighted averaging of first optical characteristics with respect to the visible light of the optical system and second optical characteristics with respect to the near-infrared light of the optical system.

An image processing device according to the present disclosure includes: a defect candidate pixel detecting unit that detects a defect candidate pixel for each of captured images captured in a state where positional relationships between an imaging range and an image sensor including a plurality of pixels are caused to be different from each other by performing defect candidate pixel detecting processing on each of the plurality of captured images; and an interpolation target defective pixel determining unit that determines, as an interpolation target defective pixel, a pixel detected as the defect candidate pixel a number of times greater than or equal to a threshold value by the defect candidate pixel detecting unit.

Techniques are provided for color correction of image frames, received from a hybrid RGBIR sensor, using resolution recovery of the red, green, blue (RGB), and infra-red (IR) channels. The color correction is to compensate for IR contamination of the RGB channels. A methodology implementing the techniques according to an embodiment includes a demosaic operation on the RGBIR image frame to generate full resolution red, green, blue, and IR frames. The demosaic operation includes filtering to extract Chroma and Luma components of the RGBIR image to reconstruct the full resolution images. The method also includes calculating an IR weighting factor for the pixels of each of the full resolution RGB frames, and correcting for IR contamination of those pixels by subtracting a scaled value of the corresponding pixels from the full resolution IR frame. The scaled value is based on the IR weighting factor associated with the pixel to be corrected.

An electronic device includes an image sensor that generates first image data upon receiving external light, generates second image data based on the first image data, and outputs the first image data and the second image data, and an application processor that increases resolution of at least a region of an image that corresponds to the first image data using a machine learning algorithm and outputs third image data that includes at least a portion of the first image data with increased resolution and at least a portion of the second image data.

Images can be processed using an image processing apparatus including: an image data obtaining section that obtains at least two pieces of parallax image data from an image capturing element that includes color filters and opening masks so that one color filter and one opening mask correspond to one of at least a part of photoelectric conversion elements and outputs the at least two pieces of parallax image data; and a correcting section that corrects color imbalance of a corresponding pixel caused between the at least two pieces of parallax image data, based on at least one of a position of the at least a part of photoelectric conversion elements in the image capturing element and an opening displacement of the opening mask.

An image processing apparatus according to the present embodiment includes a detection unit configured to detect a subject region in a captured image, an acquisition unit configured to acquire, on a per-pixel basis, color information and depth information of a pixel included in the subject region, a color determination unit configured to determine a color of the pixel based on the color information, and a correction unit configured to correct the depth information of the pixel based on a determination result from the color determination unit. When the pixel is a chromatic pixel, the correction unit corrects the depth information of the pixel based on correction information that is associated with the color of the pixel.

There is provided in one embodiment an apparatus having an image sensor array. In one embodiment, the image sensor array can include monochrome pixels and color sensitive pixels. The monochrome pixels can be pixels without wavelength selective color filter elements. The color sensitive pixels can include wavelength selective color filter elements.

In one embodiment of the invention, an apparatus is disclosed including an image sensor, a color filter array, and an image processor. The image sensor has an active area with a matrix of camera pixels. The color filter array is in optical alignment over the matrix of the camera pixels. The color filter array assigns alternating single colors to each camera pixel. The image processor receives the camera pixels and includes a correlation detector to detect spatial correlation of color information between pairs of colors in the pixel data captured by the camera pixels. The correlation detector further controls demosaicing of the camera pixels into full color pixels with improved resolution. The apparatus may further include demosaicing logic to demosaic the camera pixels into the full color pixels with improved resolution in response to the spatial correlation of the color information between pairs of colors.

An imaging apparatus according to the present invention includes: an imaging unit configured to generate RAW image data by imaging; a generation unit configured to generate record RAW image data from the RAW image data; and a recording unit configured to record in a storage unit the record RAW image data, wherein the generation unit generates the record RAW image data by performing Lossy compression on the RAW image data in a case where consecutive shooting is performed, and generates the record RAW image data by performing Lossless compression on the RAW image data in a case where single shooting or bracket photographing is performed.

An image processing apparatus that can suppress a tint phenomenon in image recovery processing and a method of controlling the same are disclosed. A saturation determination unit determines whether or not a saturated pixel is included in a reference region referred to by filter processing units. An R component output adjustment unit and a B component output adjustment unit adjust corresponding color components resulting from image recovery processing according to the determination result obtained by the saturation determination unit.