An image sensor may include an image pixel array with both image pixels to gather image data and phase detection pixels to gather phase information. The phase detection pixels may be arranged in pairs, with two adjacent pixels covered by a single microlens. The phase detection pixel pairs may be arranged in dashed lines, with image pixels interposed between each phase detection pixel pair. There may be only one image pixel interposed between each phase detection pixel pair. The phase detection pixels may all include color filter elements of the same color. The phase detection pixels may all include green color filter elements. The image pixels in the interrupted lines may include color filter elements that match the surrounding color pattern. The image pixels in the interrupted lines may all include color filter elements of the same color.

Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, suppressing the occurrence of artifact and color gradation and achieving reduction in computational costs. The image processing device includes a frequency recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to frequency recovery processing using a frequency recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the frequency recovery processing to nonlinear gradation correction, and a phase recovery processing unit which subjects image data subjected to the gradation correction to phase recovery processing using a phase recovery filter based on the point spread function of the optical system.

In a focus adjusting apparatus, a tracking unit detects from an image signal an area of a subject to be tracked, a position of an imaging plane of the area and reliability of the position, and a prediction unit predicts a position of an imaging plane when the image signal was obtained based on a history of detected positions of imaging planes. A setting unit sets a tolerance based on the reliability, and a determination unit determines the area of the detected subject as a focus adjustment area if a difference between the predicted and detected positions is within the tolerance. The prediction unit predicts a position of an imaging plane of the subject in the focus adjustment area at a future time point.

An image sensor includes a sensor substrate including first, second, third, and fourth pixels, and a color separating lens array, wherein each of the first pixels includes a first focusing signal region and a second focusing signal region that independently generate focusing signals, and the first focusing signal region and the second focusing signal region are arranged to be adjacent to each other in the first pixel in a first direction, and each of the fourth pixels includes a third focusing signal region and a fourth focusing signal region that independently generate focusing signals, and the third focusing signal region and the fourth focusing signal region are arranged to be adjacent to each other in the fourth pixel in a second direction that is different from the first direction.

An image sensor includes a sensor substrate including first, second, third, and fourth pixels, and a color separating lens array, wherein each of the first pixels includes a first focusing signal region and a second focusing signal region that independently generate focusing signals, and the first focusing signal region and the second focusing signal region are arranged to be adjacent to each other in the first pixel in a first direction, and each of the fourth pixels includes a third focusing signal region and a fourth focusing signal region that independently generate focusing signals, and the third focusing signal region and the fourth focusing signal region are arranged to be adjacent to each other in the fourth pixel in a second direction that is different from the first direction.

Provided is an image sensor including a sensor substrate including a first pixel configured to sense light of a first wavelength, and a second pixel configured to sense light of a second wavelength, and a color separating lens array configured to concentrate the light of the first wavelength on the first pixel, and the light of the second wavelength on the second pixel, the color separating lens array including a first pixel-corresponding area corresponding to the first pixel, and a second pixel-corresponding area corresponding to the second pixel, wherein a first phase difference between the light of the first wavelength that has traveled through a center of the first pixel-corresponding area and a center of the second pixel-corresponding area is different than a second phase difference between the light of the second wavelength that has traveled through the center of the first pixel-corresponding area and the center of the second pixel-corresponding area.

Provided is an image sensor including a sensor substrate including a first pixel configured to sense light of a first wavelength, and a second pixel configured to sense light of a second wavelength, and a color separating lens array configured to concentrate the light of the first wavelength on the first pixel, and the light of the second wavelength on the second pixel, the color separating lens array including a first pixel-corresponding area corresponding to the first pixel, and a second pixel-corresponding area corresponding to the second pixel, wherein a first phase difference between the light of the first wavelength that has traveled through a center of the first pixel-corresponding area and a center of the second pixel-corresponding area is different than a second phase difference between the light of the second wavelength that has traveled through the center of the first pixel-corresponding area and the center of the second pixel-corresponding area.

An apparatus for acquiring images includes an image sensor and a signal processor. The image sensor may include a sensor substrate and a color separation lens array, wherein the sensor substrate includes a plurality of photo-sensing cells, and the color separation lens array may separate an incident light into a plurality of lights having different wavelengths and forms a phase distribution for condensing the plurality of lights having the different wavelengths on adjacent photo-sensing cells of the plurality of photo-sensing cells. The signal processor may perform deconvolution on sensing signals of the plurality of photo-sensing cells to obtain a sub-sampled image, perform demosaicing to restore a full resolution image having a full resolution from the sub-sampled image, and correct a color of the full resolution image using a point spread function (PSF) of the color separation lens array.

An apparatus for acquiring images includes an image sensor and a signal processor. The image sensor may include a sensor substrate and a color separation lens array, wherein the sensor substrate includes a plurality of photo-sensing cells, and the color separation lens array may separate an incident light into a plurality of lights having different wavelengths and forms a phase distribution for condensing the plurality of lights having the different wavelengths on adjacent photo-sensing cells of the plurality of photo-sensing cells. The signal processor may perform deconvolution on sensing signals of the plurality of photo-sensing cells to obtain a sub-sampled image, perform demosaicing to restore a full resolution image having a full resolution from the sub-sampled image, and correct a color of the full resolution image using a point spread function (PSF) of the color separation lens array.

Embodiments described herein disclose a color measurement device and method for use with cameras or other imaging devices. The color measurement device may be configured to determine many different colors via a commonly owned device. Embodiments utilize sinusoidal grayscale rings to determine an exact color match of an unknown color, even if there is perspective distortion of an obtained image.