An image processing method includes correcting a magnification in a plurality of images captured at a plurality of different focus positions, aligning the plurality of images having the corrected magnification, correcting a color blur in the plurality of aligned images, and combining the plurality of images having the corrected color blur.

An optical system has the entire angle of view at a wide-angle end of not smaller than 90 degrees. A spatial frequency at which an MTF of the optical system acquired using an evaluation wavelength in a region of an image formation plane in which the distance from the center of the image formation plane is not less than 80% and less than 95% of half of the length of a diagonal line of an imaging surface of an imaging element image is not more than 30% is higher at the wide-angle end than at a telephoto end. When F(FwFt) is satisfied (where F indicates the focal length of the optical system when the target image is captured, Fw indicates the focal length at the wide-angle end, and Ft indicates the focal length at the telephoto end), a sharpening processing unit performs a restoration process based on an optical transfer function of the optical system as a sharpening process.

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

A focusing adjustment apparatus includes a focusing unit, a first acquisition unit, a second acquisition unit, and a control unit. The focusing unit outputs a first signal for a focusing operation. The first acquisition unit acquires first information, which is related to characteristics of a signal used for outputting the first signal, and second information, which is related to characteristics of a captured image and is predetermined. The second acquisition unit acquires third information on aberrations of an imaging optical system. The control unit calculates a correction value based on the first information, the second information, and the third information. By using the correction value, the control unit changes the first signal, output from the focusing unit, to a second signal used in the focusing operation.

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

An image capturing apparatus provided with an image capturing unit that captures a first image, a scene discrimination unit that discriminates a scene of an object a candidate generation unit that generates a shooting setting candidate, based on a result of the discrimination, an image generation unit that generates, based on the shooting setting candidate, an image reflecting an effect obtained by the shooting setting candidate, and a display device. The candidate generation unit performs at least one of a first operation for generating a plurality of shooting setting candidates in which a predetermined parameter is separated by greater than a threshold value and a second operation for generating at least one shooting setting candidate based on the result of the discrimination, and the display device preferentially displays the shooting setting candidates generated by the first operation.

A focusing adjustment apparatus includes a focusing unit, a first acquisition unit, a second acquisition unit, and a control unit. The focusing unit outputs a first signal for a focusing operation. The first acquisition unit acquires first information, which is related to characteristics of a signal used for outputting the first signal, and second information, which is related to characteristics of a captured image and is predetermined. The second acquisition unit acquires third information on aberrations of an imaging optical system. The control unit calculates a correction value based on the first information, the second information, and the third information. By using the correction value, the control unit changes the first signal, output from the focusing unit, to a second signal used in the focusing operation.

The processing of RGB image data can be optimized by performing optimization operations on the image data when it is converted into the YCbCr color space. For each Y-layer of the YCbCr image data, a 2D LUT is generated. The YCbCr image data is converted into optimized CbCr image data using the 2D LUTs, and optimized YCbCr image data is generated by blending CbCr image data corresponding to multiple Y-layers. The optimized YCbCr image data is converted into sRGB image data, and a tone curve is applied to the sRGB image data to produce optimized sRGB image data.

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.