An optical system has the entire angle of view at a wide-angle end of not smaller than 90 degrees. A spatial frequency at which an MTF of the optical system acquired using an evaluation wavelength in a region of an image formation plane in which the distance from the center of the image formation plane is not less than 80% and less than 95% of half of the length of a diagonal line of an imaging surface of an imaging element image is not more than 30% is higher at the wide-angle end than at a telephoto end. When F(FwFt) is satisfied (where F indicates the focal length of the optical system when the target image is captured, Fw indicates the focal length at the wide-angle end, and Ft indicates the focal length at the telephoto end), a sharpening processing unit performs a restoration process based on an optical transfer function of the optical system as a sharpening process.

Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, effectively performing phase recovery and suppressing the occurrence of artifact due to frequency recovery processing. The image processing device includes a phase recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to phase recovery processing using a phase recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the phase recovery processing to nonlinear gradation correction, and a frequency recovery processing unit which subjects image data subjected to the gradation correction to frequency recovery processing using a frequency recovery filter based on the point spread function of the optical system.

The present invention provides an image processing device, an imaging device, an image processing method, and a program capable of effectively performing a point image restoration process on a visible light image and a near-infrared ray image, and improving accuracy of a point image restoration process. An image processing device according to an aspect of the present invention includes an image input unit that receives first image data indicating a visible light image imaged with sensitivity to a visible light wavelength band by using an optical system and second image data indicating a near-infrared ray image imaged with sensitivity to a near-infrared ray wavelength band by using the optical system, a first restoration processing unit that performs a first restoration process of performing phase correction and amplitude restoration on the first image data, and a second restoration processing unit that performs a second restoration process of performing amplitude restoration without phase correction on the second image data.

The present invention provides an image processing device, an imaging device, an image processing method, and a program which are capable of accurately correcting blurring caused in first image data of an image using a near-infrared ray as a light source and, accurately performing a point image restoration process on second image data of an image using visible light and a near-infrared ray as a light source. An image processing device according to an aspect of the present invention includes an image input unit, a determination unit that determines whether image data is first image data or second image data, a first restoration processing unit that performs a first restoration process using first restoration filters for performing phase correction and amplitude restoration on the determined first image data, and a second restoration processing unit that performs a second restoration process using second restoration filters for performing amplitude restoration without phase correction on the determined second image data.

An image processing device includes a point-image restoration processing unit 40 which receives a photographic image as input, and subjects the photographic image to a point-image restoration process based on point-image restoration information to generate a restored image, an area information output unit 45 which outputs area information relating to a specific area in the restored image where restoration strength of the point-image restoration process based on the point-image restoration information is equal to or greater than a threshold value, a display control unit 50 which receives the restored image and the area information as input and performs display control to highlight the specific area in the restored image based on the area information, and a display unit 55 which highlights at least the specific area based on the display control by the display control unit 50.

A restoration filter generation device according to one embodiment of the present invention includes: an information acquisition unit that acquires information showing a difference that depends on a color of an optical transfer function of an optical system; and a restoration filter generation unit that generates a restoration filter, which weakens restoration strength according to the difference that depends on the color of the optical transfer function on the basis of the information acquired by the information acquisition unit, and makes the restoration strength of the restoration filter weaker than the restoration strength of an ideal filter decided assuming that the difference that depends on the color of the optical transfer function does not exist. As a result, the overcorrection is reduced.

Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, suppressing the occurrence of artifact and color gradation and achieving reduction in computational costs. The image processing device includes a frequency recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to frequency recovery processing using a frequency recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the frequency recovery processing to nonlinear gradation correction, and a phase recovery processing unit which subjects image data subjected to the gradation correction to phase recovery processing using a phase recovery filter based on the point spread function of the optical system.

Embodiments relate to color correction circuit operations performed by an image signal processor. The color correction circuit computes optimal color correction matrix on a per-pixel basis and adjusts it based on relative noise standard deviations of the color channels to steer the matrix.

An image capturing apparatus provided with an image capturing unit that captures a first image, a scene discrimination unit that discriminates a scene of an object a candidate generation unit that generates a shooting setting candidate, based on a result of the discrimination, an image generation unit that generates, based on the shooting setting candidate, an image reflecting an effect obtained by the shooting setting candidate, and a display device. The candidate generation unit performs at least one of a first operation for generating a plurality of shooting setting candidates in which a predetermined parameter is separated by greater than a threshold value and a second operation for generating at least one shooting setting candidate based on the result of the discrimination, and the display device preferentially displays the shooting setting candidates generated by the first operation.

A focusing adjustment apparatus includes a recording unit, a focusing adjustment unit, a calculation unit, and a calculation unit. The recording unit records a recording signal output from an image sensor. The focusing adjustment unit adjusts focusing on an object image entering the image sensor based on information about an image-forming position in a first evaluation band of the recording signal. The calculation unit calculates the image-forming position in the first evaluation band of the recording signal by correcting, using a correction value, an image-forming position in a second evaluation band of a focusing adjustment signal obtained from the image sensor. The calculation unit changes the correction value using information about the first evaluation band of the recording signal.