The present invention provides a full-color three-dimensional optical sectioning microscopic imaging system and method based on structured illumination, includes an illumination source, a dichroic prism positioned at the illumination optical path, a structured light generator positioned at the reflected optical path of the dichroic prism, a lens positioned at the transmitted optical path of the dichroic prism, a beam splitter positioned at the optical path of the lens, an objective lens and a sample stage positioned at the upper optical path of the beam splitter, a reflector mirror and a tube lens positioned at the lower optical path of the beam splitter and a CCD camera positioned behind the tube lens. The illumination source is an incoherent monochrome LED or a white light LED The structured light generator is a DMD (Digital Micro-mirror Device).

Disclosed herein is an image processing device including a subband dividing section configured to perform subband division of image data of a color whose pixel positions are alternately shifted from each other, the image data being included in image data output from an image pickup element of a pixel arrangement in which the pixel positions of at least one color of three primary colors are alternately shifted from each other in one of a horizontal direction and a vertical direction, with pixels of two upper and lower lines adjacent to each other or pixels of two left and right columns adjacent to each other as a unit.

Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, suppressing the occurrence of artifact and color gradation and achieving reduction in computational costs. The image processing device includes a frequency recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to frequency recovery processing using a frequency recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the frequency recovery processing to nonlinear gradation correction, and a phase recovery processing unit which subjects image data subjected to the gradation correction to phase recovery processing using a phase recovery filter based on the point spread function of the optical system.

An image sensing device includes a plurality of pixel groups, each pixel group including first to fourth unit pixels that are configured to respond to incident light and generate electrical signals, and wherein each of the first to fourth unit pixels of a pixel group includes optical filters operable to transmit incident light corresponding to a same color, wherein the first unit pixel and the second unit pixel that are included in the pixel group are located adjacent to each other and include portions of a first microlens, and wherein a light reception area of the third unit pixel of the pixel group has a size smaller than a size of a light reception area of the fourth unit pixel of the pixel group.

Provided is an image sensor including a sensor substrate including a first photosensitive cell and a second photosensitive cell which are configured to sense light incident on the sensor substrate, a color separating lens array configured to change a phase of first wavelength light and a phase of second wavelength light such that the first wavelength light travels to the first photosensitive cell and the second wavelength light travels to the second photosensitive cell, and a spectrum shaping layer including a plurality of nanostructures respectively having a first refractive index, and a dielectric material provided between the plurality of nanostructures and having a second refractive index, the spectrum shaping layer being provided between the sensor substrate and the color separating lens array and configured to shape a spectral profile of the light incident on the sensor substrate by reflecting and/or absorbing portion of light passing through the color separating lens array.

Provided is an image sensor including a sensor substrate including a first photosensitive cell and a second photosensitive cell which are configured to sense light incident on the sensor substrate, a color separating lens array configured to change a phase of first wavelength light and a phase of second wavelength light such that the first wavelength light travels to the first photosensitive cell and the second wavelength light travels to the second photosensitive cell, and a spectrum shaping layer including a plurality of nanostructures respectively having a first refractive index, and a dielectric material provided between the plurality of nanostructures and having a second refractive index, the spectrum shaping layer being provided between the sensor substrate and the color separating lens array and configured to shape a spectral profile of the light incident on the sensor substrate by reflecting and/or absorbing portion of light passing through the color separating lens array.