The present invention provides a full-color three-dimensional optical sectioning microscopic imaging system and method based on structured illumination, includes an illumination source, a dichroic prism positioned at the illumination optical path, a structured light generator positioned at the reflected optical path of the dichroic prism, a lens positioned at the transmitted optical path of the dichroic prism, a beam splitter positioned at the optical path of the lens, an objective lens and a sample stage positioned at the upper optical path of the beam splitter, a reflector mirror and a tube lens positioned at the lower optical path of the beam splitter and a CCD camera positioned behind the tube lens. The illumination source is an incoherent monochrome LED or a white light LED The structured light generator is a DMD (Digital Micro-mirror Device).

Provided is an image sensor including a pixel array which provides a plurality of pixels arranged in rows and columns. The plurality of pixels include: a plurality of image sensing pixels each including a plurality of image sensing sub pixels that include the same color filter; and a plurality of phase detection pixels each including at least one phase detection sub pixel which generates a phase signal for calculating a phase difference between images, wherein the plurality of image sensing sub pixels included in the same image sensing pixel are connected to one selection signal line and receive the same selection signal.

An image sensor includes a sensing layer for sensing a light beam and a number of pixel groups. Each of the pixel groups includes a yellow filter unit allowing a green light component and a red light component of the light beam to pass through, a green filter unit allowing the green light component of the light beam to pass through, and a blue filter unit allowing a blue light component of the light beam to pass through.

Provided are an image sensor and an image capturing apparatus including the image sensor. The image sensor includes a pixel array including: multiple sensing pixels outputting image signals respectively corresponding to intensities of incident light; and at least one pair of focusing pixels that are adjacent each other, and each outputting a phase difference of the incident light as a focusing signal; wherein each focusing pixel includes: a semiconductor layer including a photodetecting device accumulating electric charges generated according to absorbed light from among the incident light; a wiring layer formed on a first surface of the semiconductor layer and including wirings; a planarization layer having a first surface on a second surface of the semiconductor layer; a shielding layer formed in the planarization layer to block some of the incident light to be incident to the photodetecting device; and a color filter layer and a micro lens layer.

Provided is an image sensor including a sensor substrate including a first pixel configured to sense light of a first wavelength, and a second pixel configured to sense light of a second wavelength, and a color separating lens array configured to concentrate the light of the first wavelength on the first pixel, and the light of the second wavelength on the second pixel, the color separating lens array including a first pixel-corresponding area corresponding to the first pixel, and a second pixel-corresponding area corresponding to the second pixel, wherein a first phase difference between the light of the first wavelength that has traveled through a center of the first pixel-corresponding area and a center of the second pixel-corresponding area is different than a second phase difference between the light of the second wavelength that has traveled through the center of the first pixel-corresponding area and the center of the second pixel-corresponding area.

Provided is an image sensor including a sensor substrate including a first pixel configured to sense light of a first wavelength, and a second pixel configured to sense light of a second wavelength, and a color separating lens array configured to concentrate the light of the first wavelength on the first pixel, and the light of the second wavelength on the second pixel, the color separating lens array including a first pixel-corresponding area corresponding to the first pixel, and a second pixel-corresponding area corresponding to the second pixel, wherein a first phase difference between the light of the first wavelength that has traveled through a center of the first pixel-corresponding area and a center of the second pixel-corresponding area is different than a second phase difference between the light of the second wavelength that has traveled through the center of the first pixel-corresponding area and the center of the second pixel-corresponding area.

The present disclosure relates to a signal processing device, a signal processing method, and a signal processing program which can more accurately perform color reproduction to an image captured by using visible light and infrared light. A plurality of pixel signals, output by a color-difference sequential system from an image sensor on which light having passed through a color filter array including a plurality of complementary color filters is incident, are acquired. With respect to the plurality of pixel signals, a parameter to eliminate a term corresponding to a predetermined infrared wavelength in an equation to calculate a color-difference signal from the plurality of pixel signals, is set using the plurality of pixel signals. Thereafter, a luminance signal obtained by performing an addition process of the plurality of pixel signals and a color-difference signal obtained by performing a subtraction process between the plurality of pixel signals are calculated using the parameter.

An image sensor according to some example embodiments includes a pixel array unit including a plurality of transmission signal lines and a plurality of output signal lines, and a plurality of pixels connected to the plurality of transmission signal lines and the plurality of output signal lines. Each of the plurality of pixels includes a plurality of photoelectric conversion elements, which are configured to detect and photoelectrically convert incident light. The plurality of pixels include at least one autofocusing pixel and at least one normal pixel.

An image sensor and an image pick-up apparatus including the same are provided. The image sensor includes a plurality of phase difference detection pixels and a plurality of image detection pixels arranged in a lattice pattern together with the phase difference detection pixels, wherein the phase difference detection pixels are arranged at an interval of a predetermined number of pixels in the lattice pattern, and the predetermined number of pixels has a maximum value of 16. In a phase difference detection type auto focus (AF) system, focus accuracy is improved without deterioration of image quality.

The present invention provides an image processing device, an imaging device, an image processing method, and a program which are capable of accurately correcting blurring caused in first image data of an image using a near-infrared ray as a light source and, accurately performing a point image restoration process on second image data of an image using visible light and a near-infrared ray as a light source. An image processing device according to an aspect of the present invention includes an image input unit, a determination unit that determines whether image data is first image data or second image data, a first restoration processing unit that performs a first restoration process using first restoration filters for performing phase correction and amplitude restoration on the determined first image data, and a second restoration processing unit that performs a second restoration process using second restoration filters for performing amplitude restoration without phase correction on the determined second image data.