A first light beam can be collected by using an optical module. A second light beam can be obtained based on the first light beam. An image sensor can perform photoelectric conversion on the infrared light beam that is in the second light beam and that is irradiated to the first channel to obtain a first electrical signal. Photoelectric conversion can be performed on the visible light beam that is in the second light beam and that is irradiated to the second channel to obtain a second electrical signal. An initial image can be generated based on the first electrical signal and the second electrical signal. A color image and a grayscale image can be sent to an image processor. The image processor can receive the color image and the grayscale image. Fusion processing can be performed on the color image and the grayscale image to obtain a fused image.

An object of the present disclosure is to provide a solid-state imaging device capable of suppressing deterioration of image quality. The solid-state imaging device includes: a first pixel that has a plurality of photoelectric conversion units sharing a first color filter with each other and a plurality of on-chip lenses; a second pixel that is arranged adjacent to the first pixel and has a plurality of photoelectric conversion units sharing a second color filter with each other and a plurality of on-chip lenses; and a first light shielding region that is provided between the first pixel and the second pixel.

Object detection is performed for an image acquired by imaging using an array sensor in which a plurality of imaging elements are arranged one-dimensionally or two-dimensionally, some of the imaging elements are configured as color-filter-disposed pixels in which a color filter is disposed in an incident optical path, and color information acquisition points are formed by the color-filter-disposed pixels. Then, coloring processing in a pixel range of a detected object is performed by referring to color information acquired at the color information acquisition points corresponding to the inside of the pixel range of the detected object.

A method includes capturing, by a camera disposed behind a display panel of an electronic device, an original image through a semi-transparent pixel region of the display panel. The original image includes one or more color components. The method further includes determining, for a plurality of pixel regions of the original image, a point spread function (PSF) for each of the one or more color components. The method further includes performing, for the plurality of pixel regions of the original image, a deconvolution of each of the one or more color components of the original image based at least in part on their respective PSFs. The method thus includes generating a reconstructed image corresponding to the original image based on the deconvolutions of the one or more color components of the plurality of pixel regions of the original image.

The present disclosure discloses an image sensor, an imaging device, a mobile terminal and an imaging method. The image sensor comprises a photosensitive pixel array and a filer arranged on the photosensitive pixel array. The filter comprises a filer unit array comprised a plurality of filter units, wherein each filter unit covers N photosensitive pixels, and some of the filter units comprise white filter areas. The white filter areas cover at least one of the N photosensitive pixels of the N photosensitive pixels, wherein a merged pixel is formed by the N photosensitive pixels covered by the same filter unit, wherein N is a positive integer.

A lens unit (120) shows longitudinal chromatic aberration and focuses an imaged scene into a first image for the infrared range in a first focal plane and into a second image for the visible range in a second focal plane. An optical element (150) manipulates the modulation transfer function assigned to the first and second images to extend the depth of field. An image processing unit (200) may amplify a modulation transfer function contrast in the first and second images. A focal shift between the focal planes may be compensated for. While in conventional approaches for RGBIR sensors contemporaneously providing both a conventional and an infrared image of the same scene the infrared image is severely out of focus, the present approach provides extended depth of field imaging to rectify the problem of out-of-focus blur for infrared radiation. An imaging system can be realized without any apochromatic lens.

The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments with luminance and chrominance emitted from a controlled light source.

An imaging unit 20 has a configuration in which an identical polarization pixel block made up of a plurality of pixels with an identical polarization direction is provided for each of a plurality of polarization directions and pixels of respective predetermined colors are provided in the identical polarization pixel block. A correction processing unit 31 performs correction processing such as white balance correction on a polarized image generated by the imaging unit 20. A polarized image processing unit 32 separates or extracts a reflection component using the polarized image after the correction processing. By using a polarized image of the separated or extracted reflection component, for example, it is possible to generate normal line information with high accuracy.

An image processing apparatus is configured to: acquire a correction factor from a recording unit for recording, for each of a plurality of pixels, the correction factor for correcting a difference in pixel value corresponding to a difference between a spectral sensitivity and a preset reference spectral sensitivity in a predetermined wavelength range at a pixel of interest, based on image data generated by an image sensor, the image sensor having the plurality of pixels on which color filters of a plurality of colors with different spectral transmittances are respectively located, the color filters forming a predetermined array pattern; calculate a correction amount for correcting a pixel value of the pixel of interest based on the correction factor at the pixel of interest and pixel values of pixels surrounding the pixel of interest; and correct the pixel value of the pixel of interest by using the correction amount.

A system for obtaining color imagery using SPADs includes a SPAD array that has a plurality of SPAD pixels. Each of the plurality of SPAD pixels includes a respective color filter positioned thereover. The system is configurable to capture an image frame using the SPAD array and generate a filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to, after performing the temporal filtering operation, generate a color image by demosaicing the filtered image.