One embodiment according to the technology of the present disclosure provides an optical element, an optical device, and an imaging apparatus, which can acquire a multispectral image having a good image quality. An optical element according to one aspect of the present invention includes: a frame having a plurality of aperture regions; and a plurality of optical filters that are mounted in the plurality of aperture regions, the plurality of optical filters including at least two types of filters having different wavelength ranges of transmitted light, and centroids of at least two types of aperture regions coincide with each other.

The invention relates to an image capturing device (1) comprising an image sensor (9) making it possible to obtain both an infrared image (31) and an image in the visible range (35) by means of an array of elementary optical filters comprising first optical filters, which are at least partially transmissive in the infrared range, and second optical filters which are at least partially transmissive in the visible range. The image capturing device comprises a calculator (12) which is programmed to control the image sensor to perform two shots, one being exposed according to an ambient brightness in the infrared range for obtaining the first image and the other being exposed as a function of an ambicin brightness in the visible range for obtaining the second image. The invention also relates to a system for monitoring a driver (3), comprising such an image capturing device.

Provided is an image processing device including an acquisition unit configured to acquire a first image data that is captured based on visible light and a second image data that is captured based on infrared light, a composition coefficient calculating unit configured to calculate a composition coefficient based on the second image data and a third image data including a luminance information that is extracted from the first image data, and a composition unit configured to calculate a fourth image data by a weighted addition of the second image data and the luminance information by using the composition coefficient.

A solid-state imaging element includes a pixel section including a plurality of pixels that are arranged in a matrix and to perform photoelectric conversion, and circuitry to perform reading control on pixels in the pixel section, such that reading control is not performed on at least one pixel included in the pixel section.

Provided is a camera capable of accurately calculating a foreground image. An infrared camera includes: a first detection unit including a plurality of first detection elements configured to detect an electromagnetic wave having a first wavelength range; a second detection unit including a plurality of second detection elements capable of detecting an electromagnetic wave emitted from an inside of a housing, wherein the electromagnetic wave having at least one of wavelengths within a second wavelength range; a first transparent member disposed to correspond to the second detection elements is transparent for the second wavelength range; a second transparent member transparent for a third wavelength range from an outside to the inside of the housing; and the first wavelength range including at least one wavelength overlapping a wavelength within the third wavelength range, and the second wavelength range not overlapping the third wavelength range.

Techniques are provided for infrared (IR) crosstalk correction for hybrid Red-Green-Blue-IR (RGB-IR) sensors. A methodology implementing the techniques according to an embodiment includes estimating illumination characteristics applied to a subject. The estimation is based on the subject image provided by a hybrid RGB-IR sensor, which comprises a plurality of pixels, each of the pixels associated with an R, G, B, or IR channel. The method further includes selecting a set of correction model parameters from a calibration database, the selection based on the estimated illumination characteristics, and generating a correction model based on the selected set of correction model parameters. The correction model provides correction weights for the RGB channels. The method further includes generating RGB correction values as a product of the correction weights and the IR channel and adjusting the RGB channels by the correction values to reduce IR crosstalk between the IR channel and the RGB channels.

The present technology relates to solid-state imaging apparatuses and electronic equipment, each of which is capable of contributing to an increased sense of resolution at an outer peripheral portion of an image photographed by using a wide-angle lens. The solid-state imaging apparatus includes a pixel array section in which a plurality of pixels is arranged such that a pixel pitch becomes smaller at a greater distance away from a central portion toward an outer peripheral portion. The present technology is applicable to, for example, solid-state imaging apparatuses and the like suited for photographing by using a wide-angle lens such as a fisheye lens used in a 360-degree panoramic camera.

Provided is a photoelectric conversion device including: a photoelectric conversion unit including one microlens and a plurality of photoelectric conversion elements, a readout circuit unit configured to read out a first signal based on charges accumulated by a first photoelectric conversion element of the plurality of photoelectric conversion elements and a second signal based on charges accumulated by a second photoelectric conversion element of the plurality of photoelectric conversion elements, and a signal processing unit configured to, according to a determination result based on at least one of the first signal and the second signal, output a third signal obtained by adding the first signal and the second signal or output a fourth signal by replacing the third signal with the fourth signal different from the third signal.

Provided are image pickup apparatuses capable of measuring a distance in a wide range speedily and accurately, and control methods for the same. In an image pickup apparatus, an image pickup device and a light source are separately disposed in the optical paths branched by a partial reflecting mirror, and the distance from a subject to the image pickup device is calculated using a signal output by the image pickup device. In another image pickup apparatus, an image pickup device includes a light receiver and a light source, and the distance is calculated by a TOF method using a signal output by the light receiver. In another image pickup apparatus, the distance is calculated by a TOF method using a signal output by an image pickup device, and light emission of a light source is controlled on the basis of light emission conditions determined according to image pickup conditions.

An image processing method includes obtaining a plurality of frames of raw images. After preprocessing such as image alignment, channel splitting or pixel rearrangement is performed on the obtained plurality of frames of raw images, detail restoration is performed on an image based on a deep learning network, and luminance enhancement and color enhancement are performed on an image output by the deep learning network. A plurality of types of processing related to detail restoration are integrated into a same deep learning network.