This application discloses example optical filter arrays, including a first-type optical filter array and a second-type optical filter array, where the first-type optical filter array comprises spectral information of a first band range, the second-type optical filter array comprises spectral information of a second band range, and the spectral information of the second band range is different from the spectral information of the first band range. Alternatively, the spectral information of the second band range and the spectral information of the first band range overlap within a preset band range. Embodiments of this application further provide example mobile terminals, example intelligent vehicles, example monitoring devices, and example electronic devices.

The embodiments disclosed in the present document relate to an image sensor for detecting infrared multi-band light, and an electronic device using same. The image sensor according to the various embodiments of the present invention may comprise: a first filter configured to allow light in the infrared band to pass; a pixel array comprising a first pixel configured to be able to at least detect light of a first band which corresponds to part of the light in the infrared band that passed through the first filter, and a second pixel configured to be able to at least detect light of a second band which corresponds to another part of the light in the infrared band that passed through the first filter; and a second filter provided on top of the first pixel, for lowering electrical reactivity of the first pixel towards light in a band other than the first band.

A 3D information calculation apparatus includes processing circuitry that may receive first and second images of different first and second wavelength bands, respectively, at a same time and angle of view based on a subject being imaged while structured light of the first wavelength band is projected on to subject, receive third and fourth images of the first and second wavelength bands, respectively, at a same time and angle of view based on the subject being imaged while the structured light is not projected on the subject, calculate a first difference image of the first wavelength band based on subtracting the first and third images, calculate a second difference image of the second wavelength band based on subtracting the second and fourth images, calculate an extraction image based on subtracting the first and second difference images, and calculate a distance to the subject based on the extraction image.

A digital loupe system is provided which can include a number of features. In one embodiment, the digital loupe system can include a stereo camera pair and a distance sensor. The system can further include a processor configured to perform a transformation to image signals from the stereo camera pair based on a distance measurement from the distance sensor and from camera calibration information. In some examples, the system can use the depth information and the calibration information to correct for parallax between the cameras to provide a multi-channel image. Ergonomic head mounting systems are also provided. In some implementations, the head mounting systems can be configurable to support the weight of a digital loupe system, including placing one or two oculars in a line of sight with an eye of a user, while improving overall ergonomics, including peripheral vision, comfort, stability, and adjustability. Methods of use are also provided.

[Object] To make it possible to improve reading efficiency of pixel signals in a signal processing device in which rows of pixels having different pixel arrays are arranged at intervals of one line.

[Solution] Provided is a signal processing device, including: a pixel array unit configured to include first pixels, second pixels, third pixels, and fourth pixels which have different spectral sensitivity characteristics and are arranged in a matrix form; and a pixel signal reading unit configured to read pixel signals obtained from the plurality of pixels arranged in the pixel array unit. The first pixels are adjacent to the second pixels in a row direction and a column direction, the second pixels are arranged at a two-pixel pitch in the row direction and the column direction, the third pixels are adjacent to the second pixels in one diagonal direction, the fourth pixels are adjacent to the second pixels in the other diagonal direction, and the pixel signal reading unit adds and reads the pixel signals obtained from the plurality of first pixels.

The present disclosure relates to an image pickup apparatus, an image pickup method, a program, and an image processing apparatus that enable a color image to be generated on the basis of an infrared image and a visible image captured using an image pickup device that uses a focal plane reading system.

An image pickup apparatus according to the present disclosure includes: an image pickup device that generates, in a one frame period, sub-frame images in a number corresponding to 3 or more sub-frame periods; an infrared light irradiation unit that turns on/off irradiation of infrared light onto an image pickup range in a time length unit that is the same as the sub-frame period in the one frame period; and a color image generation unit that generates a color image in a predetermined frame rate on the basis of an infrared image based on the sub-frame image in which a period during which the infrared light is irradiated is included in an exposure time and a visible image based on the sub-frame image in which the period during which the infrared light is irradiated is not included in the exposure time. The present disclosure is applicable to a surveillance camera, for example.

A lens unit (120) shows longitudinal chromatic aberration and focuses an imaged scene into a first image for the infrared range in a first focal plane and into a second image for the visible range in a second focal plane. An optical element (150) manipulates the modulation transfer function assigned to the first and second images to extend the depth of field. An image processing unit (200) may amplify a modulation transfer function contrast in the first and second images. A focal shift between the focal planes may be compensated for. While in conventional approaches for RGBIR sensors contemporaneously providing both a conventional and an infrared image of the same scene the infrared image is severely out of focus, the present approach provides extended depth of field imaging to rectify the problem of out-of-focus blur for infrared radiation. An imaging system can be realized without any apochromatic lens.

According to the invention, an image sensor is disclosed. The image sensor may include a plurality of pixels. Each pixel of a first portion of the plurality of pixels may include a near-infrared filter configured to block red, green, and blue light; and pass near-infrared light. Each pixel of a second portion of the plurality of pixels may be configured to receive at least one of red, green, or blue light; and receive near-infrared light.

A pixel array includes octagon-shaped pixel sensors and a combination of visible light pixel sensors (e.g., red, green, and blue pixel sensors) and near infrared (NIR) pixel sensors. The color information obtained by the visible light pixel sensors and the luminance obtained by the NIR pixel sensors may be combined to increase the low-light performance of the pixel array, and to allow for low-light color images in low-light applications. The octagon-shaped pixel sensors may be interspersed in the pixel array with square-shaped pixel sensors to increase the utilization of space in the pixel array, and to allow for pixel sensors in the pixel array to be sized differently. The capability to accommodate different sizes of visible light pixel sensors and NIR pixel sensors permits the pixel array to be formed and/or configured to satisfy various performance parameters.

An imaging device includes a light splitting unit which splits first light from a subject into second light and third light, first and second imaging units, and an arithmetic unit. The first light includes the second light having infrared light and at least one of green light and blue light, and the third light having red light or the green light. The first imaging unit includes a first and a second light reception regions. The first light reception region generates at least one of the group consisting of a B signal according to the blue light and a G signal according to the green light. The second light reception region generates an IR signal according to the infrared light. The arithmetic unit generates a visible light image signal from the R signal, the G signal, and the B signal and generates an infrared light image signal from the IR signal.