A color and infrared image sensor includes a silicon substrate, MOS transistors formed in the substrate and on the substrate, first photodiodes at least partly formed in the substrate, a photosensitive layer covering the substrate, and color filters, the photosensitive layer being interposed between the substrate and the color filters. The image sensor further includes first and second electrodes on either side of the photosensitive layer and delimiting second photodiodes in the photosensitive layer, the first photodiodes being configured to absorb the electromagnetic waves of the visible spectrum and of a first portion of the infrared spectrum and the photosensitive layer being configured to absorb the electromagnetic waves of the visible spectrum and to give way to the electromagnetic waves of said first portion of the infrared spectrum.

Provided is an image sensor including a sensor substrate including a plurality of first pixels configured to sense first wavelength light in an infrared ray band and a plurality of second pixels configured to sense second wavelength light in a visible light band, and a color separating lens array disposed on the sensor substrate and configured to change a phase of the first wavelength light incident on the color separating lens array such that the first wavelength light is condensed to the plurality of first pixels, wherein the color separating lens array includes a plurality of light condensing regions configured to condense the first wavelength light respectively on the plurality of first pixels, and wherein an area of each of the plurality of light condensing regions is larger than an area of each of the plurality of first pixels.

An image processor according to the present disclosure includes: an image segmentation processing section to generate a plurality of first map data on the basis of first image map data including a plurality of pixel values, the plurality of first map data having arrangement patterns of pixel values different from each other and including pixel values located at positions different from each other; an interpolation processing section to generate a plurality of second map data by determining a pixel value at a position where no pixel value is present in each of the plurality of first map data with use of interpolation processing; and a synthesis processing section to generate third map data by generating, on the basis of pixel values at positions corresponding to each other in the plurality of second map data, a pixel value at a position corresponding to the positions.

An image capture device may include an image sensor comprising a first pixel cell and a second pixel cell adjacent to the first pixel cell, a plurality of individual alternative light filters configured to filter non-visible light, one individual alternative light filter of the plurality of individual alternative light filters covering both a first set of pixels of the first pixel cell and a second set of pixels of the second pixel cell, and a plurality of individual visible color filters covering pixels of the first and second pixel cells, the pixels of the first and second pixel cells covered by the individual visible light color filters being different from the first and second sets of pixels covered by the individual alternative light filters.

A method of performing better controlled switching between day mode and night mode imaging in a camera, where those illuminants contributing to the ambient light in day mode are considered when determining the visible light during night mode. Characteristic values of those illuminants are mixed with several levels of IR light to simulate the presence of an IR illuminator, and these characteristic values are compared to corresponding values derived from the color components of the ambient light in night mode in order to determine the IR proportion, and from that the amount of visible light.

A method of performing better controlled switching between day mode and night mode imaging in a camera, where those illuminants contributing to the ambient light in day mode are considered when determining the visible light during night mode. Characteristic values of those illuminants are mixed with several levels of IR light to simulate the presence of an IR illuminator, and these characteristic values are compared to corresponding values derived from the color components of the ambient light in night mode in order to determine the IR proportion, and from that the amount of visible light.

An apparatus includes an RGB-IR image sensor, a structured light projector, and a control circuit. The control circuit may be configured to control a shutter exposure time of the RGB-IR image sensor and a turn on time of the structured light projector to obtain a sequence of images captured by the RGB-IR image sensor, wherein the sequence of images comprises at least one image including a structured light pattern and at least one image where the structured light pattern is absent.

The present invention provides systems and methods for color tuning optical modules and executing color calibration methods on artificial reality systems and devices. Embodiments can include a lens with a colored coating, a plurality of cameras, including a visible spectrum camera and an infrared camera, each positioned behind the lens, and a processor and memory. The colored coating includes a plurality of regions for selectively transmitting light. The processor and memory can be configured to receive light information indicative of environmental information for executing an operation on the device, identify wavelengths of light reflected by the color profile in front of each camera, determine a color calibration to amplify wavelengths of reflected light, update the environmental information based on the color calibration, and execute the operation on the device.

The present invention provides systems and methods for color tuning optical modules and executing color calibration methods on artificial reality systems and devices. Embodiments can include a lens with a colored coating, a plurality of cameras, including a visible spectrum camera and an infrared camera, each positioned behind the lens, and a processor and memory. The colored coating includes a plurality of regions for selectively transmitting light. The processor and memory can be configured to receive light information indicative of environmental information for executing an operation on the device, identify wavelengths of light reflected by the color profile in front of each camera, determine a color calibration to amplify wavelengths of reflected light, update the environmental information based on the color calibration, and execute the operation on the device.

An imaging device may have an array of image pixels that includes red, green, blue, and infrared pixels. The imaging device may include a dual-band filter that allows transmission of light in the visible band and in the near-infrared band and may include color processing circuitry that produces a color image with marked infrared regions. The color processing circuitry may include a standard color processing pipeline with a color correction matrix that produces a tone-mapped standard red, green, and blue image and may include infrared marking circuitry. The infrared marking circuitry may include hue angle determination circuitry, cell means determination circuitry, and near-infrared determination circuitry that determine portions of the image with high infrared reflectance to be marked. The infrared-marked tone-mapped standard red, green, and blue image may be output to a machine vision system to identify objects in the imaged scene with high infrared reflection.