A pixel array including; color filter array (CFA) cells, each respectively including CFA blocks, each CFA block including color pixels, and the color pixels include a sub-block. The sub-block includes at least one first color pixel sensing a first color, at least one second color pixel sensing a second color different from the first color, and at least one third color pixel sensing a third color different from the first color and the second color.

An apparatus comprises a generating unit configured to generate a plurality of pieces of RAW data for respective exposure times from RAW data obtained from a sensor that can perform shooting at an exposure time that is different for each pixel, and an encoding unit configured to encode the generated plurality of pieces of RAW data.

A method for converting an image format applied to an RGB-IR image sensor includes: (Step 1) acquiring an RGB-IR image in digital form; (Step 2) selecting a pixel of the RGB-IR image as a center pixel and selecting a pixel unit with the center pixel at the center; (Step 3) interpolating the center pixel to obtain missing color components of the center pixel; (Step 4) repeating blocks (S2) and (S3) for interpolating each pixel of the RGB-IR image to obtain the missing color component of each pixel; and (Step 5) outputting an image after the interpolation process.

A color compensation method includes obtaining a target brightness, a target frame rate and a target pulse number; selecting a plurality of second gamma groups from a plurality of first gamma groups according to the target brightness and the target pulse number, wherein the plurality of first gamma groups respectively correspond to a plurality of frame rates; and calculating the compensation value to compensate the display brightness and color according to the target brightness, the target frame rate, the plurality of second gamma groups and a calculation method.

There is provided in one embodiment an apparatus having an image sensor array. In one embodiment, the image sensor array can include monochrome pixels and color sensitive pixels. The monochrome pixels can be pixels without wavelength selective color filter elements. The color sensitive pixels can include wavelength selective color filter elements.

The method comprises a step of processing pixel values provided at the output of an image sensor comprising a two-dimensional array of pixels including a mix of IR pixels and color pixels. The step of processing includes, for each color pixel, determining a local color-related ratio indicative of a part of infrared light reception in the color pixel, and estimating an infrared portion value from a color pixel value based on the local color-related ratio. The method further includes generating an infrared image from pixel values from the IR pixels and the estimated infrared portion values from the color pixels.

A method of calibrating an image sensor including a color filter array having a first-type array pattern, the method includes capturing a target using the image sensor to generate first image data, performing a white balance operation on the first image data to generate second image data, performing an inverse white balance operation on the second image data based on a second-type array pattern to generate third image data, the second-type array pattern being different from the first-type array pattern, and calibrating the image sensor based on the third image data.

An image processing device includes: an image sensor configured to generate first image data by using a color filter array; and processing circuitry configured to select a processing mode from a plurality of processing modes for the first image data, the selecting being based on information about the first image data; generate second image data by reconstructing the first image data using a neural network processor based on the processing mode; and generate third image data by post-processing the second image data apart from the neural network processor based on the processing mode.

Apparatuses, systems, and techniques to receive, at one or more processor associated with an image signal processing (ISP) pipeline, a compressed image generated by an image sensor, wherein the compressed image is captured at a first bit-depth associated with the image sensor and is compressed to a second bit-depth that is lower than the first bit-depth, and wherein the ISP is associated with a third bit-depth that is lower than the first bit-depth and higher than the second bit-depth; and decompress the compressed image according to a power curve to generate a partially decompressed image having the third bit-depth, wherein a plurality of regions of the partially decompressed image are decompressed at separate decompression amounts based on a corresponding pixel value of each region of the plurality of regions.

An imaging device includes a pixel array with first and second pixels respectively having first and second conversion gains connected to row and column lines; a row driver determining a selection row line among the row lines; a readout circuit obtaining first and second pixel signals from first and second pixels connected to the selection row line; a column driver generating first and second image data from the first and second pixel signals; and an image signal processor using the first and second image data to generate an object image. The second pixels include an expansion capacitor connected between a floating diffusion node and a ground node. Exposure time of the first pixels is equal to or longer than exposure time of the second pixels. An area of a light receiving region of the first pixels is equal to an area of a light receiving region of the second pixels.