An image processing apparatus has: a WB processing circuit that performs a plurality of kinds of WB processing for an input image that is undeveloped and captured by an image capturing element in which pixels of a plurality of colors are arranged in a mosaic pattern under a predetermined rule; filter circuits that perform color interpolation processing by referring to the input image and a signal subjected to WB processing and generate images of respective color signals whose color ratio is equivalent to that of the input image; and resizing circuits that resize the generated images.

Techniques are provided for color correction of image frames, received from a hybrid RGBIR sensor, using resolution recovery of the red, green, blue (RGB), and infra-red (IR) channels. The color correction is to compensate for IR contamination of the RGB channels. A methodology implementing the techniques according to an embodiment includes a demosaic operation on the RGBIR image frame to generate full resolution red, green, blue, and IR frames. The demosaic operation includes filtering to extract Chroma and Luma components of the RGBIR image to reconstruct the full resolution images. The method also includes calculating an IR weighting factor for the pixels of each of the full resolution RGB frames, and correcting for IR contamination of those pixels by subtracting a scaled value of the corresponding pixels from the full resolution IR frame. The scaled value is based on the IR weighting factor associated with the pixel to be corrected.

A device (e.g., an image sensor, camera, etc.) may identify a camera lens and color filter array (CFA) sensor used to capture an image, and may determine filter parameters (e.g., a convolutional operator) based on the identified camera lens and CFA sensor. For example, a set of kernels (e.g., including a set of horizontal filters and a set of vertical filters) may be determined based on properties of a given lens and/or q-channel CFA sensor. Each kernel or filter may correspond to a row of a convolutional operator (e.g., of a restoration bit matrix) used by an image signal processor (ISP) of the device for non-linear filtering of the captured image. The corresponding outputs from the horizontal and vertical filters (e.g., two outputs of the horizontal and vertical filters corresponding to an input channel associated with the CFA sensor) may then be combined using a non-linear classification operation.

A Bayer-mask image is decoded by forming a decoded green array; calculating a slope at each pixel of the array, expressed as an angle; calculating an activity at each pixel; converting the slope angle and the activity into a complex number for each pixel, of modulus equal to the activity and argument equal to twice the slope angle; expressing said complex numbers in Cartesian coordinates to form a Cartesian slope signal and filtering the Cartesian slope signal with a linear spatial filter to derive a slope measure. Blue-green and red-green values are calculated and interpolated using a slope-adaptive interpolation filter steered by said slope measure.

An image processing apparatus includes a separation unit, a Bayer image signal supply unit, and a signal processing unit. The separation unit separates and removes, in input image signals in which pixel signals each including an invisible light component are arranged in an array different from a Bayer array, the invisible light components from the pixel signals. The Bayer image signal supply unit arranges the pixel signals from which the invisible light components have been removed in the Bayer array and supplies the pixel signals as Bayer image signals. The signal processing unit subjects the Bayer image signals to predetermined signal processing.

A color temperature of each of a first sensed image that is sensed by a first image sensing device and a second sensed image that is sensed by a second image sensing device different from the first image sensing device is acquired, a color temperature that is common between the first image sensing device and the second image sensing device is decided based on the acquired color temperatures, and color information in an image sensed by the first image sensing device and an image sensed by the second image sensing device is adjusted based on the decided color temperature.

An image processing apparatus includes: an acquisition unit configured to obtain image data generated by an image sensor forming an array pattern using color filters having mutually different spectral transmittances and to obtain a correction coefficient for correcting a difference between pixel values corresponding to a difference between a spectral sensitivity and a preset reference spectral sensitivity in a wavelength range in a pixel-of-interest; a correction amount calculation unit configured to calculate an estimation value of a color component in the pixel-of-interest using a pixel value of each of pixels in surrounding pixels of a same color and the correction coefficient and configured to calculate a correction amount of the pixel value of the pixel-of-interest based on the estimation value and the correction coefficient of the pixel-of-interest; and a pixel value correction unit configured to correct the pixel value of the pixel-of-interest based on the calculated correction amount.

Aspects of the present disclosure relate to systems and methods for selectively processing tiles of a captured image. The captured image may be parsed into a plurality of tiles. A subset of the plurality of tiles may be selected based at least in part on at least one metric. The selected tiles may be processed according to a first technique, while each unselected tile may be selectively processed according to one or more techniques different from the first technique. The first technique and the one or more techniques may each be either an image demosaicing technique or an image denoising technique.

A method of de-mosaicing pixel data from an image processor includes generating a pixel block that includes a plurality of image pixels. The method also includes determining a first image gradient between a first set of pixels of the pixel block and a second image gradient between a second set of pixels of the pixel block. The method also includes determining a first adaptive threshold value based on intensity of a third set of pixels of the pixel block. The pixels of the third set of pixels are adjacent to one another. The method also includes filtering the pixel block in a vertical, horizontal, or neutral direction based on the first and second image gradients and the first adaptive threshold value utilizing a plurality of FIR filters to generate a plurality of component images.

A system for acquiring images in color and near-infrared, comprising: a matrix sensor, which comprises first, second, and third types of pixels sensitive to respective visible colors and a fourth type of panchromatic pixels sensitive in the near-infrared; and a signal processing circuit configured to reconstruct first and second sets of monochromatic images, a panchromatic image, a color image from the images of the first set and from the panchromatic image, and at least one image in the near-infrared from the images of the second set and from the panchromatic image. A visible-near-infrared bispectral camera comprises such an acquisition system and method implemented by means of such a camera.