Provided are an image composition apparatus for composing color images with black-and-white images including infrared components, and an image composition method thereof. The image composition method includes generating a first image signal with color information and a second image signal including infrared components without color information, dividing the first image signal into a brightness signal and a color signal, composing the brightness signal of the first image signal with a brightness signal of the second image signal to generate a composed brightness signal, and composing the composed brightness signal with the color signal of the first image signal to generate a color image.

An apparatus and related methods for enhancing low dynamic range and high dynamic range digital images. The process converts single digital images into a form that can be shown on traditional electronic and computer displays and paper prints through luminance mapping and tone mapping functions. These functions require the calculation of values for each pixel within the digital image. The values calculated include, but are not limited to, color, grey-level, and luminance. The present apparatus and method builds upon the tone mapping process by combining log-average luminance values of various sized neighborhood tiles with the global log-average luminance of the entire image.

Conversion between different projection formats of a 360-degree video may be performed in a uniform way. The geometric characteristics of the different projection formats may be considered when applying 3D-to-2D and 2D-to-3D mapping. Parameters reflective of the geometric characteristics of the different projection formats may be determined and used in the mapping and/or conversion. The parameters may include a normal vector that is perpendicular to a projection plane, a reference point in the projection plane, and/or unit vectors defined in the projection plane. An architecture with consolidated modules for handling the various projection formats may be provided.

Conversion between different projection formats of a 360-degree video may be performed in a uniform way. The geometric characteristics of the different projection formats may be considered when applying 3D-to-2D and 2D-to-3D mapping. Parameters reflective of the geometric characteristics of the different projection formats may be determined and used in the mapping and/or conversion. The parameters may include a normal vector that is perpendicular to a projection plane, a reference point in the projection plane, and/or unit vectors defined in the projection plane. An architecture with consolidated modules for handling the various projection formats may be provided.

Processing raw image data in a camera includes computing a luminance image from the raw image data, and computing a chrominance image corresponding to at least one of the sensor's image colors from the raw image data. The luminance image and chrominance image(s) can represent the same range of colors able to be represented in the raw image data. The chrominance image can have a lower resolution than that of the luminance image. A camera for performing the method is also disclosed.

Processing raw image data in a camera includes computing a luminance image from the raw image data, and computing a chrominance image corresponding to at least one of the sensor's image colors from the raw image data. The luminance image and chrominance image(s) can represent the same range of colors able to be represented in the raw image data. The chrominance image can have a lower resolution than that of the luminance image. A camera for performing the method is also disclosed.

A method for local automatic white balance (AWB) of wide dynamic range (WDR) images is provided that includes collecting statistics for local AWB by an image signal processor (ISP) from a first WDR image generated by the ISP, receiving, by the ISP, a plurality of local gain lookup tables (LUTs), one for each color channel, wherein the plurality of local gain LUTs is generated using the statistics, and applying, by the ISP, a gain value to each pixel in a second WDR image generated by the ISP, wherein the gain value for the pixel is determined by the ISP using the local gain LUT for the color channel of the pixel.

A method for local automatic white balance (AWB) of wide dynamic range (WDR) images is provided that includes collecting statistics for local AWB by an image signal processor (ISP) from a first WDR image generated by the ISP, receiving, by the ISP, a plurality of local gain lookup tables (LUTs), one for each color channel, wherein the plurality of local gain LUTs is generated using the statistics, and applying, by the ISP, a gain value to each pixel in a second WDR image generated by the ISP, wherein the gain value for the pixel is determined by the ISP using the local gain LUT for the color channel of the pixel.

An image capturing method, a camera assembly, and a mobile terminal are provided. An image sensor includes a two-dimensional (2D) pixel array. The 2D pixel array includes multiple panchromatic pixels and multiple color pixels. The 2D pixel array includes minimum repeating units. Each minimal repeating unit includes multiple sub-units. Each sub-unit includes multiple monochromatic pixels and multiple panchromatic pixels. The image capturing method includes the following. The 2D pixel array is exposed to obtain a panchromatic original image and a color original image. The color original image is processed to obtain a color intermediate image. The panchromatic original image is processed to obtain a panchromatic intermediate image. The color intermediate image and/or the panchromatic intermediate image are processed to obtain a target image.

An image capturing method, a camera assembly, and a mobile terminal are provided. An image sensor includes a two-dimensional (2D) pixel array. The 2D pixel array includes multiple panchromatic pixels and multiple color pixels. The 2D pixel array includes minimum repeating units. Each minimal repeating unit includes multiple sub-units. Each sub-unit includes multiple monochromatic pixels and multiple panchromatic pixels. The image capturing method includes the following. The 2D pixel array is exposed to obtain a panchromatic original image and a color original image. The color original image is processed to obtain a color intermediate image. The panchromatic original image is processed to obtain a panchromatic intermediate image. The color intermediate image and/or the panchromatic intermediate image are processed to obtain a target image.