Mobile terminal and image photographing method are provided. The mobile terminal includes first camera module and second camera module. First pixel array corresponding to first image sensor of the first camera module includes preset quantity of first pixel units arranged in first predetermined manner, and the first pixel unit includes first and second pixels. Second pixel array corresponding to the second image sensor includes preset quantity of second pixel units arranged in second predetermined manner, and the second pixel unit includes first pixel. The first pixel includes red, green, and blue subpixels. The second pixel includes the green subpixel and infrared subpixel, and at least one of the red subpixel and the blue subpixel. The first pixel and the second pixel are full-pixel dual-core focus pixels, and each of the first pixel and the second pixel includes four full-pixel dual-core focus subpixels.

The method for processing a matrix of pixels each containing an original red, green, blue, or infrared component, comprises at least one interpolation of an interpolated component different from the original component of a pixel of interest from the components of a group of pixels neighboring the pixel of interest. The interpolation comprises: a calculation of the sum of the components of reference pixels weighted by a respectively assigned weight, the reference pixels being pixels of the group having the same original component as the interpolated component, an evaluation of the spatial uniformity of an environment, within the group of each reference pixel, a calculation of the weights assigned to the reference pixels at values which are normalized and proportional to the respective spatial uniformity.

The method for processing a matrix of pixels each containing an original red, green, blue, or infrared component, comprises at least one interpolation of an interpolated component different from the original component of a pixel of interest from the components of a group of pixels neighboring the pixel of interest. The interpolation comprises: a calculation of the sum of the components of reference pixels weighted by a respectively assigned weight, the reference pixels being pixels of the group having the same original component as the interpolated component, an evaluation of the spatial uniformity of an environment, within the group of each reference pixel, a calculation of the weights assigned to the reference pixels at values which are normalized and proportional to the respective spatial uniformity.

Provided is an image acquisition apparatus including an image sensor configured to obtain an image, and a processor configured to obtain a basis based on a surrounding environment of the image acquisition apparatus, estimate illumination information based on the obtained basis, and perform color conversion on the image based on the estimated illumination information.

A dual sensor imaging system and a depth map calculation method thereof are provided. The dual sensor imaging system includes at least one color sensor, at least one infrared ray (IR) sensor, a storage device, and a processor. The processor is configured to load and execute a computer program stored in the storage device to: control the color sensor and the IR sensor to respectively capture multiple color images and multiple IR images by adopting multiple exposure conditions suitable for an imaging scene, adaptively select a combination of the color image and the IR image that are comparable to each other from the color images and the IR images; and calculate a depth map of the imaging scene by using the selected color image and IR image.

A pixel for an image sensor includes a microbolometer sensor portion, a visible image sensor portion and an output path. The microbolometer sensor portion outputs a signal corresponding to an infrared (IR) image sensed by the microbolometer sensor portion. The visible image sensor portion outputs a signal corresponding to a visible image sensed by the visible image sensor portion. The output path is shared by the microbolometer and the visible image sensor portions, and is controlled to selectively output the signal corresponding to the IR image or the signal corresponding to the visible image. The output path may be further shared with a visible image sensor portion of an additional pixel, in which case the output path may be controlled to selectively to also output the signal corresponding to a visible image of the additional pixel.

A color filter array includes a plurality of pixel filters arranged in a predetermined pattern composed of 2×2 pixel filters including two infrared filters and two visible filters. The two infrared filters in the predetermined pattern are disposed along one diagonal, and the two visible filters in the predetermined pattern are disposed along another diagonal.

Imaging systems, cameras, and image sensors of this disclosure include imaging pixels that include subpixels. Diffractive optical elements such as a metasurface lens layers or a liquid crystal polarization hologram (LCPH) are configured to focus image light to the subpixels of the imaging pixels.

An imaging device includes a pixel array including a 4x4 grouping of pixel circuits. The 4x4 grouping of pixel circuits includes four rows and four columns of the pixel array. A plurality of bitlines includes a first bitline, a second bitline, a third bitline, and a fourth bitline. Each one of the first, second, third, and fourth bitlines is coupled to a respective four pixel circuits in the 4x4 grouping of pixel circuits. Each one of the first, second, third, and fourth bitlines is coupled to all four of the rows and to all four of the columns of the 4x4 grouping of pixel circuits.

An image generation device acquires first received light data and second received light data from an image sensor. The image sensor receives invisible light and visible light separately through a filter. The first received light data indicates the received light result of the invisible light. The second received light data indicates the received light result of the visible light. In addition, the image generation device generates an image by performing demosaicing for at least one of the first received light data and the second received light data based on illuminance information. The illuminance information indicates the illuminance of the surrounding environment of the image sensor. When the illuminance is less than a first threshold value, the image generation device generates an invisible light image by performing first demosaicing for the first received light data without performing second demosaicing for the second received light data.