DUAL-MODE IMAGE SENSOR AND COLOR FILTER ARRAY THEREOF

Abstract

A color filter array includes a plurality of pixel filters arranged in a predetermined pattern composed of 2×2 pixel filters including two infrared filters and two visible filters. The two infrared filters in the predetermined pattern are disposed along one diagonal, and the two visible filters in the predetermined pattern are disposed along another diagonal.

Claims

1. A color filter array, comprising: a plurality of pixel filters arranged in a predetermined pattern composed of 2×2 pixel filters including two infrared filters and two visible filters; wherein the two infrared filters in the predetermined pattern are disposed along one diagonal, and the two visible filters in the predetermined pattern are disposed along another diagonal.

2. The color filter array of claim 1, wherein the two visible filters in the predetermined pattern comprise two white filters or transparent filters.

3. The color filter array of claim 1, wherein the two visible filters in the predetermined pattern comprise two same color filters that are either red filters, green filters or blue filters.

4. The color filter array of claim 3, wherein color filters of the entire color filter array are half green, one quarter red and one quarter blue, and are arranged with Bayer arrangement.

5. A dual-mode image sensor, comprising: a plurality of pixel sensors; and a plurality of pixel filters that are correspondingly aligned with the plurality of pixel sensors, the plurality of pixel filters being arranged in a predetermined pattern composed of 2×2 pixel filters including two infrared filters and two visible filters, the two infrared filters in the predetermined pattern being disposed along one diagonal and the two visible filters in the predetermined pattern being disposed along another diagonal; wherein infrared signals from pixel sensors corresponding to the infrared filters and visible signals from pixel sensors corresponding to the white filters are read out separately.

6. The dual-mode image sensor of claim 5, wherein the infrared signals from the pixel sensors corresponding to the two infrared filters within the predetermined pattern are combined to result in a combined infrared signal within the pattern, and combined infrared signals of all the plurality of pixel sensors constitute an infrared image.

7. The dual-mode image sensor of claim 6, wherein the visible signals from the pixel sensors corresponding to the two visible filters within the predetermined pattern are combined to result in a combined visible signal within the pattern, and combined visible signals of all the plurality of pixel sensors constitute a visible image.

8. The dual-mode image sensor of claim 7, wherein the infrared image is used for biometric recognition capable of identifying individuals by human characteristics, and the visible image is used for surveillance capable of monitoring behavior or activities for purpose of information gathering.

9. The dual-mode image sensor of claim 5, wherein the two visible filters in the predetermined pattern comprise two white filters or transparent filters.

10. The dual-mode image sensor of claim 5, wherein the two visible filters in the predetermined pattern comprise two same color filters that are either red filters, green filters or blue filters.

11. The dual-mode image sensor of claim 10, wherein color filters of all the plurality of pixel filters are half green, one quarter red and one quarter blue, and are arranged with Bayer arrangement.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0010] FIG. 1A shows a perspective view of a color filter array (CFA) disposed on an image sensor according to a first embodiment of the present invention;

[0011] FIG. 1B shows a top view of the CFA of FIG. 1A;

[0012] FIG. 1C shows a schematic curve of transmission versus wavelength of a lens with dual band filtering adaptable to the CFA of FIG. 1A;

[0013] FIG. 2 schematically shows a method of reading out signals from the image sensor of FIG. 1A;

[0014] FIG. 3A shows a perspective view of a color filter array (CFA) disposed on an image sensor according to a second embodiment of the present invention;

[0015] FIG. 3B shows a top view of the CFA of FIG. 3A;

[0016] FIG. 3C shows schematic curves of transmission versus wavelength of a red filter, a green filter and a blue filter, respectively;

[0017] FIG. 3D shows a schematic curve of transmission versus wavelength of a lens with dual band filtering adaptable to the CFA of FIG. 3A; and

[0018] FIG. 4 schematically shows a method of reading out signals from the image sensor of FIG. 3A.

DETAILED DESCRIPTION OF THE INVENTION

[0019] FIG. 1A shows a perspective view of a color filter array (CFA) 100 disposed on an image sensor 102 according to a first embodiment of the present invention. Specifically, the image sensor 102, for example, a complementary metal-oxide-semiconductor (CMOS) image sensor or CIS, may include a plurality of pixel sensors (or photo sensors) 12. The CFA 100 of the embodiment may include a plurality of pixel filters (or filters for short) 11 that are correspondingly aligned with the pixel sensors 12. For better viewing, only partial pixel filters 11 are depicted.

[0020] FIG. 1B shows a top view of the CFA 100 of FIG. 1A. Specifically, the pixel filters 11 of the CFA 100 are arranged in a predetermined (repetitive) pattern composed of 2×2 pixel filters 11 including two infrared (IR) filters and two visible (light) filters. In the embodiment, the two visible filters are white (or transparent) filters (W). Particularly, the two IR filters are disposed along one diagonal and the two white filters are disposed along another diagonal. FIG. 1C shows a schematic curve of transmission versus wavelength of a lens (not shown) with dual band filtering adaptable to the CFA 100 of FIG. 1A. It is noted that the IR light band in FIG. 1C may be 800-860 nm, and the transmission peak may be 840 nm. Actually, the curve of FIG. 1C depends on the material or coating.

[0021] FIG. 2 schematically shows a method of reading out signals from the image sensor 102 of FIG. 1A. In the embodiment, IR signals from the pixel sensors 12 corresponding to the IR filters and visible signals (specifically white signals in this embodiment) from the pixel sensors 12 corresponding to the white filters are read out separately.

[0022] Specifically, the IR signals from the pixel sensors 12 corresponding to the two IR filters within the predetermined pattern are combined (i.e., binning) to result in a combined IR signal within the pattern, thereby getting better sensitivity. The combined IR signals of the entire image sensor 102 constitute an IR image, which is one quarter the resolution of the image sensor 102. For example, the image sensor 102 has resolution of 960×800, and the associated IR image thus has resolution of 480×400.

[0023] Simultaneously, the white signals from the pixel sensors 12 corresponding to the two white filters within the predetermined pattern are combined (i.e., binning) to result in a combined white signal within the pattern, thereby getting better sensitivity. The combined white signals of the entire image sensor 102 constitute a visible image (specifically a monochrome image in this embodiment), which is one quarter the resolution of the image sensor 102. For example, the image sensor 102 has resolution of 960×800, and the associated monochrome image thus has resolution of 480×400.

[0024] FIG. 3A shows a perspective view of a color filter array (CFA) 200 disposed on an image sensor 102 according to a second embodiment of the present invention. Specifically, the image sensor 102, for example, a CMOS image sensor or CIS, may include a plurality of pixel sensors (or photo sensors) 12. The CFA 200 of the embodiment may include a plurality of pixel filters (or filters for short) 21 that are correspondingly aligned with the pixel sensors 12.

[0025] FIG. 3B shows a top view of the CFA 200 of FIG. 3A.

[0026] Specifically, the pixel filters 21 of the CFA 200 are arranged in a predetermined pattern composed of 2×2 pixel filters 21 including two infrared (IR) filters and two visible (light) filters. In the embodiment, the two visible filters are (same) color filters that are either red (R) filters, green (G) filters or blue (B) filters. Particularly, the two IR filters are disposed along one diagonal and the two color filters are disposed along another diagonal. It is noted that, in the embodiment, the color filters of the entire CFA 200 are half green, one quarter red and one quarter blue, and are arranged with Bayer arrangement. FIG. 3C shows schematic curves of transmission versus wavelength of a red filter, a green filter and a blue filter, respectively. It is noted that, in addition to a specific band through which light of specific color can pass, the filter may also pass a small amount of other light (e.g., infrared). FIG. 3D shows a schematic curve of transmission versus wavelength of a lens (not shown) with dual band filtering adaptable to the CFA 200 of FIG. 3A.

[0027] FIG. 4 schematically shows a method of reading out signals from the image sensor 102 of FIG. 3A. In the embodiment, IR signals from the pixel sensors 12 corresponding to the IR filters and visible signals (specifically color signals in this embodiment) from the pixel sensors 12 corresponding to the color filters (i.e., R, G and B) are read out separately.

[0028] Specifically, the IR signals from the pixel sensors 12 corresponding to the two IR filters within the predetermined pattern are combined (i.e., binning) to result in a combined IR signal within the pattern. The combined IR signals of the entire image sensor 102 constitute an IR image, which is one quarter the resolution of the image sensor 102. For example, the image sensor 102 has resolution of 960×800, and the associated IR image thus has resolution of 480×400.

[0029] Simultaneously, the color signals from the pixel sensors 12 corresponding to the two color filters within the predetermined pattern are combined (i.e., binning) to result in a combined color signal within the pattern. The combined color signals of the entire image sensor 102 constitute a visible image (specifically a color (or RGB) image in this embodiment), which is one quarter the resolution of the image sensor 102. For example, the image sensor 102 has resolution of 960×800, and the associated color image thus has resolution of 480×400.

[0030] According to the CFA 100 or the CFA 200 with the predetermined pattern and the associated read out method as described above, higher sensitivity and signal-to-noise ratio (for the IR image) and less artifact (for the monochrome or color image) can be achieved after being processed by an image signal processor (ISP) as compared with conventional CFAs.

[0031] It is noted that the infrared image and the monochrome image in the first embodiment may be simultaneously and separately obtained for different applications, thereby realizing a dual mode image sensor. Similarly, the infrared image and the color image in the second embodiment may be simultaneously and separately obtained for different applications, thereby realizing a dual mode image sensor.

[0032] The CFA 100 or the CFA 200 in companion with the image sensor 102 may constitute an artificial intelligence smart sensor adaptable to artificial intelligence (AI) applications. Specifically, the IR image obtained in the embodiment, in companion with an IR light source for enhancing image quality, may be used for biometric recognition (e.g., facial recognition) capable of identifying individuals by human characteristics. For example, the IR image obtained in the embodiment may be used in Windows Hello, a biometrics-based technology that authenticates secure access with a fingerprint, iris scan or facial recognition. On the other hand, the monochrome image or the color image obtained in the embodiment may be used for surveillance capable of monitoring behavior or activities for the purpose of information gathering. For example, the monochrome image or the color image obtained in the embodiment may be used to detect an approaching or leaving person, based on which an electronic device (e.g., computer) may accordingly wake up or sleep. Therefore, the dual-mode image sensor disclosed in the embodiments can simultaneously and separately provide the infrared image and the monochrome/color image, thereby providing cost effective solution and allowing flexibility on video camera.

[0033] Although specific embodiments have been illustrated and described, it will be appreciated by those skilled in the art that various modifications may be made without departing from the scope of the present invention, which is intended to be limited solely by the appended claims.