APPARATUS FOR CAPTURING AN IMAGE AND DETERMINING AN AMBIENT LIGHT INTENSITY
20240048864 ยท 2024-02-08
Inventors
Cpc classification
H04N23/54
ELECTRICITY
G01J1/0411
PHYSICS
H04N23/57
ELECTRICITY
H04N25/79
ELECTRICITY
International classification
Abstract
An apparatus includes a body defining an aperture. The apparatus also includes an image sensor including an array of sensing elements. The apparatus further includes an ambient light sensor. The image sensor and the ambient light sensor are each arranged to receive radiation from the aperture.
Claims
1. An apparatus comprising: a body defining an aperture; an image sensor comprising an array of sensing elements; and an ambient light sensor, wherein the image sensor and the ambient light sensor are each arranged to receive radiation from the aperture.
2. The apparatus of claim 1, wherein the array of sensing elements of the image sensor is formed on an image sensor die and the ambient light sensor is formed on a separate ambient light sensor die.
3. The apparatus of claim 2, wherein the separate dies of the image sensor and the ambient light sensor are both supported by a common support substrate.
4. The apparatus of claim 3, wherein the ambient light sensor is disposed on an opposite side of the common support substrate to the image sensor.
5. The apparatus of claim 2, wherein the image sensor die and the ambient light sensor die are stacked to form a three-dimensional integrated circuit.
6. The apparatus of claim 1, wherein the image sensor and the ambient light sensor are formed using different process nodes.
7. The apparatus of claim 1, further comprising an optical element supported by the body, the optical element being arranged to project at least a portion of the radiation received by the aperture onto the image sensor.
8. The apparatus of claim 7, wherein the optical element comprises a fixed-focus lens.
9. The apparatus of claim 7, wherein the optical element comprises a lens provided with an adjustment mechanism operable to control a focal length of the lens and/or a position of the lens relative to the image sensor.
10. The apparatus of claim 1, wherein the image sensor is disposed between the aperture defined in the body and the ambient light sensor.
11. The apparatus of claim 1, further comprising at least one light guide arranged to receive a portion of light from the aperture and to guide said portion of light from the aperture to the ambient light sensor.
12. The apparatus of claim 11, wherein the apparatus comprises a plurality of light guides, each arranged to receive a portion of light from the aperture and to guide said portion of light from the aperture to the ambient light sensor.
13. The apparatus of claim 11, wherein the apparatus comprises a diffusor arranged to scatter light received by the plurality of light guides before it is incident on the ambient light sensor.
14. The apparatus of claim 7, further comprising at least one light guide arranged to receive a portion of light from the aperture and to guide said portion of light from the aperture to the ambient light sensor, wherein the at least one light guide is arranged to receive a portion of light scattered to a side or edge of the optical element and to guide said portion of light scattered to a side or edge of the optical element to the ambient light sensor.
15. The apparatus of claim 7, further comprising at least one light guide arranged to receive a portion of light from the aperture and to guide said portion of light from the aperture to the ambient light sensor, wherein the at least one light guide is arranged to receive a portion of light from the aperture that is not incident on the optical element to guide said portion of light from the aperture that is not incident on the optical element to the ambient light sensor.
16. The apparatus The apparatus of claim 7, further comprising at least one light guide arranged to receive a portion of light from the aperture and to guide said portion of light from the aperture to the ambient light sensor, wherein the at least one light guide is arranged to receive a portion of light from the aperture that is transmitted by the optical element and is not incident on the image sensor and to guide said portion of light to the ambient light sensor.
17. The apparatus of claim 7, wherein the ambient light sensor comprises at least one light sensing element arranged to receive a portion of light from the aperture that is transmitted by the optical element and is not incident on the image sensor.
18. The apparatus of claim 1, wherein the image sensor is arranged to receive radiation from the aperture and wherein the ambient light sensor is arranged to receive a portion of said radiation that is transmitted by the image sensor.
19. The apparatus of claim 18, wherein the image sensor comprises a pixel die of a multilayer stacked CMOS sensor and wherein the ambient light sensor is provided on another die of the multilayer stacked CMOS sensor.
20. The apparatus of claim 19, wherein the ambient light sensor is provided on a memory die or a logic circuit die of the multilayer stacked CMOS sensor.
21. The apparatus of claim 19, wherein the ambient light sensor is provided on a peripheral portion of the other die of the multilayer stacked CMOS sensor.
22. The apparatus of claim 1, further comprising a spectral filter arranged to limit a bandwidth of radiation from the aperture that is received by the ambient light sensor.
23. The apparatus of claim 1, further comprising a diffusor arranged scatter radiation from the aperture that is received by the ambient light sensor.
24. A mobile electronic device comprising the apparatus of claim 1.
Description
BRIEF DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0063] Some embodiments of the disclosure will now be described by way of example only and with reference to the accompanying drawings, in which:
[0064]
[0065]
[0066]
[0067]
[0068]
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0075] Generally speaking, the disclosure provides an apparatus comprising both an image sensor and an ambient light sensor, which each receive radiation (for example visible light) from a common aperture. This arrangement is advantageous since it allows the ambient light sensor to be integrated into a camera module of a mobile electronic device. The disclosure may be considered to disclose an apparatus that is generally of the form of a camera module of a mobile electronic device and which has been adapted to include an ambient light sensor that is arranged to receive ambient light from an aperture that also provides light to an image sensor of the camera module. This allows, for example, the ambient light sensor and the image sensor to share a common support or printed circuit board (PCB). Advantageously, this can reduce the size of a bezel of the mobile electronic device. In turn, this allows the size of a screen of the mobile electronic device to be increased. The proposed solution does not require a transmissive screen and therefore can be used with mobile electronic devices comprising an LCD display (or other light blocking display technologies). In addition, the proposed solution can offer advantages when used with mobile electronic devices comprising partially transparent display screens such as, for example, OLED displays (relative, for example, to an arrangement wherein an ambient light sensor is provided behind the screen). First, the transmissivity of an OLED display screen is typically very low (of the order of 2%). Second, for an arrangement wherein an ambient light sensor is provided behind an OLED screen, any ambient light measurement may be subject to a background signal from the screen display content, which may need to be corrected for. Furthermore, by supplying both an image sensor and a separate ambient light sensor, the two sensors can each be separately optimised for their intended uses.
[0076] Some examples of the solution are given in the accompanying figures.
[0077]
[0078] Each of the apparatus 100a, 100b, 100c, 100d shown in
[0079] The image sensor 106 comprises an array of sensing elements. As referred to herein the image sensor 106 comprising an array of sensing elements is intended to mean an array of photosensitive elements each of which is operable to produce a signal in response to a received dose of radiation (for example visible light). That is, the image sensor 106 is intended to mean a portion of a sensor which converts received radiation (for example visible light) into electrical signals and which defines the pixel geometry of the sensor. The image sensor 106 may comprise, for example, an active-pixel sensor technology. For example, the image sensor 106 may comprise, for example, an array of complimentary metal-oxide semiconductor (CMOS) pixels. As referred to herein the image sensor 106 may or may not also comprise any associated memory buffer or logic circuitry. For example, a two-layer stacked CMOS sensor may comprise a pixel die bonded to a logic circuit die. Similarly, a three-layer stacked CMOS sensor may comprise a pixel die, a memory die (for example providing dynamic random access memory, DRAM) and a logic circuit die. As used herein, the term image sensor 106 is intended to include the pixel die but may or may not include the other dies, as will be discussed further below.
[0080] The ambient light sensor 108 may comprise any type of photodetector. For example, the ambient light sensor 108 may comprise one or more phototransistors, photodiodes and/or photonic integrated circuits.
[0081] In each of the apparatus 100a, 100b, 100c, 100d shown in
[0082] In some embodiments of the apparatus 100a, 100b, 100c, 100d shown in
[0083] In some embodiments of the apparatus 100a, 100b, 100c, 100d shown in
[0084] In each of the apparatus 100a, 100b, 100c, 100d shown in
[0085] In the embodiments of the apparatus 100a, 100c, 100d shown in
[0086] In the embodiment of the apparatus 100b shown in
[0087] In the embodiments of the apparatus 100a, 100c shown in
[0088] For embodiments wherein the ambient light sensor 108 is disposed on an opposite side of the PCB 110 to the image sensor 106, the image sensor 106 may be disposed in a side or surface of the support substrate 110 facing the aperture 104. As shown in
[0089] Each of the apparatus 100a, 100b, 100c, 100d shown in
[0090] Optionally, each of the apparatus 100a, 100b, 100c, 100d shown in
[0091] The optical element 114 supported by the body 102 and disposed in the vicinity of the aperture 104. Furthermore, the optical element 114 is arranged to project at least a portion of radiation received by the aperture 104 onto the image sensor 106. However, it will be appreciated that the arrangement of the body 102, aperture 104 and optical element 114 shown in
[0092] The arrangement shown in
[0093] The arrangement shown in
[0094] The arrangements shown on
[0095] The arrangement shown in
[0096] The arrangement shown in
[0097] The optical element 114 may comprise a lens. Additionally or alternatively, the optical element may comprise other refractive and/or reflective optics including, for example, prisms. The optical element 114 may be a compound lens comprising a plurality of lens elements and is therefore represented in the schematic cross-sectional views of
[0098] In some embodiments, the optical element 114 may comprise a fixed-focus lens. Alternatively, in other embodiments, the optical element 114 may comprise a lens provided with an adjustment mechanism operable to control a focal length of the lens and/or a position of the lens relative to the image sensor 106. For example, the optical element 114 may comprise a lens that is coupled to the body 102 via a voice coil motor (VCM) to allow free movement of the lens (relative to the image sensor 106).
[0099] In the embodiments of the apparatus 100b, 100c shown in
[0100] Advantageously, the apparatus 100a, 100b, 100c, 100d shown in
[0101] The apparatus 100a, 100b, 100c, 100d does not require a transmissive screen (for example it can be used with phones comprising an LCD display). In addition, such an arrangement can reduce the amount of background signal generated by a screen of the mobile electronic device. This allows for more accurate measurement of ambient light levels and/or reduces the complexity of calibration of such ambient light level measurements.
[0102] Furthermore, by supplying both an image sensor 106 and a separate ambient light sensor 108, the two sensors can each be separately optimised for their intended use. For example, it may be desirable for an image sensor 106 may be optimised to maximise a density of sensing elements (pixels) and therefore to provide optimum sensitivity of the small individual sensing elements or pixels. In contrast, it may be desirable for an ambient light sensor 108 to use a larger sensing element having a greater dynamic range (to allow it to operate both in high and low ambient light levels).
[0103] Optionally, each of the apparatus 100a, 100b, 100c, 100d shown in
[0104] In each of the apparatus 100a, 100b, 100c, 100d shown in
[0105] In the embodiment of the apparatus 100a shown in
[0106] In some variant embodiments of the apparatus 100a shown in
[0107] For embodiments comprising at least one light guide 118 arranged to receive a portion of light from the aperture 104 and to guide said portion of light from the aperture 104 to the ambient light sensor 108, it may be challenging to provide an ambient light sensor 108 with a sufficient field of view to achieve an accurate determination of an ambient light level. As discussed further below, the field of view of the ambient light sensor mat be increased if the apparatus 100a comprises plurality of light guides 118, each arranged to receive a portion of light from the aperture 104 and to guide said portion of light from the aperture 104 to the ambient light sensor 108.
[0108] Optionally, the ambient light sensor 108 may comprise a plurality of light sensing elements. Each of the plurality of light guides 118 may be arranged to receive a portion of light from the aperture 104 and to guide said portion of light from the aperture 104 to a different one of the plurality of light sensing elements.
[0109] Optionally, the apparatus 100a may comprise a diffusor (not shown) arranged to scatter light received by the or each light guide 118 before it is incident on the ambient light sensor 108. Such a diffusor can improve the field of view of the ambient light sensor 108.
[0110] In the embodiments of the apparatus 100b, 100c shown in
[0111] In the embodiment of the apparatus 100b shown in
[0112] In the embodiment of the apparatus 100d shown in
[0113] Some specific implementations of the apparatus 100a shown schematically in
[0114]
[0115] The first camera module 300 comprises: a body 302, an aperture 304, an image sensor 306, a printed circuit board (PCB) 310, an optical element 314, and an infrared filter 316. As used here, the term infrared filter 316 is intended to mean a component which substantially absorbs or blocks infrared radiation (and may pass visible radiation). Features of the first camera module 300 which generally correspond to features of the apparatus 100a shown schematically in
[0116] The body 302 may comprise a base body portion and the upper body portion which are releasably engagable (for example via mutually engageable threaded portions) so as to form a two part body.
[0117] The optical element 314 may be a compound lens comprising a plurality of lens elements which are supported by the body 302.
[0118] The camera module 300 further comprises a plurality of light guides 318 and the ambient light sensor 308. As will be explained further below with reference to
[0119] It will be appreciated that light which is scattered to a side or edge of the optical element 314 may comprise light which is scattered out of the optical element in a direction generally away from an optical axis 320 of the optical element. That is, light that is scattered to a side or edge of the optical element 314 propagates in a direction having at least a component that is generally perpendicular to the optical axis 320 of the optical element 314.
[0120] The optical element 314 may comprise a compound lens having a plurality of lens elements. Each single lens element may comprise two opposed surfaces at least one of which is either concave or convex. For example, the lens elements may each have two opposed convex surfaces. The side or edge of a single lens element may be a surface of the lens disposed between the two opposed surfaces. It will be appreciated that since the optical element 314 is a compound lens scattering of light to the side or edge of the optical element 314 will in general also include light which exits the compound lens in between the individual lens elements.
[0121] The optical element 314 is supported by the body 302, which may, for example, be a two part body formed by a base body portion and an upper body portion. In particular, when the base body portion and the upper body portion are engaged with each other, the optical element 314 may be held captive therebetween. The body 302 may be considered to provide a support structure.
[0122] In general, the body 302 may be opaque (to reduce or prevent background light that bypasses the optical element 314 from being incident on the image sensor 306). However, the plurality of light guides 318 are at least partially formed in the body 302, extending from one or more positions to a side or edge of the optical element 314 towards the ambient light sensor 308. Although in this embodiment, the plurality of light guides 318 are at least partially formed in the body 302, it will be appreciated that various different body arrangements may be employed in different embodiments (see, for example,
[0123] Each of the plurality of light guides 318 may be provided with, or may act as, a diffusor. For example, a diffusor may be provided at or proximate to an entrance to each of the plurality of light guides 318. That is, a diffusor may be provided at or proximate a part of each of the plurality of light guides 318 that is proximate to a side or edge of the optical element 314. Each diffusor may substantially cover an entrance of a corresponding light guide 318. Each such diffusor may be provided as a separate optical component (to a corresponding light guide 318) and which is arranged to scatter light incident thereon. Alternatively, each such diffusor may be integrated with a corresponding light guide 318. For example, each such diffusor may be provided by a surface of each light guide (which surface may define an entrance of the light guide 318) that is provided with a texture or surface roughness that is arranged to scatter light which enters the light guide 318.
[0124] In this embodiment, each of the plurality of light guides 318 further extends through the PCB 310 to the ambient light sensor 308 (which is disposed on an opposite side of the PCB 310 to the image sensor 306 in a similar arrangement to that shown in
[0125] In an alternative arrangement, the ambient light sensor 308 may comprise a plurality of ambient light sensing elements which may each be disposed on the same side of the PCB 310 as the image sensor. For such alternative embodiments, the plurality of light guides 318 do not extend through the PCB 310.
[0126]
[0127]
[0128] The second camera module 400 comprises: a base body portion 402a an upper body portion 402b, an aperture 404, an image sensor 406, an ambient light sensor 408, a printed circuit board (PCB) 410, an optical element 414, and an infrared filter 416. As used here, the term infrared filter 416 is intended to mean a component which substantially absorbs or blocks infrared radiation (and may pass visible radiation). Features of the second camera module 400 which generally correspond to features of the apparatus 100a shown schematically in
[0129] The base body portion 402a and the upper body portion 402b are releasably engagable so as to form a two part body that corresponds to the body 102 shown in
[0130] The optical element 414 may be a compound lens comprising a plurality of lens elements. The optical element 414 is supported by the two part body formed by the base body portion 402a and the upper body portion 402b.
[0131] The optical element 414 is coupled to the upper body portion 402b in such a way so as to allow free movement of the optical element 414 (relative to the upper body portion 402b) in the direction indicated by arrow 204. To facilitate such movement gaps 202 are formed between the optical element 414 and the upper body portion 402b. For example, the upper body portion 402b may comprise a voice coil motor (VCM) to allow free movement of the optical element 414 relative thereto. The upper body portion 402b and the optical element 414 are therefore arranged in a similar way to the body 102 and the optical element 214 shown in
[0132] The second camera module 400 further comprises at least one light guide 418. It will be appreciated that other embodiments may have different numbers of light guides. The light guide 418 is arranged to receive a portion of light from the aperture 404 that is not incident on the optical element 414 and to guide said portion of light from the aperture 404 that is not incident on the optical element 414 to the ambient light sensor 408.
[0133] The gaps 202 formed between the optical element 414 and the upper body portion 402b together with the light guide 418 provide a light path allowing ambient radiation to propagate to the ambient light sensor 408. In some existing arrangements, there are already gaps in the lower body portion 402a and therefore it is known to provide a metal light shield around the upper and lower body portions 402a, 402b. It will be appreciated that for such arrangements the light guide 418 may be formed in said metal light shield.
[0134] The optical element 414 is movably supported by the two part body formed by the base body portion 402a and the upper body portion 402b. In particular, when the base body portion 402a and the upper body portion 402b are engaged with each other, the optical element 414 is held captive therebetween (allowing for some limited range of movement). The base body portion 402a and the upper body portion 402b may be considered to provide a support structure.
[0135] As now discussed, with reference to
[0136] Generally, the optical element 114 in a camera module has a circular geometry and, as shown in
[0137] In the alternative, in some embodiments, one or more ambient light sensing elements may be provided in the image plane 502 within one or more positions 506 that lie within the circular image 500 formed by the optical element 114 but lie outside of the rectangular portion 504 sampled by the image sensor 106. Such an arrangement is shown in
[0138] A specific implementation of the apparatus 100b shown schematically in
[0139] As explained above, in the apparatus 100b shown schematically in
[0140] In some embodiments, the image sensor 106 and the ambient light sensor 108 are each provided in different dies of a multilayer stacked CMOS sensor.
[0141] Multilayer stacked CMOS sensors include two-layer stacked CMOS sensors and three-layer stacked CMOS sensors.
[0142] A two-layer stacked CMOS sensor 600 is shown in
[0143] A three-layer stacked CMOS sensor 614 is shown in
[0144] In some embodiments, the image sensor 106 comprises a pixel die 602 of a multilayer stacked CMOS sensor 600, 614 and the ambient light sensor 108 is provided on another die 604, 616 of the multilayer stacked CMOS sensor 600, 614.
[0145] In some embodiments, the ambient light sensor 108 is provided on a memory die 616 or a logic circuit die 604 of a multilayer stacked CMOS sensor 600, 614. For example, the ambient light sensor 108 may be provided on peripheral portion 612, 620 of the other die 604, 616 of the multilayer stacked CMOS sensor 600, 614.
[0146] In some embodiments, additional through-silicon vias (which may or may not be provided with metal) may be provided in the peripheral portion 608 of the pixel die 602 and/or the peripheral portion 620 of the memory die 616 to increase transmission of light to the ambient light sensor 108.
[0147] Embodiments of the present disclosure can be employed in many different applications including any type of mobile electronic device such as, for example, a mobile telephone, tablet or laptop.
LIST OF REFERENCE NUMERALS
[0148] 100a first apparatus according to the present disclosure [0149] 100b second apparatus according to the present disclosure [0150] 100c third apparatus according to the present disclosure [0151] 100d fourth apparatus according to the present disclosure [0152] 102 body [0153] 104 aperture [0154] 106 image sensor 106 [0155] 108 ambient light sensor [0156] 110 printed circuit board (PCB) [0157] 112 holes, through bores or apertures [0158] 114 optical element [0159] 116 spectral filter [0160] 118 at least one light guide [0161] 200 flange [0162] 202 gaps between optical element and body [0163] 204 arrow indicating movement of optical element relative to body [0164] 300 first camera module [0165] 302 body [0166] 304 aperture [0167] 306 image sensor [0168] 308 ambient light sensor [0169] 310 printed circuit board (PCB) [0170] 314 optical element [0171] 316 infrared filter [0172] 318 plurality of light guides [0173] 320 optical axis (of the optical element) [0174] 322 positions which correspond to the light guides [0175] 400 second camera module [0176] 402a upper body portion [0177] 402b lower body portion [0178] 404 aperture [0179] 406 image sensor [0180] 408 ambient light sensor [0181] 410 printed circuit board (PCB) [0182] 414 optical element [0183] 416 infrared filter [0184] 418 light guide [0185] 500 circular image formed by optical element [0186] 502 image plane [0187] 504 rectangular portion 504 of the circular image sampled by image sensor [0188] 506 positions on a portion of the image plane that lies within the circular image [0189] 15 formed by the optical element but outside of the rectangular portion [0190] sampled by the image sensor [0191] 600 two-layer stacked CMOS sensor [0192] 602 pixel die [0193] 604 logic circuit die [0194] 606 central portion of pixel die [0195] 608 peripheral portion of pixel die [0196] 610 central portion of logic circuit die [0197] 612 peripheral portion of logic circuit die [0198] 614 three-layer stacked CMOS sensor [0199] 616 memory die [0200] 618 central portion of memory die [0201] 620 peripheral portion of memory die
[0202] It will be appreciated that as used herein the terms screen, display and display screen are synonymous with each other and may be used interchangeably.
[0203] The skilled person will understand that in the preceding description and appended claims, positional terms such as above, along, side, etc. are made with reference to conceptual illustrations, such as those shown in the appended drawings. These terms are used for ease of reference but are not intended to be of limiting nature. These terms are therefore to be understood as referring to an object when in an orientation as shown in the accompanying drawings.
[0204] Although the disclosure has been described in terms of preferred embodiments as set forth above, it should be understood that these embodiments are illustrative only and that the claims are not limited to those embodiments. Those skilled in the art will be able to make modifications and alternatives in view of the disclosure which are contemplated as falling within the scope of the appended claims. Each feature disclosed or illustrated in the present specification may be incorporated in any embodiments, whether alone or in any appropriate combination with any other feature disclosed or illustrated herein.