WINDOW AND MIRROR PRESENCE DETECTION SYSTEM AND CORRESPONDING METHOD

Abstract

A presence detection system (700) configured to detect a presence of a window (130) or a mirror (330) is disclosed. The system comprises a time-of-flight sensor (110, 310, 610) configured to detect a proximity to a target (105, 305, 605) based on reflected radiation sensed from a plurality of zones (620a-i). The system also discloses processing circuitry (750) configured to determine a presence of a mirror or window in a path from the time-of-flight sensor to the target based on one or more peaks in data corresponding to the sensed radiation reflected from each of the plurality of zones. A corresponding method of detecting a presence of a window or a mirror using the disclosed system is also disclosed.

Claims

1. A presence detection system configured to detect a presence of a window or a mirror, the system comprising: a time-of-flight sensor configured to detect a proximity to a target based on reflected radiation sensed from a plurality of zones; and processing circuitry configured to determine a presence of a mirror or window in a path from the time-of-flight sensor to the target based on one or more peaks in data corresponding to the sensed radiation reflected from each of the plurality of zones.

2. The presence detection system of claim 1, wherein the one or more peaks in data correspond to reflected radiation above a threshold defined by a noise level.

3. The presence detection system of claim 1, wherein the data corresponds to a distribution of a number of sensed photons as a function of a distance from the ToF sensor.

4. The presence detection system of claim 1 wherein the processing circuitry is configured to determine the presence of the mirror or the window and/or characteristics of the mirror or the window by comparing data corresponding to at least two zones of the plurality of zones.

5. The presence detection system of claim 1 wherein, if the data comprises: a peak corresponding to a first distance from the ToF sensor and a peak corresponding to a second distance from the ToF sensor in a first zone of the plurality of zones; a peak substantially corresponding to the first distance and a peak substantially corresponding to the second distance in a second zone of the plurality of zones; the second distance being further than the first distance, and the peaks not being associated with reflections from a cover glass; then the processing circuitry determines that the peak corresponding to the first distance from the ToF sensor corresponds to reflections from a mirror or a window.

6. The presence detection system of claim 5 wherein, if the second distance is substantially double the first distance, then the processing circuitry determines that the peak corresponding to the first distance from the ToF sensor corresponds to reflections from a mirror.

7. The presence detection system of claim 5 wherein, if the peak corresponding to the first distance from the ToF sensor has a magnitude above a predefined threshold and/or is characterized by pileup greater than a/the predefined threshold, the processing circuitry determines that the peak corresponding to the first distance from the ToF sensor corresponds to reflections from a mirror.

8. The presence detection system of claim 5 wherein, if the first peak is substantially wider than a width defined by a further predefined threshold, then the processing circuitry determines that the peak corresponding to the first distance from the ToF sensor corresponds to reflections from a window comprising a plurality of panes of glass.

9. The presence detection system of claim 5 wherein the processing circuitry is configured to determine which zone of the plurality of zones comprises a peak with the greatest magnitude substantially corresponding to the first distance, and to indicate that the determined zone is the zone oriented closest to perpendicular relative to the window or mirror.

10. The presence detection system of claim 1 wherein the processing circuitry is configured to correct the data for the effects of pile-up.

11. The presence detection system of claim 1 wherein, if the data comprises: a peak with a magnitude above a first threshold corresponding to a relatively short distance from the ToF sensor in a/the first zone of the plurality of zones, the relatively short distance defined by a second threshold, and substantially no peak corresponding to the relatively short distance from the ToF sensor in a/the second zone of the plurality of zones; then the processing circuitry determines that the ToF sensor is disposed at the relatively short distance from a window.

12. The presence detection system of claim 1 wherein the processing circuitry configured to determine whether one or more peaks in the data is associated with reflections from a/the cover glass.

13. The presence detection system of claim 1, wherein the processing circuitry is configured to store the data for each of the plurality of zones in bins, wherein each bin corresponds to a number of sensed photons as a function of distance from the ToF sensor.

14. An apparatus comprising: an imaging system with an adjustable focus, and a presence detection system comprising a ToF sensor according to claim 1, wherein the focus of the imaging system is configured to be adjusted to avoid focussing on a window or mirror based on a determination of a presence of a mirror or window in a path from the time-of-flight sensor to a target by the presence detection system.

15. The apparatus of claim 14, wherein the apparatus is one of: a cellular telephone; a camera; or a video recording device; a robotic device; a measuring device; a gaming device; or an automotive device.

16. A method of detecting a presence of a window or a mirror, the method comprising: configuring a time-of-flight sensor to provide data corresponding to sensed reflected radiation from a plurality of zones; and analysing one or more peaks in the data corresponding to the sensed radiation reflected from each of the plurality of zones to determine if a window or a mirror is in a path from the time-of-flight sensor to a target.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0059] These and other aspects of the present invention will now be described, by way of example only, with reference to the accompanying drawings, which are:

[0060] FIG. 1a a representation of an imaging device substantially perpendicular to a window;

[0061] FIG. 1b an example of a histogram corresponding to data from the sensor of the imaging device of FIG. 1a;

[0062] FIG. 1c a magnified portion of the histogram of FIG. 1b;

[0063] FIG. 2a a representation of the imaging device an angle relative to the window;

[0064] FIG. 2b an example of a histogram corresponding to data from the sensor of the imaging device of FIG. 2a;

[0065] FIG. 3a a representation of the imaging device substantially perpendicular to a mirror;

[0066] FIG. 3b an example of a histogram corresponding to data from the sensor of the imaging device of FIG. 4a;

[0067] FIG. 4a a representation of the imaging device at an angle relative to the mirror;

[0068] FIG. 4b an example of a histogram corresponding to data from the sensor of the imaging device of FIG. 5a;

[0069] FIG. 5a a photograph of a use case of the sensor held against or close to a window;

[0070] FIG. 5b an example of a histogram corresponding to data from a first zone of sensor of the imaging device held against a window;

[0071] FIG. 5c an example of a histogram corresponding to data from a second zone of sensor held against a window;

[0072] FIG. 6a a representation of an apparatus comprising an imaging system with an adjustable focus, and a presence detection system according to an embodiment of the disclosure;

[0073] FIG. 6b a representation of zones sensed by the multi-zone sensor of the apparatus of FIG. 6a;

[0074] FIG. 7a a block diagram of a presence detection system; and

[0075] FIG. 7b a diagram of a packaged presence detection system.

DETAILED DESCRIPTION OF DRAWINGS

[0076] FIG. 1a depicts a representation of an imaging device 115 substantially perpendicular to a window 130. A target 105 is disposed at an opposite side of the window 130 to the imaging device 115. The imaging device comprises a sensor 110. In the example of FIG. 1a, the target 105 is a person. For purposes of example, the depicted imaging device 115 is a cellular telephone. It will be appreciated that the sensor 110 may be a component of another imaging device or a system, such as a camera or the like. In some embodiments, the sensor 110 is a component of a system having an adjustable focus, such as to allow imaging of targets at a range of distances from the imaging device. In the example of FIG. 1a, the imaging device 115 is a cellular telephone comprising a camera 120.

[0077] In the example of FIG. 1, the sensor 110 is a time-of-flight sensor. The sensor 110 may be a direct time-of-flight sensor. In some embodiments, the sensor 110 may be an indirect time-of-flight sensor. As such, the sensor 110 is configured to detect a proximity to the target 105 based on sensed radiation 125 emitted from the sensor 110 and reflected from the target 105.

[0078] The time-of-flight sensor 110 may comprise one or more radiation emitters. The radiation emitter may be a laser, such as a vertical cavity surface emitting laser (VCSEL). The time-of-flight sensor 110 may be configured to sense radiation 125 having a wavelength corresponding to a wavelength of radiation 125 emitted by the radiation emitter. The sensor 110 may comprise a Single Photon Avalanche Diode (SPAD), or an array of SPADs. The sensor 110 may comprise one or more time-to-digital converters, configured to indicate a time between an emitted pulse of radiation and one or more received pulses of radiation 125. The sensor 110 may comprise a histogram block configured to accumulate data from the one or more time-to digital converters in a histogram. Processing circuitry may be configured to generate an output signal indicative of a time-of-flight based on an evaluation of the histogram, as described in more detail with reference to FIGS. 1b and 1c.

[0079] The sensor 110 may be configured to sense radiation 125 reflected from a plurality of different zones. Each zone of the plurality of zones may define an area or field sensed by the sensor 110. Each area or field may be distinct, or may at least partially overlap an area of field of a zone defined by at least one adjacent zone. Operation of such a multi-zone sensor is described in more detail below with reference to FIGS. 6a to 6c.

[0080] Also shown in FIG. 1a is a window 130 disposed in a path from the sensor 110 to the target 105. The window 130 is at least partly transparent to the radiation 125.

[0081] As such, at least a portion of radiation 125 emitted by the sensor 110 propagates through the window 130 and is reflected from the target 105. However, at least a portion of the radiation 125 is reflected from the window 130 itself. In some instances, a substantial majority of the radiation 125 is reflected by the window 130. Such reflections may be due, at least in part, to dirt, debris and/or other anomalies or artefacts present on and/or in the window 130. The window 130 may comprise one or more materials that are at least partially reflective to the radiation 125.

[0082] The radiation 125 depicted in FIG. 1a is shown as a dashed line between the window 130 and the target 105, and a solid line between the window 130 and the sensor 110, thus indicative of radiation travelling from the window 130 to the sensor 110 comprising both radiation reflected from the window 130 and radiation reflected from the target 105.

[0083] The example in FIG. 1a may correspond to a use-case of a user operating the camera 120 of the imaging device 115 to take a photograph of the target 105 through a window 130.

[0084] FIG. 1b depicts an example of a histogram 150 corresponding to data from the sensor 110 of FIG. 1a. The sensor 110, e.g. the time-of-flight sensor, or processing circuitry associated with the sensor 110, may provide data corresponding to a count of sensed photons as a function of time. Since the speed of the photons is known, and for example may be assumed to be approximately 3×10.sup.8 ms.sup.−1, such a time directly corresponds to a distance. The data may be provided, or stored, in a format or structure corresponding to the example histogram 150. Circuitry within the sensor 110 and/or processing circuitry may be configured to store the data as the histogram 150. The sensor 110 may store the data as the histogram 150, or in a format corresponding to a histogram, and may make the data available to processing circuitry.

[0085] The data depicted in the histogram 150 comprises a peak 155, which substantially corresponds to radiation reflected from the window 130. As such, the sensor 110 may be used to determine a proximity of the window 130 to the sensor.

[0086] FIG. 1c, which depicts a magnified portion of the histogram of FIG. 1b, clearly shows three distinct peaks 155, 160, 165. The three peaks 155, 160, 165 correspond to reflected radiation above a threshold defined by a noise level. For example, noise may be averaged, filtered, and/or otherwise smoothed, to define a level corresponding to a threshold. As such, a peak or spike in data that is substantially greater than level of noise would exceed the threshold, and thus may be readily identifiable as a peak or spike. The threshold may correspond to a multiple of the noise level. The threshold may correspond to an offset from the noise level. The processing circuitry may be configured to determine the noise level. In the example of FIG. 1c, the noise level is between approximately 50 and 150 counts. As such, a first peak 160 having a magnitude of approximately 400 counts is clearly distinguishable over the noise level. Similarly, a third peak 165 having a magnitude of approximately 400 counts is clearly distinguishable over the noise level.

[0087] In the example of FIG. 1c, the first peak 160 corresponds to a cover glass. The cover glass may be, for example, a protective component of the sensor 110. The cover glass may be a component of an optical system in which the sensor 110 is implemented, e.g. the imaging device 115. As such, because the cover glass is disposed at a fixed distance from the sensor 110, the first peak 160 can be readily identified as corresponding to radiation reflected from the cover glass. That is, processing circuitry may readily determine, from the data depicted in histogram 200 of FIGS. 1b and 1c, that a first peak 160 corresponds to the cover glass, because the first peak 160 occurs at a time corresponding to a distance known to be the fixed between the sensor 110 and the cover glass.

[0088] The second peak 155 is substantially greater in magnitude than the first peak 160 or the third peak 165. The second peak corresponds to sensed radiation reflected from the window. Due to the relatively perpendicular orientation of the sensor 110 relative to the window 130, the reflected radiation comprises a substantial component of reflected specular radiation. The reflected radiation may also comprises a component of diffuse radiation, e.g. radiation that is more generally reflected from the window 130 due to, for example, the above described impurities, artefacts, dirt, dust or the like on or in the window.

[0089] The third peak 165 is substantially smaller in magnitude than the second peak 160. The third peak 165 corresponds to sensed radiation reflected from the target 105, e.g. the target 105 disposed at an opposite side of the window 130 to the sensor 110, as depicted in FIG. 1a. As such, by determining that a window 130 is present between the sensor 110 and the target 105, the sensor 110 may be able to determine a proximity of the target 105 to the sensor 110, as described in more detail below.

[0090] FIG. 2a depicts a representation of the imaging device 115 an angle e.g. not perpendicular, relative to the window 130. In a similar manner to the example of FIG. 1a, in this instance radiation 125b emitted from the sensor 110, e.g. the time-of-flight sensor, is reflected back to the sensor 110 from the window 130 and from the target 105.

[0091] However, in contrast to the example of FIG. 1 a, a substantial portion of the 10 radiation 125a that is reflected from the window 130 is not incident upon the sensor 110.

[0092] That is, an amount of specular radiation sensed by the sensor is substantially reduced. This is because, taking account for an angle of incidence of the radiation on the window 130 and an angle of reflection of the radiation from the window 130, a substantial portion of the reflected radiation 1 is not directed toward the sensor 110.

[0093] A portion of radiation 125b, which may comprise diffuse radiation, is detected by the sensor 110. Such diffuse radiation may be due, at least in part, to dirt, debris and/or other anomalies or artefacts present on or in the window 130, causing radiation 125b to be reflected in the direction of the sensor 130. Furthermore, the portion of radiation 125b may comprise radiation reflected from the target 105.

[0094] FIG. 2b depicts an example of a histogram 200 corresponding to data from the sensor of FIG. 2a. FIG. 2b clearly shows three distinct peaks 255, 260, 265. As described above, the peaks 255, 260, 265 correspond to reflected radiation above a threshold defined by a noise level.

[0095] The data depicted in the histogram 200 comprises a first peak 260 above the noise level. As described above, the first peak corresponds to a cover glass.

[0096] The data depicted in the histogram 200 comprises a second peak 255, which substantially corresponds to radiation reflected from the window 130. It will be noted that a magnitude of a peak 255 of a sensed reflection from the window 130 is substantially less than a magnitude of a peak 155 of sensed reflection from the window 130 depicted in FIGS. 1b and 1c. As described above, this is due to specular reflection of the radiation 125a not being detected by the sensor 110 due to angle of the sensor relative to the window 130.

[0097] The histogram 200 of FIG. 2b also depicts a third peak 265. The third peak 265 corresponds to sensed radiation 125b reflected from the target 105, e.g. the target 105 disposed at an opposite side of the window 130 to the sensor 110 as depicted in FIG. 2a.

[0098] Thus, it can be observed that by comparing histograms of data sensed from a target through a window substantially perpendicular to the sensor 110, e.g. equivalent to in a first zone relative to the sensor 110, and at an angle relative to the sensor 110, e.g. equivalent to in a second zone relative to the sensor 110, the absence of the second peak, or substantial reduction in the magnitude of the second peak, indicates that the window is present. Based on this principle, in an embodiment of the invention, a presence detection system such as a system implemented on a cellular telephone camera, may be configured to detect a presence of a window or a mirror. Such a system comprises a time-of-flight sensor configured to detect a proximity to a target based on reflected radiation sensed from a plurality of zones and processing circuitry configured to determine a presence of a mirror or window in a path from the time-of-flight sensor to the target based on one or more peaks in data corresponding to the sensed radiation reflected from each of the plurality of zones.

[0099] FIG. 3a depicts a representation of an imaging device 315 substantially perpendicular to a mirror 330. The imaging device 315 comprises a sensor 310. Also shown is a target 305 which, for purposes of example, is a person. The depicted imaging device 315 is a cellular telephone. It will be appreciated that the sensor 310 may be a component of another imaging device or system, such as a camera or the like. In some embodiments, the sensor 310 is a component of a system having an adjustable focus, such as to allow imaging of targets at a range of distances from the imaging device. In the example of FIG. 3a, the imaging device 315 is a cellular telephone comprising a camera. In the example of FIG. 3a, the sensor 310 is a time-of-flight sensor. As such, the sensor 310 is configured to detect a proximity to the target 305 based on sensed radiation 325a, 325b reflected from the target. As described above with reference to the example of FIG. 1a, the sensor 310 may be configured to sense radiation 325 reflected from a plurality of different zones. Each zone of the plurality of zones may define an area or field sensed by the sensor 310. Each area or field may be distinct, or may at least partially overlap an area of field of a zone defined by at least one adjacent zone. Operation of such a multi-zone sensor is described in more detail below with reference to FIGS. 6a to 6c.

[0100] The mirror 330 is disposed in a radiation path from the sensor 310 to the target 305. The mirror 330 reflects the radiation 325a, 325b.

[0101] As such, radiation 325b which is depicted as a solid line in FIG. 3a, is emitted by the sensor 310, and propagates towards the mirror 330 and is reflected from the mirror 330 toward the target 305. Radiation reflected from the target 305 then propagates toward the mirror 330 and is reflected back towards the sensor 310. As such, at least a portion of the reflected radiation 325b received by the sensor 310 is reflected from the target 305, via the mirror 330.

[0102] However, in some instances at least a portion of the radiation 325a is reflected directly from the mirror to the sensor 310, and is not reflected from the target 305. That is, at least a portion of the radiation 325a emitted by the sensor 310 propagates to the mirror and is reflected back to the sensor 310 without reflecting off the target 305. This radiation 325a is depicted as a dashed line in FIG. 3a, and is shown as a direct path between the mirror 330 and the sensor 310.

[0103] The example in FIG. 3a may correspond to a use-case of a user, e.g. the target 305, taking a photograph of a reflection of himself or herself in the mirror 330 using the imaging device 315, e.g. the user's cellular telephone.

[0104] FIG. 3b depicts an example of a histogram 350 corresponding to data from the sensor 310 of FIG. 3a. The sensor 310, e.g. the time-of-flight sensor, or processing circuitry associated with the sensor 310, may provide data corresponding to a count of sensed photons as a function of time. As described above, such a count corresponds to a distance, and the data may be provided, or stored, in a format or structure corresponding to the example histogram 350.

[0105] The data depicted in the histogram 350 comprises a peak 355, which substantially corresponds to radiation reflected from the mirror 330. As such, the sensor 310 may, in some instances, be used to determine a proximity of the mirror 330 to the sensor.

[0106] FIG. 3c, which depicts a magnified portion of the histogram of FIG. 3b, clearly shows three distinct peaks 355, 360, 365. The peaks 355, 360, 365 correspond to reflected radiation above a threshold defined by a noise level, as described above with reference to FIG. 1b. In the example of FIG. 3c, the noise level is between approximately 50 and 150 counts. As such, a first peak 360 having a magnitude of approximately 480 counts is clearly distinguishable over the noise level. Similarly, a third peak 365 having a magnitude of approximately 450 counts is clearly distinguishable over the noise level.

[0107] In the example of FIG. 3c, the first peak 360 corresponds to a cover glass, as described above with reference to FIG. 1b. As such, processing circuitry may readily determine from the data depicted in histogram 350 that the first peak 360 corresponds to the cover glass, because the first peak 360 occurs at a time corresponding to a distance known to be the fixed between the sensor 310 and the cover glass.

[0108] The second peak 355 is substantially greater in magnitude than the first peak 360 or the third peak 365. The second peak 355 corresponds to sensed radiation reflected from the mirror. Due to the relatively perpendicular orientation of the sensor 310 relative to the mirror 330, the reflected radiation comprises a substantial component of reflected specular radiation. The reflected radiation may also comprises a component of diffuse radiation, e.g. radiation that is more generally reflected from the mirror 330 due to, for example, the above described impurities, artefacts, dirt, dust or the like on or in the mirror.

[0109] The third peak 365 is substantially smaller in magnitude than the second peak 355. The third peak 365 corresponds to sensed radiation reflected from the target 305.

[0110] FIG. 4a depicts a representation of the imaging device 315 an angle e.g. not perpendicular, relative to the mirror 330. In a similar manner to the example of FIG. 2a, in this instance only a portion of the radiation 325b emitted from the sensor 310, e.g. the time-of-flight sensor, is reflected back to the sensor 310 from the target 305, via the mirror 330.

[0111] In contrast to the example of FIG. 3a, a portion of the radiation that is reflected from the mirror 330 is not incident upon the sensor 310. That is, an amount of specular radiation sensed by the sensor 310 is substantially reduced. This is because, taking account for an angle of incidence of the radiation on the mirror 330 and an angle of reflection of the radiation from the mirror 330, a portion of the reflected radiation is not directed toward the sensor 310.

[0112] A portion of radiation 325a, e.g. diffuse radiation, may be detected by the sensor 310. Such diffuse radiation may be due, at least in part, to dirt, debris and/or other anomalies or artefacts present on or in the mirror 330, causing radiation 325a to be reflected in the direction of the sensor 330.

[0113] FIG. 4b depicts an example of a histogram 450 corresponding to data from the sensor of FIG. 4a. FIG. 4b clearly shows two distinct peaks 460, 465. As described above, the peaks 460, 465 correspond to reflected radiation above a threshold defined by a noise level.

[0114] The data depicted in the histogram 450 comprises a first peak 460 above the noise level. As described above, the first peak corresponds to a cover glass.

[0115] The data depicted in the histogram 450 also comprises a small second peak 455, which substantially corresponds to diffuse radiation reflected from the mirror 330. In this example the mirror 330 is particularly clean, and as such a magnitude of the second peak is relatively low. It will be noted that a magnitude of a peak 455 of a sensed reflection from the mirror 330 is substantially less than a magnitude of a peak 355 of sensed reflection from the mirror 330 depicted in FIG. 3c. As described above, this is due to specular reflection of the radiation 325a not being detected by the sensor 310 due to angle of the sensor 310 relative to the mirror 330.

[0116] The histogram 450 of FIG. 4b also depicts a third peak 465. The third peak 465 corresponds to sensed radiation 325b reflected from the target 305, as depicted in FIG. 4a.

[0117] Thus, it can be observed that by comparing histograms of data sensed from a target reflected in a mirror 330 substantially perpendicular to the sensor 310, e.g. equivalent to in a first zone relative to the sensor 310, and also at an angle relative to the sensor 310, e.g. equivalent to in a second zone relative to the sensor 310, the absence of the second peak 355, or substantial reduction in the magnitude of the second peak 355, indicates that a mirror 330 may be present.

[0118] Based on the above described principles, a presence detection system such as a system implemented on a camera in a cellular telephone, may be configured to detect a presence of a window 130 or a mirror 330. Such a system comprises a time-of-flight sensor configured to detect a proximity to a target 105, 305 based on reflected radiation 125a, 125b, 325a, 325b sensed from a plurality of zones and processing circuitry configured to determine a presence of a mirror or window in a path from the time-of-flight sensor to the target based on one or more peaks in data corresponding to the sensed radiation reflected from each of the plurality of zones. That is, processing circuitry within such a system may be configured to determine of the presence of the mirror 330 or the window 130 by comparing data corresponding to at least two zones of the plurality of zones.

[0119] In an embodiment of the invention, a presence detection system may be configured such that, if sensed data comprises: a peak 155, 355 corresponding to a first distance from the sensor 110, 310 and a peak 165, 365 corresponding to a second distance from the time-of-flight sensor in a first zone of a plurality of zones; and a peak 255, 455 substantially corresponding to the first distance and a peak 265, 465 substantially corresponding to the second distance in a second zone of the plurality of zones; and the second distance is further than the first distance; and the peaks are not associated with reflections from a cover glass; then the processing circuitry may determine that the peak 155, 355 corresponding to the first distance from the time-of-flight sensor corresponds to reflections from a mirror 330 or a window 130.

[0120] Furthermore, if the second distance is substantially double the first distance, then the processing circuitry may determine that the peak 155, 355 corresponding to the first distance from the sensor 110, 310 corresponds to reflections from a mirror 330.

[0121] FIG. 5a is a photograph of a particular use case wherein a camera 510 comprising the sensor 110, 310, is placed very close to, or against, the window 130. This use case may occur when a user attempts to take a photograph through a window, while avoiding visible light reflections in the window.

[0122] FIG. 5b depicts an example of a histogram 500 corresponding to data from a first zone of a sensor held against the window 130. The first zone is orientated substantially perpendicular to a surface of the window. A first peak 555 of substantial magnitude is shown in FIG. 5b. The first peak 555 corresponds to crosstalk and target peak overlap. For example, the peak 555 may correspond to a substantial reflection from the window 130. Furthermore, reflections from the cover glass may be obscured in the data due to a proximity of the window to the cover glass.

[0123] FIG. 5c depicts an example of a histogram 550 corresponding to data from a second zone of the sensor held against the window 130. The second zone is orientated at an angle, e.g. not perpendicular, to a surface of the window 130. A first peak 595 of is shown in FIG. 5c. The first peak 595 corresponds to reflections from the cover glass. Notably, a magnitude of the peak 595 is substantially less than a magnitude of the peak 555 depicted in FIG. 5b. That is, in the first zone perpendicular to the window, the sensor detects an object, e.g. the window 130. In the second zone at an angle, e.g. not perpendicular to the window 130, the sensor does not detect the object, e.g. the window 130.c

[0124] In an embodiment of the invention, a presence detection system may be configured such that, if sensed data comprises: a peak 555 with a magnitude above a first threshold corresponding to a relatively short distance from the sensor 110, 330 in the first zone of the plurality of zones, the relatively short distance defined by a second threshold, and substantially no peak or a relatively small peak 595 corresponding to the relatively short distance from the sensor 110, 330 in the second zone of the plurality of zones; then processing circuitry may determines that the sensor 110, 330 is disposed at the relatively short distance from a window 130.

[0125] The relatively short distance may be, for example, in the range of millimteres. The relatively short distance may be, for example, a distance generally comparable in magnitude to a distance from the time-of-flight sensor to a cover glass. That is, the relatively short distance may be a distance in the region of one inch, or less.

[0126] FIG. 6a depicts a representation of an apparatus 600 comprising an imaging system with an adjustable focus, and a presence detection system according to an embodiment of the disclosure. The apparatus 600 is a cellular telephone and the presence detection system comprises a multi-zone time-of-flight sensor 610, and a camera 615 with an adjustable focus. A target 605 is also shown.

[0127] Since the time-of-flight sensor is capable of multi-zone detection, and since the sensor 610 is capable of multi-object detection in each zone, e.g. producing a corresponding histogram with a plurality of peaks, then the apparatus 600 may be configured to detect a presence of a mirror 330 or window 130 in a path between the sensor 610 and the target 605. That is, as described above, histograms corresponding to a plurality of zones may be compared to determine whether a window or mirror is present in the path between the sensor 610 and the target 605. In one example embodiment, such a determination may be made by processing circuitry within the apparatus. In some example embodiments, at least a portion of the processing circuitry and/or storage such as one or more memory devices associated with the processing circuitry, may be remote from the apparatus 600. For example, at least a portion of the processing circuitry may be provided on one or more servers and/or cloud-based devices. At least a portion of the processing circuitry may be provided on a remote console or client device.

[0128] The apparatus 600 may be configured to adjust a focus of the camera 615 based at least in part upon a detected proximity of the target 605 to the sensor 610. The detected proximity to the target 605 may be accurately and reliably determined by determining whether a mirror or window is present in a path between the target 605 and the sensor 610, as described above.

[0129] FIG. 6b depicts a representation of zones sensed by the multi-zone sensor of the apparatus of FIG. 6a. A scene is divided into a 3×3 array of zones, denoted 620a-620i. Each zone corresponds to an area or field sensed by the sensor 610. It will be appreciated that the 3×3 array is depicted for purposes of example only, and in other embodiments the plurality of zones may comprise a 2×2, 4×4 or an even larger array of zones. Furthermore, the plurality of zone need not necessarily define a square as shown in FIG. 6b. For example, each zone may be a non-square shape and/or the array may have other dimensions, such as 3×4, 2×3, or the like. Furthermore, each zone may be distinct or may at least partially overlap an adjacent zone.

[0130] The time-of-flight sensor 610 is configured to perform multi-object detection in each zone 620a-620j of the plurality of zones. As such, the apparatus 600, and in particular processing circuitry within the apparatus 600 or associated with the apparatus 600, may acquire histogram data corresponding to each zone 620a-620j. By comparisons of such acquired histogram data, a determination of a presence of a window 130 or mirror 330 may be made, as described above with reference to FIGS. 1a to 5c.

[0131] FIG. 7a depicts a block diagram of a presence detection system 700 according to an embodiment of the disclosure. The system 700 comprises a multi-zone time-of-flight sensor 710. The multi-zone time-of-flight sensor 710 comprises a VCSEL 715 configure to emit radiation, and an array of SPADs 720 for detecting radiation. The SPADs 720 have associated TDC and histogram circuitry. The multi-zone time-of-flight sensor 710 also comprises control circuitry 725 and driver circuitry 730 for the VCSEL. In the example embodiment, optics 735 are depicted which may comprise, for example, one or more lenses, multi lens array(s) (MLA), diffractive optical elements (DOEs) and/or optics filters.

[0132] The multi-zone time-of-flight sensor 710 also comprises processing circuitry 750, which in the example embodiment of FIG. 7a is an ARM Cortex MO+. In some embodiments, the processing circuitry 750 is configured to determine a presence of a mirror 330 or window 130 in a path from the multi-zone time-of-flight sensor 710 to a target based on one or more peaks in data in histogram data corresponding to sensed radiation reflected from each of a plurality of zones. Also shown is a host device 760. The host device 760 is communicably coupled to the multi-zone time-of-flight sensor 710. The host device 760 comprises further processing circuitry. The host device may be, for example, processing circuitry within a cellular telephone. As described above, the host device 760 may be remote from the multi-zone time-of-flight sensor 710, e.g. on a remote server or cloud based device.

[0133] In some embodiments, the host device 760 is configured to determine a presence of a mirror 330 or window 130 in a path from the multi-zone time-of-flight sensor 710 to a target based on one or more peaks in data in histogram data corresponding to sensed radiation reflected from each of a plurality of zones. That is, in some embodiments, internal processing circuitry 750 within the time-of-flight sensor 710 may be configured to communicate data, e.g. histogram data to the host device 760, such that the host device 760 can determine the presence of a window or mirror.

[0134] FIG. 7b depicts a package 780, the package 780 housing the presence detection system 700 of FIG. 7a. The package comprises electrical contacts 785 for coupling the presence detection system 700 to another device, such as the host device 760. The package 780 comprises a first aperture 790 for emitting radiation, e.g. radiation emitted by the VCSEL 715. The package 780 comprises a second aperture 795 for receiving reflected radiation, e.g. for received radiation to be incident upon the array of SPADs 720.

[0135] In some embodiments, the above-described cover glass may be integrated into the package 780 such that it provides a protective cover over the first aperture 790 and/or the second aperture 795.

[0136] The Applicant discloses in isolation each individual feature described herein and any combination of two or more such features, to the extent that such features or combinations are capable of being carried out based on the specification as a whole in the light of the common general knowledge of a person skilled in the art, irrespective of whether such features or combinations of features solve any problems disclosed herein, and without limitation to the scope of the claims. The applicant indicates that aspects of the disclosure may consist of any such individual feature or combination of features. In view of the foregoing description it will be evident to a person skilled in the art that various modifications may be made within the scope of the disclosure.

[0137] Although the disclosure has been described in terms of preferred embodiments as set forth above, it should be understood that these embodiments are illustrative only and that the claims are not limited to those embodiments. Those skilled in the art will be able to make modifications and alternatives in view of the disclosure, which are contemplated as falling within the scope of the appended claims. Each feature disclosed or illustrated in the present specification may be incorporated in any embodiments, whether alone or in any appropriate combination with any other feature disclosed or illustrated herein.

TABLE-US-00001 List of Reference Numerals 105 target 110 sensor 115 imaging device 120 camera 125 radiation 125a radiation 125b radiation 130 window 150 histogram 155 second peak 160 first peak 165 third peak 200 histogram 255 second peak 260 first peak 265 third peak 305 target 310 sensor 315 imaging device 325a radiation 325b radiation 330 mirror 350 histogram 355 second peak 360 first peak 365 third peak 450 histogram 455 second peak 460 first peak 465 third peak 500 histogram 510 camera 555 first peak 550 histogram 595 first peak 600 apparatus 605 target 610 sensor 615 camera 620a zone 620b zone 620c zone 620d zone 620e zone 620f zone 620g zone 620h zone 620i zone 700 presence detection system 710 time-of-flight sensor 715 VCSEL 720 SPAD 725 control circuitry 730 driver circuitry 735 optics 750 processing circuitry 760 host device 780 package 785 electrical contacts 790 first aperture 795 second aperture