Sensing system
20230130040 · 2023-04-27
Inventors
- Miguel Bruno Vaello Paños (Zurich, CH)
- Daniel FURRER (Gebenstorf, CH)
- Javier Miguel Sánchez (Zurich, CH)
- Stephan Beer (Schaffhausen, CH)
Cpc classification
G01S7/4915
PHYSICS
G01S17/34
PHYSICS
International classification
G01S17/34
PHYSICS
Abstract
A sensing system is disclosed for performing distance measurements. The sensing system may include an emitter configured to emit electromagnetic radiation modulated at a known frequency. The sensing system may further include a detector configured to sample incident electromagnetic radiation at the known frequency, convert the sampled electromagnetic radiation into charge carriers, and collect the charge carriers in a storage component to produce an electronic signal. The sensing system may include a processor configured to determine a correction by applying a non-linear polynomial function to the electronic signal.
Claims
1. A sensing system for performing distance measurements; wherein the sensing system comprises: an emitter configured to emit electromagnetic radiation modulated at a known frequency; a detector configured to: sample incident electromagnetic radiation at the known frequency; convert the sampled electromagnetic radiation into charge carriers; and, collect the charge carriers in a storage component to produce an electronic signal, wherein the sensing system further comprises a processor configured to determine a correction by applying a non-linear polynomial function to the electronic signal.
2. The sensing system of claim 1, wherein a variable of the non-linear polynomial function is proportional to a non-linear offset to the electronic signal, the non-linear offset being at least partially dependent upon a non-linear charge transfer in the storage component.
3. The sensing system of claim 1, wherein the electronic signal is indicative of a plurality of amplitudes of the sampled electromagnetic radiation at a plurality of different phases of the sampled electromagnetic radiation.
4. The sensing system of claim 1, wherein the electronic signal is indicative of a difference between a first amplitude at a first phase of the sampled electromagnetic radiation and a second amplitude at a second phase of the sampled electromagnetic radiation.
5. The sensing system of claim 1, wherein the processor is configured to apply the non-linear polynomial function to the electronic signal only above a threshold value of the electronic signal, wherein the threshold value corresponds to an electronic signal value at which the collection of charge carriers in the storage component becomes non-linear.
6. The sensing system of claim 1, wherein the storage component comprises an integration gate, and wherein the electronic signal is an integration gate signal that corresponds to an amount of charge that is stored in the integration gate.
7. The sensing system of claim 1, wherein the emitter is configured to emit continuous wave electromagnetic radiation modulated at the known frequency.
8. The sensing system of claim 1, wherein the non-linear polynomial function is a second order polynomial function having the following form:
y=p.sub.2.Math.x.sup.2+p.sub.1.Math.x+p.sub.0 where y is the correction, x is the electronic signal and p.sub.0, p.sub.1, and p.sub.2 are coefficients that are indicative of a non-linear offset experienced by the electronic signal.
9. The sensing system of claim 1, wherein the non-linear polynomial function is a second order polynomial function having the following form:
y=p.sub.2.Math.x.sup.2+p.sub.1.Math.x+(p.sub.0+xtalk.sub.i) where y is the correction, x is the electronic signal, p.sub.0, p.sub.1, and p.sub.2 are coefficients that are indicative of a non-linear offset experienced by the electronic signal, and xtalk.sub.i is indicative of a portion of the emitted electromagnetic radiation that is reflected by a component of the sensing system and/or components of an electronic device incorporating the sensing system.
10. The sensing system of claim 1, wherein the detector is configured to: sample a plurality of different phases of the incident electromagnetic radiation at the known frequency; convert the sampled plurality of different phases into charge carriers; and, collect the charge carriers in a plurality of storage components, wherein the processor is configured to determine a plurality of corrections by applying a plurality of non-linear polynomial functions to the plurality of electronic signals.
11. The sensing system of claim 10, wherein the processor is configured to apply the plurality of non-linear polynomial functions to the plurality of electronic signals only above a plurality of threshold values of the plurality of electronic signals.
12. The sensing system of claim 10, wherein the processor is configured to subtract a common-mode signal from the plurality of electronic signals before applying the plurality of non-linear polynomial functions to the plurality of electronic signals.
13. An electronic device comprising the sensing system of claim 1.
14. A method of performing a distance measurement comprising: emitting electromagnetic radiation modulated at a known frequency; sampling incident electromagnetic radiation at the known frequency; converting the sampled electromagnetic radiation into charge carriers; collecting the charge carriers to produce an electronic signal; and, determining a correction by applying a non-linear polynomial function to the electronic signal.
15. The method of claim 14, wherein a variable of the non-linear polynomial function is proportional to a non-linear offset to the electronic signal, the non-linear offset being at least partially dependent upon a non-linear charge transfer associated with collecting the charge carriers.
16. The method of claim 14, wherein the electronic signal is indicative of a plurality of amplitudes of the sampled electromagnetic radiation at a plurality of different phases of the sampled electromagnetic radiation.
17. The method of claim 14, wherein the electronic signal is indicative of a difference between a first amplitude at a first phase of the sampled electromagnetic radiation and a second amplitude at a second phase of the sampled electromagnetic radiation.
18. The method of claim 14, wherein the non-linear polynomial function is applied to the electronic signal only above a threshold value of the electronic signal, wherein the threshold value corresponds to an electronic signal value at which the collection of charge carriers becomes non-linear.
19. The sensing system of claim 14, wherein collecting the charge carriers to produce an electronic signal comprises storing the charge carriers in an integration gate, and wherein the electronic signal is an integration gate signal that corresponds to an amount of charge that is stored in the integration gate.
20. (canceled)
21. (canceled)
22. (canceled)
23. (canceled)
24. A computer program comprising computer readable instructions configured to cause a computer to carry out a method according to claim 14.
25. (canceled)
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0090] Some embodiments will now be described by way of example only and with reference to the accompanying drawings, in which:
[0091]
[0092]
[0093]
[0094]
[0095]
[0096]
[0097]
[0098]
[0099]
[0100]
[0101]
[0102] Elements that are identical, similar or have the same effect are given the same reference signs in the Figures. The Figures and the proportions of the elements shown in the Figures are not to be regarded as to scale. Rather, individual elements can be shown exaggeratedly large for better representability and/or for better comprehensibility.
DETAILED DESCRIPTION
[0103]
[0104] The sensing system further comprises a detector 130 configured to sample incident electromagnetic radiation 140 at the known frequency. The detector 130 is further configured to convert the sampled electromagnetic radiation 140 into charge carriers which are collected in a storage component (not shown) to produce an electronic signal. The detector 130 is configured to measure an amplitude and a phase of the sampled electromagnetic radiation 140. The detector 130 comprises an array of demodulation pixels (not shown). The demodulation pixels are configured to demodulate the incident electromagnetic radiation 140 at the known frequency. The demodulation pixels may be referred to as lock-in pixels due to their similarity in function to lock-in amplifiers.
[0105] The detector 130 may operate on a charge-coupled device (CCD) principle and/or a complementary metal-oxide-semiconductor (CMOS) principle. The detector 130 detects electromagnetic radiation that has been emitted by the emitter 110 after the electromagnetic radiation has exited the sensing system 100, interacted with (e.g. reflected from) an external target (not shown) and propagated back to the detector 130. The detector 130 may comprise any form of photodetector, e.g. a photodiode or a single photon avalanche diode (SPAD).
[0106] The sensing system 100 further comprises a processor 150 configured to determine a correction by applying a non-linear polynomial function to the electronic signal. The processor 150 may be configured to determine a phase shift of the sampled electromagnetic radiation relative to a phase of the emitted electromagnetic radiation.
[0107] In the example of
[0108] The components of the sensing system 100 are contained within a housing 170. The housing 170 includes apertures 180, 190 for allowing emitted electromagnetic radiation 120 to exit the sensing system 100 and for allowing incident electromagnetic radiation 140 to enter the sensing system 100 and be incident on the detector 130. The sensing system 100 may comprise one or more optical assemblies (not shown) configured to adjust a characteristic of the emitted electromagnetic radiation 120 and/or the incident electromagnetic radiation 140. The optical assemblies may be collocated with the apertures 180, 190. The optical assembly may comprise a transmissive (e.g., glass) carrier for supporting an optical element (not shown). The optical element may comprise a micro-lens array (MLA, an optical diffuser, a lens, a refractive or diffractive optical element, a spectral filter, a polarizing filter, etc.
[0109] The sensing system 100 is configured to perform indirect time-of-flight measurements to calculate distances to targets. The sensing system 100 is suitable for being incorporated into an electronic device such as, for example, a mobile phone or a tablet computer. The sensing system 100 may be used for relatively high accuracy distance measurements. The sensing system 100 may alternatively be used as a proximity sensing system in which the emitter 110 emits electromagnetic radiation, at least some of which exits the sensing system 100 and interacts with (e.g. reflects from) from one or more external objects before being incident on the detector 130 for detection. The amount of radiation emitted by the emitter 110 may be compared to the amount of radiation detected by the detector 130 in order to determine a distance between the sensing system 100 and the one or more external objects. The proximity sensing system may be used for relatively low accuracy measurements.
[0110]
[0111] A time-of-flight of the reflected signal 210 may be determined using the following equation:
[0112] where Δφ is the phase shift Δφ between the emitted signal 200 and the reflected signal, and f is a modulation frequency of the emitted signal 200.
[0113] In the example of
[0114] where A.sub.0, A.sub.1, A.sub.2 and A.sub.3 are amplitudes of the reflected signal 210 at four different phases and n is the number of samples taken in the modulation period (in this example, n=4). This information may be used to construct a black and white image of a scene sensed by the detector.
[0115] An amplitude 220 of the reflected signal 210 may be determined using the following equation:
[0116] This information may be used to determine a reliability of measurements performed using the sensing system.
[0117] A phase of the reflected signal 210 may be determined using the following equation:
[0118] This information may be used to determine the phase shift Δφ between the emitted signal 200 and the reflected signal 210. In turn, the phase shift Δφ may be used to determine a distance between the sensing system and a target that reflected the reflected signal 210.
[0119] As previously discussed, the detector converts the sampled electromagnetic radiation into charge carriers (e.g. electrons and/or holes) which are collected in a storage component to produce an electronic signal. The storage component may be referred to as a tap. The storage component may be implemented as CCD gate or a p-n junction diode. The storage component may be referred to as an integration gate. The resulting electronic signal may be referred to as an integration gate signal. The integration gate signal may correspond to an amount of charge that is stored in the integration gate. The electronic signal or the integration gate signal may take the form of a voltage.
[0120] The electronic signal may comprise one or more amplitudes (e.g. A0, A1, A2 and/or A3) of the reflected signal 210 at one or more different phases of the reflected signal 210. The electronic signal comprising the one or more amplitudes (e.g. A0, A1, A2 and/or A3) of the reflected signal 210 at one or more different phases of the reflected signal 210 may be used to calculate the amplitude offset 230 (B) as described above.
[0121] The electronic signal may comprise a difference between two or more amplitudes of the reflected signal 210 at two or more different phases of the reflected signal 210. For example, the electronic signal may be comprise a difference between a fourth amplitude at a fourth phase and a second amplitude at a second phase (e.g. A.sub.3−A.sub.1). As another example, the electronic signal may comprise a difference between a first amplitude at a first phase and a third amplitude at a third phase (e.g. A.sub.0−A.sub.2). The electronic signal may comprise a difference between any combinations of the measured amplitudes at the different phases. The electronic signal comprising a difference in amplitudes at different phases may be used when calculating the amplitude 220 (A) of the reflected signal 210 and/or the phase (φ) of the reflected signal 210 as described above. A non-linear polynomial function may be applied to the electronic signal in order to improve an accuracy of said calculations (described in more detail below).
[0122] The charge carriers generated in a photosensitive region of the detector may be directed towards the storage component using a bias voltage. The bias voltage may be modulated (e.g. at a frequency that is substantially equal to the known modulation frequency of the emitted electromagnetic radiation) such that only charge carriers generated during certain time intervals (corresponding to certain phases of the emitted electromagnetic radiation) are collected by the storage component. Other charge carriers may be directed to a charge dump. The modulating voltage may effectively act as an electronic shutter that operates at substantially the same frequency as the known modulation frequency of the emitted electromagnetic radiation.
[0123]
[0124] Photo-generated charges coming from the detection region are fed into the demodulation stage below the middle gate MG. The adjacent left gate and right date LG, RG may be used to activate either the left or the right conduction channel respectively for demodulation purposes, respectively. Such an activation may involve setting the potential of one of the left gate LG or the right gate RG higher than the potential of the middle gate MG and to set the potential of the other gate smaller than the potential of the middle gate MG. An illustration of the potentials applied to the different gates at a given time is shown in
[0125] On both sides the particular charge carriers are stored in the first integration gate IG1 or the second integration gate IG2. The first and second decoupling gates DG1 and DG2 inhibit the ability of the charge carriers to diffuse uncontrollably to output nodes D1, D2. The output nodes D1, D2 may be referred to as sense nodes or diffusion regions. When the charge carriers that are accumulated in one of the integration gates IG1, IG2 are to be transferred to the output nodes D1, D2 of the demodulation region, the potential level of the integration gates IG1, IG2 and of the left and right gates LG, RG are set to the potential level of the decoupling gates DG1, DG2 enabling the diffusion of the charge carriers to the output nodes D1, D2.
[0126] In the example of
[0127] The storage compartments and/or the sensor nodes are not identical to each other. That is, imperfections result in small differences within the electronics, and each storage compartment and/or sensor node has its own characteristic response to charge carrier collection and electronic signal readout. Such imperfections may include varying non-linear charge transfer when approaching saturation of the storage compartments, differences between the storage compartments, differences between the paths taken by the charge carriers and/or electronic signals, etc. These imperfections contribute a non-linear offset to the electronic signal that negatively affects the accuracy of measurements performed by the sensing system (particularly at larger distances when the signal-to-noise ratio is not as strong). These non-linear offsets can be at least partially compensated for if each sample or combination of samples (e.g. the differences between samples) is adjusted by a non-linear polynomial function whose variable is proportional to the non-linear offset values.
[0128] As previously discussed, the detector may comprise an array of SPADs. In such embodiments, the storage component may comprise a plurality of counters configured to count the number of breakdown events triggered in the array of SPADs. Each counter may be configured to sample breakdown events during certain time intervals that correspond to certain phases of the reflected signal. That is, each counter may correspond to a different phase of the reflected signal.
[0129]
[0130] In the example of
[0131] In the example of
y=p.sub.2.Math.x.sup.2+p.sub.1.Math.x+p.sub.0 [0132] where y is the correction, x is the electronic signal and p.sub.0, p.sub.1, and p.sub.2 are coefficients of the second order polynomial function that are indicative of the non-linear offset experienced by the electronic signal. The coefficients of the polynomial function may be determined by performing a calibration measurement and/or performing a statistical analysis of the results of the calibration. For example, the emitter may be used to illuminate different targets at different distances with electromagnetic radiation having different characteristics (e.g. wavelength, power, etc.).
[0133] The second order polynomial function may take the following form:
y=p.sub.2.Math.x.sup.2+p.sub.1.Math.x+p.sub.0+xtalk.sub.i [0134] where xtalk.sub.i is indicative of one or more portions of the emitted signal that are reflected back towards the detector by components (e.g. an optical assembly) of sensing system itself and/or by components (e.g. a cover or screen) of an electronic device comprising the electronic system. For example if the sensing system is incorporated into a mobile phone, the screen of the mobile phone may reflect part of the emitted signal back towards the reflect without ever leaving the mobile phone and being incident on a target. Such internally reflected portions of emitted signal do not provide information on targets located outside of the mobile phone, and therefore negatively affect an accuracy of measurements made using the sensing system. The term xtalk.sub.i at least partially accounts for these internally reflected portions of the emitted signal, thereby improving an accuracy of the sensing system.
[0135] The term xtalk.sub.i may be determined by performing a calibration measurement and/or performing a statistical analysis of the results of the calibration. For example, the emitter may be used to illuminate different targets at different distances with electromagnetic radiation having different characteristics (e.g. wavelength, power, etc.). The term xtalk.sub.i may be determined for each sensing system and/or each electronic device that the sensing system is incorporated into. This is because the term xtalk.sub.i may vary between different electronic devices that incorporate the sensing system (e.g. different mobile phone glass covers, even within the same or similar mobile phone models). The time-of-flight of these internally reflected portions of the emitted signal is significantly less than the time-of-flight of reflected signals of interest (i.e. signals reflected form a target outside of the sensing system/electronic device). This knowledge may be used to identify such internally reflected signals and calibrate for them using the term xtalk.sub.i.
[0136] Terms and/or coefficients of the non-linear polynomial function may be stored in a memory of the sensing system. The non-linear polynomial may be applied to electronic signals associated with each storage compartment individually to determine individual corrections for each storage compartment. The processor may be configured to use the correction(s) and the electronic signal(s) to determine values that are indicative of a distance to the target and/or a reflectivity of a target (e.g. an amplitude offset B between the emitted signal and the reflected signal, an amplitude A of the reflected signal, a phase φ of the reflected signal and/or a phase shift Δφ between the emitted signal and the reflected signal).
[0137] Scaling may be used to simplify the computation of the correction. That is, to save data and/or computational memory space, some scaling may be implemented, e.g. in a firmware of the sensing system. A distance value may be scaled. For example, instead of performing calculations based on meters (and having to handle a numerical value of, for example, “1000” meters, the numerical value can be scaled by 1*10.sup.3 (i.e. 1E3) to be represented in kilometers. This way, the sensing system handles a smaller numerical value of “1” instead of “1000”.
[0138]
[0139]
[0140]
[0141]
[0142] Embodiments may be used in many different applications, such as for example a smartphone, a tablet computer, a laptop computer, a computer monitor, a car dashboard and/or navigation system, an interactive display in a public space, a home assistant, etc.
LIST OF REFERENCE NUMERALS
[0143] 100 sensing system [0144] 110 emitter [0145] 120 electromagnetic radiation [0146] 130 detector [0147] 140 incident electromagnetic radiation [0148] 150 processor [0149] 160 printed circuit board [0150] 170 housing [0151] 180 aperture [0152] 190 aperture [0153] 200 emitted electromagnetic signal [0154] 210 reflected electromagnetic signal [0155] 220 amplitude of reflected signal [0156] 230 amplitude offset [0157] A0-A3 phases of reflected signal [0158] 2 demodulation region [0159] LG left gate [0160] MG middle gate [0161] RG right gate [0162] IG1 first integration gate [0163] DG1 first decoupling gate [0164] IG2 second integration gate [0165] DG2 second decoupling gate [0166] GCI gate contact [0167] GCm gate contact [0168] V potential [0169] D1 output node [0170] D2 output node [0171] GS closed gate [0172] GC10-GC40 gate contacts [0173] IG10-IG40 integration gates [0174] DG10-DG40 decoupling gates [0175] D10-D40 output nodes [0176] V potential [0177] GH gate material [0178] MCV correction [0179] ES electronic signal value [0180] T threshold value [0181] MD measured distance [0182] AD actual distance [0183] 610 first background light condition [0184] 620 second background light condition [0185] 630 third background light condition [0186] 640 fourth background light condition [0187] 650 fifth background light condition [0188] 660 sixth background light condition [0189] 670 seventh background light condition [0190] 700 electronic device [0191] 710 camera [0192] 720 touch screen [0193] 810 first method step [0194] 820 second method step [0195] 830 third method step [0196] 840 fourth method step [0197] 850 fifth method step
[0198] The skilled person will understand that in the preceding description and appended claims, positional terms such as ‘above’, ‘along’, ‘side’, etc. are made with reference to conceptual illustrations, such as those shown in the appended drawings. These terms are used for ease of reference but are not intended to be of limiting nature. These terms are therefore to be understood as referring to an object when in an orientation as shown in the accompanying drawings.
[0199] Although the disclosure has been described in terms of preferred embodiments as set forth above, it should be understood that these embodiments are illustrative only and that the claims are not limited to those embodiments. Those skilled in the art will be able to make modifications and alternatives in view of the disclosure that are contemplated as falling within the scope of the appended claims. Each feature disclosed or illustrated in the present specification may be incorporated in any embodiments, whether alone or in any appropriate combination with any other feature disclosed or illustrated herein.