TIME-OF-FLIGHT SENSOR AND METHOD FOR ADJUSTING AN EXPOSURE TIME OF SUCH A SENSOR
20230393250 · 2023-12-07
Assignee
Inventors
- Jeremie Teyssier (Grenoble, FR)
- Antoine Drouot (Paris, FR)
- Thibault AUGEY (Grenoble, FR)
- Valerie PENA-LAROCHE (Grenoble, FR)
Cpc classification
G01S17/894
PHYSICS
G01S7/4915
PHYSICS
G01S7/4918
PHYSICS
International classification
G01S7/481
PHYSICS
G01S17/894
PHYSICS
Abstract
An indirect time-of-flight measurement sensor includes a photosensitive pixel array configured to acquire a succession of images of a scene during a given exposure time. The sensor includes a control unit configured to control the acquisition of the succession of images by the pixel array and to define an exposure time for this acquisition based on a pixel saturation rate of the array, distances between the sensor and elements of the scene, and a standard deviation of the distances between the sensor and the elements of the scene.
Claims
1. An indirect time-of-flight measurement sensor, comprising: a photosensitive pixel array configured to acquire a succession of images of a scene during a given exposure time; and a control unit configured to control an acquisition of a succession of images by the pixel array and to define an exposure time for the acquisition according to a pixel saturation rate of the array, distances between the sensor and elements of the scene, and a standard deviation of the distances between the sensor and the elements of the scene.
2. The sensor according to claim 1, wherein the control unit is configured to define the exposure time for the acquisition from the pixel saturation rate of the array and a precision of the sensor corresponding to a ratio between the distances between the sensor and elements of the scene and the standard deviation of the distances between the sensor and the elements of the scene.
3. The sensor according to claim 2, wherein the control unit is configured to compare the pixel saturation rate with a saturation rate threshold, and to: if the pixel saturation rate is greater than the saturation rate threshold, reduce the exposure time, otherwise compare the precision to a precision threshold, and if the precision is greater than the precision threshold, reduce the exposure time, otherwise, increase the exposure time.
4. The sensor according to claim 3, wherein the control unit is configured to adjust the exposure time of the sensor by increasing or by reducing the value of the exposure time by a percentage between a minimum step and a maximum step.
5. The sensor according to claim 4, wherein the precision is evaluated from the mathematical formula
6. The sensor according to one of claim 5, wherein, if the saturation rate threshold is incompatible with the precision threshold, then the control unit is configured to update the precision threshold with the saturation rate.
7. A method, comprising: acquiring a succession of images of a scene with pixels of a photosensitive pixel array of an indirect time-of-flight measurement sensor during a given exposure time; and defining the exposure time for the acquisition based on a pixel saturation rate of the array, distances between the sensor and elements of the scene, and a standard deviation of the distances between the sensor and the elements of the scene.
8. The method according to claim 7, comprising defining the exposure time for the acquisition based on the pixel saturation rate of the array and a precision of the sensor corresponding to a ratio between the distances between the sensor and elements of the scene and the standard deviation of the distances between the sensor and the elements of the scene.
9. The method according to claim 8, comprising comparing the pixel saturation rate with a saturation rate threshold, and if the pixel saturation rate is greater than the saturation rate threshold, reducing the exposure time, otherwise comparing the precision with a precision threshold, and if the precision is greater than the precision threshold, reducing the exposure time, otherwise, increasing the exposure time.
10. The method according to claim 9, comprising adjusting the exposure time of the sensor by increasing or by reducing the value of the exposure time by a percentage between a minimum step and a maximum step.
11. The method according to claim 10, comprising evaluating the precision from the mathematical formula
12. The method according to claim 11, comprising updating the precision threshold with the saturation rate if the saturation rate threshold is incompatible with the precision threshold.
13. A method, comprising: sensing, for each of a plurality of objects, a distance between a sensor and the object; calculating a standard deviation of the distances; selecting, with a control unit of the sensor, an exposure time based on a pixel saturation rate of a photosensitive pixel array of the sensor and on the standard deviation of the distance; acquiring, with a photosensitive pixel array of a sensor, a plurality of images of the objects with the selected exposure time.
14. The method of claim 13, comprising selecting the exposure time based on a precision of the sensor.
15. The method of claim 14, wherein the precision of the sensor corresponds to a ratio between the distances and the standard deviation of the distances.
16. The method of claim 15, comprising comparing, with the control unit, the pixel saturation rate with a saturation rate threshold.
17. The method of claim 16, comprising reducing the exposure time if the pixel saturation rate is greater than the saturation rate threshold.
18. The method of claim 17, comprising: comparing the precision to a precision threshold if the pixel saturation rate is less than the saturation rate threshold; reducing the exposure time if the precision is greater than the precision threshold; and increasing the exposure time if the precision is less than the precision threshold.
19. The method of claim 18, comprising adjusting the exposure by increasing or by reducing the value of the exposure time by a percentage between a minimum step and a maximum step.
20. The method of claim 19, comprising evaluating, with the control unit, the precision from a mathematical formula
Description
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
[0039] Other advantages and characteristics of principles of the present disclosure shall appear when examining the detailed description of embodiments, in no way limiting, and of accompanying drawings wherein:
[0040]
[0041]
[0042]
[0043]
DETAILED DESCRIPTION
[0044]
[0045] The iTOF sensor is configured to emit a light signal in a scene wherein the iTOF sensor is placed. This light signal can then be reflected by the different elements of the scene to the pixel array PXM.
[0046] The pixel array PXM is configured to carry out acquisitions of successions of images of the scene by accumulating the light signals that it detects.
[0047] The successions of images acquired allow the control unit UC to determine a phase shift between the signal emitted by the sensor and the signals reflected by the elements of the scene and detected by the pixel array PXM. The control unit UC is then configured to calculate a distance between this sensor and the elements of the scene from the determined phase shift.
[0048] The acquisition of the images is carried out during an exposure time that can be adapted so as to offset the various luminosities of the images acquired.
[0049] The control unit UC is also configured to adapt the exposure time of the pixels of the array PXM for each acquisition of a succession of images.
[0050] The exposure time is adapted according to the method for adjusting the exposure time described hereinafter in relation with
[0051]
[0052] The method for adjusting includes a step 20 of acquiring wherein a succession of images is acquired by the pixel array PXM during a given exposure time T.sub.int. The pixels then deliver the data acquired to the control unit.
[0053] The method for adjusting further includes a step 21 of determining statistics STAT to be taken into account for the adjusting of the exposure time T.sub.int. As shown in
[0054] In particular, the distances between the elements of the scene and the sensor and the standard deviation of the distances are used to determine a precision of the measurements with respect to the distances. In particular, the precision is determined by the formula
wherein z corresponds to the distance of an element of the scene with respect to the sensor, and σ.sub.z corresponds to the standard deviation of the distances of the elements of the scene with respect to the sensor. An average of the precision
corresponding to the precision of the succession of acquired images. However, for reasons of simplification, it is preferable to use the formula
to evaluate the precision of the sensor. Indeed, this method has the advantage of varying linearly with respect to the exposure time.
[0055] The method for adjusting then includes a step 22 of determining an exposure time T.sub.int to be applied. In this step 22, the control unit UC determines the exposure time T.sub.int to be applied for the next acquisition of images according to the statistics determined in step 21.
[0056] Finally, the method for adjusting includes a step 23 of updating the exposure time T.sub.int. In this step 23, the control unit UC updates the exposure time to be applied for the next acquisition by the exposure time T.sub.int determined in step 22.
[0057] Steps 20 to 23 are repeated for each acquisition of images.
[0058]
[0059] If the calculated saturation rate is greater than the given saturation rate threshold T.sub.sat, then the exposure time T.sub.int to be applied is decreased with respect to the previously applied exposure time T.sub.int.
[0060] If the calculated saturation rate is less than the given saturation rate threshold, then step 22 includes a comparison 31 of the saturation rate threshold T.sub.sat and the precision threshold T.sub.prec making it possible to determine if the given saturation rate threshold T.sub.sat is compatible with a given precision threshold T.sub.prec.
[0061] Comparing in a first step the saturation rate with the saturation rate threshold T sat makes it possible to prevent saturating the pixels of the array.
[0062] If the given saturation rate threshold T.sub.sat is compatible with the given precision threshold T.sub.prec, the step 22 includes a comparison 32 between a calculated precision and the given precision threshold T.sub.prec. A precision greater than the precision threshold T.sub.prec means that the data acquired from the pixel array PXM is too precise. A precision less than the precision threshold T.sub.prec means that the data acquired from the pixel array PXM is not precise enough.
[0063] If the calculated precision is greater than the given precision threshold T.sub.prec, then the exposure time T.sub.int to be applied is decreased with respect to the previously applied exposure time T.sub.int.
[0064] If the calculated precision is less than the given precision threshold T.sub.prec, then the exposure time T.sub.int to be applied is increased with respect to the previously applied exposure time T.sub.int.
[0065] Moreover, if the given saturation rate threshold T.sub.sat is incompatible with the given precision threshold T.sub.prec, then step 22 includes an updating 33 of the precision threshold T.sub.prec with the saturation rate T.sub.sat. In practice, the precision threshold T.sub.prec is updated with a value proportional to T.sub.sat in order to prevent a phenomenon of blinking of the luminosity of the images. The proportionality coefficient being a parameter that can be adjusted of the algorithm between zero and one. Then, step 22 includes the comparison 32 between the calculated precision and the given precision threshold T.sub.prec, before adjusting the exposure time T.sub.int as described hereinabove.
[0066] During step 22, the control unit UC thus adjusts the exposure time of the sensor by increasing or by reducing the value of the exposure time T.sub.int by a percentage between a minimum step and a maximum step. This minimum step and this maximum step are defined parameters of the algorithm and known by the control unit.
[0067] The iTOF sensor is therefore configured to adapt the exposure time for an acquisition of a succession of images not only according to a saturation rate of the sensor but also according to the distance between the elements of the scene and the sensor as well as the standard deviation of the distances between the elements of the scene and the sensor.
[0068] In particular, the distance between the elements of the scene and the iTOF sensor as well as the standard deviation of the distances between the elements of the scene and the sensor make it possible to define a precision of the acquisition with respect to the distance of the elements of the scene with respect to the sensor.
[0069] The iTOF sensor is therefore configured to adapt the exposure time according to a saturation rate of the sensor and a precision of the acquisition. Such an adjustment of the exposure time makes it possible to optimize a compromise between an energy consumption of the sensor and a signal-to-noise ratio of the sensor. By taking account of the precision of the acquisition to define the exposure time, it is possible to reduce the exposure time to obtain a desired precision and a desired saturation of the pixels. The sensor therefore makes it possible to prevent an undesired increase in the exposure time which would result in excessively high precision of the sensor with respect to the distance of the elements of the scene with respect to the sensor.
[0070] An indirect time-of-flight measurement sensor may be summarized as including: a photosensitive pixel array (PXM) configured to acquire a succession of images of a scene during a given exposure time, a control unit (UC) configured to control an acquisition of a succession of images by the pixel array (PXM) and to define an exposure time for this acquisition according to a pixel saturation rate of the array (PXM), distances (z) between the sensor and elements of the scene and a standard deviation (σ.sub.z) of the distances between the sensor and the elements of the scene.
[0071] The control unit (UC) may be configured to define the exposure time (T.sub.int) for the acquisition from the pixel saturation rate of the array (PXM) and a precision of the sensor corresponding to a ratio between the distances (z) between the sensor and elements of the scene and the standard deviation (σ.sub.z) of the distances between the sensor and the elements of the scene.
[0072] The control unit (UC) may be configured to compare the pixel saturation rate with a saturation rate threshold (T.sub.sat), and to: if the pixel saturation rate is greater than the saturation rate threshold (T.sub.sat), reduce the exposure time (T.sub.int), otherwise compare the precision to a precision threshold (T.sub.prec), and if the precision is greater than the precision threshold (T.sub.prec), reduce the exposure time (T.sub.int), otherwise, increase the exposure time (T.sub.int).
[0073] The control unit (UC) may be configured to adjust the exposure time of the sensor by increasing or by reducing the value of the exposure time (T.sub.int) by a percentage between a minimum step and a maximum step.
[0074] The precision may be evaluated from the mathematical formula
wherein z is a distance between an element of the scene with respect to the sensor and σ.sub.z is the standard deviation of the distances between the sensor and the elements of the scene.
[0075] The saturation rate threshold (T.sub.sat) may be incompatible with the precision threshold (T.sub.prec), then the control unit is configured to update the precision threshold (T.sub.prec) with the saturation rate (T.sub.sat).
[0076] The method for defining an exposure time for an acquisition of a succession of images of a scene by pixels of a photosensitive pixel array (PXM) of an indirect time-of-flight measurement sensor during a given exposure time, the method may be summarized as including a definition of the exposure time for the acquisition according to a pixel saturation rate of the array (PXM), of the distances between the sensor and elements of the scene and a standard deviation of the distances between the sensor and the elements of the scene.
[0077] The method may include a definition of the exposure time (T.sub.int) for the acquisition from the pixel saturation rate of the array (PXM) and a precision of the sensor corresponding to a ratio between the distances (z) between the sensor and elements of the scene and the standard deviation (σ.sub.z) of the distances between the sensor and the elements of the scene.
[0078] The method may include a comparison of the pixel saturation rate with a saturation rate threshold (T.sub.sat), and if the pixel saturation rate is greater than the saturation rate threshold (T.sub.sat), a reduction in the exposure time (T.sub.int), otherwise a comparison of the precision with a precision threshold (T.sub.prec), and if the precision is greater than the precision threshold (T.sub.prec), a reduction in the exposure time (T.sub.int), otherwise, an increase in the exposure time (T.sub.int).
[0079] The method may include an adjustment of the exposure time (T.sub.int) of the sensor by increasing or by reducing the value of the exposure time (T.sub.int) by a percentage between a minimum step and a maximum step.
[0080] The precision may be evaluated from the mathematical formula
wherein z is a distance between an element of the scene with respect to the sensor and σ.sub.z is the standard deviation of the distances between the sensor and the elements of the scene.
[0081] If the saturation rate threshold (T.sub.sat) is incompatible with the precision threshold (T.sub.prec), then the method may include an updating of the precision threshold (T.sub.prec) with the saturation rate (T.sub.sat).
[0082] These and other changes can be made to the embodiments in light of the above-detailed description. In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but should be construed to include all possible embodiments along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.