DETECTION DEVICE OF LIDAR, LIDAR, AND DETECTION METHOD THEREFOR
20230003850 · 2023-01-05
Inventors
Cpc classification
G01S17/42
PHYSICS
International classification
G01S7/481
PHYSICS
Abstract
A detection device of a light detection and ranging (lidar) device, a detection method, and a lidar device are provided. The detection device predicts the location of light spots of a reflected echo on a detector array, and reads electric signals of a subset of the photodetectors corresponding to the light spots. According to the detection method, the location on a detector array for light spots of a reflected echo is predicted according to a time of flight of a detection beam, a subset of the photodetectors corresponding to the light spots are activated, and their electric signals are read. All received light is detected, without increasing the receiving field of view, ambient light interference is suppressed, and the problem of shift of the light spots on a focal plane caused by optical path distortion is effectively solved.
Claims
1. A detection device of a light detection and ranging (lidar) device, comprising: a detector array, comprising a plurality of individually addressable photodetectors, wherein each of the plurality of individually addressable photodetectors is configured to: receive an echo of a detection beam emitted by the lidar device and reflected by a target object; and convert the echo into an electric signal; and a controller, coupled to the detector array, and configured to: predict a location on the detector array for a light spot of the echo of the detection beam reflected by the target object according to a time of flight of the detection beam emitted by the lidar device; and read electric signals of a subset of the plurality of individually addressable photodetectors corresponding to the light spot.
2. The detection device according to claim 1, wherein each of the plurality of individually addressable photodetectors comprises a single-photon detector, the detection device further comprises a plurality of address lines respectively corresponding to and connected to the plurality of individually addressable photodetectors, and the controller is electrically connected to the plurality of individually addressable photodetectors through the plurality of address lines for reading the electric signals.
3. The detection device according to claim 1, wherein the plurality of individually addressable photodetectors remain in an activated state during an operation of the lidar device.
4. A detection device of a light detection and ranging (lidar) device, comprising: a detector array, comprising a plurality of individually addressable photodetectors, wherein each of the plurality of individually addressable photodetectors is configured to: receive an echo of a detection beam emitted by the lidar device and reflected by a target object; and convert the echo into an electric signal; and a controller, coupled to the detector array, and configured to: predict a location on the detector array for a light spot of the echo of the detection beam reflected by the target object according to a time of flight of the detection beam emitted by the lidar device; energize a subset of the plurality of individually addressable photodetectors corresponding to the light spot to be in an activated state; and read electric signals of the subset of the plurality of individually addressable photodetectors.
5. The detection device according to claim 4, further comprising: a drive circuit for each of the plurality of individually addressable photodetectors, wherein the drive circuit comprises a Zener diode, each of the plurality of individually addressable photodetectors is connected to a drive voltage through the Zener diode, wherein the drive circuit further comprises a switching device coupled at two ends of the Zener diode, wherein the switching device is coupled to the controller, and an on or an off state of the switching device is controlled by the controller; and based on the switching device being turned on, the Zener diode is short-circuited and the corresponding photodetector is activated; and based on the switching device being turned off, the Zener diode is not short-circuited, and the corresponding photodetector is disabled.
6. The detection device according to claim 5, wherein each of the plurality of individually addressable photodetectors comprises a single-photon detector, the detection device further comprises a plurality of address lines respectively corresponding to and connected to the plurality of individually addressable photodetectors, and the controller is electrically connected to the plurality of individually addressable photodetectors through the plurality of address lines for reading the electric signals.
7. A light detection and ranging (lidar) device, comprising a detection device, the detection device comprising: a detector array, comprising a plurality of individually addressable photodetectors, wherein each of the plurality of individually addressable photodetectors is configured to: receive an echo of a detection beam emitted by the lidar device and reflected by a target object; and convert the echo into an electric signal; and a controller, coupled to the detector array, and configured to: predict a location on the detector array for a light spot of the echo of the detection beam reflected by the target object according to a time of flight of the detection beam emitted by the lidar device; and read electric signals of a subset of the plurality of individually addressable photodetectors corresponding to the light spot.
8. The lidar device according to claim 7, further comprising: a laser emitter, configured to emit a laser beam for detecting the target object; an emitting lens, located downstream of an optical path of the laser emitter, and configured to: receive the laser beam; modulate the laser beam; and emit the modulated laser beam to outside of the lidar device; and a receiving lens, configured to: receive an echo of the laser beam emitted by the laser emitter and reflected by the target object; and converge the echo onto the detector array, wherein the detector array is located on a focal plane of the receiving lens.
9. The lidar device according to claim 8, wherein a location (x.sub.t, y.sub.t) on the detector array for the light spot of the echo of the detection beam reflected by the target object is determined by the controller according to the following formulas:
10. The lidar device according to claim 7, further comprising: a laser emitter, configured to emit a laser beam for detecting the target object; a field of view scanning apparatus, configured to: reflect the laser beam to outside of the lidar device; and receive an echo of the laser beam emitted by the laser emitter and reflected by the target object; and a receiving lens, configured to converge the echo of the laser beam emitted by the laser emitter and reflected by the target object onto the detector array, wherein the detector array is located on a focal plane of the receiving lens.
11. The lidar device according to claim 10, wherein a location (x.sub.t, y.sub.t) on the detector array for the light spot of the echo of the detection beam reflected by the target object is determined by the controller according to the following formulas:
x.sub.t=f*tan{2θ.sub.x(t)}x.sub.0
y.sub.t=f*tan{2θ.sub.y(t)}+y.sub.0 wherein (x.sub.0, y.sub.0) is a light spot origin location, the light spot origin location is an intersection of an optical axis of the receiving lens on the detector array, f is a focal length of the receiving lens, t is a time of flight calculated starting from a moment when the laser emitter emits a pulse, and (θ.sub.x(t), θ.sub.y(t)) is an angle component by which the field of view scanning apparatus rotates in an x direction and a y direction within the time t.
12. The lidar device according to claim 9, wherein the controller of the detection device is configured to: obtain an actual projection location of the echo of the lidar device on the detector array; calculate an offset (Δx, Δy) between a location obtained according to the formulas and the actual projection location; calculate an average offset (
13. The lidar device according to claim 8, wherein the lidar device comprises a plurality of laser emitters, the detector array comprises a plurality of independent sub-planar arrays, and each of the plurality of independent sub-planar array corresponds to one of the plurality of laser emitters and constitutes a detection channel.
14. The lidar device according to claim 8, wherein the laser emitter is an edge-emitting laser or a vertical-cavity surface-emitting laser.
15. A detection method of a light detection and ranging (lidar) device, wherein a detection device of the lidar device comprises a detector array that comprises a plurality of individually addressable photodetectors, wherein each of the plurality of individually addressable photodetectors is configured to receive an echo of a detection beam emitted by the lidar device and reflected by a target object, and further configured to convert the echo into an electric signal, the detection method comprising: emitting a detection beam to outside of the lidar device; calculating a time of flight starting from a moment when the detection beam is emitted; predicting, according to the time of flight, a location on the detector array for a light spot of the echo of the detection beam reflected by the target object; and reading electric signals of a subset of the plurality of individually addressable photodetectors corresponding to the light spot.
16. The detection method according to claim 15, wherein the lidar device further comprises: a laser emitter, configured to emit a laser beam for detecting the target object; an emitting lens, located downstream of an optical path of the laser emitter, and configured to: receive the laser beam; modulate the laser beam; and emit the modulated laser beam to outside of the lidar device; and a receiving lens, configured to: receive an echo of the laser beam emitted by the laser emitter and reflected by the target object; and converge the echo onto the detector array, wherein the detector array is located on a focal plane of the receiving lens, wherein the predicting, according to the time of flight, the location on the detector array for the light spot of the echo of the detection beam reflected by the target object comprises: determining a location (x.sub.t, y.sub.t) of the light spot according to the following formulas:
17. The detection method according to claim 15, wherein the lidar device further comprises: a laser emitter, configured to emit a laser beam for detecting the target object; a field of view scanning apparatus, configured to: reflect the laser beam to outside of the lidar device; and receive an echo of the laser beam emitted by the laser emitter and reflected by the target object; and a receiving lens, configured to converge the echo of the laser beam emitted by the laser emitter and reflected by the target object onto the detector array, wherein the detector array is located on a focal plane of the receiving lens, wherein the predicting, according to the time of flight, the location on the detector array for the light spot of the echo of the detection beam reflected by the target object comprises: determining a location (x.sub.t, y.sub.t) of the light spot according to the following formulas:
x.sub.t=ƒ*tan{2θ.sub.x(t)}+x.sub.0
y.sub.t=ƒ*tan{2θ.sub.y(t)}y.sub.0 wherein (x.sub.0, y.sub.0) is a light spot origin location, the light spot origin location is an intersection of an optical axis of the receiving lens on the detector array, f is a focal length of the receiving lens, t is a time of flight calculated starting from a moment when the laser emitter emits a pulse, and (θ.sub.x(t), θ.sub.y(t)) is an angle component by which the field of view scanning apparatus rotates in an x direction and a y direction within the time t.
18. The detection method according to claim 16, further comprising: obtaining an actual projection location of the echo of the lidar device on the detector array; calculating an offset (Δx, Δy) between a location obtained according to the formulas and the actual projection location; calculating an average offset (
19. The detection method according to claim 15, wherein the lidar device comprises a plurality of laser emitters, the detector array comprises a plurality of independent sub-planar arrays, and each of the plurality of independent sub-planar arrays corresponds to one of the plurality of laser emitters, wherein an electric signal of one of the plurality of individually addressable photodetectors in one of the plurality of independent sub-planar arrays read when a corresponding laser emitter emits a laser beam.
20. The lidar device according to claim 7, wherein the controller of the detection device is further configured to control the subset of the plurality of individually addressable photodetectors corresponding to the light spot to be in an activated state, before reading the electric signals of the subset of the plurality of individually addressable photodetectors corresponding to the light spot.
21. The detection method according to claim 15, wherein, before reading the electric signals of the subset of the plurality of individually addressable photodetectors corresponding to the light spot, the detection method further comprises: controlling the subset of the plurality of individually addressable photodetectors corresponding to the light spot to be in an activated state.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0064] The accompanying drawings are used to provide a further understanding of this application, and constitute a part of the specification, are used to explain this application in combination with the embodiments of this application, and do not constitute a limitation to this application. In the accompanying drawings:
[0065]
[0066]
[0067]
[0068]
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
[0075]
DETAILED DESCRIPTION
[0076] Exemplary embodiments are briefly described below. As those skilled in the art can realize, the described embodiments may be modified in various different ways without departing from the spirit or the scope of the present disclosure. Therefore, the accompanying drawings and the description are to be considered as essentially illustrative but not restrictive.
[0077] In the description of the present disclosure, it should be understood that, orientations or position relationships indicated by terms such as “center”, “longitudinal”, “transverse”, “length”, “width”, “thickness”, “up”, “down”, “front”, “rear”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inner”, “outer”, “clockwise”, “counterclockwise” are orientations or position relationship shown based on the accompanying drawings, and are merely used for describing the present disclosure and simplifying the description, rather than indicating or implying that the apparatus or element should have a particular orientation or be constructed and operated in a particular orientation, and therefore, should not be construed as a limitation on the present disclosure. In addition, the terms “first” and “second” are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, features defined by “first” and “second” may explicitly or implicitly include one or more of the features. In the descriptions of the present disclosure, unless otherwise explicitly specified, “multiple” means two or more than two.
[0078] In the description of the present disclosure, it is to be noted that, unless otherwise expressly specified or defined, terms such as “mount”, “connect”, and “connection” should be understood in a broad sense, for example, the connection may be a fixed connection, a detachable connection, or an integral connection; or the connection may be a mechanical connection, or may be an electrical connection or in communication with each other; or the connection may be a direct connection, an indirect connection through an intermediate medium, internal communication between two elements, or an interaction relationship between two elements. A person of ordinary skill in the art may understand specific meanings of the foregoing terms in the present disclosure according to specific situations.
[0079] In the present disclosure, unless otherwise explicitly stipulated and restricted, that a first feature is “on” or “under” a second feature may include that the first and second features are in direct contact, or may include that the first and second features are not in direct contact but in contact by using other features therebetween. In addition, that the first feature is “on”, “above”, or “over” the second feature includes that the first feature is right above and diagonally above of the second feature or merely indicates that a level of the first feature is higher than that of the second feature. The first feature being “under”, “below”, and “underneath” the second feature includes that the first feature is directly below and diagonally below the second feature, or merely indicates that a level of the first feature is lower than that of the second feature.
[0080] Many different embodiments or examples are provided in the following disclosure to implement different structures of the present disclosure. In order to simplify the disclosure of the present disclosure, components and settings in examples are described below. Certainly, they are merely examples and are not intended to limit the present disclosure. In addition, in the present disclosure, reference numerals and/or reference letters may be repeated in different examples. The repetition is for the purposes of simplification and clarity, but does not indicate a relationship between the various embodiments and/or settings discussed. In addition, the present disclosure provides examples of various processes and materials, but those of ordinary skill in the art may be aware of application of other processes and/or use of other materials.
[0081] Embodiments of the present disclosure are described below in detail with reference to the accompanying drawings. It should be understood that the y embodiments described herein are merely used to illustrate and explain the present disclosure, but are not intended to limit the present disclosure.
[0082]
[0083] As shown in
[0084]
[0085] As shown in
[0086] According to an embodiment of the present disclosure, the plurality of photodetectors 101 all remain in an activated state during operation of the lidar. By updating addresses of a subset of the photodetectors 101 to be read in the detection unit, that is, by reading electric signals of the subset of the photodetectors 101 corresponding to the adjusted photosensitive surface 305, the location of an effective photosensitive surface may be dynamically adjusted. Therefore, it is ensured that all optical signals can be effectively received, and there is no need to read electric signals of the photodetector 101 other than the effective photosensitive surface, which improves the capability of the system to suppress ambient light.
[0087]
[0088] In view of this, according to an exemplary embodiment of the present disclosure, in addition to a plurality of address lines configured to be connected to the photodetectors for reading electric signals, the control unit 200 further includes a plurality of energizing lines respectively coupled to the photodetectors 101 and configured to control on or off of the photodetectors 101 (the quenching mode is not shown in the figure for simplicity), and details are described in detail below.
[0089]
[0090] According to an embodiment of the present disclosure, the switching device may include a field-effect transistor FET, where a gate of the switching device is used as a control terminal connected to the control unit 200 through the energizing line; and a source and drain of the switching device are respectively connected to two ends of the Zener diode. Alternatively, the switching device may also include a bipolar junction transistor (BJT). According to an embodiment of the present disclosure, the photodetector is a single-photon detector.
[0091] The inventor found that, the size of the light spot may change to a certain extent with the change of distance, and the size of the received light spot is related to the size of an emitting light spot, the size of a receiving lens, the focal length, and the distance. To be specific, a closer target object indicates a larger light spot. The size of the light spot does not greatly change when the target object is far away from the lidar. Generally, the size of the light spot may obviously change when the distance between the target object and the lidar is within several meters, and an exemplary value may be obtained according to optical simulation. Therefore, according to an embodiment of the present disclosure, during the prediction of the received light spot 304 based on the calculation of the time of flight, in addition to calculating the location for a center of the received light spot 304, the size of the received light spot 304 may also be calculated. For example, a longer time of flight indicates a smaller received light spot 304. On the contrary, a shorter time of flight indicates a larger received light spot 304. Therefore, the area of the photosensitive surface 305 can be appropriately adjusted. The detailed description is made below with reference to
[0092] According to an exemplary embodiment of the present disclosure, as shown in
[0093] The present disclosure further relates to a lidar including the detection unit 10 as described above. The detailed description is made below with reference to
[0094] According to an exemplary embodiment of the present disclosure, a lidar 40 shown in
[0095]
(since h<<d1, it can be considered that d1≈d2, and d1≈C*t/2, where C is a speed of light).
[0096] To simplify the description process, the location for the light spot is represented by a coordinate of a center of the light spot (that is, a center coordinate of a circular light spot shown in
[0097] In the foregoing formulas, the focal length f of the receiving lens, the speed of light C, h.sub.x, and h.sub.y (where h.sub.x, and h.sub.y are components of the paraxial optical axis distance h in an x-axis and a y-axis) are all constants, t is a time of flight calculated a moment when a laser emitter emits a pulse. In view of this, the light spot moves towards the origin o (x.sub.0, y.sub.0) with the increase of the time of flight t.
[0098] It can be seen from a relationship between the coordinates of the light spot and the time of flight, a theoretical location for the light spot may be calculated in real time according to the time the laser has already flown, and selections pre-set for the area of the photosensitive region (the area of the photosensitive surface) are referred, so that a reading address of the detector array is planned in real time, and the location of the photosensitive region can be dynamically and quickly adjusted by the detection unit formed by the detector array, thereby detecting received light and suppressing ambient light interference.
[0099] In another embodiment of the present disclosure, a theoretical location of the light spot may be calculated in real time according to the time period the laser has already flown, and selections pre-set for the area of the photosensitive region (the area of the photosensitive surface) are referred, so that a subset of photodetectors are planned in real time to be in an activated state and electric signals are read, and the location of the photosensitive region can be dynamically and quickly adjusted by the detection unit formed by the detector array, thereby detecting received light and suppressing ambient light interference.
[0100]
[0101] It can be seen from a geometrical relationship that, triangles of two shaded regions in
which is transformed to be:
[0102] Since h<<d1, it can be considered that d1≈d2≈C*t/2, substituted into the foregoing formula to obtain:
[0103] It is more general that the emitted laser beam 403 is not parallel to the optical axis 407 of the receiving lens, parallelism is only a special case of such a model, that is, θ=0. In the same way, the location on the focal plane (x.sub.t, y.sub.t) for the light spot and the time of flight shall satisfy the following formulas:
[0105]
[0106] According to another exemplary embodiment of the present disclosure, the lidar shown in
[0107] The field of view scanning apparatus includes a galvanometer or an oscillating mirror. Taking the galvanometer as the field of view scanning device as an example, the optical axis 607 of the receiving lens 606 and the laser beam 603 can be parallel and even overlapped at a moment of laser emission, so that a receiving field of view can be consistent with an emitting field of view.
[0108] However, field of view scanning is achieved by rapidly rotating galvanometer, and the galvanometer has rotated by a certain angle θ (t) when the echo generated by the emitted laser beam 603 is received again after the time of flight t, so that an angle between the received echo 605 passing through the receiving lens 606 and the optical axis 607 of the receiving lens is 2θ(t) (which is caused by normal line deflection by θ(t)).
[0109] In view of this, the offset of the light spot on the detection unit 100 is:
α(t)=f*tan{2θ(t)}
[0110] An intersection of the optical axis 607 of the receiving lens on the focal plane is defined as a light spot origin location (x.sub.0, y.sub.0), and the coordinate (x.sub.t, y.sub.t) of the light spot on the focal plane and the time of flight satisfy the following formulas:
x.sub.t=f*tan{2θ.sub.x(t)}+x.sub.σ
y.sub.t=f*tan{2θ.sub.y(t)}+y.sub.0
[0111] In the foregoing formulas, θ.sub.x(t) and θ.sub.y(t) are components of θ(t), θ(t) is related to the vibration speed of the galvanometer, and the location of the light spot may be accurately predicted based on the foregoing formula θ(t), thereby adjusting the effective photosensitive surface of the detector array in real time.
[0112] In the foregoing descriptions, whether it is a lidar of a paraxial optical path or a lidar based on a scanning field of view, the location of the light spot on the detection unit can be calculated according to the time of flight. During actual operation, mechanical aging and deformation, glue deformation, and thermal expansion and cold contraction, and other reasons may lead to a deviation of light spot origin location (x.sub.0, y.sub.0), which will lead to inconsistency between the theoretically calculated light spot location (x.sub.t, y.sub.t) and the actual light spot coordinate (x′, y′) on the detection unit. In this case, correction is preferably required.
[0113] To solve the deviation of the light spot origin caused by mechanical deformation, after each detection of the actual spot location, the offset calculation can be performed to obtain the difference between the theoretically calculated spot location (x.sub.t, y.sub.t) and the coordinate (x′, y′) of the actual light spot on the detection unit. The formula is as follows:
Δx=x′−x.sub.t
Δy=y′−y.sub.t
[0114] Since the process of mechanical deformation process is relatively slow, in order to measure the offset more accurately and increase the robustness of the system, the offset can be measured for a long time to give more accurate results (
[0115] After an accurate offset of the light spot origin location ((
[0116] According to an exemplary embodiment of the present disclosure, a laser emitter of an emitting end may include a plurality of edge-emitting lasers or vertical-cavity surface-emitting lasers. The detector array may include a plurality of independent sub-planar array located on the focal plane of the receiving lens, and each sub-planar array corresponds to one of the laser emitters and constitutes a detection channel. Alternatively, a large photodetector array is arranged on the focal plane of the receiving lens, and different regions correspond to different laser emitters to constitute a detection channel.
[0117] The present disclosure further relates to a method 700 that performs laser detection by using a lidar 40 provided in the present disclosure. As shown in
[0118] At step S701: Emit a detection beam to outside of a lidar.
[0119] At step S702: Calculate a time of flight starting from a moment when the detection beam is emitted.
[0120] At step S703: Predict, according to the time of flight, a location on a detector array for a light spot of an echo of the detection beam reflected by a target object.
[0121] At step S704: Read electric signals of a subset of the photodetectors corresponding to the light spot.
[0122] At step S703, the method for predicting the location of the light spot according to the time of flight is determined according to the structure of the lidar. For paraxial lidar and the scanning galvanometer lidar, the formula for calculating the location of the light spot is provided in the foregoing embodiments, and details will not be repeated herein. For offset of the light spot origin caused by mechanical aging and deformation, glue deformation, and thermal expansion and cold contraction, the correction method has also been described above, and details will not be repeated herein.
[0123] The method shown in
[0124] The present disclosure further relates to a method 800 that performs laser detection by using a lidar 40 provided in the present disclosure. As shown in
[0125] At step S801: Emit a detection beam to outside of a lidar.
[0126] At step S802: Calculate a time of flight starting from a moment when the detection beam is emitted.
[0127] At step S803: Predict, according to the time of flight, a location on a detector array for a light spot of an echo of the detection beam reflected by a target object.
[0128] At step S804: Control a subset of the photodetectors only corresponding to the light spot to be in an activated state and read electric signals.
[0129] At step S803, the method for predicting the location of the light spot according to the time of flight is determined by the structure of the lidar. For paraxial lidar and the scanning galvanometer lidar, the formula for calculating the location of the light spot has been provided in the foregoing embodiments, and details will not be repeated herein. For offset of the light spot origin caused by mechanical aging and deformation, glue deformation, and thermal expansion and cold contraction, the correction method has also been described above, and details will not be repeated herein.
[0130] At step S804, the method of controlling only a subset of the photodetectors corresponding to the light spot to be in an activated state has been provided in the foregoing embodiments, and details will not be repeated herein.
[0131] An exemplary embodiment of the present disclosure provides a detection unit of a lidar that can dynamically adjust a photosensitive region, and provides a method for calculating a location of a light spot according to a time of flight based on different lidar structures. An exemplary embodiment of the present disclosure further provides a detection method of a lidar through dynamic adjustment performed on the photosensitive surface. All received light is detected, without increasing the receiving field of view, ambient light interference is suppressed, and the problem of location offset of the light spot on a focal plane caused by optical path deformation resulting from mechanical deformation in an optical machine structure is effectively solved.
[0132] It should be finally noted that the foregoing descriptions are merely exemplary embodiments of the present disclosure, but are not intended to limit the present disclosure. Although the present disclosure has been described in detail with reference to the foregoing embodiments, for a person of ordinary skill in the art, modifications can be made to the technical solutions described in the foregoing embodiments, or equivalent replacements can be made to certain technical features in the technical solutions. Any modification, equivalent replacement, or improvement made and the like within the spirit and principle of the present disclosure shall fall within the protection scope of the present disclosure.