OBJECT RECOGNITION BY AN ACTIVE OPTICAL SENSOR SYSTEM
20230152457 ยท 2023-05-18
Assignee
Inventors
- Sergio Fernandez (Bietigheim-Bissingen, DE)
- Christoph Pfrang (Bietigheim-Bissingen, DE)
- Viktor Trusov (Bietigheim-Bissingen, DE)
- Ali Bassiouny (Bietigheim-Bissingen, DE)
Cpc classification
B60W60/00
PERFORMING OPERATIONS; TRANSPORTING
G01S7/4802
PHYSICS
G06V20/56
PHYSICS
International classification
G01S7/4865
PHYSICS
Abstract
According to a method for object recognition by an active optical sensor system (2), a detector unit (2b) detects light (3b) reflected off an object (4) and generates a sensor signal (5a, 5b, 5c, 5d, 5e, 5f) on the basis thereof. A computing unit (2c) ascertains a first pulse width (D1) defined by a predetermined first limit value (G1) for an amplitude of the sensor signal (5a, 5b, 5c, 5d, 5e, 5f) as well as a second pulse width (D2) defined by a predetermined second limit value (G2). The signal pulse is assigned to one of at least two categories according to at least one predefined signal pulse parameter, and a scatter plot for object recognition is generated, said scatter plot containing exactly one entry for the signal pulse, said entry corresponding to the first pulse width (D1) or to the second pulse width (D2) according to the category to which the signal pulse belongs.
Claims
1. A method for object recognition by an active optical sensor system, comprising: registering light reflected by an object in an environment of the sensor system by a detector unit of the sensor system and a sensor signal is generated on the basis of the registered light; determining a first pulse width of a signal pulse of the sensor signal by a computer unit, the first pulse width being established by a predetermined first limit value for an amplitude of the sensor signal; wherein the computer unit is configured to: determine a second pulse width of the signal pulse, the second pulse width being established by a predetermined second limit value for the amplitude of the sensor signal; assign the signal pulse to one of at least two categories as a function of at least one predefined parameter of the signal pulse, and generate a point cloud for object recognition, which contains precisely one entry for the signal pulse, the entry corresponding either to the first pulse width or to the second pulse width as a function of the category of the signal pulse.
2. The method as claimed in claim 1, wherein a radial distance of the object from the sensor system is determined by the computer unit as a function of the signal pulse; and the signal pulse is assigned to the one of at least two categories as a function of the radial distance.
3. The method as claimed in claim 2, wherein the second limit value is greater than the first limit value; the signal pulse is assigned to a first category of the at least two categories if the radial distance is greater than a predefined limit distance; and the point cloud is generated with the entry which corresponds to the first pulse width if the signal pulse has been assigned to the first category.
4. The method as claimed in claim 3, wherein the signal pulse to a second category of the at least two categories if the radial distance is less than the limit distance and the second pulse width is greater than zero; and the point cloud is generated with the entry which corresponds to the second pulse width if the signal pulse has been assigned to the second category.
5. The method as claimed in claim 3, wherein the at least two categories contain at least three categories; the signal pulse to a third category of the at least three categories if the radial distance is less than the limit distance and the second pulse width is equal to zero; and the point cloud is generated with the entry which corresponds to the first pulse width if the signal pulse has been assigned to the third category.
6. The method as claimed in claim 1, wherein the entry contains an identifier that indicates the category to which the signal pulse has been assigned.
7. The method as claimed in claim 1, wherein the object is classified automatically on the basis of the point cloud while taking the entry into account.
8. The method as claimed in claim 1, wherein the second limit value is greater than the first limit value and the first limit value is greater than a predetermined noise level of the detector unit; and/or the second limit value is greater than the first limit value, and the second limit value is greater than a predetermined saturation limit value of the detector unit.
9. A method for the at least partially automatic control of a motor vehicle, comprising: generating a point cloud for object recognition by a method as claimed in claim 1; and controlling the motor vehicle at least partially automatically as a function of the point cloud.
10. The method as claimed in claim 9, wherein the point cloud is generated by object classification automatically on the basis of the point cloud while taking the entry into account; and the motor vehicle is controlled at least partially automatically as a function of a result of the classification.
11. An active optical sensor system, comprising: a detector unit, which is adapted to register light reflected by an object in an environment of the sensor system and to generate a sensor signal on the basis of the registered light; a computer unit, which is adapted to determine a first pulse width of a signal pulse of the sensor signal, the first pulse width being established by a predetermined first limit value for an amplitude of the sensor signal; and wherein the computer unit is adapted to: determine a second pulse width of the signal pulse, the second pulse width being established by a predetermined second limit value for the amplitude of the sensor signal; assign the signal pulse to one of at least two categories as a function of at least one predefined parameter of the signal pulse; and generate a point cloud for object recognition, which contains precisely one entry for the signal pulse, the entry corresponding either to the first pulse width or to the second pulse width as a function of the category of the signal pulse.
12. An electronic vehicle guidance system for a motor vehicle comprising: an active optical sensor system as claimed in claim 11; and a control device, which is adapted to generate at least one control signal as a function of the point cloud, in order to control the motor vehicle at least partially automatically.
13.-14. (canceled)
15. A non-transitory computer-readable storage medium which stores a computer program which, when executed by an electronic vehicle guidance system as claimed in claim 12, cause the vehicle guidance system to perform a method comprising: registering light reflected by an object in an environment of the sensor system by a detector unit of the sensor system and generating a sensor signal on the basis of the registered light; determining a first pulse width of a signal pulse of the sensor signal by a computer unit, the first pulse width being established by a predetermined first limit value for an amplitude of the sensor signal; the computer unit being further configured to: determine a second pulse width of the signal pulse, the second pulse width being established by a predetermined second limit value for the amplitude of the sensor signal; assign the signal pulse to one of at least two categories as a function of at least one predefined parameter of the signal pulse; and generate a point cloud for object recognition, which contains precisely one entry for the signal pulse, the entry corresponding either to the first pulse width or to the second pulse width as a function of the category of the signal pulse.
Description
[0066] In the figures:
[0067]
[0068]
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
[0075] The electronic vehicle guidance system 6 has, in particular, an active optical sensor system 2 according to the improved concept. Optionally, the vehicle guidance system 6 may also have a control device 7.
[0076] The active optical sensor system 2 has an emitter unit 2a, which contains for example an infrared laser. The sensor system 2 furthermore has a detector unit 2b, which contains for example one or more optical detectors, for example APDs.
[0077] The sensor system 2 furthermore has a computer unit 2c. Functions of the computer unit 2c which are described below may also be undertaken in various configurations by the control device 7, or vice versa.
[0078] The emitter unit 2a emits laser pulses 3a into the environment of the motor vehicle 1, where they are partially reflected by an object 4 and at least partially reflected back as reflected pulses 3b in the direction of the sensor system 2, and in particular of the detector unit 2b. The detector unit 2b, in particular the optical detectors of the detector unit 2b, registers the reflected components 3b and, on the basis thereof, generate a time-dependent sensor signal which has an amplitude that is proportional to the radiation intensity or radiation power of the registered light 3b. Corresponding examples of various signal pulses are represented in
[0079] The computer unit 2c determines a first time interval, during which the sensor signal 5a, 5b, 5c, 5d exceeds a first limit value G1. This first time interval then corresponds to the first pulse width D1 of the corresponding signal pulse. In the same way, the computer unit 2c determines a second pulse width D2 by corresponding comparison of the sensor signal sensor signal 5a, 5b, 5c, 5d with a second limit value G2, which is greater than the first limit value G1.
[0080] The computer unit 2c or the control device 7 may then determine a property of the object 4, for example a reflectivity or an extent of the object 4, on the basis of the first pulse width D1 and the second pulse width D2.
[0081] In particular, the computer unit 2c or the control device 7 may classify the object 4 as a function of the property or of the pulse widths D1, D2.
[0082] On the basis of a result of the classification, or on the basis of the property of the object, the control device 7 then for example generates control signals in order to control the motor vehicle 1 at least partially automatically.
[0083]
[0084] If APDs are used as optical detectors, for example, the saturation limit value GS may for example be of the order of a few hundreds of mV, for example lying between 100 mV and 1000 mV.
[0085]
[0086] The computer unit 2c generates a point cloud on the basis of the signal pulses, in particular respectively on the basis either of the first pulse width D1 or of the second pulse width D2. For this purpose, the signal pulses are assigned to one of three categories I, II, III, as represented schematically in
[0087] If the radial distance r which has been determined for the signal pulse on the basis of the time-of-flight measurement is greater than a predefined limit distance R, it is unlikely that an object 4 in the vicinity of the motor vehicle 1 will reflect light with a sufficiently high intensity for the second limit value G2 to be exceeded, and the second pulse width D2 is accordingly greater than zero. Accordingly, the signal pulse is in this case assigned to a first category I. For signal pulses of category I, the corresponding entry for the signal pulse is generated in such a way that it reproduces the first pulse width D1.
[0088] If the radial distance r is less than the limit distance R, however, it may be assumed that pulses which do not reach the second limit value G2 are due to noise effects or are unreliable for other reasons.
[0089] Accordingly, signal pulses for which the particular radial distance is less than the limit distance R, and whose second pulse width D2 is greater than zero, are assigned to a second category II and those signal pulses for which the radial distance r is less than the limit distance R, and whose second pulse width D2 is equal to zero, are assigned to a third category III.
[0090] For signal pulses of category II, the entry of the point cloud relates to the second pulse width D2, and for signal pulses of category III the entry relates to the first pulse width D1.
[0091]
[0092] In this way, the points of category III may be filtered out since with a high probability they are due to noise effects.
[0093] By signal pulses having a radial distance r greater than the limit distance R being taken into account with the second pulse width D2, however, points are represented in the point cloud 9 even for relatively large distances from the sensor system.
[0094]
[0095]
[0096]
[0097] The improved concept, as described, makes it possible to provide a point cloud for object recognition or object classification, which on the one hand has a lesser influence of noise and, on the other hand, emulates a high sensitivity of the sensor system. Furthermore, the improved concept saves on memory space, particularly in comparison with the storage of two complete point clouds.
[0098] In various configurations of the improved concept, a hybrid point cloud is thus generated in order to convert the analog signal pulses into the discrete domain. For example, each point may be assigned a flag according to how great the radial distance from the sensor system is and how high the maximum amplitude of the signal pulse is. In this way, points whose radial distance is small and whose maximum amplitude is likewise small may be filtered out since they are due to interference or noise.