METHOD AND DEVICE FOR RECOGNIZING MISALIGNMENTS OF A STATIONARY SENSOR AND STATIONARY SENSOR

Abstract

A method for recognizing misalignments of a stationary sensor. A first occupancy map is generated based on first sensor data, which the sensor generates at a first point in time. Based on second sensor data, which the sensor generates at a second point in time, a second occupancy map is generated. A cross-correlation of the first occupancy map and of the second occupancy map is calculated. A misalignment of the sensor is recognized based on the calculated cross-correlation.

Claims

1. A method for recognizing misalignments of a stationary sensor, comprising the following steps: generating a first occupancy map based on first sensor data, which the sensor generates at a first point in time; generating a second occupancy map based on second sensor data, which the sensor generates at a second point in time; calculating a cross-correlation of the first occupancy map and of the second occupancy map; and recognizing a misalignment of the sensor based on the calculated cross-correlation.

2. The method as recited in claim 1, wherein a spatial offset is calculated based on the calculated cross-correlation, and the misalignment of the sensor is recognized based on the spatial offset.

3. The method as recited in claim 2, wherein the misalignment of the sensor is recognized when the spatial offset is greater than a predefined threshold value.

4. The method as recited in claim 2, wherein a calibration of the sensor for compensating for the misalignment is carried out based on the calculated spatial offset.

5. The method as recited in claim 1, wherein the cross-correlation is a multidimensional cross-correlation.

6. The method as recited in claim 1, wherein the first and second occupancy maps are calculated in a polar representation.

7. The method as recited in claim 1, wherein the first point in time, at which the sensor generates sensor data, is at night.

8. The method as recited in claim 1, wherein the sensor generates the first sensor data and/or second sensor data over a time period of several seconds.

9. A device configured to recognize misalignments of a stationary sensor, comprising: an interface configured to receive sensor data from the sensor; and a processing unit configured to: generate a first occupancy map based on first sensor data, which the sensor generates at a first point in time; generate a second occupancy map based on second sensor data, which the sensor generates at a second point in time; calculate a cross-correlation of the first occupancy map and of the second occupancy map; and recognize a misalignment of the sensor based on the calculated cross-correlation.

10. A stationary sensor, comprising: a radar sensor or a LIDAR sensor including a device configured to recognize misalignments of the stationary sensor, the device configured to: generate a first occupancy map based on first sensor data, which the sensor generates at a first point in time; generate a second occupancy map based on second sensor data, which the sensor generates at a second point in time; calculate a cross-correlation of the first occupancy map and of the second occupancy map; and recognize a misalignment of the sensor based on the calculated cross-correlation.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0031] FIG. 1 shows a schematic block diagram of a stationary sensor including a device for recognizing misalignments of the stationary sensor according to one specific example embodiment of the present invention.

[0032] FIG. 2 shows an exemplary occupancy map at a first point in time, according to the present invention.

[0033] FIG. 3 shows an exemplary occupancy map at a second point in time, according to the present invention.

[0034] FIG. 4 shows an exemplary representation of a two-dimensional cross-correlation of the occupancy map in FIG. 2 and of the occupancy map in FIG. 3.

[0035] FIG. 5 shows a flow chart of a method for recognizing misalignments of a stationary sensor according to one specific example embodiment of the present invention.

[0036] In all figures, identical or functionally identical elements and devices are denoted by the same reference numerals. The numbering of method steps is used for the sake of clarity and, in general, is not intended to imply a certain chronological order. In particular, multiple method steps may also be carried out simultaneously.

DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS

[0037] FIG. 1 shows a schematic block diagram of a stationary sensor 1 including a device 2 for recognizing misalignments of the stationary sensor 1. Stationary sensor 1 may be a radar sensor or a LIDAR sensor. However, in general, the stationary sensor may be any arbitrary type of sensor which detects point clouds, i.e., for example, also an ultrasonic sensor or a 3D camera sensor.

[0038] Sensor 1 includes sensor elements 5 which generate sensor data. In the case of a radar sensor, antenna elements may be provided, for example, which emit radar radiation according to a conventional radar method and receive the radar radiation reflected at objects. In the case of a LIDAR sensor, sensor elements 5 include a laser which scans the surroundings, as well as receivers to detect light which is reflected back.

[0039] The generated sensor data are transferred to an interface 3 of device 2. Interface 3 may be a hard-wired or wireless interface. The sensor data may also be stored in a memory which device 2 is able to access.

[0040] Device 2 furthermore includes a processing unit 4, which may include at least one microprocessor, microcontroller, integrated circuit, or the like. Processing unit 4 evaluates the sensor data. Processing unit 4 may generate occupancy maps based on the sensor data for this purpose. In the occupancy map, surroundings of the sensor are divided into a plurality of cells. Each cell is assigned an occupancy probability by processing unit 4 based on the sensor data. In the simplest case, only the values 0 (unoccupied) and 1 (occupied) may be assigned; however, according to further specific embodiments, a plurality of different occupancy probabilities between 0 and 1 are possible.

[0041] Processing unit 4 may be designed to extract the occupancy probability of one cell from the sensor data with the aid of signal processing, for example with the aid of filters. In this way, a cell may be assigned to each reflection detected based on the sensor data. For this purpose, associated location coordinates are calculated for the reflection, for example the distance and azimuth angle for a polar representation. According to further specific embodiments, it is also possible to ascertain three-dimensional location coordinates, i.e., for example, an elevation angle is additionally ascertained. The occupancy map is then three-dimensional.

[0042] For initialization, sensor elements 5 generate first sensor data at a first point in time. This point in time may be during or shortly after the installation of sensor 1. These first sensor data serving as reference data are generated in the process, after the sensor was physically aligned in the desired position. The first sensor data thus represent the best possible state. For example, the first point in time is at night since, at this point in time, only few interfering temporarily present objects (for example vehicles) are to be expected. The first sensor data may be generated over a time period of several seconds, for example at least 10 seconds. Larger time periods result in greater robustness. The measurement takes place in a manner that is as interference-free as possible. In particular, no further work is to be carried out at the location of the sensor, which could influence the alignment.

[0043] Processing unit 4 calculates a first occupancy map of the surroundings of sensor 1 based on the first sensor data. The first occupancy map serves as a reference for ascertaining the occupancy in the surroundings of sensor 1, while the sensor is correctly aligned.

[0044] Sensor 1 is then put into operation. At a second point in time, it is to be ascertained whether a misalignment of sensor 1 is present. For this purpose, sensor elements 5 generate second sensor data. The second sensor data may be generated over a time period of several seconds, for example at least 10 seconds. Processing unit 4 calculates a second occupancy map of the surroundings of sensor 1 based on the second sensor data.

[0045] Processing unit 4 furthermore calculates a cross-correlation of the first occupancy map and of the second occupancy map. For a two-dimensional occupancy map, this involves a two-dimensional function, which encompasses a convolution of the signal with respect to the first occupancy map and of the signal with respect to the second occupancy map. If a misalignment now occurs, the occupancy maps are then displaced and/or twisted relative to one another. Due to the convolution, this manifests itself in a shift (offset) of the cross-correlation, which processing unit 4 is able to ascertain.

[0046] For example, processing unit 4 may compare the offset to a threshold value. If the offset is greater than the predefined threshold value, processing unit 4 is able to recognize the misalignment of sensor 1. Otherwise, processing unit 4 recognizes that sensor 1 continues to be correctly aligned, at least within a tolerance range.

[0047] If processing unit 4 recognizes a misalignment of sensor 1, a warning signal may be output, for example to a user. Sensor 1 may then be manually realigned again. However, it is also possible to compensate for the misalignment of sensor 1. By shifting the sensor data by the offset, a calibration of sensor 1 may thus be carried out, resulting in corrected sensor data which correspond to the original position and/or alignment of sensor 1.

[0048] FIG. 2 shows an exemplary occupancy map at a first point in time. The occupancy map has been generated in a polar representation, the occupancy probabilities being ascertained for different distances d and azimuth angles cp.

[0049] FIG. 3 shows an exemplary occupancy map at a second point in time. The occupancy map has been generated by sensor 1 which, however, due to external influences was aligned in a twisted manner.

[0050] FIG. 4 shows an exemplary representation of a two-dimensional cross-correlation of the occupancy map in FIG. 2 and the occupancy map in FIG. 3. A peak is present at a position shifted by an offset, axes s_d and s_φ corresponding to the offset of distance d and the offset of azimuth angle φ. The offset barely corresponds to the misalignment of sensor 1. In the shown case, only a twisting of sensor 1 has occurred, i.e., offset s_φ of azimuth angle φ is not equal to 0, and offset s_d is equal to 0.

[0051] FIG. 5 shows a flowchart of a method for recognizing misalignments of a stationary sensor 1, in particular of the above-described sensor 1.

[0052] In a first step S1, a first occupancy map is generated based on first sensor data, which sensor 1 generates at a first point in time. In a second step S2, a second occupancy map is generated based on second sensor data, which sensor 1 generates at a second point in time.

[0053] In a step S3, a cross-correlation of the first occupancy map and of the second occupancy map is calculated.

[0054] In a step S4, a misalignment of sensor 1 is recognized based on the calculated cross-correlation.

[0055] In a further step S5, a compensation of the misalignment or a recalibration of sensor 1 may be carried out based on an offset calculated with the aid of the cross-correlation.