Method for checking a static monitoring system

20230230383 ยท 2023-07-20

Assignee

Inventors

Cpc classification

International classification

Abstract

A system and method of inspecting a static monitoring installation, installed in a traffic space. An evaluation circuit is able to create an image of the environment from a signal reflected from an object, wherein at least one reference value of a reference image of the environment is stored in the evaluation circuit, and the at least one reference value is formed from the reflected signals of at least one reference point for a reflected signal

Claims

1. A method of inspecting a static monitoring installation, the method comprising: creating a comparison image from the signals reflected from an object: forming a comparison value of the comparison image from the reflected signals: determining a deviation value between the comparison value of the comparison image and a reference value of a reference image formed from signals reflected from a reference point: and outputting a blockage signal when the deviation value exceeds a threshold value.

2. The method according to claim 1, wherein the comparison image is temporally smoothed.

3. The method according to claim 2, further comprising smoothing the comparison image using a low-pass filter.

4. The method according to claim 3, wherein the comparison image comprises multiple comparison images recorded with a time offset, and wherein comparison values are formed for each comparison image among the multiple comparison images.

5. The method according to claim 4, further comprising delaying the blockage signal based on a change in the comparison values or a change in the deviation value.

6. (canceled)

7. The method according to claim 5, further comprising adjusting the threshold values based on the deviation value.

8. (canceled)

9. The method according to claim 7, further comprising adjusting the reference image or the reference value based on the comparison image or the comparison value.

10. The method according to claim 9, wherein the reference image is divided into different areas, with at least one reference value being formed for each area, and wherein the blockage signal comprises information about the areas in which the deviation value of a comparison point from the reference point exceeds the threshold value.

11. (canceled)

12. The method according to claim 1, wherein forming the reference value is based on signal strength or a signal characteristic of the signals reflected from the object.

13. (canceled)

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Further advantages and features will become apparent from the following description in connection with the appended drawings, in which:

[0036] FIG. 1 shows a schematic illustration of a monitoring installation;

[0037] FIG. 2 shows a schematic illustration of a recorded image of the monitoring installation from FIG. 1;

[0038] FIG. 3 shows a schematic illustration of a reference image of the monitoring installation from FIG. 1;

[0039] FIG. 4 shows a schematic illustration of a comparison image of the monitoring installation from FIG. 1 with an obstacle;

[0040] FIG. 5 shows a schematic illustration of a comparison image of the monitoring installation from FIG. 1 with clouding; and

[0041] FIG. 6 shows a second schematic illustration of a reference image.

DETAILED DESCRIPTION

[0042] FIG. 1 shows a static monitoring installation 10 for a traffic space 12, in this example an intersection.

[0043] FIG. 1 shows only one monitoring installation 10. The traffic space 12 may however also contain multiple monitoring installations 10, for example in order to be able to monitor the traffic space 12 from different directions and/or perspectives. The monitoring installations 10 may be connected to one another or be connected to a common controller in order for example to compare the data from the monitoring installations 10 and/or to create a three-dimensional image of the traffic space 12.

[0044] The monitoring installation has a signal transmitter 14 and a signal receiver 16. The signal transmitter 14 transmits a signal 18, which is reflected from an object 20. The signal 18 is for example an optical, acoustic and/or electromagnetic signal. By way of example, the signal is a radar (radio detection and ranging) or lidar (light detection and ranging) signal.

[0045] If the signal 18 impacts an object 20, the signal 18 is reflected. The reflected signal 18 is detected by the signal receiver 16. The distance of the object 20 is able to be determined from the time of flight of the signal 18 from the signal transmitter 14 to the signal receiver 16. The direction of the object 20 is additionally able to be determined from the direction in which the signal 18 is transmitted and the direction from which the signal 18 is received by the signal receiver 16.

[0046] An image 26 of the traffic space 12 is able to be created in an evaluation circuit 24 from the received signals 22 or the direction and the distance of the objects 20. Each reflection may in this case be represented in this image 26 in simplified form by a point 28 (see FIG. 2).

[0047] The image 26 is constantly updated in order to recognize changes in the traffic space 12, for example moving objects 30 such as vehicles. By way of example, the signal transmitter 14 is pivoted or moved such that it captures the entire area to be monitored regularly or at a predefined frequency.

[0048] If a moving object 30 is located in the traffic space 12, this may be recognized through the fact that the reflections, that is to say the points 28 of this object in the image 26 change, for example change their position, or the time of flight and/or the frequency of the signal 22 increases or decreases.

[0049] Static objects, for example houses or traffic signs, on the other hand, provide a reflection of the signal 22 that is always the same, meaning that the points 28 that represent these static objects in the image 26 always remain unchanged.

[0050] During operation of such a static monitoring installation 10, there may be complete or partial blockages of the area to be monitored, for example caused by stationary objects 31 (see FIG. 4) that conceal areas of the traffic space 12 to be monitored. There may also be soiling or clouding directly in front of the signal transmitter 14 and/or the signal receiver 16 or in the signal path that completely or partially blocks the signal. By way of example, smoke, dense fog or precipitation may lead to partial or complete absorption of the signal 18.

[0051] Such blockages, soiling or clouding may limit the function of the monitoring installation 10, since the traffic space is no longer able to be monitored. It is therefore necessary to reliably and quickly recognize such problems in order to be able to rectify them. It is also necessary to reliably distinguish such problems from transient blockages, for example caused by a moving object.

[0052] In order to reliably recognize such problems, a reference image 32 (FIG. 3) is created beforehand and stored in the evaluation circuit 24, said reference image representing the traffic space 12 without moving objects 30 and without visual obstructions.

[0053] The reference image 32 may for example be recorded beforehand or when the monitoring installation 10 is installed and stored in the evaluation circuit 24. By way of example, when or immediately after the monitoring installation 10 is installed, a state is produced and/or detected in which only static objects are located in the traffic space 12 to be monitored.

[0054] The reference image 32 thus contains only reflections 34 that characterize fixed objects. At least one reference value is acquired and/or formed from these reflections 34.

[0055] By way of example, a radar cross section (RCS) or an effective backscatter area is acquired for individual reflections 34.

[0056] A common reference value may optionally also be formed from the radar cross sections of the reflections 34, for example a total value or an average value of the radar cross sections. By way of example, the total number of reflections 34 and/or the number of reflections within a defined time may also be acquired.

[0057] The reference values thus formed are stored in the evaluation circuit 24. A threshold value is also stored for each reference value, with a comparison value not being allowed to deviate from this reference value by more than said threshold value.

[0058] During operation of the monitoring installation 10, a comparison image 36 (FIGS. 4 and 5) is created from the received signals 22. The comparison image 36 may in this case represent a single recording of an image 26. The comparison image 36 may also be created from multiple images 26 recorded in temporal succession, for example in which the comparison image 36 is smoothed and/or filtered over a relatively long period of time.

[0059] At least one comparison value corresponding to the at least one reference value is acquired and/or formed for this comparison image 36. The comparison value is in this case formed from the reflections 38 of the current image of the monitoring installation 10, that is to say the comparison image 36.

[0060] The comparison values are compared with the corresponding reference values and a value of any deviation that is present between the reference value and the comparison value is determined. This value of the deviation is compared with the threshold value that is stored for the respective reference value. If the value of the deviation exceeds the threshold value, a blockage signal is triggered. The blockage signal may for example be received by a superordinate controller. The monitoring installation 10 may then for example be diagnosed or the monitoring installation 10 is controlled manually in order to verify and possibly remove the visual obstruction.

[0061] In addition to the reflections 34 from the static objects, reflections from objects that are present briefly, for example vehicles 30, also influence the comparison value. Static objects may also be at least partially concealed by moving objects for a short period of time.

[0062] To reduce these brief influences, the comparison image 36 is smoothed or filtered. By way of example, multiple comparison images 36 may be recorded with a time offset, in particular in immediate succession, and an average value may be formed from these images.

[0063] If some static objects are fully or partially concealed, this has a permanent influence on the at least one comparison value that is also not, or is only slightly, reduced by smoothing, filtering and/or averaging. On the other hand, the influence of a moving object on the comparison value decreases.

[0064] The threshold values of the reference values are in this case selected such that the changes in the comparison values caused by a transient visual obstruction are so low that the threshold values are not exceeded and the blockage signal is not triggered.

[0065] If the blockage persists over a longer period of time, the comparison values on the other hand change such that the threshold values are exceeded and a blockage signal is output.

[0066] The threshold values may be fixedly prescribed, for example when the monitoring installation 10 is installed. It is also possible for multiple threshold values to be prescribed.

[0067] In the case of multiple reference values, a blockage signal may also be output only when threshold values of different reference values are exceeded or a total threshold value formed from the individual threshold values is exceeded.

[0068] The threshold values may furthermore also be adjusted during operation of the monitoring installation 10. The threshold values may be adjusted for example on the basis of the comparison images or the comparison values.

[0069] By way of example, a threshold value may be reduced if it turns out, during operation of the monitoring installation 10, that the comparison value does not exceed a particular deviation from the reference value, or does so only extremely rarely.

[0070] If there are often brief blockages that lead to triggering of the blockage signal, the threshold value may also be increased in order to prevent incorrect triggering of the blockage signal.

[0071] Optionally or in addition, the reference image may also be adjusted and/or corrected during operation of the monitoring installation 10, as a result of which the reference values are also adjusted and/or corrected. This makes it possible for example to react to changes to static objects that do not limit the monitoring area of the monitoring installation 10.

[0072] The reference image and the comparison image may optionally be divided into areas 40 (FIG. 6), with at least one reference value being ascertained for each area and a comparison value corresponding to the reference value being determined. At least one threshold value is defined for each reference value.

[0073] For each of the areas, the at least one reference value is compared with the corresponding comparison value. If a threshold value defined for this area is exceeded, the blockage signal is output.

[0074] The areas make it possible to determine the blockage more accurately. If the threshold values are exceeded only in some areas of the comparison image, this may be an indicator of a partial blockage. If all threshold values are exceeded, the monitoring area of the monitoring installation is completely blocked. The position of the area in which the threshold value is exceeded may additionally be used to conclude as to where the blockage is located and how quickly it needs to be rectified.

[0075] By way of example, different threshold values or threshold values of different values may be defined for different areas. If frequent short blockages, for example caused by vehicles, are to be expected in an area, the threshold value may be set higher in order to prevent incorrect triggering of the blockage signal.

[0076] For areas of the reference image or of the comparison image in which brief blockages, for example caused by vehicles, are highly unlikely, the threshold value may accordingly be set lower.

[0077] The threshold values may furthermore be adjusted during operation of the monitoring installation 10, for example if it turns out that an area of the reference image or of the comparison image is frequently briefly blocked or areas of the reference image or of the comparison image are blocked very rarely.

[0078] The reference image 32 may furthermore be adjusted over the service life of the monitoring installation 10, for example by virtue of the evaluation circuit containing an algorithm that makes it possible to recognize new static objects and/or the change of static objects in the traffic space.

[0079] This makes it possible for example to recognize a moving visual obstruction that blocks individual reference points with greater reliability. By way of example, comparing the individual comparison images 36 makes it possible to check whether individual reference points 34 are blocked in all comparison images 36 or whether individual reference points 34 are visible again after a certain time, meaning that the remaining concealed reference points may be expected to be visible again. The evaluation circuit 24 may in particular hold back the blockage signal if such a situation is recognized.

[0080] Comparing the comparison images 36 with one another also makes it possible to recognize further static objects for which reference points 34 may be stored.

[0081] In addition to a complete blockage of one or all reference points 34, there may also be diffuse visual impairments, for example caused by strong clouding of the air or directly in front of the signal transmitter and/or the signal receiver. By way of example, substances in the air, such as rain, fog or smoke, may lead to strong absorption of the signals 18. Soiling on or in front of the signal transmitter and/or the signal receiver may also lead to absorption of the signals 18. In other words, the signal is still able to be transmitted and received, but reflection is considerably weaker due to the partial signal absorption (FIG. 5).

[0082] Such a visual impairment may also be detected using the method described above. By way of example, the absorption of the signals leads to the deviation in reference values and comparison values formed from the radar cross section or the effective backscatter area.

[0083] Different reference values and comparison values are preferably formed. If different signal values and/or signal characteristics are used, then errors may be minimized and/or more accurate information about the visual blockages may be obtained.

[0084] By way of example, a diffuse visual impairment caused by smoke or fog may lead to a large deviation of a comparison value formed from the radar cross section or the effective backscatter area from the corresponding reference value, while the deviation of a comparison value based on the number of reflections per unit of time from the corresponding reference value turns out to be lower, since reflections are present in spite of the diffuse visual impairment.