METHOD AND PROCESSOR CIRCUIT FOR OPERATING A RADAR SYSTEM COMPRISING MULTIPLE ANTENNAS, RADAR SYSTEM AND MOTOR VEHICLE
20230041793 · 2023-02-09
Inventors
Cpc classification
International classification
Abstract
System and method for operating a radar system that includes a plurality of antennas, wherein a respective antenna signal is received from each of the antennas and is converted into a digital antenna signal via an analog-to-digital conversion. Digital signal data of the antennas are provided in a data memory. Signal evaluation is performed in a two-stage design, where a predetermined subset of the signal data is supplied to an evaluation module for a target detection, and resolution cells for which, the associated resolution gate meets a predetermined occupancy criterion are selected, and only the signal data available in the data memory for the selected resolution cells are selected for these resolution cells for further processing.
Claims
1-12. (canceled)
13. A method for operating a radar system for a vehicle, comprising: receiving signal data from a data memory, the signal data comprising digital antenna signals associated with a plurality of antennas detecting a monitoring area, wherein each of the plurality of antennas are respectively associated with first and second resolution gates; processing, via an evaluation module, a subset of the signal data to produce a first target detection having a first resolution comprising a cell grid having a plurality of resolution cells and corresponding first resolution gates; selecting resolution cells in which the corresponding first resolution gates meet an occupancy criterion; and processing, via the evaluation module, the selected resolution cells to produce a second target detection having a second resolution comprising a sub-cell grid having a plurality of resolution sub-cells and corresponding second resolution gates, wherein the second resolution is finer than the first resolution.
14. The method of claim 13, further comprising determining one or more of (i) range, (ii) relative velocity in the radial direction, (iii) relative velocity in the tangential direction, (iv) azimuth angle, and (v) elevation angle, via the first target detection and/or the second target detection.
15. The method of claim 13, further comprising forming a radar image for the monitoring area based on (i) first target detection results not meeting the occupancy criterion, and (ii) second target detection results for selected resolution cells meeting the occupancy criterion.
16. The method according to claim 13, wherein the digital antenna signals comprise echoes of at least one chirp signal.
17. The method according to claim 16, wherein the subset of the signal data comprises a low-frequency signal portion of the chirp signal.
18. The method according to claim 13, wherein the occupancy criterion comprises resolution gates of the respective antenna signals having signal power that is greater than a predetermined threshold value.
19. The method according to claim 13, wherein the occupancy criterion comprises a signal pattern of a machine-learning model.
20. A radar system for a vehicle, comprising: a plurality of antennas for detecting a monitoring area of the vehicle; a data memory configured to receive signal data comprising digital antenna signals associated with the plurality of antennas, wherein each of the plurality of antennas are respectively associated with first and second resolution gates; and an evaluation module, wherein the evaluation module is configured to process a subset of the signal data to produce a first target detection having a first resolution comprising a cell grid having a plurality of resolution cells and corresponding first resolution gates; select resolution cells in which the corresponding first resolution gates meet an occupancy criterion; and process the selected resolution cells to produce a second target detection having a second resolution comprising a sub-cell grid having a plurality of resolution sub-cells and corresponding second resolution gates, wherein the second resolution is finer than the first resolution.
21. The radar system of claim 20, wherein the evaluation model is configured to determine one or more of (i) range, (ii) relative velocity in the radial direction, (iii) relative velocity in the tangential direction, (iv) azimuth angle, and (v) elevation angle, via the first target detection and/or the second target detection.
22. The radar system of claim 20, further comprising a processing apparatus configured to form a radar image for the monitoring area based on (i) first target detection results not meeting the occupancy criterion, and (ii) second target detection results for selected resolution cells meeting the occupancy criterion.
23. The radar system according to claim 20, wherein the digital antenna signals comprise echoes of at least one chirp signal.
24. The radar system according to claim 23, wherein the subset of the signal data comprises a low-frequency signal portion of the chirp signal.
25. The radar system according to claim 20, wherein the occupancy criterion comprises resolution gates of the respective antenna signals having signal power that is greater than a predetermined threshold value.
26. The radar system according to claim 20, wherein the occupancy criterion comprises a signal pattern of a machine-learning model.
27. A method for operating a radar system for a vehicle, comprising: receiving signal data from a data memory, the signal data comprising digital antenna signals associated with a plurality of antennas detecting a monitoring area, wherein each of the plurality of antennas are respectively associated with first and second resolution gates; processing, via an evaluation module, a subset of the signal data to produce a first target detection having a first resolution comprising a cell grid having a plurality of resolution cells and corresponding first resolution gates; selecting resolution cells in which the corresponding first resolution gates meet an occupancy criterion; and processing, via the evaluation module, the selected resolution cells to produce a second target detection having a second resolution comprising a sub-cell grid having a plurality of resolution sub-cells and corresponding second resolution gates, wherein the second resolution is finer than the first resolution; and determining one or more of (i) range, (ii) relative velocity in the radial direction, (iii) relative velocity in the tangential direction, (iv) azimuth angle, and (v) elevation angle, via the first target detection and/or the second target detection.
28. The method of claim 27, further comprising forming a radar image for the monitoring area based on (i) first target detection results not meeting the occupancy criterion, and (ii) second target detection results for selected resolution cells meeting the occupancy criterion.
29. The method according to claim 27, wherein the digital antenna signals comprise echoes of at least one chirp signal.
30. The method according to claim 29, wherein the subset of the signal data comprises a low-frequency signal portion of the chirp signal.
31. The method according to claim 15, wherein the occupancy criterion comprises resolution gates of the respective antenna signals having signal power that is greater than a predetermined threshold value.
32. The method according to claim 27, wherein the occupancy criterion comprises a signal pattern of a machine-learning model.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Exemplary embodiments of the present disclosure are described hereafter. In the drawings:
[0018]
[0019]
[0020]
[0021]
DETAILED DESCRIPTION
[0022] The exemplary embodiments described hereafter are preferred exemplary embodiments of the present disclosure. In the exemplary embodiments, the described components in each case represent individual features of the present disclosure which are to be considered independently of one another and which also refine the present disclosure independently of one another and, as a result, shall also be considered to be an integral part of the present disclosure, either individually or in a combination other than the one shown. Furthermore, the described exemplary embodiments can also be supplemented with additional of the above-described features of the present disclosure.
[0023] In the figures, functionally equivalent elements are each denoted by the same reference numerals.
[0024] In some examples described in greater detail below, a predetermined monitoring area in a surrounding area or an environment of a radar system is examined for the presence of at least one object during a signal evaluation by means of the signal data of the digital antenna signals. The monitoring area can be a detection area (detection range) of the radar system. To make the signal evaluation efficient, in terms of computing, for the entire monitoring area, the signal evaluation may be configured with a two-stage design, and in a first processing step, only a predetermined subset of the signal data is supplied to an evaluation module, which carries out a first target detection based on the subset of the signal data in the entire monitoring area via first so-called resolution gates. The described evaluation module can be tangibly-embodied software, for example, which is executed by the processor circuit. The term “resolution gates” as used herein denotes a generalization of the term “range gate,” that is, the measure known for radar signal processing or signal evaluation of combining signal portions of the antenna signals by integration over the time, for example to detect the signal power or signal energy in the integrated time segment. A resolution gate can in each case be provided for the dimension or measured variable that is range, velocity, azimuth, elevation, or a combination thereof (so-called multi-dimensional resolution gate). This is known per se from the state of the art. However, not all signal data are used in the first processing step, that is, only a segment or a portion of the digital antenna signals generated or available during the measurement cycle is supplied to the evaluation module, resulting in reduced resolving power for the target detection. In other words, in the first processing step, the entire environment or the entire monitoring area is examined or checked using fewer than the available signal data by means of a coarser or low-resolution target detection. The resolution gates divide the monitoring area into a cell grid having a first resolution (coarse resolution). This means that each resolution gate corresponds to or yields one resolution cell of the cell grid. A resolution cell thus corresponds to the subregion of the monitoring area that is covered or monitored by means of an assigned resolution gate. The underlying subset of the signal data is selected in such a way that in fact more signal data are available in the data memory for the target detection in each resolution gate; however, not all signal data or pieces of information available for the particular resolution gate are in fact utilized or supplied to the evaluation module. An algorithm available from the prior art can be resorted to for the particular target detection.
[0025] Then, those resolution cells for which, in the first processing step, the associated resolution gate meets a predetermined occupancy criterion are selected, and only the signal data available in the data memory for the selected resolution cells are selected for these resolution cells. In other words, it is recognized by way of the occupancy criterion which of the resolution cells potentially includes an object. With this, it is also known which of the overall available pieces of signal data have to be supplied to the evaluation module again and/or additionally for a further, in particular higher-resolution, signal evaluation. For a given measurement cycle, these do not have to be all signal data, so that it is prevented in this way that signal data that are only relevant for resolution cells for which no indication of an object exists are processed unnecessarily.
[0026] In a second processing step, the selected signal data are then supplied to the evaluation module, which based on the selected signal data in each case only carries out a target detection in the selected resolution cells by means of second resolution gates a second target detection [sic], which provide a greater or finer resolution of the particular dimension or measured variable, that is, they divide the particular resolution cell into a sub-cell grid having a second resolution (fine resolution) that is finer compared to the first resolution. In other words, a resolution cell for which the occupancy criterion is met is divided into sub-cells, and the target detection is carried out individually or separately in the sub-cells. For this purpose, only those signal data that are relevant for the sub-cells are then resorted to. In particular, it is then also only necessary to carry out those calculations, using the selected signal data, which are relevant for the target detection in the particular sub-cell. In contrast, signal data that are only relevant for unoccupied resolution gates are identified and can remain without consideration in the first and second processing steps. In this case, carrying out calculations for the remaining resolution cells can be dispensed with, which advantageously saves calculation steps.
[0027] The present disclosure thus yields the advantage that, proceeding from the raw data, that is, the signal data of the digitized antenna signals, only those signal data are used for the target detection having the greater or finer second resolution (fine resolution), and that the calculations are only carried out in those resolution cells, for which any indication of a possible object resulted in the first processing step based on the subset of the signal data by means of the occupancy criterion. This saves a plurality of calculation steps per measurement cycle.
[0028] The present disclosure also includes examples that yield additional advantages.
[0029] In one some examples, a radar image for the entire monitoring area is formed of respective results data of the first target detection for those resolution cells of the first cell grid for which the occupancy criterion is not met, and of respective results data of the second target detection for those resolution cells that meet the occupancy criterion. In this way, an overall image of the environment is advantageously provided, even though the second target detection was only carried out for the selected resolution cells that meet the occupancy criterion. For the remaining resolution cells, the detection result of the first target detection, that is, the results data thereof, can be used for the entire resolution cell.
[0030] In some examples, at least one of the following reductions results from the predetermined subset of the signal data, compared to a total of the signal data of the particular measurement cycle: [0031] a reduced number of antennas and/or [0032] a reduced sampling rate of the analog-to-digital conversion and/or [0033] a limited bandwidth and/or [0034] a limited measuring time.
[0035] In this way, the number of available antennas can be (artificially) reduced compared to or for the evaluation module in that signal data of at least one antenna remain without consideration. By reducing the sampling rate, a frequency resolution of the analog-to-digital conversion can be decreased. A limited bandwidth can, for example, be achieved by low pass filtering or band pass filtering or raw pass filtering. A limited measuring time can, for example, be achieved by trimming or cutting out a time segment of a digitized antenna signal. These measures have proven to be advantageous since they are suitable for allowing the use of a conventional evaluation model even in the first processing step, without necessitating a special adaptation of the evaluation module. The measuring time can also be adapted based on Fast Fourier transforms (FFT). The described reduction of the signal data can simplify so-called compressive sensing hypotheses and/or can simplify constant false alarm rate (CFAR) calculations.
[0036] In another example, antenna signals may be configured as echoes of an (electromagnetic) chirp signal or of multiple such chirp signals, and that only a low-frequency signal component or signal portion of the particular chirp signal is comprised by the predetermined subset of the signal data. A chirp signal is a signal in which the frequency continuously increases or continuously decreases over time, so that there is a low-frequency signal component at the beginning of the chirp signal, or at the end thereof. In this way, it is possible to ascertain the low-frequency signal component by simply selecting a first or a last sub-portion of the antenna signal. By selecting the length of the signal portion, it is possible to decide up to which cut-off frequency the low-frequency signal component is being selected. This is a particularly simple processor operation, by way of which a subset of the signal data can be efficiently selected in the data memory.
[0037] In some examples, the resolution gates each may have a one-dimensional or multi-dimensional design, and that respective resolution gates are provided for at least one of the following measured variables or “dimensions:” range, relative velocity in the radial direction, relative velocity in the tangential direction, azimuth angle, and elevation angle. This results in resolution gates that are accordingly referred to as range gates, velocity gates, azimuth gates or elevation gates. By combining two or more than two of these measured variables in each case, the above-described respective multi-dimensional resolution gate is obtained, for example a combination of range and azimuth angle.
[0038] In some examples, the occupancy criterion is configured such that a signal power of the antenna signals in the respective resolution gate, as determined based on the subset of the signal data, is greater than a predetermined threshold value. An occupancy criterion that is particularly efficient for the calculation can thus be implemented by a threshold value comparison The threshold value can be established as a function of the cell size of the particular resolution cell. The calculation of the signal power can, for example, include an integral of the squared signal values of an antenna signal or of a combination (formed, for example, by beamforming) of multiple antenna signals over time.
[0039] In some examples, the occupancy criterion encompasses that a predetermined machine learning model (AI, artificial intelligence), such as an artificial neural network, signals an occupancy of the particular resolution cell based on the subset of the signal data. By appropriately training such a model, an occupancy of a resolution cell can be detected or identified. In particular, artificial deep neural networks (for example, DNN, CNN, recurrent neural networks and spiking neural networks) have proven to be suitable machine learning algorithms Compared to a threshold value comparison, the use of a machine learning model can yield the advantage that additional pieces of information or criteria, for example the further resolution cells adjoining a resolution cell to be checked, and/or a signal pattern of multiple resolution cells can be taken into consideration. Using appropriate training data, for which also so-called label data, that is, the correct detection result or the so-called Ground Truth, are provided, a machine learning model can be accordingly trained or prepared.
[0040] In some examples, compared to the first target detection, the second target detection additionally comprises at least one predetermined super resolution algorithm. Examples of such super resolution algorithms are MUSIC, ESPRIT, KEYSTONE, SAR, which, even though they are computationally intensive, only have to be applied in the second processing step of the method to the selected resolution cells, whereby these super resolution algorithms are rendered usable or applicable in a radar system, in particular in a radar system for a motor vehicle and/or under real-time requirements.
[0041] In some examples, the first processing step and the second processing step can be repeated at least once iteratively, wherein, in the first processing step, in each case those sub-cells of the sub-cell grid are used as a basis for the particular repetition, instead of the entire monitoring area, which in the preceding second processing step in each case meet the occupancy criterion. In other words, during the next iteration an individual selected sub-cell can be regarded as a monitoring area again, which is subdivided by means of further resolution gates. In this way, it can be prevented that unnecessary calculations are carried out within a selected resolution cell for those sub-cells for which it was already recognized in a preceding iteration that no object is present there.
[0042]
[0043] In this example of an automated driving function, an outside surrounding area or an environment 13 of the motor vehicle 10 is detected via a radar system 14, which can monitor a monitoring area 15 in the environment 13 as to whether at least one object 16 is present therein, and where this object 16 is situated relative to the motor vehicle 10. The monitoring area 15 may extend around the entire motor vehicle 10 (that is, 360°, horizontally). For this purpose, the radar system 14 includes antenna modules 17, by which antennas 18 for receiving radar echoes 19 can be provided. The radar echoes, or “echoes” 19 for short, can be echoes of electromagnetic radar signals 20, which can have been emitted by transmitting modules 21 via corresponding transmitting antennas 22. The emission of radar signals 20 and the reception of echoes 19 can be repeated periodically or at predetermined points in time in consecutive measurement cycles. Ellipses 23 symbolize that the illustrated number of antennas 18 and transmitting antennas 22 is only by way of example. The antenna modules 17 and the transmitting modules 21 can be connected, by way of example, via an analog signal connection 24 to a central station 25, which can comprise an analog-to-digital converter 26 (ADC) and a processor circuit 27. Additional components of the central station 25 are not shown in the illustration for simplicity reasons.
[0044] From the antennas 18, antenna signals 28 can be received via the analog signal connection 24 in the central station 25, and in the analog-to-digital converter 26. From this, digital antenna signals 29 can be generated in the manner known per se by the analog-to-digital converter 26, the signal data 30 of which can be stored in a data memory 31. Proceeding from the signal data 30, the method described hereafter can be carried out for each measurement cycle, based on an evaluation module 32. The evaluation module 32 can, for example, stem from the prior art in the manner known per se.
[0045]
[0046] In a step S14, this can provide, for example, the calculation of FFTs/compressive sensing hypotheses/CFAR/resolution gates, for example, for range, velocity, azimuth and/or elevation in the evaluation module 32, based on only a subset 35 of the signal data 30. It is possible, for example, to provide n<N antennas and/or, per antenna, fewer than the overall available signal data 30 or samples of the analog-to-digital converter and/or digital antenna signals having a limited bandwidth (for example, due to band pass filtering or low pass filtering) and/or having a limited measuring time (trimming of the digital antenna signals in terms of time), as was already described above.
[0047] The limitation to only a subset of the signal data results in resolution gates having a comparatively low resolving power. Each resolution gate represents or monitors a resolution cell. The shape of the resolution cells defines a cell grid 40 including resolution cells 41, of which each resolution cell 41 corresponds to a resolution gate. The cell grid 40 can cover the entire monitoring area 15. It is now possible to check for each resolution cell 41 by means of the occupancy criterion 37 whether a probability for an object 16 in the particular resolution cell 41 is greater than a predetermined minimum value. In the process, an occupancy criterion 37 can be checked for individual resolution cells, for which purpose, for example, a machine learning model, for example an artificial neural network, such as a DNN or one of the other models, is utilized.
[0048] In a step S15, all resolution cells 41 for which the occupancy criterion 37 is met can be selected.
[0049] In a step S16, it is then possible, as part of the second processing step 34, to carry out a target detection again by means of the evaluation module 32, this time a second target detection Z, which can be carried out based on additional or other signal data 30, which can be selected from the data memory 31 according to the selected resolution cells 41.
[0050] For the selection 42 of resolution cells 41, for example, in each case signal data of up to N antennas can be used, in particular all antennas relevant for the resolution cell 41 (which, for example with respect to this resolution cell 41, are not blocked by the motor vehicle 10 itself). Optionally, it is possible by means of a for the selected resolution cells 41.
[0051] This results in a sub-cell grid for each selected resolution cell, for the sub-cells 43 of which optionally an occupancy criterion 37′ can be applied to carry out an optional recursion or iteration 44.
[0052] It is also possible in a step S17, for example, to apply super resolution algorithms, such as have already been described, for the selected resolution gates, due to the lower number of signal data 30 to be used.
[0053] In a step S18, it is then possible to merge the results data 46 from the occupied resolution cells (results data 46 from the second method step 34 and the results data from the unoccupied resolution gates (results data from the first processing step 33)), and in a step S19 to generate an overall image 47 of the monitoring area 15 therefrom. For example, a coordinate transformation of the point cloud and a forwarding to an environment model of the autonomous driving function 12 can take place.
[0054]
[0055] In
[0056]
[0057] With this, it is achieved that the data volume to be calculated is reduced for high-resolution radar systems, and that a reliable, high-resolution object detection is obtained. High-resolution, imaging 3D radar systems in fact require extensive computing capacity for processing the data, such as, for example, the calculation of a range-Doppler matrix.
[0058] As a result of the described, following approach, an increase in efficiency can be achieved: [0059] i. Roughly resolved scan in the entire field of view (monitoring area 15). Detection of the occupied range-Doppler cells (resolution cells). [0060] ii. Finely resolved scan/processing of the occupied range-Doppler cells for high-resolution object detection. [0061] iii. Merging the two cans from i. and ii. results in a complete image of the environment, including all the necessary information.
[0062] The following advantages are achieved: [0063] i. Reduction of the necessary computing power [0064] ii. Energy savings since fewer calculations are required [0065] iii. Cost savings in the control unit
[0066] To reduce the complexity of the problem, a two-stage signal evaluation is carried out. In the first processing step, a deliberately coarser resolution is processed (see
[0067] The technique for reducing the computing complexity for high-resolution radar sensors, as described in the present disclosure, is an advantageous procedure at the present time to be able to calculate the “data cube” of a modern radar in real time at all. This applies both to the case where conventional linear processors are used in control units, and for today's parallel processing units.
[0068] This makes it possible, from a computing complexity point, for radar sensor systems to penetrate into resolution ranges that, at least in terms of the angle, have previously been reserved for laser sensors and cameras. With this, a weather-independent and reliable high-resolution sensor would be available for monitoring the vehicle environment for automatic driving.
[0069] In this way, the data volume to be processed can already be reduced based on the raw radar signals. The identification of the relevant resolution cells and the sequential post-processing with a finer resolution take place in two stages. In the process, at least one of the following variables can be adapted: the bandwidth of the sampling rate of the ADCs, the number of antennas, the frequency bandwidth, the measuring time based on FFTs, compressive sensing hypotheses, CFAR calculations, range gates, velocity gates, azimuth gates or elevation gates can be reduced. In particular the use of machine learning algorithms, such as artificial deep neural networks (for example DNN, CNN, recurrent NN, spiking NN), can be used to identify the occupied resolution cells. Furthermore, these AI methods can be used to reduce or increase the resolving power.
LIST OF REFERENCE NUMERALS
[0070] 10 motor vehicle
[0071] 11 autopilot
[0072] 12 driving function
[0073] 13 environment
[0074] 14 radar system
[0075] 15 monitoring area
[0076] 16 object
[0077] 17 antenna module
[0078] 18 antennas
[0079] 19 echo
[0080] 20 radar signal
[0081] 21 transmitting module
[0082] 22 antenna
[0083] 23 ellipsis
[0084] 24 signal connection
[0085] 25 central station
[0086] 26 analog-to-digital converter
[0087] 27 processor circuit
[0088] 28 antenna signal
[0089] 29 antenna signal
[0090] 30 signal data
[0091] 31 data memory
[0092] 32 evaluation module
[0093] 33 processing step
[0094] 34 processing step
[0095] 35 subset
[0096] 37 occupancy criterion
[0097] 40 cell grid
[0098] 41 resolution cell
[0099] 43 sub-cell grid
[0100] 44 iteration
[0101] 46 results data
[0102] 47 overall image
[0103] 50 occupied cell