RADAR DEVICE AND SENSOR FUSION SYSTEM USING THE SAME

Abstract

In order to improve accuracy of kind identification of a detected object in a radar device provided in a sensor fusion system, information of the result of kind identification by a camera device provided in the sensor fusion system is given to the radar device and an attribution degree database that is used for identification determination by the radar device during the operation of the sensor fusion system is updated by a database update block.

Claims

1. A radar device serving as a sensor device having an identification device that identifies a kind of a detected object by using a preliminarily created database, said radar device comprising a database update block that updates said database on the basis of the result of said identification device and the result of an object kind identification device, which is obtained by a different sensor device.

2. The radar device according to claim 1, further comprising: a radar signal processing block that calculates a distance, a relative speed, and an angle of the object by performing signal processing on the basis of a transmission wave and a reception wave; an attribution degree database serving as said database in which a feature quantity of a preliminarily defined object is made into data to be stored; and an attribution degree calculation block serving as said identification device that calculates an attribution degree to the distribution of the feature quantity related to the preliminarily defined object on the basis of the detection result of said radar signal processing block and said attribution degree database and outputs an identification result, wherein said database update block updates said attribution degree database on the basis of the result of said attribution degree calculation block and the identification result of object kind, which is obtained by said different sensor device.

3. The radar device according to claim 1, wherein the identification result of object kind, which is obtained by said different sensor device, is a result outputted from a camera device.

4. The radar device according to claim 2, wherein the identification result of object kind, which is obtained by said different sensor device, is a result outputted from a camera device.

5. A sensor fusion system comprising: the radar device as set forth in claim 1; a camera device serving as said different sensor device; and a sensor fusion section that performs fusion processing of the detection result of said radar device and the detection result of said camera device.

6. A sensor fusion system comprising: the radar device as set forth in claim 2; a camera device serving as said different sensor device; and a sensor fusion section that performs fusion processing of the detection result of said radar device and the detection result of said camera device.

7. The sensor fusion system according to claim 5, wherein said sensor fusion section includes: a fusion processing block which determines as to whether or not the detection result of said radar device and the detection result of said camera device are the same and performs tracking processing; and a selection processing block that selects control data necessary for vehicle control and data necessary for update of said database of said radar device from the result of fusion outputted by said fusion processing block.

8. The sensor fusion system according to claim 6, wherein said sensor fusion section includes: a fusion processing block which determines as to whether or not the detection result of said radar device and the detection result of said camera device are the same and performs tracking processing; and a selection processing block that selects control data necessary for vehicle control and data necessary for update of said database of said radar device from the result of fusion outputted by said fusion processing block.

Description

BRIEF DESCRIPTION OF THE DRAWING

[0016] FIG. 1 is a block diagram showing a sensor fusion system of Embodiment 1 of the present invention.

[0017] FIG. 2 is a block diagram showing a radar device provided in the sensor fusion system according to Embodiment 1 of the present invention.

[0018] FIG. 3 is an explanation view showing the relationship between distance and received power at the time when a vehicle and/or a person is detected by an individual of standard transmission power, in the radar device provided in the sensor fusion system according to Embodiment 1 of the present invention.

[0019] FIG. 4 is an explanation view showing the relationship between distance and received power at the time when a vehicle and/or a person is detected by an individual that is smaller in transmission power than the standard individual, in the radar device provided in the sensor fusion system according to Embodiment 1 of the present invention.

[0020] FIG. 5 is an explanation view showing results in which the relationship between the distance and the received power at the time when the vehicle and/or the person is detected by the individual that is smaller in transmission power than the standard individual, is made to shift in response to the identification result of a camera device, in the radar device provided in the sensor fusion system according to Embodiment 1 of the present invention.

[0021] FIG. 6 is an explanation view showing a relationship of attribution degrees of respective categories (kinds) to a certain feature quantity.

DETAILED DESCRIPTION OF THE INVENTION

Embodiment 1

[0022] First, the present applicant investigates the aforementioned problems to obtain a radar device capable of identifying an object by using features of the object extracted from measurement values of a radar device.

[0023] The radar device such as this includes: a first feature quantity extraction block that extracts information related to at least a relative distance and a relative speed to the object and an angle and the reflection strength of the object about a plurality of objects, as a first feature quantity at a constant time cycle from a reception signal of the radar device; a data storage processing block which stores the first feature quantity and associates a plurality of the first feature quantities with the same object in temporal sequence over a plurality of cycles; a second feature quantity extraction block that extracts a second feature quantity such as a maximum value (maximum detection distance) of the relative distance, a received power value, a change quantity of the received power value from the first feature quantity in the data storage processing block; an attribution degree calculation block that calculates an attribution degree to the distribution of the second feature quantity related to a preliminarily defined category; and an object determination block that determines the category of the object on the basis of the attribution degree.

[0024] Incidentally, the attribution degree calculation block calculates a value for each category of each feature quantity of the second feature quantity (attribution degree) which is inputted from the second feature quantity extraction block on the basis of the distribution of attribution degree for each second feature quantity obtained from an attribution degree database. More specifically, the attribution degree to the distribution of the second feature quantity related to the preliminarily defined category is calculated.

[0025] For example, when the distribution of attribution degree showing the relationship between a feature quantity and an attribution degree in a certain distance is registered in the attribution degree database as shown in FIG. 6, and when the second feature quantity about a certain object detected by the radar is calculated as a value shown by a black point, the attribution degree of a category 1 is a small value (=α), the attribution degree of a category 2 is a large value (=β), and the attribution degree of a category 3 is 0 (=γ).

[0026] Furthermore, the attribution degree database quantifies and stores: the distribution of the second feature quantity obtained by preliminarily observing several examples about the preliminarily defined categories; the distribution of the second feature quantity based on theoretical values derived from transmission power, distance, antenna gain, reflection sectional area, and the like; and properties based on experimental knowledge related to the categories.

[0027] For example, acquisition of the distribution of the attribution degree of FIG. 6 can be made by standardizing a maximum value after creating a histogram of a sample (teacher data).

[0028] The object determination block identifies which category the object belongs on the basis of the attribution degree for each category related to the object inputted from the attribution degree calculation block, more specifically, identifies a kind of the object (for example, vehicle, person, low position object capable of being overridden, and the like), and outputs the result of the identification.

[0029] The aforementioned radar device sets a change quantity in a short time of the reflection strength of the object obtained by the radar device as the feature quantity and identifies the category (kind) of the object; and therefore, highly accurate object identification can be achieved in a short time or from a small number of measurement points.

[0030] Furthermore, the radar device identifies the category (kind) of the objects on the basis of a plurality of feature quantities of the object obtained by the radar device; and therefore, highly accurate object identification can be achieved even when there exists a deficit or the like.

[0031] By the way, the aforementioned radar device creates the attribution degree database in which the feature quantities of the known objects are preliminarily made into a database; however, for example, when there is an individual difference in transmission power of a radio wave of the radar device and in the case of an individual that is low in transmission power, the received power value is decreased. When the feature quantity depending on the received power value is used, there arises a difference from the feature quantity stored in the database and accordingly an erroneous determination is likely to be made. For example, the radar device identifies a certain object as a person and the camera device identifies the same object as a vehicle; and accordingly, the detected object by the radar device and the detected object by the camera device are likely to be determined as different objects in sensor fusion processing.

[0032] Furthermore, in the case of creating the attribution degree database in the aforementioned radar device, it is conceivable that a robust object can be identified with an increase in source data; however, much time and cost are likely to be required for data accumulation.

[0033] Next, Embodiment 1 of the present invention that solves the problems in the radar device such as this will be described on the basis of drawings. FIG. 1 and FIG. 2 show the configuration of a sensor fusion system and the radar device that is a major portion thereof in Embodiment 1 of the present invention. Incidentally, the same reference numerals as those shown in the respective drawings represent identical or corresponding elements.

[0034] As shown in FIG. 1, a sensor fusion system 100 includes: a radar device 101 serving as a sensor device having an identification device that identifies a kind of a detected object; a camera device 102 serving as a different sensor device having an object kind identification device that can obtain the identification result of object kind; a sensor fusion section 103; a fusion processing block 104; and a selection processing block 105. The sensor fusion system 100 is used for controlling a vehicle control engine control unit (ECU) 106.

[0035] The sensor fusion section 103 performs fusion processing of the detection result of the radar device 101 and the detection result of the camera device 102. The fusion processing block 104 determines as to whether or not the detection result of the radar device 101 and the detection result of the camera device 102 are the same and performs tracking processing in the sensor fusion section 103. The selection processing block 105 selects control data necessary for vehicle control and data necessary for database update of the radar device 101 from the result of fusion outputted by the fusion processing block 104. The vehicle control ECU 106 performs vehicle control which is automatic braking and/or adaptive cruise control (ACC) from information obtained by the sensor fusion system 100.

[0036] Next, the radar device 101 that is the major portion of the present invention will be described in detail on the basis of FIG. 2. As shown in the same drawing, the radar device 101 includes: a radio frequency/intermediate frequency (RF/IF) block 201; a radar signal processing block 202; an attribution degree calculation block 203 serving as an identification device; an attribution degree database 204; and a database update block 205. The radar device 101 performs sending/receiving of a signal to/from the sensor fusion section 103. Incidentally, the sensor fusion section 103 is configured similarly to those shown in FIG. 1.

[0037] The RF/IF block 201 transmits/receives a signal wave and generates a base band signal from a transmission wave and a reception wave. The radar signal processing block 202 performs analog/digital (A/D) conversion of the base band signal sent from the RF/IF block 201 and calculates a distance, a relative speed, and an angle of an object from the A/D conversion signal. The attribution degree calculation block 203 calculates an attribution degree for each category of each detected object from the detection result of the radar signal processing block 202 and the attribution degree database 204 and outputs a final identification result. The attribution degree database 204 is an attribution degree database that is intended to be referred by the attribution degree calculation block 203. The database update block 205 updates the attribution degree database 204 on the basis of the result of the attribution degree calculation block 203 and an identification result by the camera device, the identification result being an output from the sensor fusion section 103.

[0038] In the thus configured radar device, a database suitable for a practical use environment is generated by updating the attribution degree database 204 by the database update block 205 during running.

[0039] As the specific operation of the database update block 205, description will be made on a case where attribution degrees of a vehicle and a person are calculated from received power. FIG. 3 is a view showing the relationship between a distance and a received power value when a vehicle and a person are detected by an individual that is standard in transmission power of the RF/IF block 201 in the radar device 101. If the relationship between the distance and the received power of the object detected by the radar device is within a distribution range of received power from the vehicle: A, the attribution degree of the vehicle becomes high; and if the relationship is within a distribution range of received power from the person: B, the attribution degree of the person becomes high.

[0040] Whereas, FIG. 4 is a view showing the relationship between a distance and a received power value in the case of detecting a vehicle and a pedestrian by an individual that is small in transmission power. If reception performance is almost the same as the standard individual, the received power becomes small since the transmission power is small. More specifically, as shown in FIG. 4, as for the distribution of the received power, both of a distribution range of received power from the vehicle: Aa and a distribution range of received power from the person: Ba are positioned in a lower direction (in a direction reducing the received power).

[0041] Here, when the radar device 101 detects an object showing a value of a range shown by a dotted line E in FIG. 3 and FIG. 4, the object is likely to be identified as the person in the case of being detected by the standard individual, but the object is likely to be identified as the vehicle in the case of being detected by the individual that is small in transmission power; and accordingly, it results in erroneous identification. However, when the identification result of the camera device 102 is determined as the person, the attribution degree can be correctly obtained by shifting the relationship between the distance and the received power as shown in FIG. 5. More specifically, in FIG. 5, it becomes characteristics like a solid line curve by shifting characteristics shown by a dotted line curve upward as shown by an arrow “C”; and both of the distribution range of received power from the vehicle: A and the distribution range of received power from the person: B become the characteristics of FIG. 3.

[0042] As described above, in the present invention, even when the database prepared in manufacturing has variations in performance of the radar device, information in which the camera device identifies as the person from the result of sensor fusion is inputted to the radar device. Then, from the result thereof, it is recognized that the distribution of received power of the person is lower than that of the standard individual, it becomes possible to reflect to the database, identification performance of the object by the radar device can be improved, and it becomes possible to improve determination performance of the same object of the sensor fusion system. Furthermore, the radar device suitable for the sensor fusion system can be obtained.

[0043] Furthermore, the sensor fusion system using the radar device and the camera device is provided in Embodiment; however, a sensor fusion system which uses a sensor device with high identification accuracy other than the camera device and a radar device can also be provided.

[0044] The present invention is not limited to the above example, but the embodiment can be appropriately changed in the scope of the present invention.