OBJECT RECOGNITION VIA INDIRECT SIGNAL REFLECTION
20200174134 ยท 2020-06-04
Inventors
Cpc classification
G01S17/42
PHYSICS
G01S2013/464
PHYSICS
G06V20/58
PHYSICS
G01S2013/932
PHYSICS
International classification
B60W30/16
PERFORMING OPERATIONS; TRANSPORTING
G01S17/42
PHYSICS
Abstract
A control system is suitable for use in a motor vehicle and is configured and intended for detecting a position and/or a speed of an object in the surroundings of the host motor vehicle according to determined objects and/or according to driving-related information concerning other motor vehicles, based on surroundings data from at least one surroundings sensor situated on the host motor vehicle and provided to the control system. Based on these surroundings data, an object in the surroundings of the host motor vehicle is detected, and a virtual position and/or a virtual speed are/is associated with this object. The virtual position and/or speed associated with the object are/is adapted based on the driving-related information concerning another motor vehicle and/or based on driving-related information concerning the host motor vehicle, in order to determine an instantaneous position and/or an instantaneous speed of the object.
Claims
1. A control system (10) which for use in a host motor vehicle (12) is configured and intended for determining a position and/or a speed of an object in the surroundings of the host motor vehicle (12), based on surroundings data that are obtained from at least one surroundings sensor (14, 16, 18) situated on the host motor vehicle, wherein the at least one surroundings sensor (14, 16, 18) is configured for providing to an electronic control unit (20) of the control system (10) at least information concerning objects and/or driving-related information concerning other motor vehicles in an area (20, 22, 24) in front of, to the side of, and/or behind the host motor vehicle (12), and wherein the control system (10) is at least configured and intended for detecting an object (28) in the surroundings of the host motor vehicle (12), based on the provided surroundings data, associating a virtual position and/or a virtual speed with the object (28), based on the provided surroundings data, and adapting the virtual and/or the virtual speed position associated with the object (28), based on driving-related information concerning another motor vehicle (26) and/or based on driving-related information concerning the host motor vehicle (12), in order to determine an instantaneous position and/or an instantaneous speed of the object (28).
2. The control system according to claim 1, wherein the driving-related information concerning the host motor vehicle (12) includes at least one instantaneous speed of the host motor vehicle (12), and wherein the driving-related information concerning the other motor vehicle (26) includes at least one instantaneous speed of the other motor vehicle (26).
3. The control system (10) according to claim 1, wherein the object (28) is situated at least partially outside a direct detection range of the at least one surroundings sensor (14, 16, 18).
4. The control system (10) according to claim 1, wherein the object (28) is situated completely outside a direct detection range of the at least one surroundings sensor (14, 16, 18).
5. The control system (10) according to claim 1, wherein the object (28) includes multiple subareas, wherein the object reflects electromagnetic waves at least on one of the subareas, and wherein the control system is further configured and intended for detecting the object (28) in the surroundings of the host motor vehicle as a selection from a plurality of objects and/or as a selection from one of the subareas of the object (28).
6. The control system (10) according to claim 1, which is further configured and intended for determining the virtual position and/or the virtual speed of the object (28) based on mirrorings and/or reflections of a signal of the at least one surroundings sensor (14, 16, 18).
7. The control system (10) according to claim 6, which is configured and intended for analyzing the mirrorings and/or the reflections for detecting the object (28) and/or for determining the virtual position and/or the virtual speed of the object (28) with regard to their respective signal strength.
8. The control system (10) according to claim 1, which is further configured and intended for analyzing the plausibility of the mirrorings and/or the reflections for detecting the object (28) and/or for determining the virtual position and/or the virtual speed of the object (28).
9. The control system (10) according to claim 1, which is further configured and intended for determining the instantaneous position and/or the instantaneous speed of the object (28) as the ratio of the virtual speed of the object (28) to the instantaneous speed of the host motor vehicle (12).
10. The control system (10) according to claim 1, wherein the object (28) is a further motor vehicle and/or a road sign and/or a sign gantry and/or a virtual object.
11. The control system (10) according to claim 10, which is further configured and intended for testing reflection hypotheses in each case with regard to a pair comprising the virtual object and the further motor vehicle and/or the road sign and/or the sign gantry, in order to distinguish the virtual object from the further motor vehicle and/or the road sign and/or the sign gantry.
12. The control system (10) according to claim 1, wherein the at least one surroundings sensor (14, 16, 18) includes a radar sensor and/or a lidar sensor.
13. A motor vehicle (12) that includes a control system (10) according to claim 1.
14. A control method, which in a host motor vehicle (12) determines a position and/or a speed of an object in the surroundings of the host motor vehicle (12), based on surroundings data that are obtained from at least one surroundings sensor (14, 16, 18) situated on the host motor vehicle 12, wherein the at least one surroundings sensor (14, 16, 18) provides at least information concerning objects and/or driving-related information concerning other motor vehicles in an area (20, 22, 24) in front of, to the side of, and/or behind the host motor vehicle (12), and wherein the control system comprises at least the following steps: detecting (S100) an object (28) in the surroundings of the host motor vehicle (12), based on the provided surroundings data, associating (S102) a virtual position and/or a virtual speed with the object (28), based on the provided surroundings data, and adapting (S104) the virtual position associated with the object (28) and/or the virtual speed associated with the object (28), based on driving-related information concerning another motor vehicle (26) and/or based on driving-related information concerning the host motor vehicle (12), in order to determine an instantaneous position and/or an instantaneous speed of the object (28).
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Further aims, features, advantages, and possible applications result from the following description of exemplary embodiments, which are not to be construed as limiting, with reference to the associated drawings. All features described and/or graphically illustrated, alone or in any combination, constitute the subject matter disclosed herein. The dimensions and proportions of the components shown in the figures are not to scale.
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
DETAILED DESCRIPTION OF THE DRAWINGS
[0045] Within the scope of the following disclosure, certain aspects are described primarily with regard to the control system. However, these aspects are of course also applicable within the scope of the disclosed control method, which may be carried out, for example, by a central control device (ECU) of a motor vehicle. This may take place by making suitable write and read access to a memory associated with the motor vehicle. The control method may be implemented within the motor vehicle as hardware or software, and also as a combination of hardware and software. Also included are digital signal processors, application-specific integrated circuits, field-programmable gate arrays, and other suitable switching and computing components.
[0046]
[0047]
[0048] At least one additional or alternative surroundings sensor 16, likewise facing the front in the travel direction of the motor vehicle 12, is situated in the area of the windshield of the motor vehicle 12. For example, this surroundings sensor 16 may be situated between a rearview mirror of the motor vehicle 12 and its windshield. Such a surroundings sensor 16 detects an area 22 in front of the motor vehicle 12; depending on the design of the motor vehicle 12, an area 22 directly in front of the motor vehicle 12 cannot be detected due to the front section (or geometry) of the motor vehicle 12.
[0049] In addition, at least one surroundings sensor 18 may be situated at the side and/or the rear of the motor vehicle 12. This optional surroundings sensor 18 detects an area 24 to the side of and/or behind the motor vehicle 12 in the travel direction of the motor vehicle 12. For example, the data or signals of this at least one surroundings sensor 18 may be used to verify information that is detected by the other surroundings sensors 14, 16, and/or to determine a curvature of a lane traveled on by the motor vehicle 12.
[0050] The at least one surroundings sensor 14, 16, 18 may be implemented in any desired manner, and may include a front camera, a rear camera, a side camera, a radar sensor, a lidar sensor, an ultrasonic sensor, and/or an inertial sensor. For example, the surroundings sensor 14 may be implemented in the form of a radar, lidar, or ultrasonic sensor or in the form of a front camera. A front camera is particularly suited for the surroundings sensor 16 situated at a higher level, whereas the surroundings sensor 18 situated in the rear of the motor vehicle 12 may be implemented in the form of a radar, lidar, or ultrasonic sensor or in the form of a rear camera and/or side camera.
[0051] The electronic control unit ECU processes the surroundings data obtained from the surroundings sensor(s) 14, 16, 18 situated on the motor vehicle 12 in order to detect a lane traveled on by the motor vehicle 12 via a first and a second lateral lane marking in front of the motor vehicle 12. In addition, the electronic control unit ECU processes the surroundings data obtained from the surroundings sensor(s) 14, 16, 18 situated on the motor vehicle in order to detect a lane traveled on by another motor vehicle (the lane adjacent to the lane traveled on by the host vehicle, where adjacent means that one or more further lanes may also be situated between the adjacent lanes), and its lateral lane markings in front of the motor vehicle. For this purpose, the surroundings sensors 14, 16, 18 provide surroundings data to the electronic control unit ECU that represent the area in front of, to the side of, and/or behind the vehicle. To this end, the control system 10 is connected to the at least one surroundings sensor 14, 16, 18 via at least one data channel or bus (illustrated by dashed lines in
[0052] Alternatively or additionally, the control system 10 or its electronic control unit ECU may obtain data from one or more other assistance systems 20 or some other control unit 20 of the motor vehicle 12 which indicate or allow the derivation of the lanes traveled on by the host vehicle, the other vehicle, and further motor vehicles via their lateral lane markings. Thus, data and information already determined by other systems may be used by the control system 10.
[0053] In addition, the control system 10 or its electronic control unit ECU determines a driving situation with the surroundings sensors, i.e., based on the surroundings data obtained using the at least one surroundings sensor 14, 16, 18. Here as well, an assistance system 20 or an electronic control unit 20 that is already present may alternatively or additionally supply data and/or information which define(s) a driving situation, or from which a driving situation may be quickly derived. A position and/or a speed of an object in the surroundings of the host motor vehicle 12 are/is subsequently determined, depending on the determined driving situation.
[0054] The driver assistance system 20 or the electronic control unit 20 may also be configured and intended for (semi)autonomously controlling the motor vehicle. In this case, the control system 10 is configured and intended for outputting data to the driver assistance system 20 or to the electronic control unit 20 for autonomous driving. In particular, the control system 10 (or its ECU) may output data that indicate to the component 20 a position and/or a speed of an object in the surroundings of the host motor vehicle 12 in an instantaneous driving situation (also a traffic situation). The data may likewise be transmitted via a data channel or bus in a wired or wireless manner.
[0055]
[0056] The roadway 34 is delimited by lateral lane markings 30 (left) and 32 (right). The roadway 34 may, but does not have to, have multiple lanes. During the following travel, the host motor vehicle 12 and the other motor vehicle 26 may be in the same lane of the roadway 34 or in different lanes of the roadway 34.
[0057] In the example shown in
[0058] In this way the control system 10 determines, among other things, a lateral distance of the other motor vehicle 26 (or of its longitudinal axis) from an actually present center line (detected by the at least one surroundings sensor 14, 16, 18) or a virtual center line of the lane of the roadway 34 being traveled on at the moment, as well as a distance along the roadway 34 (longitudinal distance) between the host motor vehicle 12 and the other motor vehicle 26. In addition, the control system 10 may determine the lateral speed and longitudinal speed as well as the lateral acceleration and longitudinal acceleration of the other motor vehicle 26.
[0059] In the driving situation illustrated in
[0060] At the point in time at which the host motor vehicle 12 actually travels under the sign gantry, reflections (also referred to as mirrorings) of the sensor signal 29 and/or of other sensor signals (not shown in
[0061] The resulting reflections are now described with reference to
[0062] Since the control system 10 initially cannot distinguish such multiply reflected output signals at the at least one surroundings sensor 14, 16, 18 from output signals, which have been reflected only once (for example, at the rear of the other motor vehicle) and thus correspond to a distance between the host motor vehicle 12 and the other motor vehicle 26 that is actually present, based on the output signal 36 the control system 10 detects only the virtual object 12 illustrated in
[0063] The virtual object 12, as shown in
[0064] The virtual object 12 involves incorrect information for the control system 10, which, for example, may be recognized and suppressed for a further processing chain. According to the present disclosure, however, it is possible to determine the position and/or speed of such a real object based on the information concerning the reflected signals, i.e., the multiple reflections of the signals emitted at the host motor vehicle 12. For this purpose, at least one speed, in the present case the longitudinal speed of the other motor vehicle 26 by way of example, is calculated using the emitted sensor signal 29 and based on the surroundings data obtained by the at least one surroundings sensor 14, 16, 18 and provided to the control system 10. In addition, the control system 10 is provided in a suitable manner with an instantaneous speed of the host motor vehicle 12. Based on each of these speeds, i.e., the correctly reconstructed speed of the other motor vehicle 26 as well as the speed of the host motor vehicle 12, an instantaneous (actual) position and an instantaneous (actual) speed of the virtual object 12 may then be determined.
[0065] According to another example illustrated in
[0066] In addition to the sensor signal 29 for detecting the other motor vehicle 26, previously described with reference to
[0067] Another example in which the above-described detection principle is used is illustrated in a top view with reference to
[0068] Similarly to the example illustrated with reference to
[0069] Here as well, the electromagnetic output signal 36, which is emitted in the front area of the host motor vehicle, prompted by the control system 10, for example, undergoes a total of three reflections (similarly to the example from
[0070] From the viewpoint of the control system, however, the situation is as shown in
[0071] The control system 10 is able to identify the virtual object 46 as such. This may take place, for example, via a plausibility check of the driving-related information determined for the virtual object, such as the distance from the host motor vehicle 12 and/or the relative speed and/or the relative acceleration between the host motor vehicle and the virtual object 46, and/or via measured angles between a longitudinal axis of the host motor vehicle 12 and a radial distance vector between the host motor vehicle 12 and the virtual object 46. Changes in the above-mentioned parameters between successive detection cycles may also be included in the plausibility check. Further options for the plausibility check involve an analysis of signals (i.e., also reflections), detected by the at least one surroundings sensor 14, 16, 18, with regard to their signal amplitude and/or a radar cross section.
[0072] As soon as the virtual object 46 has been identified in this way, the position determined for this purpose and/or the associated speed are/is adapted in such a way that the actual position and/or the actual speed of the real object are/is calculated in the form of the further motor vehicle 46. This calculation is in turn based on the instantaneous speed of the host motor vehicle 12 that is provided to the control system 10. Alternatively, this calculation may be based on the correctly reconstructed speed of the preceding vehicle 26 which is obtained via the sensor signal 29, for example. The passing further motor vehicle 46 may thus be correctly detected with regard to its position and its speed, and optionally also with regard to its acceleration, without being present in the direct visual range of surroundings sensors 14, 16 situated at the front of the host motor vehicle 12.
[0073] Based on this position information and speed information concerning the further motor vehicle 46, for example the driver assistance system 20 of the host motor vehicle 12 may then appropriately respond to a passing operation without using a reception signal of the at least one surroundings sensor 14, 16, 18 that is situated in the direct visual range of the surroundings sensor in question. The driver assistance system 20 may then, for example, warn a driver of the host motor vehicle 12 about him/herself initiating a passing operation at this point in time. For autonomously traveling motor vehicles, a potentially imminent swerving maneuver into the left lane 42, in which the further motor vehicle 46 at that moment is passing at a greater speed, is prevented.
[0074]
[0075] An object in the surroundings of the motor vehicle 12 is detected in a first step S100, based on the provided surroundings data. A virtual position and/or a virtual speed are/is then associated with the object in a step S102, based on the provided surroundings data. In this way, a virtual object together with the position information and speed information is thus detected by the control system 10.
[0076] Lastly, the virtual position associated with the object and/or the virtual speed associated with the object are/is adapted in a step S104, based on driving-related information concerning another motor vehicle. Alternatively or additionally, the virtual position associated with the object and/or the virtual speed associated with the object may be adapted based on driving-related information concerning the host motor vehicle. In both cases, an instantaneous position and/or an instantaneous speed of the object are/is determined via this adaptation. In this way, based on the virtual object, speed information and/or position information concerning an object that in reality exists in the surroundings of the host motor vehicle 12 are/is determined by the control system 10, to which suitable control systems (the driver assistance system, for example) of the host motor vehicle 12 may then appropriately respond.
[0077] It is understood that the exemplary embodiments explained above are not exhaustive, and do not limit the subject matter disclosed herein. In particular, it is apparent to those skilled in the art that they may combine the features of the various embodiments with one another and/or omit various features of the embodiments without thereby departing from the subject matter disclosed herein.