METHOD AND DEVICE FOR CONTROLLING AN AUTOMATICALLY DRIVING VEHICLE

Abstract

A method for controlling an automatically driving vehicle by a vehicle control center includes transmitting a sensor signal recorded on a part of the vehicle to the vehicle control center, where the sensor signal has a time stamp, and checking the time stamp in the vehicle control center upon receipt of the sensor signal. When a predetermined first age of the time stamp of the sensor signal is exceeded the sensor signal is displayed in a marked manner to a teleoperator of the vehicle control center for identifying a signal delay and when the time stamp exceeds a predetermined second age a display of the sensor signal is suppressed.

Claims

1.-8. (canceled)

9. A method for controlling an automatically driving vehicle by a vehicle control center, comprising the steps of: transmitting a sensor signal recorded on a part of the vehicle to the vehicle control center, wherein the sensor signal has a time stamp; and checking the time stamp in the vehicle control center upon receipt of the sensor signal; wherein when a predetermined first age of the time stamp of the sensor signal is exceeded the sensor signal is displayed in a marked manner to a teleoperator of the vehicle control center for identifying a signal delay; and wherein when the time stamp exceeds a predetermined second age a display of the sensor signal is suppressed.

10. The method according to claim 9, wherein the sensor signal is displayed in a marked manner by displaying an absolute delay value and/or by displaying a color coding.

11. The method according to claim 9, wherein the marked manner is varied depending on an age of the sensor signal.

12. The method according to claim 9, further comprising the steps of requesting the transmitting of the sensor signal by the vehicle control center and recording a time duration that has elapsed from the requesting to the transmitting.

13. The method according to claim 9, wherein when the time stamp exceeds the predetermined second age and the display of the sensor signal is not suppressed, a command sent by the vehicle control center to the vehicle is either rejected or a confirmation is requested.

14. The method according to claim 13, wherein an implementation of the command is rejected by the vehicle.

15. The method according to claim 9, wherein the sensor signal is a video signal or an audio signal or a driving direction indicator signal or an ignition signal or an engine signal or a signal of a radar-based sensor or a signal of a lidar-based sensor or a signal of an ultrasonic-based sensor or a signal of a laser scanner.

16. An apparatus for controlling an automatically driving vehicle, comprising: a vehicle control center; a first control unit of the vehicle, wherein the vehicle transmits a sensor signal recorded on a part of the vehicle to the vehicle control center via the first control unit and wherein the first control unit provides the sensor signal with a time stamp; a second control unit of the vehicle control center, wherein the second control unit checks the time stamp upon receipt of the sensor signal at the vehicle control center; and a display unit coupled to the second control unit; wherein when a predetermined first age of the time stamp of the sensor signal is exceeded, the second control unit marks the sensor signal and the display unit displays the sensor signal in a marked manner to a teleoperator of the vehicle control center for identifying a signal delay; wherein when the time stamp exceeds a predetermined second age a display of the sensor signal is suppressed by the second control unit.

Description

BRIEF DESCRIPTION OF THE DRAWING

[0016] The FIGURE shows schematically a vehicle which is connected to a vehicle control center in a data-technical manner.

DETAILED DESCRIPTION OF THE DRAWING

[0017] In the single FIGURE, a vehicle 1 and a vehicle control center 2 are depicted, wherein the vehicle 1 is connected in a data-technical manner to the vehicle control center 2.

[0018] The vehicle 1 can be controlled by means of the vehicle control center 2, such that a driving operation of the vehicle 1 can be carried out automatically and without a driver depending on sensor signals S recorded on the part of the vehicle.

[0019] Typically, an autonomy of the vehicle 1 is primarily limited when safe driving operation of the vehicle 1, i.e., safe progressive movement, is no longer possible due to recorded sensor signals S of a vehicle sensor system 3 and also by means of a highly accurate digital map and a controller integrated in the vehicle.

[0020] Thus, it can be, for example, that light signals of a light signal system cannot be detected by means of at least one sensor on the part of the vehicle, for example a camera, because of a snowdrift. It can also be that a police officer regulates the traffic due to an accident and/or that a relatively new building site does not have a completely functioning protection and light signaling system.

[0021] To do so, it is necessary for the vehicle sensor system 3 and the vehicle control center 2 to recognize such a state by means of recorded sensor signals S and for the vehicle 2 to be shifted into a safe state, in particular operating state, which is achieved, for example, by the vehicle 1 stopping, parking on a hard shoulder of a road, inter alia.

[0022] In order to again shift the vehicle 1 out of the safe operating state into the automatic driving operation, or in order to move the vehicle 1 away at least out of a certain region, in which the vehicle 1 interferes, for example, a method described below is provided.

[0023] It is known that sensor signals S recorded on the part of the vehicle are evaluated by means of the vehicle control center 2 and the vehicle 1 is manually moved out of the region by means of commands of a teleoperator of the vehicle control center 2 or is shifted into the automatic driving operation.

[0024] For this, the method provides that a currency, i.e., an age, of the sensor signals S sent on the part of the vehicle to the vehicle control center 2 is ascertained, in order to correspondingly determined a further process in relation to the vehicle 1 in the safe operating state.

[0025] As sensor signals S on the part of the vehicle, by way of example, video signals of an image recording unit of the vehicle 1 are transmitted to the vehicle control center 2, wherein what a human vehicle user would see, in particular, is reproduced by means of the video signals. Alternatively or additionally, lateral surroundings images directed and recorded towards the back of the vehicle 1 and/or other recorded surroundings images of the vehicle 1 are transmitted as sensor signals S on the part of the vehicle to the vehicle control center 2.

[0026] Aerial view camera signals of the vehicle 1 and/or a camera signal from a bird's eye perspective and/or image signals of a night vision camera can also be transmitted as the sensor signal S to the vehicle control signal 2.

[0027] In turn, alternatively or additionally, audio signals, which emit a siren, light signals, driving direction indicator signals, state signals of an ignition and/or engine signals are transmitted as the sensor signals S to the vehicle control center 2.

[0028] As explained above, the vehicle 1 has the vehicle sensor system 3, which comprises a number of detection units arranged in and/or on the vehicle 1, such that radar-based, lidar-based and/or ultrasound-based signals, for example, and/or a signal of a laser scanner can be transmitted as sensor signals S to the vehicle control center 2.

[0029] In an embodiment of the method, there is a common time base between the vehicle 1 and the vehicle control center 2, e.g., as a result of sufficiently exact hours, which are synchronized, for example, on an atomic clock via a radio connection, in particular via WLAN.

[0030] The vehicle 1, i.e., a control unit 4 of the vehicle 1 connected in a data-technical manner to the vehicle sensor system 2, provides each sensor signal S to be sent with a time stamp.

[0031] When transmitting the respective sensor signals S provided with a time stamp, various signal delays can occur until the sensor signal S is received by the vehicle control center 2 and is displayed there in a corresponding application program, in particular for the teleoperator.

[0032] For example, an existing radio connection between the vehicle 1 and the vehicle control center 2 can be responsible for the signal delay when transmitting the sensor signals S. It can also be that the signal delays occur due to the internet, the vehicle control center 2 and/or an IT infrastructure in general.

[0033] The respective sensor signal S provided with a time stamp is checked in relation to the time stamp upon receipt by means of a further control unit 5 of the vehicle control center 2 and an age, i.e., a transmission time and thus a signal delay, of the sensor signal S is ascertained.

[0034] If the transmission time as the signal delay of a sensor signal S exceeds a first age stored in the further control unit 5, then the sensor signal S is optically output on a display unit 6 connected to the further control unit 5 for identifying in a marked manner. By means of the identification, the respective teleoperator of the vehicle control center 2 is made aware of the signal delay and thus of the age of the received sensor signal S.

[0035] If, when analyzing the time stamp of a sensor signal S transmitted on the part of the vehicle to the vehicle control center 2, a second age stored in the further control unit 5 is exceeded, then displaying this sensor signal S on the display unit 6 is suppressed by means of the further control unit 5. This sensor signal S is thus not displayed to the teleoperator.

[0036] For example, the identification of the transmitted sensor signal S whose time stamp exceeds the first age in relation to the signal delay is carried out by means of displaying an absolute delay value and/or by means of a color coding and/or another suitable coding.

[0037] For example, as the sensor signal S, a video signal is transmitted from the vehicle 1 in the safe operating state to the vehicle control center 2, which is provided with a time stamp of 12 h35 min12 sec150 msec. Upon receipt of the sensor signal S in the further control unit 5, a receipt time stamp is 12 h35 min15 sec950 msec, such that the signal delay is 800 msec. Such a delay value is graded as comparatively high, such that the sensor signal S output on the display unit 6 is displayed in the form of the video signal outlined in yellow. If the delay value is 1 sec, for example, then the sensor signal S can be displayed outlined in red, in order to make the teleoperator aware of the age of the received sensor signal S.

[0038] If the delay value is 1.5 sec, for example, the optical output of the sensor signal S would be switched off by means of the display unit 6. The display of this sensor signal S whose signal delay exceeds the predetermined second age is thus suppressed.

[0039] For example, the color coding is carried out to the effect that, with a signal delay approximating the second age, the sensor signal S is marked with a different color than when the signal delay is not as high.

[0040] In a further embodiment, the further control unit 5 of the vehicle control center 2 explicitly requests a sensor signal S of the vehicle 1. The further control unit 5 then waits for the receipt of the requested sensor signal S and here records a time duration from the point in time of the request until the receipt of the sensor signal S. Here, the request time is also taken into consideration, i.e., also counted, yet this second embodiment can be seen as a relatively safe determination for signal delays, since more sensor signals S are discarded due to the inclusion of the request time than would be necessary, yet sensor signals S, which exceed the predetermined second age, i.e., are potentially or actually dated, are not displayed.

[0041] Furthermore, it can be provided that sensor signals S received by the further control unit 5 are always displayed by means of the display unit 6, even if the signal delay exceeds the predetermined second age. If the vehicle control center 2 or a teleoperator intends to transmit a command for implementing an action to the vehicle 1, this is not transmitted when a corresponding signal delay is present. Alternatively, the command for implementing is transmitted to the vehicle 1 when the vehicle control center 2 again confirms this transmission.

[0042] A further embodiment of the method by means of which the implementation thereof can be increased provides that it is not the vehicle control center 2 that rejects the transmission and implementation of the command, but rather the vehicle 1, i.e., its control unit 4, rejects the implementation of the command.

[0043] For this, it is necessary for the signal delay to not only be ascertained in the vehicle control center 2 but also in the vehicle 1. For example, the determination takes place by the receipt of the sensor signals S, which are transmitted from the vehicle 1 to the vehicle control center 2, being confirmed again on the vehicle 1. Thus, it is possible that the vehicle 1 can also determine the age of the sensor signals S, i.e., the time duration for transmission. Based on this, the vehicle 1 can reject the implementation of the command transmitted by the vehicle control center 2 if the age of the sensor signals S has already or simultaneously exceeded the predetermined second age as the threshold value.