System for automated driving with assistance for a driver in performing a non-driving activity

Abstract

An automated driving system with assistance for a driver in performing a non-driving activity includes an assistance device configured to assist the driver in performing the non-driving activity. The automated driving system, in a first operating state controls the vehicle in an automated manner, and in a second operating state hands over control of the vehicle to the driver. The assistance device is configured to assist the driver in performing the non-driving activity if the automated driving system switches from the first operating state to the second operating state.

Claims

1. An automated driving system (1) with assistance for a driver of a vehicle (2) in performing a non-driving activity, comprising: an assistance device (10) configured to assist the driver in performing the non-driving activity; and a sensor (30) configured to identify an activity of the driver, wherein the automated driving system (1), in a first operating state controls the vehicle (2) in an automated manner, and in a second operating state hands over control of the vehicle to the driver, wherein the assistance device (10) is configured to assist the driver in performing the non-driving activity if the automated driving system (1) switches from the first operating state to the second operating state, wherein the non-driving activity includes the outputting to the driver of received messages, and the assistance device (10) is further configured to determine, based upon information from the sensor, a corresponding passage in a text of a passage that the driver has just read, and wherein the assistance device (10) is further configured to offer the driver to finish an e-mail or message that the driver started to write during the autonomous driving mode.

2. The system as claimed in claim 1, further comprising: an input (20) configured to input an instruction for assisting the driver in performing the non-driving activity, wherein the assistance device (10) is further configured to assist the driver in performing the non-driving activity if the instruction has been input into the input (20).

3. The system as claimed in claim 2, wherein the assistance device (10) is further configured to offer assistance to the driver in performing the non-driving activity if the automated driving system (1) switches from the first operating state to the second operating state.

4. The system as claimed in claim 3, wherein the sensor (30) comprises a camera (40) configured to acquire an image that shows the activity of the driver, and wherein the assistance device (10) is further configured to analyze the acquired image and identify the activity of the driver.

5. The system as claimed in claim 4, further comprising: an infotainment device (50) configured to offer an infotainment program, wherein the assistance device (10) is further configured to assist the driver in executing the infotainment program if the automated driving system (1) switches from the first to the second operating state.

6. The system as claimed in claim 5, wherein the assistance device (10) is further configured to: ascertain and learn usage behavior of the driver in relation to the infotainment device (50), and assist the driver in executing the infotainment program according to the learned usage behavior.

7. The system as claimed in claim 1, wherein the assistance device (10) is further configured to learn the behavior of the driver in relation to the non-driving activity during the first operating state of the automated driving system (1), and wherein the assistance device (10) is further configured to assist the driver in performing the non-driving activity according to the learned behavior of the driver in relation to the non-driving activity.

8. The system as claimed in claim 1, wherein the assistance device (10) is further configured to assist the driver in performing a reading activity if the automated driving system (1) switches from the first operating state to the second operating state.

9. The system as claimed in claim 1, further comprising: a voice input (60), wherein the assistance device (10) is configured to assist the driver in performing a writing activity by converting acoustic signals received via the voice input (60) into written text if the automated driving system (1) switches from the first operating state to the second operating state.

Description

BRIEF DESCRIPTION OF THE FIGURE

(1) The invention is explained in more detail below with reference to a FIGURE, which is used to illustrate embodiments of the present invention. The FIGURE shows the interior of a vehicle comprising a system for automated driving with assistance for a driver in performing a non-driving activity.

DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS

(2) A system 1 for automated driving of a vehicle 2 with assistance for a driver in performing a non-driving activity comprises an assistance device 10. The assistance device 10 is configured to assist the driver in performing a non-driving activity. The system 1 for automated driving can be operated in a first operating state in which the system controls the vehicle 2 in an automated manner. In a second operating state of the system 1 for automated driving, the system hands over control of the vehicle 2 to the driver. The assistance device 10 is configured such that it assists the driver in performing the non-driving activity if the system 1 for automated driving switches from the first operating state, i.e., the autonomous driving state, to the second operating state, i.e., manual control of the vehicle by the driver.

(3) According to an embodiment, the system comprises an input device for inputting an instruction for assisting the driver in performing the non-driving activity. The system can be primarily voice-controlled. The input device 20 may be a microphone, for example, into which the driver inputs an instruction for assisting in performing the non-driving activity. The assistance device 10 is designed such that it assists the driver in performing the non-driving activity if the driver has input the instruction into the input device 20, in particular the microphone.

(4) According to an embodiment, the assistance device 10 is configured such that the assistance device 10 offers assistance to the driver in performing the non-driving activity to the driver if the system 1 for automated driving switches from the first operating state (autonomous driving mode) to the second operating state (manual driving mode). The driver then has the option to accept or decline the offer from the assistance device 10 to assist him in performing the non-driving activity while he is controlling the vehicle.

(5) According to another embodiment, the system 1 for automated driving can comprise a sensor device 30 for identifying an activity of the driver. The assistance device 10 is configured to assist the driver in performing the non-driving activity if the system 1 switches during automated driving from the first operating state (autonomous operating state) to the second operating state (manual operating state).

(6) The sensor device 30 may comprise a camera 40, for example, for acquiring an image that shows a current activity of the driver. In the embodiment shown in the FIGURE, this camera 40 may be fitted, for instance, in the vehicle mirror inside the vehicle. The assistance device 10 is designed in this embodiment such that it can analyze the acquired image from the camera and identify the activity of the driver. Depending on the identified activity of the driver, the assistance device 10 can assist the driver in performing the non-driving activity or at least offer to the driver this assistance.

(7) According to another embodiment of the system for automated driving, which embodiment is shown in the FIGURE, the system comprises an infotainment device 50 for offering an infotainment program. The infotainment device 50 can comprise, for example, a screen on which certain contents of the infotainment program of the vehicle are displayed. The assistance device 10 is configured such that it assists the driver in executing the infotainment program if the system 1 for automated driving switches from the autonomous operating state to the manual operating state. The sensor device 30 can be coupled, for example, to the infotainment device 50. The sensor device 30 can thereby identify a current activity of the driver during the automated driving, and assist the driver during manual driving in performing the non-driving activity on the infotainment device 50, or offer the driver this assistance.

(8) According to another embodiment, the assistance device 10 can be configured to be a learning assistant. The assistance device 10 in this embodiment can be configured in particular to ascertain and learn the usage behavior of the driver in relation to the infotainment device 50. The assistance device 10 is configured in particular to assist the driver in executing the infotainment program according to the learned usage behavior.

(9) In the case of a learning assistant, the assistance device 10 can be configured in particular such that it learns the behavior or the preferences of the driver in relation to the non-driving activity during autonomous driving. In this case, the assistance device 10 can assist the driver in performing the non-driving activity according to the learned behavior of the driver in relation to the non-driving activity.

(10) For example, the assistance device 10 can be configured to learn certain behavior patterns of the driver. For instance, if the driver was occupied with reading messages during automated driving, and after taking over control of the vehicle has in the past regularly declined the offer from the assistance device 10 to read a message aloud, the assistance device 10 in future no longer offers to the driver to read the message aloud.

(11) The learning function of the assistance device can also be embodied such that the assistance device learns over the course of time whether a driver prefers messages to be output in written or spoken form. The assistance device 10, when assisting the driver in relation to the non-driving activity, can accordingly display a text on a screen of the infotainment device 50 or output the text by loudspeaker output.

(12) According to an embodiment, the assistance device 10 can be configured such that it assists the driver in performing a reading activity if the system 1 for automated driving switches from the first operating state (autonomous operating state) to the second operating state (manual operating state). For example, the assistance device can offer to the driver (via natural voice output) to read aloud a remaining part of an e-mail, of a message, of an online article, or of an e-book chapter, etc.

(13) The driver would then have the option to accept the offer (via voice input). By coupling a camera to connected image processing system, for instance to an in-car eye-tracking system, and to the communication devices of the driver (smartphone, tablet, etc.), the assistance device can determine a corresponding passage in a text that the driver has just read. This passage in the text can then be read aloud by voice output. By natural voice dialog, the driver has the option at any time to jump forwards and backwards in the text and to pause the voice output from the assistant.

(14) According to another embodiment, the system comprises a voice input device 60 for voice input. The voice input device 60 may be a microphone, for example. The assistance device 10 is configured such that it assists the driver in performing a writing activity. For this purpose, the assistance device 10 is configured to convert acoustic signals received via the voice input device 60 into written text if the system 1 for automated driving switches from the autonomous operating state to the manual operating state. The written text can be displayed on a screen, for example on a monitor of the infotainment device 50.

(15) The assistance device 10 can offer to a driver, for example, to finish an e-mail or a message that the driver started to write during the autonomous driving mode. If the driver accepts the offer (via voice input), the assistance device reads aloud the last lines, for example, of the already drafted message for example. The driver can then dictate the additional text, get the text read again aloud, and finally send the text. The interaction between the driver and the assistance device can take place entirely via natural voice dialog.

(16) By active assistance for a driver in concluding the interrupted non-driving activity, the defined system allows safe driving after the transfer of the driving task from autonomous to manual driving without the driver having to turn his attention away from independent driving and hence from the road environment. The defined solution increases safety during driving because the driver performs his actual activity, i.e., manual driving, and is not distracted by his initiated secondary activity. The system for automated driving with assistance for the driver in performing the non-driving activity can be used in principle in all means of transportation. These include, in addition to autonomously driving vehicles, also rail vehicles in rail transport, which can assist a train driver, for instance.

(17) Although exemplary embodiments have been discussed in the above description, it should be noted that numerous modifications are possible. Furthermore, it should be noted that the exemplary embodiments are merely examples which are not intended to limit the scope of protection, the applications and the structure in any way. Instead, the above description gives the person skilled in the art a guideline for the implementation of at least one exemplary embodiment, wherein various changes may be made, especially with regard to the function and arrangement of the component parts described, without departing from the scope of protection as emerges from the claims and combinations of features equivalent thereto.