A smart device display for an autonomous vehicle, comprising a first display section that displays an external view of the autonomous vehicle, a second display section that displays vehicle actions that the autonomous vehicle will take and a third display section that displays alternative vehicle actions that an authorized passenger of the autonomous vehicle may select to override the vehicle actions. Such system can also comprise an artificial intelligence module that learns the alternative vehicle actions the authorized passenger selects in various intervention situations, wherein the artificial intelligence module uses machine learning algorithms to decide the best alternative vehicle actions that the authorized passenger is likely to select for similar future situations.

The invention present disclosure relates to a control device for redundant execution of an operating function, wherein the control device comprises at least a first processor unit and a second processor unit and a plurality of peripheral units and a first switching unit is provided for the first processor unit and a second switching unit is provided for the second processor unit, and wherein the control device is designed in a first operating mode to execute the operating function by means of the first processor unit and in the meantime to execute a predetermined auxiliary function by means of the second processor unit. According to the invention, the control device is designed, in a second operating mode to execute the operating function by means of the second processor unit, and in so doing to continue to execute the auxiliary function (24) in a predefined reduced scope by means of the second processor unit, wherein a coupling device is provided, which is designed to connect the second processor unit to the first switching unit.

An agent system includes a microphone configured to collect a sound of a vehicle interior, a speaker configured to output a sound to the vehicle interior, a recognizer configured to recognize a meaning of the sound collected, an agent controller configured to generate an agent sound for speaking to an occupant of a vehicle on the basis of the meaning recognized and cause the agent sound to be output to the speaker so that a sound image of the generated agent sound is localized at a prescribed position, and a travel environment acquirer configured to acquire a travel environment of the vehicle, wherein the agent controller causes an aspect in which the sound image of the agent sound is localized to be changed when the travel environment of the vehicle acquired by the travel environment acquirer is changed or is predicted to be changed in the future.

An agent device includes a microphone which collects audio in a vehicle cabin, a speaker which outputs audio to the vehicle cabin, an interpreter which interprets the meaning of the audio collected by the microphone, a display provided in the vehicle cabin, and an agent controller which displays an agent image in a form of speaking to an occupant in a region of the display and causes the speaker to output audio by which the agent image speaks to at least one occupant, and the agent controller changes the face direction of the agent image to an direction different from an direction of the occupant who is a conversation target in a case that an utterance with respect to the face direction is interpreted by the interpreter after the agent image is displayed on the display.

A system for controlling operation of a vehicle, the system comprising: a voice synthesizer unit for providing voice communication to a driver; a speech recognition unit for receiving speech from a driver; a breath alcohol sensor unit for detecting a presence of alcohol on the breath of a driver and providing a signal representative of the same; a vehicle operation interface for controlling operation of the vehicle; and a controller for (i) selectively causing the voice synthesizer unit to speak to the driver, (ii) operating the speech recognition unit to detect speech by the driver, (iii) receiving the signal from the breath alcohol sensor unit, and (iv) depending on the signal received from the breath alcohol sensor unit, providing a command to the vehicle operation interface to control operation of the vehicle.

An in-vehicle voice recognition apparatus capable of recognizing user voice more correctly by removing sound generated in a vehicle from sound input to a microphone, and a method of controlling the same are disclosed. The in-vehicle voice recognition apparatus according to an embodiment of the present disclosure includes a central processing unit configured to output a media signal, a digital signal processor configured to receive the media signal from the central processing unit and to convert the media signal into an analog signal, and an eco cancellation hardware connected to the digital signal processor and configured to receive the analog signal, to acquire a first final media output on the basis of the analog signal and to acquire a voice command from a sound input through a microphone on the basis of the first final media output.

The present disclosure relates to a vehicle control device for a vehicle having a voice input unit, an audio output unit, and a display. The vehicle control device may include a communication unit configured to communicate with at least one of the voice input unit, the audio output unit, and the display, and a processor configured to control the communication unit to output a message for inducing an utterance of a passenger aboard the vehicle in at least one of an auditory manner and a visual manner when a preset event occurs, and identify the passenger based on receiving a response of the passenger to the message through the voice input unit, and perform a different function based on the identified passenger.

Method and apparatus are disclosed for accelerometer-based external sound monitoring for voice controlled autonomous parking. An example vehicle includes a body control module, an infotainment head unit, and an autonomy unit. The example body control module communicatively couples to a mobile device. The example infotainment head unit communicatively couples to an accelerometer mounted on a window of the vehicle. The example autonomy unit autonomously parks the vehicle in response to a first key word detected by the accelerometer when (i) a button is activated on the infotainment head unit and (ii) a message from the mobile device is being periodically received.

The embodiments herein relate to a method performed by a vehicle system (400) for handling a user's (105) experience of using a vehicle (100). The vehicle system obtains a request for recording information associated with the user's (105) experience when using the vehicle (100), and records the information by means of at least one of an audio recorder, an image recorder and a data recorder, as requested. The vehicle system determines from which at least one of the audio recorder, image recorder and the data recorder the recorded information should be provided to at least one other system, and provides the information from the determined recorder to the at least one other system.

A vehicle, and a control method thereof, prevents and/or suppresses a user's negative emotions by providing necessary feedback based on the user's emotional state. The vehicle includes a sensing unit configured to acquire user emotion information indicating a user's emotional state using at least one sensor, a storage configured to store situation information representing the numbers of expressions of respective emotional states in each unit situation and user long-term information representing the numbers of expressions of the respective emotional states for a unit period based on the acquired user emotion information, and a controller configured to control feedback devices provided in the vehicle to control the user's emotional state based on at least one of the situation information, the user long-term information, and the user emotion information.