Implementations described herein relate to determining how to fulfill a spoken utterance based on a user that provided the spoken utterance. For example, implementations can receive a spoken utterance from a user, determine a set of fulfillment actions for the spoken utterance, and determine whether the user that provided the spoken utterance corresponds to a first user or a second user. Further, and in response to determining that the user corresponds to the first user, implementations can select a subset of first fulfillment action(s) from the set, and cause the subset of first fulfillment action(s) to be implemented to satisfy the spoken utterance. Moreover, and in response to determining that the user corresponds to the second user, implementations can select a subset of distinct, second fulfillment action(s) from the set, and cause the subset of second fulfillment action(s) to be implemented to satisfy the spoken utterance.

One or more presence sensors of a vehicle are used to detect the presence of one or more people outside the vehicle. When the presence of the one or more people outside the vehicle is detected, one or more external microphones of the vehicle are used to capture any speech by people. A speech recognizer of the vehicle is used to determine whether the captured speech includes a verbal request for emergency services. And, upon determining that the captured speech includes the verbal request for emergency services, a network access device of the vehicle is used to automatically request emergency services.

It is an aspect of the present disclosure to provide a dialogue system capable of providing an extended function to the user by registering a new vocabulary that matches the user's preference and by changing the pre-stored conversation pattern.

Techniques for dynamic contact ingestion are described. A system may interpret a voice command received from a first device based on contact data or other information associated with a second device connected to the first device. For example, when a data connection is made between the first device and the second device, the first device may receive the contact data and send the contact data to a remote system. The remote system may temporarily associate the contact data with the first device, enabling the remote system to interpret a voice command received from the first device using the contact data. The remote system may use the contact data to perform disambiguation, enabling the remote system to initiate outbound calls, announce inbound calls, and/or the like. When the second device is disconnected from the first device, the remote system may remove the association between the contact data and the first device.

An agent device includes a microphone configured to collect a speech sound inside a vehicle cabin, a speaker configured to output a speech sound inside the vehicle cabin, and a plurality of agent function elements having different functions. Each of the plurality of agent function elements generates a speech sound of an agent that speaks to an occupant of a vehicle on the basis of a meaning of the speech sound collected by the microphone, causes the speaker to output the generated speech sound of the agent. The agent function element serving as a main agent that has a dialogue with the occupant is switched on the basis of content of the speech sound collected by the microphone.

Implementations are directed to determining an audio delay, of a computing device, by causing an audio data stream to be transmitted to the computing device via a wireless communication channel. The computing device causes audio output generated using the audio data stream to be rendered via speaker(s). The rendered audio output is captured via microphone(s), and the audio delay determined by comparing the captured audio output with the audio data stream. A delay audio segment can be appended to an additional audio data stream transmitted to the computing device, where the length of the delay audio segment is determined using the audio delay. A noise reduction technique can additionally or alternatively be adapted based on the audio delay. Implementations are additionally or alternatively directed to determining if an audio data stream transmitted to a computing device for rendering through speaker(s) driven by the computing device—is actually being rendered.

The disclosure describes systems and methods for processing audio signals in a vehicle to perform sound source separation. The sound source separation is performed using transfer functions and involves separation of the speech of multiple occupants. The separated speech can be used to isolate and correctly respond to a command to control vehicle systems.

A vehicle includes an interface device, an in-vehicle control unit, a functional unit, and a processing circuitry. The interface device receives a spoken command to identify an in-cabin vehicle zone of two or more in-cabin vehicle zones of the vehicle, and receives background audio data concurrently with a portion of the spoken command. The in-cabin vehicle control unit separates the background audio data from the spoken command, and selects which in-cabin vehicle zone of the two or more in-cabin vehicle zones is identified by the spoken command. The functional unit controls a function within the vehicle. The processing circuitry stores, to a command buffer, data processed from the received spoken command, and controls, based on the data processed from the received spoken command, the functional unit using audio input received from the selected in-cabin vehicle zone.

An apparatus and a method for controlling the output of driver information to a driver of a vehicle, with the objective of entertaining the driver and/or the passengers of the vehicle and/or increasing the driver attentiveness of the driver. A database of points of interest or objects of general interest, a database of topographic information, a device for determining the whereabouts of the vehicle, and an evaluation device to which these information items are delivered, are provided. The evaluation device ascertains, from the current whereabouts of the vehicle and from the topographic information, which points of interest or objects of general interest are present in the driver's field of view, and outputs via an output device the driver information regarding the point of interest or the object of general interest which has been ascertained by the evaluation device to be located in the driver's field of view.

An agent device is equipped with a plurality of agent controllers which provide a service including causing an output device to output a response of voice in accordance with an utterance of an occupant of a vehicle, in which a first agent controller included in the plurality of agent controllers provides an agent controller different from the first agent controller with first service information on the service to be provided to the occupant.