A vehicle includes a plurality of tactile input devices configured to receive a tactile input for controlling a function of the vehicle; a microphone configured to receive an audio input; and a voice recognition system configured to control the function of the vehicle based on the audio input, where the voice recognition system is configured to determine a target object to be controlled based on the tactile input, determine a control instruction for the target object based on the audio input, and control the target object based on the control instruction.

A vehicle operation system includes an operation unit disposed within a vehicle and including an operating element configured to receive an operation of an occupant of the vehicle, a determiner configured to determine a target-specific device serving as an operation target from among a plurality of specific devices on the basis of an operation different from a mechanical operation performed on the operating element by the occupant of the vehicle, and a device controller configured to control the target-specific device on the basis of the mechanical operation performed on the operating element by the occupant of the vehicle.

A system and method of responding to a vocal utterance may include capturing and converting the utterance to word(s) using a language processing method, such as natural language processing. The context of the utterance and of the system, which may include multimodal inputs, may be used to determine the meaning and intent of the words.

Systems and methods are disclosed herein for implementation of a vehicle command operation system that may use multi-modal technology to authenticate an occupant of the vehicle to authorize a command and receive natural language commands for vehicular operations. The system may utilize sensors to receive data indicative of a voice command from an occupant of the vehicle. The system may receive second sensor data to aid in the determination of the corresponding vehicular operation in response to the received command. The system may retrieve authentication data for the occupants of the vehicle. The system authenticates the occupant to authorize a vehicular operation command using a neural network based on at least one of the first sensor data, the second sensor data, and the authentication data. Responsive to the authentication, the system may authorize the operation to be performed in the vehicle based on the vehicular operation command.

A voice activation system for a vehicle. The voice activation system for a vehicle which has at least one sound panel capable of providing vibrations of a user's voice from the outside of the vehicle into an inside area of the vehicle. A laser listening device is operably connected to the panel for receiving vibrations from a user's voice. A controller receives a pre-identified command of the user from the laser listener and operates an action in the vehicle in response thereto.

Systems and methods for adjusting vehicle components based on audible commands are disclosed herein. In an embodiment, the system includes a plurality of adjustable vehicle components, an audio device, and a controller. The audio device is configured to receive an audible command and generate corresponding command data. The controller is programmed to generate at least one confidence score based on the command data and (i) cause a first response to be output from the audio device after determining that the at least one confidence score does not meet a first threshold, (ii) cause a second response to be output from the audio device after determining that the at least one confidence score does not meet a second threshold, and (iii) cause an adjustment of at least one adjustable vehicle component after determining that the at least one confidence score meets the second threshold.

It is an aspect of the present disclosure to provide a dialogue system capable of providing an extended function to the user by registering a new vocabulary that matches the user's preference and by changing the pre-stored conversation pattern.

It is disclosed a voice pickup method and apparatus for an intelligent rearview mirror, an electronic device and a computer readable storage medium which relates to the technical field of vehicle-mounted equipment, and may be used in the field of automatic driving technologies. A voice pickup implementation of the intelligent rearview mirror according to some embodiments includes: acquiring an image of the interior of the vehicle; determining the position of a person in the vehicle with the image of the interior of the vehicle; and adjusting a beamforming direction of a microphone array according to the position of the person in the vehicle.

This application provides an intelligent recommendation method. The method includes capturing images of occupants in a vehicle using at least one camera, and obtaining attributes of occupants in the vehicle according to the captured images. Voice information of the occupants in the vehicle is collected using a microphone. Once the attributes of occupants in the vehicle and the voice information are sent to a cloud server, recommendation information can be obtained from the cloud server, wherein the recommendation information is generated based on a user intention that is obtained based on the attributes of occupants in the vehicle and the voice information.

A method for training a classification device, the method comprising: receiving classification device constraints at an intermediary device; receiving training data at the intermediary device; matching the training data to the classification device constraints to provide constrained training data; mapping the constrained training data to classification device functionality to provide a command model; and transmitting the command model to the classification device.