An in-vehicle speech interaction method and a device are provided. The method includes: obtaining user speech information; determining a user instruction based on the user speech information; determining, based on the user instruction, whether response content to the user instruction is privacy-related; and determining, based on whether the response content is privacy-related, whether to output the response content in a privacy protection mode, to protect privacy from being leaked.

This application provides an in-vehicle user positioning method, an in-vehicle interaction method, a vehicle-mounted apparatus, and a vehicle. In an example, the in-vehicle user positioning method includes: obtaining a sound signal collected by an in-vehicle microphone; in response to that a first voice command is recognized from the sound signal, determining a first user who sends the first voice command; and determining an in-vehicle location of the first user based on a mapping relationship between an in-vehicle user and an in-vehicle location.

Systems and methods are disclosed herein for implementation of a vehicle command operation system that may use multi-modal technology to authenticate an occupant of the vehicle to authorize a command and receive natural language commands for vehicular operations. The system may utilize sensors to receive data indicative of a voice command from an occupant of the vehicle. The system may receive second sensor data to aid in the determination of the corresponding vehicular operation in response to the received command. The system may retrieve authentication data for the occupants of the vehicle. The system authenticates the occupant to authorize a vehicular operation command using a neural network based on at least one of the first sensor data, the second sensor data, and the authentication data. Responsive to the authentication, the system may authorize the operation to be performed in the vehicle based on the vehicular operation command.

One or more embodiments described herein relate to a modular multifunctional system for a vehicle, and more specifically, to a versatile sensor system integrated into a modular overhead console. Multiple systems and functions are consolidated into particular overhead units to allow for increase space inside a vehicle, decreased design restrictions, and the use of a single type of modular overhead console in multiple vehicle types and models.

A display apparatus configured to receive a command, and convert the command to displayable information to an outside pedestrian or drivers in other vehicles may include a main body that includes a securing portion to secure the display apparatus to a vehicle; a communication unit to receive the command; a processor to convert the command to displayable information; a display portion having a displaying layer to display information; and a power managing unit to store and provide electrical energy for the display apparatus. In one embodiment, the power managing unit may include a power generating unit to be positioned to overlap with the displaying layer.

An agent device includes an agent functional controller configured to provide a service including causing an output device to output a response of voice in response to an utterance of an occupant of a vehicle, and a controller configured to permit an operation of a power window of the vehicle when a speed of the vehicle is less than a first threshold value and limit the operation of the power window of the vehicle when the speed of the vehicle is equal to or greater than the first threshold value when the agent functional controller is activated.

A voice recognition apparatus in a motor vehicle is configured to recognize at least one voice command, which is linked to at least one condition and which is related to the actuation of at least two functional units of the motor vehicle by a control device to provide voice-based operation of the motor vehicle by a vehicle occupant. The control apparatus is configured to generate, in accordance with the voice command, which is recognized by the voice recognition apparatus, a rule for actuating the at least two functional units according to the generated rule.

A mobile body control system includes: a window open or close instruction recognition unit that recognizes an open or close instruction of a window provided to a mobile body in accordance with a voice operation or an operation of a mobile terminal performed by a passenger on the mobile body; a window control unit that executes a window open or close control for opening or closing the window, when the open or close instruction of the window is recognized; and a window operation restriction unit that executes at least one of window operation inhibition processing for inhibiting execution of the window open or close control by the window control unit in accordance with an operation of a switch provided to the mobile body, and window operation stop processing for stopping the window being operated by the window open or close control in accordance with an operation of the switch.

Proposed are a system for and a method of controlling an in-vehicle environment based on the purpose of using a vehicle. The system includes a recognition unit configured to acquire behavioral information of an occupant, in-vehicle voice information, and seat-position information, a determination unit configured to determine a behavioral pattern of the occupant or the purpose of using a vehicle, using the information transferred through the recognition unit, and a controller configured to control at least one of in-vehicle illumination and a window transparency level according to the purpose of using the vehicle or according to a user's preference.

A voice recognition function link control system of a vehicle, which is configured for mounting a smart speaker used in the home or office in the vehicle and utilizing the smart speaker in linkage with an infotainment system of the vehicle, includes a traffic management system server, an infotainment system, a content service provider system server, and a smart speaker for receiving and transmitting a voice command of any user to the content service provider system server, receiving specific content from the content service provider system server, and outputting the received specific content.