A vehicle-mounted device operation system, includes: an operating part that is located in a vehicle cabin, and configured to be subjected to operation for manually operating a vehicle-mounted device; a sound collector that is located in the vehicle cabin, and configured to collect speech of an occupant; and a processor configured to determine whether a command to the vehicle-mounted device is included in a content of the speech of the occupant collected by the sound collector, activate the vehicle-mounted device according to the command, when the processor determines that the command to the vehicle-mounted device is included in the content of the speech of the occupant, and highlight the operating part for the vehicle-mounted device activated by the processor.

An adaptive warning system and method for adapting an alert to a vehicle operator based on noise in a vehicle interior compartment, includes a loudspeaker, a dashboard display, a noise level sensing device for providing a noise value, and an electronic processor having a memory. The electronic processor is configured to compare the noise value with a first threshold and when the noise value is not greater than the first threshold, provide an audio alert at regular sound level and providing a visual alert on a dashboard display at regular indicia size in a normal alert mode. The electronic processor is also configured to when the noise value is greater than the first threshold, provide the audio alert at an increased sound level and provide the visual alert on the dashboard display having an increased indicia size in a second enhanced alert mode.

Implementations relate to interactions, over a wireless communication modality, between an automated assistant of an automobile computer system, and separate client device(s). In some of those implementations, the client device(s) can be paired with the automobile computer system, and the client device(s) and the automobile computer system can include separate instances of an automated assistant, which can be associated with different user accounts. In some additional or alternative implementations, particular actions to be performed by a local application of a client device can be advanced via user interaction with the automobile automated assistant, despite a counterpart to the local application not being installed directly on automobile computer system. For example, despite an automobile computer system not having a third-party messaging application installed, the automobile automated assistant can access requested actions to be performed by the third-party messaging application in order to further a requested action. The automobile computer system can transmit, via the wireless communication modality, content to cause the third-party application to further the requested action.

A conversation guidance method of a speech recognition system may include managing a user domain based on speech recognition function information and situation information corrected from a system mounted on a vehicle, generating a conversation used for speech recognition based on the user domain, and guiding a user with the generated conversation.

A vehicle may include: an input processor to receive a speech of a user and convert the speech into a text-type utterance; a natural language processor that performs morpheme analysis on the text-type utterance, and identifies an intent of the user and selects a domain related to the text-type utterance based on a result of the morpheme analysis; a storage to store a plurality of domains; a controller to add a new domain to the plurality of domains based on a specific condition, and determine a final domain among the plurality of domains and the added new domain; and a result processor to generate a command based on the determined final domain.

A device having a voice-based interface activates or wakes when it detects an utterance that includes a wakeword; the device may be installed in a vehicle, such as an automobile. The device may distinguish between different wakewords; a different speech processing system may be associated with each wakeword, and each speech processing engine may have its own speech style and associated applications and functions.

A shovel includes a lower traveling body, an upper turning body turnably mounted on the lower traveling body, a cab mounted on the upper turning body, a display device provided in the cab and configured to display a setting screen associated with work assistance, an audio input device provided in the cab, and a hardware processor configured to perform audio recognition. The hardware processor is configured to recognize speech input through the audio input device and executes a process related to the setting screen according to a recognition result.

An operating apparatus includes: a first display; a second display; and an electronic control unit. The electronic control unit is configured to output a second image onto the second display. The electronic control unit is configured to output a first image onto the first display. The electronic control unit is configured to switch between the first mode and the second mode. In a first mode, a first mode image independent of the second image is output as the first image. In the second mode, a second mode image having the same appearance as the second image is output as the first image. The electronic control unit is configured to execute a first predetermined function in the first mode and a second predetermined function in the second mode.

A vehicle assistance system with at least one outside camera, a control unit, at least one display unit, an occupant identification unit, and a human machine interface (Human Machine Interface, HMI).

The present invention has an object to provide a technology of accurately identifying a device that a driver desires to operate out of on-board devices, and supporting operation of the device. An operation support device of the present invention includes a line of sight direction acquisition unit, a characteristic behavior acquisition unit, a device identification unit, and a display controller. The device identification unit is configured to identify at least one on-board device out of a plurality of on-board devices mounted in the vehicle as an operation target device that the driver desires to operate, based on a line of sight direction and a characteristic behavior. The display controller is configured to cause a display device mounted in the vehicle to display an operation screen of the operation target device.