A method and system for assisting a user when interacting with a graphical user interface combines gaze based input with gesture based user commands. A user of a computer system without a traditional touch-screen can interact with graphical user interfaces in a touch-screen like manner using a combination of gaze based input and gesture based user commands. A solution for touch-screen like interaction uses gaze input and gesture based input as a complement or an alternative to touch-screen interactions with a computer device having a touch-screen. Combined gaze and gesture based interaction with graphical user interfaces can be used to achieve a touchscreen like environment in computer systems without a traditional touchscreen or in computer systems having a touchscreen arranged ergonomically unfavorable for the user or a touchscreen arranged such that it is more comfortable for the user to use gesture and gaze for the interaction than the touchscreen.

In a driving support device, an image output unit outputs an image including a vehicle object representing a vehicle and a peripheral situation of the vehicle, to a display unit. An operation signal input unit receives a gesture operation by a user that involves moving of the vehicle object in the image displayed on the display unit. A command output unit outputs a command according to the gesture operation, to an automatic driving control unit that controls automatic driving.

An information output apparatus for a straddle vehicle is configured to provide output information to a driver, and includes a receiving unit configured to receive input information input by the driver, a learning unit configured to learn an input tendency that is a tendency of the input information by the driver based on the input information received by the receiving unit, a generating unit configured to generate the output information according to a learned content learned by the learning unit, and an output unit configured to cause a sound device to output the output information generated by the generating unit in a form of a voice in natural language.

Disclosed are a vehicle control method and an intelligent computing apparatus for controlling a vehicle. By obtaining action information of a driver, when a change in a gaze of a driver is recognized, displaying an image related to a direction different from a direction of the changed gaze of the driver through a display related to the direction of the gaze of the driver when a change in a gaze of a driver is recognized, it is possible to effectively assist the driver in driving by providing a lot of information related to a driving obstacle factor, and the driver can easily observe the information related to the driving obstacle factor. At least one of a vehicle, a user equipment, and a server of the present disclosure may be associated with an artificial intelligence module, a robot, an augmented reality (AR) device, a virtual reality (VR) device, and a device related to a 5G service.

Techniques for interacting with authorized and unauthorized users by a door interface component are discussed herein. A vehicle computing device can implement the door interface component and/or an authentication component to control operation of a door of the vehicle or initiate a communication for assistance. For instance, the door interface component can include a button, that provides different visual indicators and functionality based on whether the user is authorized to enter the autonomous vehicle (e.g., open a door or provide visual indicators for the user to select to cause the door to open) or to request to move the vehicle, initiate hiring the vehicle, or call for help when the user is unauthorized to enter the autonomous vehicle.

A detection system for a vehicle comprises a blind spot detection module and a glasses module. The blind spot detection module comprises a first video recording device recording a vehicle surrounding image; a first identification device generating a blind spot identification result; a first determination device determining whether to transmit the vehicle surrounding image and/or a blind spot warning message; and a transmitting device transmitting the vehicle surrounding image and/or the blind spot warning message. The glasses module comprises a receiving device receiving the vehicle surrounding image and/or the blind spot warning message; a second video recording device recording a user surrounding image; a second identification device generating an eye identification result; a second determination device determining whether to transmit the user surrounding image and/or an eye warning message via an artificial intelligence (AI); and a display device displaying the user surrounding image and/or the eye warning message.

A system for controlling a vehicle includes a microphone, at least one vehicle component, and an interface system communicatively coupled to the microphone and the at least one vehicle component, the interface system configured to detect, via the microphone, an utterance of a vocal command by an occupant of the vehicle, transmit the utterance to at least one of a virtual personal assistant (VPA) of the vehicle and a VPA of a mobile device positioned within the vehicle, receive control signals from at least one of the VPA of the vehicle and the VPA of the mobile device, the control signals generated according to the vocal command, and transmit the control signals to the at least one vehicle component for controlling the at least one vehicle component.

A method and a system for user interaction with a hologram includes displaying the hologram inside a passenger compartment of the vehicle, after displaying the hologram inside the passenger compartment of the vehicle, monitoring a vehicle user inside the passenger compartment of the vehicle to determine whether the vehicle user provided a user command, determining that the vehicle user provided the user command, and in response to determining that the vehicle user provided the user command, manipulating the hologram in accordance with the user command.

An applique is mounted over one or both B-pillars of an autonomous vehicle and includes a display, speaker, touch input, and microphone. The applique may include a curved cover mounted over a printed circuit board (PCB) having LED arrays mounted thereto. A diffuser defines windows for the LED arrays and has a planar surface interfacing with the PCB and a curved surface interfacing with the curved cover. A controller of the vehicle detects proximity to a passenger to be picked up and displays the passenger's name at a first proximity, outputs a spoken message at a second, closer, proximity, and outputs a visible and audible prompt to enter an access code at a third proximity closer than the second proximity.

The disclosure generally pertains to systems and methods for identifying a location of an occupant in a vehicle. In an example method, a processor deconvolves a vocal utterance by an occupant of a vehicle and also determines an angle of arrival of the vocal utterance. The location of the occupant in the vehicle is then identified by the processor based on evaluating the deconvolved vocal utterance and the angle of arrival of the vocal utterance. Deconvolving the vocal utterance can involve applying a cabin impulse response to the vocal utterance for eliminating undesirable effects that may be imposed upon the vocal utterance by acoustic characteristics of the cabin of the vehicle (echo, sound reflections, sound damping, reverberation etc.). In some applications, the processor may refer to a lookup table to estimate a location of the occupant in the vehicle.