The present disclosure relates to an apparatus for controlling a multi-image display provided in a vehicle, and a method thereof. According to the present disclosure, a multi-image display device may simultaneously output two or more images separated depending on an output angle or an optical frequency, and a first reflection member provided in an indoor ceiling of the vehicle may reflect one image among the two or more images output from the multi-image display device.

The disclosure is directed to systems and system for providing human-machine interface (HMI), and more particularly, to system for providing a part of HMI system and system components for controlling a vehicle, controlling a personal communication device and displaying integrated information from both to the user.

The invention relates to a method for operating an interactive visibility screen on a transparent pane of a pane device, in particular in a motor vehicle. The visibility screen is generated by means of a display unit of the pane device on the pane by pixel-wise fade-in of opaque image points, wherein the image points form a coherent visibility screen area. In the method, an operational action by the user is first detected by means of a detection device, which comprises a selection of a setting range and a movement relative to the pane. Subsequently, an expansion of the visibility screen area at the setting range is set as a function of the detected movement by means of a control device.

A computer-implemented method for enabling gesture-based interactions between a computer program and a user is disclosed. According to certain embodiments, the method may include initiating the computer program. The method may also include detecting that a condition has occurred. The method may also include activating a gesture-based operation mode of the computer program. The method may also include receiving gesture data generated by a sensor, the gesture data representing a gesture performed by the user. The method may further include performing a task based on the gesture data.

A user interface device includes: an output device having an output region predefined around an output unit; an acquisition unit acquiring information about a user's gesture performed around the output region; and a controller determining an area of a shielded region which is shielded by the user's gesture in the output region based on the acquired information and controlling output of the output device.

Provided is a multi-modal input-based service device and service provision method. A service provision device according to the present specification may comprise: a storage unit for storing multiple applications; a user input unit for receiving a user input including at least one of a voice command and a touch input; and a processor which is functionally connected to the multiple applications, and controls execution of at least one application on the basis of the user input so that dialogs generated by the multiple applications are output in consideration of a pattern of the user input, wherein the processor may analyze an execution screen of a particular application and the user input on the execution screen, infer the intention of the user input, and control a dialog corresponding to the inferred intention to be generated in an application corresponding to the inferred intention.

This application provides a gesture instruction execution method, apparatus, and system, and a storage medium. One example method includes obtaining a plurality of gesture instructions acting on different areas of a target screen; obtaining an operation area on the target screen corresponding to each of the obtained plurality of gesture instructions; determining, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and screen ranges to which a plurality of applications on the target screen belong, a target application corresponding to each gesture instruction; and controlling, based on instruction content of each gesture instruction, the target application corresponding to each gesture instruction.

According to an aspect of the present disclosure, there is provided a system for controlling media play comprising: a control target recognition unit configured to recognize target medium that is to be controlled by the user, among mediums that are played using a vehicle display, a control command generation unit configured to generate a control command according to a result of recognizing a user's request for the target medium; and a medium control unit configured to control the target medium according to the control command.

According to an aspect of the present disclosure, an interaction system for a first vehicle is provided, which comprises a processor and a memory storing processor-executable instructions that, when executed by the processor, cause the latter to implement steps comprising: receiving a first input from the first vehicle and displaying a first avatar on a display; and receiving a second input from a second vehicle and displaying a second avatar on the display, wherein the first input and the second input are updated in real time, and the first avatar and the second avatar dynamically change accordingly.

The present invention relates to a vehicle user interface device including a display configured to display a first Augmented Reality (AR) graphic object at a point in a display area corresponding to a first point, and at least one processor configured to obtain distance data between a vehicle and the first point and change the first AR graphic object based on the distance data.