A user, such as the driver of a vehicle, to retrieve information related to a point of interest (POI) near the vehicle by pointing at the POI or performing some other gesture to identify the POI. Gesture recognition is performed on the gesture to generate a target region that includes the POI that the user identified. After generating the target region, information about the POI can be retrieved by querying a server-based POI service with the target region or by searching in a micromap that is stored locally. The retrieved POI information can then be provided to the user via a display and/or speaker in the vehicle. This process beneficially allows a user to rapidly identify and retrieve information about a POI near the vehicle without having to navigate a user interface by manipulating a touchscreen or physical buttons.

The invention regards a system for automated execution of a maneuver or behavior selected by an operator of a system and a respective method for automated execution. At first a situation is determined in which the system currently is based on environment sensing. Then, based on the determined situation, maneuver options and/or behavior options are determined. Such options are maneuvers or behaviors which potentially can be executed by the system in the determined situation. Then information on at least one of the determined maneuver options or behavior options are output using a haptic display. The system receives an input selecting one of the options from a user. On the basis of the selected option then the selected option or maneuver is executed in an automated fashion.

A user interface apparatus for a vehicle including a touch screen; a gesture input unit configured to detect a gesture of a user; and a processor configured to in response to the gesture detected by the gesture input unit being applied from a driver seat of the vehicle, display a preset first screen on the touch screen corresponding to driver operations of the vehicle, and in response to the gesture detected by the gesture input unit being applied from a front passenger seat of the vehicle, display a preset third screen on the touch screen corresponding to passenger operations of the vehicle excluding vehicle driving operations.

A hologram display control apparatus may include a determination device turning on a hologram display control depending on an input signal of a user, a hologram projection device projecting a first hologram image corresponding to an image of a manipulating device of a steering wheel onto a first area predefined based on a space coordinate system of a vehicle, when the hologram display control is turned on, a detector recognizing a set operation in a second area predefined for operation recognition with respect to button manipulation in the first hologram image, a manipulation button recognizing device recognizing a manipulation button in the first hologram image based on a location at which the set operation is recognized by the detector, and a signal processing device transmitting a control signal to a driving device of the vehicle operated by the manipulation button.

A gesture recognition apparatus may execute a command by recognizing a user's gesture. The gesture recognition apparatus includes a gesture sensor that detects a position and movement of an object in space, and a cover that includes a contact surface which is positioned away from the gesture sensor by a predetermined distance and is brought into contact with the object.

A touch pad includes a flat portion and a convex type three-dimensional portion having a hemispherical shape. An outer circumferential surface of the three-dimensional portion constitutes a spherical operation area. A second recognition unit of the touch-pad controller recognizes a gesture operation of at least two fingers to be the same gesture operation as a pinch-in operation in a planar operation area, in a case where movement trajectories of the at least two fingers in the spherical operation area are arc-shaped movement trajectories which are bulged outwardly in a case where the spherical operation area is viewed in a plan view.

A touch-sensitive display apparatus and a control apparatus are included in an operating device of a motor vehicle. The control apparatus is configured, in a first operating mode, to display on the display apparatus a screen keyboard for receiving a character sequence from a user. A driver is not to operate the on-screen keyboard during a journey. A sensor apparatus is configured to detect an approach of an object to the display apparatus, a distinction being drawn between a driver approach from a predetermined driver side and a passenger approach from a passenger side opposite the driver side. The control apparatus is configured to deactivate the first operating mode in the event of a detected driver approach of the object and, instead, to activate an alternative operating mode that is different from the first operating mode.

A gesture device comprises: an input module for obtaining an image; a gesture process unit for extracting a gesture from the obtained image; and a control unit for controlling to convert a lock state mode to an idle state mode on the basis of the extracted gesture. A vehicle includes: a driver's seat; a console box disposed next to the driver's seat; a gear knob; and a rearview mirror. The vehicle includes: an input module installed on the lower portion of the rearview mirror so as to obtain an image; a gesture process unit for extracting a gesture from the obtained image; and a control unit for controlling to convert a lock state mode to an idle state mode on the basis of the extracted gesture and to perform a function corresponding to the extracted gesture.

A vehicle may include: a microphone provided inside the vehicle and configured to receive a voice uttered by an occupant of the vehicle; a camera configured to obtain an image inside the vehicle; a display device configured to display a menu screen comprising a plurality of menu items; and a controller configured to control the display device. The controller may be configured to recognize, based on the image obtained via the camera, a hand gesture of the occupant, determine, based on the hand gesture, a menu item, of the plurality of menu items on the menu screen, pointed to by the occupant, and execute, based on the voice uttered by the occupant, a command corresponding to the pointed menu item.

A respective sensing region of at least one radar unit is oriented into a passenger compartment of the motor vehicle and a control device is configured to sense a position of a body part of a person and/or a movement of the body part in the passenger compartment on the basis of the reflection respectively received by the at least one radar unit, thus providing non-contact detection of the body part of the person in the motor vehicle. As viewed from the passenger compartment, the at least one radar unit can be arranged behind a display surface of a display device or alongside the display surface of the display device.