A method and system for executing gesture based control of a vehicle system that include receiving at least one signal that pertains to at least one muscle movement from sensors disposed within a gear shift knob. The method and system also include determining at least one gesture based on the at least one signal. Additionally, the method and system include determining an interaction command with the vehicle system based on the at least one gesture. The method and system further include outputting the interaction command to the vehicle system.

A system includes a sensor that detects motions of a first portion and a second portion of a body of a user, a controller that sets an association relationship between a coordinate system of a real space and a coordinate system of a virtual space in response to the motion of the first portion and receives an operation for an object in the virtual space in response to a position and the motion of the second portion, and a notification device that contactlessly notifies a third portion of the body of prescribed information.

An operation assistance system includes: a motion recognition unit that recognizes predetermined motion of a hand of a vehicle occupant; a position recognition unit that recognizes a first relative position corresponding to a relative position of the hand of the vehicle occupant with respect to a first vehicle; a specifying unit that specifies a second on-vehicle device of a second vehicle that is operated by using an operation unit of the second vehicle provided at a second relative position that is a relative position with respect to the second vehicle and corresponds to the first relative position; and a control unit that assists an operation for a first on-vehicle device of the first vehicle, the first on-vehicle device including a function common with that of the second on-vehicle device.

In a driving support device, an image output unit outputs an image including a vehicle object representing a vehicle and a peripheral situation of the vehicle, to a display unit. An operation signal input unit receives a gesture operation by a user that involves moving of the vehicle object in the image displayed on the display unit. A command output unit outputs a command according to the gesture operation, to an automatic driving control unit that controls automatic driving.

The present invention relates to a vehicle display device comprising: a display; a gesture sensing unit disposed in the vicinity of the display so as to generate a first sheet beam to be emitted in a first direction and a second sheet beam to be emitted in a second direction different from the first direction, and sensing a three-dimensional gesture of an object through the first and second sheet beams; and a processor for providing a control signal according to the three-dimensional gesture.

Method and apparatus are disclosed for gaze detection of occupants for vehicle displays. An example vehicle includes a panoramic display including polarized displays. The example vehicle also includes a controller to identify a primary operator interface and a primary passenger interface and detect, via one or more cameras, an operator gaze and a passenger gaze. The controller also is to present the primary operator interface to an operator via one of the polarized displays corresponding with the operator gaze and present the primary passenger interface to a passenger via one of the polarized displays corresponding with the passenger gaze.

A method for classifying a gesture made in proximity to a touch interface. A system receives data related to the position and/or movement of hand. The data is delimited by identifying a variable length window of touch frames. The variable length window of touch frames is selected to include touch frames indicative of feature data. The variable length window of touch frames is classified based upon classifications learned by the classifying module to identify gestures.

An in-vehicle device comprises a gesture defection unit, which recognizes a user's hand position located within a predetermined range, a driving state recognition unit which detects a driving state of a vehicle, and a gesture control unit which controls a state of a gesture operation based on a recognition result of the hand position by the gesture detection unit, wherein the gesture control unit disables the gesture operation when the driving state of the vehicle detected by the driving state recognition unit is in a predetermined disabling state.

A respective sensing region of at least one radar unit is oriented into a passenger compartment of the motor vehicle and a control device is configured to sense a position of a body part of a person and/or a movement of the body part in the passenger compartment on the basis of the reflection respectively received by the at least one radar unit, thus providing non-contact detection of the body part of the person in the motor vehicle. As viewed from the passenger compartment, the at least one radar unit can be arranged behind a display surface of a display device or alongside the display surface of the display device.

Method and apparatus are disclosed for gaze detection of occupants for vehicle displays. An example vehicle includes a panoramic display including polarized displays. The example vehicle also includes a controller to identify a primary operator interface and a primary passenger interface and detect, via one or more cameras, an operator gaze and a passenger gaze. The controller also is to present the primary operator interface to an operator via one of the polarized displays corresponding with the operator gaze and present the primary passenger interface to a passenger via one of the polarized displays corresponding with the passenger gaze.