A multimodal system and process processed one or more sensor signals and extracts features from the one or more sensor signals through a spatiotemporal correlation between consecutive frames of an image or video sequence. The multimodal system and process determines the movement and direction of the features through an image subtraction, or a coherence measure and synthesizes a musical instrument signal in response to the detected movement and direction or the triggers. The imaginary musical instrument signal is added to an infotainment signal within a vehicle.

A method for the automated activation of a vision support system of a vehicle, in particular of a motor vehicle, has improved automatic activation in particular with regard to the prevention of false-negative and false-positive activation. The method detects an activation gesture formed by a movement of the head and/or torso of a vehicle user, in particular of a driver; determines, using the detected activation gesture, a field of vision desired by the vehicle user; and activates the part of the vision support system which images the desired field of vision.

A method and system for assisting a user when interacting with a graphical user interface combines gaze based input with gesture based user commands. A user of a computer system without a traditional touch-screen can interact with graphical user interfaces in a touch-screen like manner using a combination of gaze based input and gesture based user commands. A solution for touch-screen like interaction uses gaze input and gesture based input as a complement or an alternative to touch-screen interactions with a computer device having a touch-screen. Combined gaze and gesture based interaction with graphical user interfaces can be used to achieve a touchscreen like environment in computer systems without a traditional touchscreen or in computer systems having a touchscreen arranged ergonomically unfavorable for the user or a touchscreen arranged such that it is more comfortable for the user to use gesture and gaze for the interaction than the touchscreen.

A vehicular input apparatus includes a gesture sensor, an external device controller, and an output stop unit. The gesture sensor detects a gesture that is a non-contact gesture. The external device controller outputs an operation signal corresponding to the gesture detected by the gesture sensor to a first external device. When the gesture sensor detects the gesture, the output stop unit causes the external device controller to stop outputting the operation signal in response to a detection signal from at least one of a contact sensor and a proximity sensor for manipulating a second external device. The external device controller outputs the operation signal to the first external device after a second predetermined period of time.

A method and system for diagnosing and communicating events associated with one or more components of vehicle is described. In general, a vehicle may provide information regarding its recorded and/or monitored system and component states via a self-diagnostic and/or reporting capability.

A system includes: a sensor that detects motions of a first portion and a second portion of a body of a user; a controller that sets a base point of the second portion in response to the motion of the first portion and receives a prescribed input in response to the motion of the second portion with respect to the base point; and a notification device that contactlessly notifies a third portion of the body that the base point is set.

A system for an improved control of data stream management in a vehicle, said system comprising: a media controller; a processor; a storage element coupled to the processor; encoded instructions; wherein the system is configured to: select at least a first input/output system to receive a packet payload by the media controller; determine an applicable rule set governing a destination input/output system and payload type; determine a current input/output system configuration; determine whether the payload can be provided to each of the destination input/output systems; detect a stimulus indicating that caching of media is to be performed; selectively cache the payload from the destination input/output system for future playback for an operator at the first destination input/output system or at another operator-specific input/output system by the media controller; and wherein the selective caching for future playback on operator-specific input/output system results in improved vehicular data stream management.

A method and an apparatus for controlling a mobile terminal. The apparatus includes a receiving module for receiving gesture information from a first mobile terminal with an image capturing device, wherein the gesture information is from a user; and a sending module for sending a particular operation instruction to a second mobile terminal whose graphic user interface is being currently displayed on a display screen of a display device to instruct the second mobile terminal to execute an operation corresponding to the particular operation instruction, wherein the particular operation instruction is related to the received gesture information.

A touch-sensitive display apparatus and a control apparatus are included in an operating device of a motor vehicle. The control apparatus is configured, in a first operating mode, to display on the display apparatus a screen keyboard for receiving a character sequence from a user. A driver is not to operate the on-screen keyboard during a journey. A sensor apparatus is configured to detect an approach of an object to the display apparatus, a distinction being drawn between a driver approach from a predetermined driver side and a passenger approach from a passenger side opposite the driver side. The control apparatus is configured to deactivate the first operating mode in the event of a detected driver approach of the object and, instead, to activate an alternative operating mode that is different from the first operating mode.

An in-vehicle device includes a gesture detection unit for recognizing a user's hand at a predetermined range; an information control unit controlling information output to a display; and an in-vehicle device control unit receiving input from a control unit equipped in a vehicle to control the in-vehicle device. When the gesture detection unit detects a user's hand at a predetermined position, the output information control unit triggers the display to display candidates of an operation executed by the in-vehicle device control unit by associating the candidates with the user's hand motions. When the gesture detection unit detects the user's hand, and the user's hand has thereafter moved from the position, the information control unit changes a selection method or a control guide of the operation to be executed by the in-vehicle device control unit, which is displayed on the display, to subject matter which matches the control unit.