The present invention provides improved methods and systems for assisting a user when interacting with a graphical user interface by combining gaze based input with gesture based user commands. The present invention provide systems, devices and method that enable a user of a computer system without a traditional touch-screen to interact with graphical user interfaces in a touch-screen like manner using a combination of gaze based input and gesture based user commands. Furthermore, the present invention offers a solution for touch-screen like interaction using gaze input and gesture based input as a complement or an alternative to touch-screen interactions with a computer device having a touch-screen, such as for instance in situations where interaction with the regular touch-screen is cumbersome or ergonomically challenging. Further, the present invention provides systems, devices and methods for combined gaze and gesture based interaction with graphical user interfaces to achieve a touchscreen like environment in computer systems without a traditional touchscreen or in computer systems having a touchscreen arranged ergonomically unfavourable for the user or a touchscreen arranged such that it is more comfortable for the user to use gesture and gaze for the interaction than the touchscreen.

An object detection vision system and methods are disclosed. A method for detecting objects in a vision system of an industrial machine includes receiving image data from one or more vision cameras and receiving detection data from one or more detect devices. The detection data includes one or more detected objects. The method includes combining the detection data and the image data and transforming the detection data in the image data based on one or more objects in the image data. The method also includes displaying an indication of the detected one or more objects in the image data based on the transformed detection data.

The button structure including a front panel configured to define a body and having a mounting hole formed in a front surface of the front panel directed toward an interior of an occupant compartment, a button unit accommodated in the mounting hole and configured to selectively control various types of AV systems of a vehicle, a detection unit accommodated in the front panel and configured to detect a user's hand, a switch unit configured to operate various types of AV systems of the vehicle under the control of the button unit, and a lighting unit accommodated in a housing and configured to emit light to the button unit in response to a detection signal of the detection unit, in which the detection unit is disposed rearward of the button unit and positioned from the button unit in a direction opposite to the direction toward the interior of the occupant compartment.

An apparatus for controlling a heating, ventilating and air conditioning (HVAC) system for a vehicle includes a touch screen displaying an interface of the HVAC system for a vehicle, and a controller recognizing a touch of a user and controlling the interface of the HVAC system, displayed on the touch screen, based on the recognized touch.

A method for activating a cleaning mode of a touch-operable button of a motor vehicle involves switching the button to at least partially inactive in the cleaning mode to avoid an unintentional actuation. A camera monitors the button and detection of an actuation activating the cleaning mode is carried out by recognizing a cleaning implement guided by a hand of a user on the button.

Disclosed is a system for controlling subsystems of a vehicle. The system comprises a control unit, a speedometer or vehicle speed unit, a sensor in communication with the control unit that is configured to detect at least one of a first activation stimulus or a second activation stimulus; and a control panel in communication with the control unit. The control panel displays a plurality of selectable vehicle control options. When the vehicle is moving above a threshold velocity, at least one vehicle control option is disabled for the first activation stimulus and enabled for the second activation stimulus.

Methods and systems are provided for adjusting parameters using a vehicle touch screen. In one embodiment, a method includes determining an initial touch position of an external touch operation when the external touch operation is detected. A movement trajectory and final disengagement position of the external touch operation may then be detected. The movement trajectory need not be limited to an area covered by a parameter adjustment control. The parameter adjustment control may then be adjusted to a final parameter value according to the initial touch position, the final disengagement position, and the movement trajectory.

A vehicle operation system includes an operation unit disposed within a vehicle and including an operating element configured to receive an operation of an occupant of the vehicle, a determiner configured to determine a target-specific device serving as an operation target from among a plurality of specific devices on the basis of an operation different from a mechanical operation performed on the operating element by the occupant of the vehicle, and a device controller configured to control the target-specific device on the basis of the mechanical operation performed on the operating element by the occupant of the vehicle.

An operation device according to the present invention has a touch-screen-type operation surface installed in a vehicle. A plurality of operation units having a convex shape or a concave shape associated with a plurality of components mounted in the vehicle, respectively, are formed at different positions on the touch-screen-type operation surface, respectively. The plurality of operation units are configured to accept an input touch operation as an operation instruction for the component associated with each of the plurality of operation units.

An apparatus for determining an approach direction of a gesture of a vehicle occupant (a driver or a fellow passenger) by using a proximity sensor and controlling a vehicle display based on the approach direction determination. The apparatus includes an input unit to receive information on an approach direction in which an occupant’s hand in a vehicle moves to operate a vehicle function, a memory to store a program for controlling the vehicle display by using the information on the approach direction, and a processor to execute the program. The processor controls the vehicle display to perform different functions when an input is made to the same button based on information on a first approach direction in which a driver’s hand approaches from a driver seat side and information on a second approach direction in which a fellow passenger’s hand approaches from a passenger seat side.