A method for controlling an electronic device includes determining a software application that is running in the electronic device. Pressing information in relation to a predetermined physical button of the electronic device is detected and a probability of use of each of buttons corresponding to the software application is obtained by searching a preset list according to the software application. An operation is performed according to the pressing information and the probability of use of each of buttons corresponding to the software application.

An image processing apparatus described in the present specification includes a display unit configured to display a software keyboard, a reception unit configured to receive a signal transmitted from the information processing apparatus based on a depression of a keyboard, a storage unit configured to store the signal received by the reception unit in association with information about a hardware key provided on the image processing apparatus, and a control unit configured to display a character based on the signal received by the reception unit on the display unit in a case where the software keyboard is being displayed by the display unit, and to perform processing corresponding to a depression of the hardware key information about which is stored in the storage unit in association with the signal received by the reception unit in a case where the software keyboard is not being displayed by the display unit.

An image processing apparatus described in the present specification includes a display unit configured to display a software keyboard, a reception unit configured to receive a signal transmitted from the information processing apparatus based on a depression of a keyboard, a storage unit configured to store the signal received by the reception unit in association with information about a hardware key provided on the image processing apparatus, and a control unit configured to display a character based on the signal received by the reception unit on the display unit in a case where the software keyboard is being displayed by the display unit, and to perform processing corresponding to a depression of the hardware key information about which is stored in the storage unit in association with the signal received by the reception unit in a case where the software keyboard is not being displayed by the display unit.

User interface control using a keyboard is described. In an embodiment, a user interface displayed on a display device is controlled using a computer connected to a keyboard. The keyboard has a plurality of alphanumeric keys that can be used for text entry. The computer receives data comprising a sequence of key-presses from the keyboard, and generates for each key-press a physical location on the keyboard. The relative physical locations of the key-presses are compared to calculate a movement path over the keyboard. The movement path describes the path of a user's digit over the keyboard. The movement path is mapped to a sequence of coordinates in the user interface, and the movement of an object displayed in the user interface is controlled in accordance with the sequence of coordinates.

User interface control using a keyboard is described. In an embodiment, a user interface displayed on a display device is controlled using a computer connected to a keyboard. The keyboard has a plurality of alphanumeric keys that can be used for text entry. The computer receives data comprising a sequence of key-presses from the keyboard, and generates for each key-press a physical location on the keyboard. The relative physical locations of the key-presses are compared to calculate a movement path over the keyboard. The movement path describes the path of a user's digit over the keyboard. The movement path is mapped to a sequence of coordinates in the user interface, and the movement of an object displayed in the user interface is controlled in accordance with the sequence of coordinates.

Each interesting location on a screen of a portable unit is marked by a transparent flag or marker. Then, when the user scales up (magnifies the image) the map to view one of the locations, transparent arrows are placed on the screen identified with transparent location markers indicating the direction the user needs to move to arrive at the remaining locations marked earlier by markers. Either the portable unit can be moved while the map remains stationary or the device remains stationary while the map is moved by the touch screen. By following each transparent arrow, which constantly calculates the new direction as the view of the map changes, the user arrives at the desired location, often in a shortest distance, without getting lost. Once this location is viewed, the user can then proceed to follow a second transparent arrow corresponding to a second desired location. This can be done for each marked location without changing the scale or entering new search data terms since all transparent arrows (markers) can be shown on the screen. An option can exist where the user moves to the marked location immediately by issuing a verbal or physical command.

Each interesting location on a screen of a portable unit is marked by a transparent flag or marker. Then, when the user scales up (magnifies the image) the map to view one of the locations, transparent arrows are placed on the screen identified with transparent location markers indicating the direction the user needs to move to arrive at the remaining locations marked earlier by markers. Either the portable unit can be moved while the map remains stationary or the device remains stationary while the map is moved by the touch screen. By following each transparent arrow, which constantly calculates the new direction as the view of the map changes, the user arrives at the desired location, often in a shortest distance, without getting lost. Once this location is viewed, the user can then proceed to follow a second transparent arrow corresponding to a second desired location. This can be done for each marked location without changing the scale or entering new search data terms since all transparent arrows (markers) can be shown on the screen. An option can exist where the user moves to the marked location immediately by issuing a verbal or physical command.

An input method usable by a terminal including a touch screen display, identifies first touch input locations on a touch screen. The first touch input locations comprise a predetermined number of concurrent multiple touches. A predetermined number of input buttons comprising a predetermined number of areas on the touch screen are associated with corresponding identified first touch input locations. A touch pattern is detected comprising a second touch input of one or more of the predetermined number of input buttons and an alphanumeric input corresponding to the detected touch pattern is processed.

An information handling system input device coordinates presentation of keyboard augmentation panels proximate a keyboard resting on a horizontally-disposed touchscreen display. The keyboard augmentation panels relate keyboard and other inputs to an application active on the information handling system to enhance end user interactions. A keyboard augmentation module tracks the keyboard position on the touchscreen display to adapt content presentation in the keyboard augmentation panels based upon expected end user inputs. In other embodiments, other physical devices are augmented to have hybrid graphical interfaces that enhance multi-hand end user interactions.

An information handling system input device coordinates presentation of keyboard augmentation panels proximate a keyboard resting on a horizontally-disposed touchscreen display. The keyboard augmentation panels relate keyboard and other inputs to an application active on the information handling system to enhance end user interactions. A keyboard augmentation module tracks the keyboard position on the touchscreen display to adapt content presentation in the keyboard augmentation panels based upon expected end user inputs. In other embodiments, other physical devices are augmented to have hybrid graphical interfaces that enhance multi-hand end user interactions.