A user terminal device capable of attaching and detaching a pen is provided. The device includes a detector configured to detect a user manipulation regarding a screen, and a controller configured to change a layout of the screen to correspond to a pen use mode in response to the pen being removed from the user terminal device, perform a control operation corresponding to the detected user manipulation in response to the user manipulation using the pen being detected, and restore the layout of the screen to its original state in response to the pen being remounted on the user terminal apparatus.

A wearable display system can be capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.

An information processing apparatus includes a detection unit configured to detect a position of a manipulation body on a display screen and a control unit configured to, if a first manipulation on the display screen in a locked state is detected, display, on the display screen, icons to be arranged based on a reference point indicating a position of the manipulation body when the first manipulation is completed, and if a second manipulation indicating a direction from the reference point is detected, start up an application corresponding to the icon specified by the second manipulation. An associated method and computer readable storage medium are also described.

Provided is a display apparatus for displaying an operation menu associated with a data processing performed on handwritten data, wherein the operation menu includes information related to the data processing according to a display position of the operation menu.

A mobile terminal device includes a display section having a display screen, an input section having a touch input region on the display screen, and a control section for displaying a plurality of keys. The display screen is provided as a software keyboard where a touch operation on a specific key causes an input of the specific key. In the specific display region on the display screen that can display operation keys on the software keyboard, the control section selects these keys from a previously prepared set of input candidate key groups. In response to a specific operation on the specific display region, the control section allows the plurality of keys to be displayed on the specific display region. In response to touch on a desired key in the specific display region, the control section determines that an input of the key has been performed.

A data entry system, having an input interface adapted to identify a plurality of user interactions. The system includes a processor adapted to associate user interactions identified by the input interface with a plurality of letters of the alphabet, such that all the letters of the alphabet are assigned to at most eight user interactions. Most of the letters are assigned to specific user interactions according to one or more features of their shape in their printed form, such that most of the letters assigned to each user interaction have the same shape feature.

A method for executing a function of an electronic device is provided. The method includes the operations of displaying a virtual clock user interface (UI) indicating a virtual time, and an icon list UI including icons corresponding to a plurality of functions, respectively, acquiring first input data according to a user input for selecting one time by using the displayed virtual clock UI, and second input data according to a user input for selecting one icon from the icon list UI, performing control, on the basis of the first input data and the second input data, so that a function corresponding to the selected icon is executed at the selected one time, and highlighting the selected icon as the virtual time reaches the one time, and executing the function corresponding to the selected icon as the current time reaches the one time.

Disclosed is an electronic device capable of intuitively allocating a function to a button of a digital pen using different types of signals generated from an input tool, and that can more conveniently set a user environment by intuitively mapping a function to a button input of the digital pen.

The information processing device includes a display panel, a touch panel, a controller, and a storage. The display panel includes a first area and a second area. When a drawing operation on the first area is received, the controller displays an image based on the drawing operation in the first area. The controller performs second processing and third processing. The second processing corresponds to processing of storing a reproduction target image displayed in the first area and a reduced image of the reproduction target image in the storage, when a specific type of operation excluding the drawing operation is received on the touch panel, and displaying the reduced image in the second area. The third processing corresponds to processing of displaying, when an operation of selecting the reduced image is received on the touch panel, the reproduction target image corresponding to the selected reduced image in the first area.

An electronic device and method are provided to control screen properties based on a distance between the electronic device and a pen input device. The electronic device includes a camera, a touchscreen display, and a processor configured to display, on the touchscreen display, a screen including at least one target object image corresponding to at least one object obtained by the camera, and change a property of the screen based on a resizing of the at least one target object image according to a movement of at least one of the electronic device or the object.