An example wearable display system can be capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.

According to certain embodiments, a method comprises: generating a sticker from first content in a first application; mapping second content to the generated sticker, thereby resulting in a mapped sticker; and in response to receiving text input to a second application from a virtual keyboard, the text input having a meaning related to the second content, providing the mapped sticker to the second application.

The information processing device includes a display panel, a touch panel, a controller, and a storage. The display panel includes a first area and a second area. When a drawing operation on the first area is received, the controller displays an image based on the drawing operation in the first area. The controller performs second processing and third processing. The second processing corresponds to processing of storing a first image displayed in the first area and a second image which is a reduced image of the first image in the storage, when a specific type of operation excluding the drawing operation is received on the touch panel, and displaying the second image in the second area. The third processing corresponds to processing of displaying, when an operation of selecting the second image is received on the touch panel, the first image corresponding to the selected second image in the first area.

The information processing device includes a display panel, an operation receiving section, a controller, and a storage. The display panel includes a first area and a second area. When a user operation on the first area is received on the operation receiving section, the controller displays an image based on the user operation in the first area. The controller performs second processing and third processing. The second processing corresponds to processing of storing a first image displayed in the first area and a second image which is a reduced image of the first image in the storage, and displaying the second image in the second area. The third processing corresponds to processing of displaying, when a user operation of selecting the second image is received on the operation receiving section, the first image corresponding to the selected second image in the first area.

A method for executing a function of an electronic device is provided. The method includes the operations of displaying a virtual clock user interface (UI) indicating a virtual time, and an icon list UI including icons corresponding to a plurality of functions, respectively, acquiring first input data according to a user input for selecting one time by using the displayed virtual clock UI, and second input data according to a user input for selecting one icon from the icon list UI, performing control, on the basis of the first input data and the second input data, so that a function corresponding to the selected icon is executed at the selected one time, and highlighting the selected icon as the virtual time reaches the one time, and executing the function corresponding to the selected icon as the current time reaches the one time.

An electronic device is provided. The electronic device includes a display and at least one processor that is configured to display an object corresponding to an application on the display, display an execution screen of the application in an area of the display when a hovering input is detected on the object corresponding to the application, and display the object corresponding to the application on the display when the hovering input is released.

The present invention improves operability by controlling operation received from a user according to an operation unit for a touch panel. A display apparatus according to an embodiment of the present invention includes: a display that displays an image on a screen; a touch detector that detects contact on the touch screen; an area sensor that obtains an area of the contact on the screen; and a changing unit that changes UI (User Interface) for inputting a predetermined instruction is changed based on the contact detected by the touch detector.

A display device includes: a display unit which displays an image; a detection unit which detects positions of first and second pointers on the image; a storage unit having a storage area corresponding to the pointers; a storage control unit which causes first and second virtual objects associated with the first and second pointers to be stored in the storage area, with the first and second virtual objects corresponding to first and second identifiers, respectively; and a pasting unit which pastes the first virtual object stored corresponding to the first identifier in the storage area to the image in response to an operation of the first pointer, and which pastes the second virtual object stored corresponding to the second identifier in the storage area to the image in response to an operation of the second pointer.

Feedback via an input device associated with an interaction with a point of interest (POI) and scribble recognition is provided. When using an input device to navigate a GUI, various POIs may be determined as elements beneficial for a user to notice, pay attention to, or avoid. When an input is received that may be associated with a POI, feedback may be provided. Feedback may include haptic, visual, or audible feedback. Scribble recognition may also be provided. When using an input device (e.g., digital pen), a user may “scribble” in a margin to test pen attributes. Upon recognizing a scribble, alternative pen attributes may be presented in a contextual menu. In addition, the scribble may be automatically erased upon selection of a pen attribute or upon receiving input in another area of the UI or alternatively, feedback may be provided prior to erasure of the scribble input.

Techniques for ink in an electronic document are described. According to various implementations, techniques described herein provide a rich set of tools which allow a user to markup an electronic document such as a web page, not only in static 2D where the user writes on top of a document, but in dynamic 3D. In addition, when adding 3D elements to an electronic document, the 3D elements are added based on awareness of the content of the electronic document and can adapt its content in relationship to the document.