Methods executed by a processor of computing device for launching a selected application on a computing device are disclosed. Various embodiments may include authorizing a user based on a fingerprint of a finger detected on a fingerprint sensor portion of a touchscreen display matching a fingerprint of an authorized user of the computing device, determining a selected application installed on the computing device from a selective engagement of the finger on the touchscreen display, continuous from the fingerprint sensor portion and unlocking the selected application in response to the selective engagement of the finger on the touchscreen display. In some embodiments, selection of an application may be based a continuous swipe movement by the finger on the touchscreen display from the fingerprint sensor portion toward an icon on the touchscreen display representing the selected application.

A method and an apparatus are provided for performing a function corresponding to a recognized user input through a touch screen. The method includes displaying a window of an application; displaying a setting menu of the application; receiving a selection for at least one item in the setting menu; recognizing an input object that performed the selection; registering the input object as an object for executing a function corresponding to the at least one item selected by the input object; detecting an input by the input object in the application window; and executing the function in response to the input by the input object.

Disclosed herein are examples of a wearable display system capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.

An artificial reality system is described that renders, presents, and controls user interface elements within an artificial reality environment, and performs actions in response to one or more detected gestures of the user. In one example, an artificial reality system comprises a head-mounted display configured to output artificial reality content; a stylus; a stylus action detector configured to detect movement of the stylus, detect a stylus selection action, and after detecting the stylus selection action, detect further movement of the stylus; a UI engine configured to generate stylus movement content in response to detecting movement of the stylus, and generate a UI input element in response to detecting the stylus selection action; and a rendering engine configured to render the stylus movement content and the UI input element as overlays to the artificial reality content, and update the stylus movement content based on the further movement of the stylus.

A display apparatus includes circuitry that displays a table on a screen. The circuitry acquires, from a memory, an attribute associated with the table; receives handwritten data input to the table by a user operation; and converts the handwritten data into a character string so as to have an appearance in accordance with the attribute associated with the table.

The information processing device includes a display panel, a touch panel, a controller, and a storage. The display panel includes a first area and a second area. When a drawing operation on the first area is received, the controller displays an image based on the drawing operation in the first area. The controller performs second processing and third processing. The second processing corresponds to processing of storing a first image displayed in the first area and a second image which is a reduced image of the first image in the storage, when a specific type of operation excluding the drawing operation is received on the touch panel, and displaying the second image in the second area. The third processing corresponds to processing of displaying, when an operation of selecting the second image is received on the touch panel, the first image corresponding to the selected second image in the first area.

Methods executed by a processor of computing device for launching a selected application on a computing device are disclosed. Various embodiments may include authorizing a user based on a fingerprint of a finger detected on a fingerprint sensor portion of a touchscreen display matching a fingerprint of an authorized user of the computing device, determining a selected application installed on the computing device from a selective engagement of the finger on the touchscreen display, continuous from the fingerprint sensor portion, which provides an indication of a user selection of an application, and unlocking the selected application in response to the selective engagement of the finger on the touchscreen display. In some embodiments, selection of an application may be based a continuous swipe movement by the finger on the touchscreen display from the fingerprint sensor portion toward an icon on the touchscreen display representing the selected application.

A display apparatus includes circuitry that displays, on a screen, a table including one or more table elements; receives handwritten data input on the screen by a user operation; and selects, based on the handwritten data, at least one table element of the table. The table element is a row or a column of the table.

A mobile device includes a sensing unit configured to determine whether the stylus pen is separated from the mobile device; a communication unit configured to receive a control signal including a first control signal and a second control signal from the stylus pen separated from the mobile device; and a controller configured to operate in a first control mode for performing an operation of an application being executed on the mobile device. The controller performs a first operation of the application in response to the first control signal, and performs a second operation of the application in response to the second control signal.

A display apparatus capable of being touched plural times by a single user or being used by a plurality of users is provided. The display apparatus includes: a display; a sensor sensing a user touch on the display; and a processor configured to execute a writing function corresponding to a first touch when the first touch is sensed through the sensor and executing a function corresponding to a second touch of a user at a coordinate value at which the second touch is sensed in response to the second touch when the second touch is sensed in a predetermined range of the first touch based on a coordinate value at which the first touch is sensed during a period in which the first touch is input.