Disclosed is a device for inputting symbols in an entry field. An example of the device includes an interface unit having a touch screen and a module for processing graphics objects. The module may include a detection unit for detecting a start and an end of a current graphics object being input; a storage unit for storing graphics data corresponding to the input graphics object; a recognition unit for generating a list of candidate strings of symbols from the graphics data, each candidate string being associated with a pertinence value; and an insertion unit for inserting into the entry field a string selected by the user from the list, a data group comprising the graphics data, the candidate strings, the pertinence values, and an identifier of the selected string being stored during a predetermined duration.

A system, method and computer program product for guiding hand-drawing of diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display is performed, on an interactive display of the computing device, of a guide element associated with at least one diagram element of displayed handwriting diagram input. The guide element is configured with a depiction of the at least one diagram element in recognized form.

A handwriting input display apparatus causes display means to display a stroke generated by an input made by using input means to a screen as a handwritten object. The apparatus includes display control means for causing the display means to display character string candidates including a handwriting recognition candidate when the handwritten object does not change for a predetermined time. When the handwriting recognition candidate is selected, the display control means causes the display means to erase a display of the character string candidates and a display of the handwritten object, and causes the display means to display a character string object at a position where the erased handwritten object was displayed. When selection of the handwriting recognition candidate is not performed for a predetermined time and the display of the character string candidates is erased, the display control means causes the handwritten object to be kept displayed.

Methods, systems, and computer program products are provided for stroke attribute matrices. User input strokes may be converted into attributes encoded in one or more stroke attribute matrices (SAMs), such as bitmaps, for image or other multidimensional analysis. One or more convolutional neural networks (CNNs) may recognize letters, symbols, shapes and gestures in SAMs. A selector may select output classifications from among multiple CNNs. A sequence analyzer may select a sequence of selected CNN outputs. Stroke information may comprise, for example, velocity (e.g. direction and speed), tilt, pressure, line width, pen up/down events, hover height, etc. Stroke information may be stored, for example, in bitmap color channels (e.g. to facilitate human review). For example, an x, y velocity vector and x, y tilt may be encoded, respectively, as RGBA components of pixel data. Stroke crossings may be encoded, for example, by combining attribute values at pixels where strokes intersect.

A display device for displaying a character string, includes a display configured to display one or more characters converted from handwritten data, and a first circuitry configured to display a display element or tag indicating a position of the one or more characters with respect to the character string.

A display device includes a circuitry configured to perform a search for a plurality of image candidates in an image transformation dictionary part, based on handwritten data, and a display configured to display the plurality of image candidates obtained by the search. At least a portion of the plurality of image candidates displayed on the display represents a different person or an object.

Methods, systems, and computer-readable media related to a technique for providing handwriting input functionality on a user device. A handwriting recognition module is trained to have a repertoire comprising multiple non-overlapping scripts and capable of recognizing tens of thousands of characters using a single handwriting recognition model. The handwriting input module provides real-time, stroke-order and stroke-direction independent handwriting recognition for multi-character handwriting input. In particular, real-time, stroke-order and stroke-direction independent handwriting recognition is provided for multi-character, or sentence level Chinese handwriting recognition. User interfaces for providing the handwriting input functionality are also disclosed.

A system, method and computer program product for guiding hand-drawing of diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display is performed, on an interactive display of the computing device, of a guide element associated with at least one diagram element of displayed handwriting diagram input. The guide element is configured with a depiction of the at least one diagram element in recognized form.

A content creation application with an ink augmenting feature can communicate at least one recognized term from ink strokes input to a canvas interface of the content creation application to an ink augmenting service. The content creation application can receive at least one keyword from the ink augmenting service, where each keyword indicates a corresponding recognized term having available content identified by the ink augmenting service. The content creation application then transforms a grouping of the ink strokes corresponding to the recognized term indicated by each keyword to an actionable item in the canvas interface. Selection of the actionable item invokes the command to provide the available content.

Embodiments provide systems, methods, and computer storage media for generating stroke predictions based on prior strokes and a reference image. An interactive drawing interface can allow a user to sketch over, or with respect to, a reference image. A UI tool such as an autocomplete or workflow clone tool can access or identify a set of prior strokes and a target region, and stroke predictions can be generated using an iterative algorithm that minimizes an energy function considering stroke-to-stroke and image-patch-to-image-patch comparisons. For any particular future stroke, one or more stroke predictions may be initialized based on the set of prior strokes. Each initialized prediction can be improved by iteratively executing search and assignment steps to incrementally improve the prediction, and the best prediction can be selected and presented as a stroke prediction for the future stroke. The process can be repeated to predict any number of future strokes.