Methods, systems, and computer-readable media related to a technique for providing handwriting input functionality on a user device. A handwriting recognition module is trained to have a repertoire comprising multiple non-overlapping scripts and capable of recognizing tens of thousands of characters using a single handwriting recognition model. The handwriting input module provides real-time, stroke-order and stroke-direction independent handwriting recognition for multi-character handwriting input. In particular, real-time, stroke-order and stroke-direction independent handwriting recognition is provided for multi-character, or sentence level Chinese handwriting recognition. User interfaces for providing the handwriting input functionality are also disclosed.

Certain aspects of the present methods and systems may focus on computer implemented methods of obtaining digitized hand-writing data corresponding to a sample of a needed code point of a set of code points. Such methods may include: obtaining a sample of digitized handwritten text, the sample of digitized handwritten text including glyph data corresponding to a first glyph, the first glyph corresponding to the needed code point of the set of code points; associating the first glyph with the needed code point; identifying stroke data in the glyph data, the stroke data corresponding to a stroke component of the first glyph, determining a plurality of dimensional values of the stroke component in the stroke data; and associating the plurality of dimensional values with a new code point sample of the needed code point in a code point set data structure.

An ink data modification or correction method, and an information processing device and a program for implementing the method are provided, which allow automatic correction of ink data including a spelling error in a handwritten character string. An ink data modification method according to the present disclosure includes determining a modification method of ink data by detecting a spelling error included in a handwritten character string represented by the ink data, and modifying the ink data by manipulating the ink data on the basis of the determined modification method. For example, the determined modification method may be to add a missing character, or to delete a superfluous character, or to correct a typo by replacing an erroneous character with a correct character.

A system, method and computer program product for guiding hand-drawing of diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display is performed, on an interactive display of the computing device, of a guide element associated with at least one diagram element of displayed handwriting diagram input. The guide element is configured with a depiction of the at least one diagram element in recognized form.

A system, method and computer program product for hand-drawing diagrams including text and non-text elements on a computing device are provided. The computing device has a processor and a non-transitory computer readable medium for detecting and recognizing hand-drawing diagram element input under control of the processor. Display of input diagram elements in interactive digital ink is performed on a display device associated with the computing device. One or more of the diagram elements are associated with one or more other of the diagram elements in accordance with a class and type of each diagram element. The diagram elements are re-displayed based on one or more interactions with the digital ink received and in accordance with the one or more associations.

A systems, method and computer program product for use in guiding handwriting input to a computing device are provided. The computing device is connected to an input device in the form of an input surface. A user is able to provide input by applying pressure to or gesturing above the input surface using either his or her finger or an instrument such as a stylus or pen. The present system and method monitors the input strokes. The computing device further has a processor and at least one application for recognizing the handwriting input under control of the processor. The at least one system application is configured to cause display of, on an interactive display of the computer device, a guide element contiguous with at least a portion of display of digital ink corresponding to the handwriting input. The guide element is configured to guide further handwriting input.

A method for providing recommendations based on handwritten data in a handwritten document is disclosed. The method includes fetching the handwritten data corresponding to strokes made by a user in the handwritten document on a screen of an electronic device. The method also includes recognizing text associated with the fetched handwritten data by employing a handwriting recognition technique. The method further includes identifying keywords in the recognized text and determining recommendations based on the identified keywords using a named entity linking and/or a knowledge graph. The recommendations include handwritten documents stored in a database and/or weblinks. The method also includes ranking the determined recommendations based on a similarity score of each of the determined one or more recommendations with respect to the identified one or more keywords and rendering the ranked recommendations to the user.

An electronic writing solution server includes a query engine and a user interface engine. The query engine receives a search query from a user, the search query specifying a field in at least one form and including a first stroke or text, retrieves clusters from a database, retrieves example strokes from the clusters at vary levels of similarity to the first stroke, receives user selections for strokes of interest from the example strokes, and retrieves information associated with the strokes of interest from the database. The user interface engine generates graphical data for presenting the retrieved information to the user.

Methods, systems, and computer-readable media related to a technique for providing handwriting input functionality on a user device. A handwriting recognition module is trained to have a repertoire comprising multiple non-overlapping scripts and capable of recognizing tens of thousands of characters using a single handwriting recognition model. The handwriting input module provides real-time, stroke-order and stroke-direction independent handwriting recognition for multi-character handwriting input. In particular, real-time, stroke-order and stroke-direction independent handwriting recognition is provided for multi-character, or sentence level Chinese handwriting recognition. User interfaces for providing the handwriting input functionality are also disclosed.

A method and an apparatus are provided for providing a layout based on a handwriting input. A first input is received from a user. The first input includes handwriting data. A layout is created based on the handwriting data. A second input is received from the user. Content of the second input is arranged in the created layout.