The information processing apparatus according to the present disclosure synthesizes a handwriting image with a noise image to generate a synthesized image, generates a correct label indicative of handwriting pixels from the handwriting image, and applies the synthesized image and the correct label as learning data to generate a learning model.

Systems and methods for performing spatial line grouping on digital ink stokes. The system includes an electronic processor configured to access a set of hypothetical lines in an electronic document and determine a set of hypothetical line pairings. The electronic processor is also configured to determine, via a gradient boosting tree model, a merge confidence score for each hypothetical line pairing and compare a first merge confidence score with a merge threshold. The first merge confidence score is associated with a first hypothetical line and a first neighboring hypothetical line. The electronic processor is also configured to, in response to the first merge confidence score satisfying the merge threshold, merge the first hypothetical line and the first neighboring hypothetical line to form a first line grouping. The electronic processor is also configured to perform a digital ink stroke analysis on the electronic document based on the first line grouping.

A computer system is provided that includes one or more processors configured to receive user input for inked content to a digital canvas, and process the inked content to determine one or more writing regions. Each writing region includes recognized text and one or more document layout features associated with that writing region. The one or more processors are further configured to tokenize a target writing region of the one or more writing regions into a sequence of tokens, process the sequence of tokens of the target writing region using task extraction subsystem that operates on tokens representing both the recognized text and the one or more document layout features of the target writing region, segment the target writing region into one or more sentence segments, and classify each of the one or more sentence segments as a task sentence or a non-task sentence.

Systems and methods for performing spatial line grouping on digital ink stokes. The system includes an electronic processor configured to access a set of hypothetical lines in an electronic document and determine a set of hypothetical line pairings. The electronic processor is also configured to determine, via a gradient boosting tree model, a merge confidence score for each hypothetical line pairing and compare a first merge confidence score with a merge threshold. The first merge confidence score is associated with a first hypothetical line and a first neighboring hypothetical line. The electronic processor is also configured to, in response to the first merge confidence score satisfying the merge threshold, merge the first hypothetical line and the first neighboring hypothetical line to form a first line grouping. The electronic processor is also configured to perform a digital ink stroke analysis on the electronic document based on the first line grouping.

Provided are methods and system for recognizing characters such as mathematical expressions or chemical formulas. An example method comprises the steps of receiving and processing an image by a pre-processing module to obtain one or more candidate regions, extracting features of each of the candidate regions by a feature extracting module such as a convolutional neural network (CNN), encoding the features into a distributive representation for each of the candidate regions separately using an encoding module such as a first long short-term memory (LSTM) based neural network, decoding the distributive representation into output representations using a decoding module such as a second LSTM-based recurrent neural network, and combining the output representations into an output expression, which is outputted in a computer-readable format or a markup language.

A computer-implemented method of obtaining form data can include selecting a control from within an electronic form, determining a textual representation of the control, and sending the textual representation of the control as part of a message to a client messaging system through a real-time communication system. A response message from the client messaging system can be received through the real-time communication system. Form data specified by the response message can be stored within memory when the form data is valid, as specified according to the electronic form.

An information processing apparatus and a control method capable of properly grasping the character size and drawing position for free-size or free-position handwriting input are provided. The information processing apparatus includes an input unit capable of detecting handwriting input, a display unit capable of displaying a trajectory of the handwriting input, a display control unit configured to display a trajectory of the handwriting input detected by the input unit on the display unit, a text recognition unit configured to recognize text on the basis of the handwriting input detected by the input unit, and a character size estimation unit configured to obtain a size of drawing of each character in the text, estimate a user-intended character size of the text on the basis of information about a standard height of each character, and generate information indicating the character size and a drawing position.

Examples herein disclose capturing an image of printed text and a handwritten annotation and determining a topic as related to the printed text in the captured image. The examples disclose identifying a resource based on the handwritten annotation.

To prevent an inconvenience from being generated when a user registers a graphic that the user wants to register. A graphic input device obtains registered graphic data indicating a graphic entered by a user and related information associated with the graphic, calculates similarity between the registered graphic data and one of items of graphic data registered in a dictionary, determines whether the entered graphic and a graphic indicated by the item of graphic data is similar to each other based on the calculated similarity, and, in a case where the entered graphic and the graphic indicated by the item of graphic data is not similar to each other, registers the registered graphic data and the related information in the dictionary in association with each other.

A method may include obtaining an image that includes a connected component that includes a set of pixels, calculating a representative color for the set of pixels, mapping the representative color to an application color in an application color palette of an application, and generating an electronic document that includes a revised version of the connected component in the application color.