Glyph accessibility techniques are described as implemented by a digital content processing system involving accessing glyphs and glyph alternatives. These techniques include preprocessing techniques in which a base font is used to determine similarity of glyphs within the base font to each other. Glyph metadata that describes this similarity is cached in a storage device and used during runtime to increase efficiency in locating similar glyphs in other fonts.

An information processing method includes displaying a graph on a display screen of a display, in response to a user operation of specifying at least part of the graph, displaying an icon corresponding to a numerical value which is associated with the at least part of the graph on the display screen, in response to a user operation of selecting the icon, as at least part of a mathematical expression to execute calculation using the numerical value which is associated with the icon selected, displaying the numerical value or a variable indicating the numerical value which is associated with the icon on the display screen.

An information processing method includes displaying a graph on a display screen of a display, in response to a user operation of specifying at least part of the graph, displaying an icon corresponding to a numerical value which is associated with the at least part of the graph on the display screen, in response to a user operation of selecting the icon, as at least part of a mathematical expression to execute calculation using the numerical value which is associated with the icon selected, displaying the numerical value or a variable indicating the numerical value which is associated with the icon on the display screen.

A computer-implemented method according to one embodiment includes identifying a textual document, determining a chemical reaction within the textual document, extracting a plurality of chemical terms from the chemical reaction, creating an annotation for the chemical reaction, utilizing the plurality of chemical terms, and storing a representation of the annotation for the chemical reaction.

A computer-implemented method according to one embodiment includes identifying a textual document, determining a chemical reaction within the textual document, extracting a plurality of chemical terms from the chemical reaction, creating an annotation for the chemical reaction, utilizing the plurality of chemical terms, and storing a representation of the annotation for the chemical reaction.

Methods, systems, and computer programs are presented for formatting raw text. One method includes an operation for accessing raw text comprising words corresponding to one or more sentences. The raw text is lowercase text without any punctuation. Further, the method includes operations for creating a plurality of sub-words corresponding to the raw text, and for generating, by a machine-learning (ML) model, an output for each sub-word based on the created sub-words. The output for each sub-word indicates a formatting operation for the corresponding sub-word. The method further includes an operation for generating, based on the formatting operations in the outputs for the sub-words, formatted text corresponding to the raw text. The formatted text is text with correct grammar, proper punctuation, and proper capitalization according to a meaning of words spoken by a speaker associated with the raw text.

A method of creating a mathematical or scientific expression on a computer system in which a user interface is provided on a computer display device. Input data comprising a string of alphanumeric characters is received from a keyboard. The input data is matched with one or more verbalisations of a mathematical or scientific term. The or each matching term is displayed on the display device. When a user selects one of the displayed matching terms a corresponding graphical symbol is displayed on the display device. The method allows the user to type a verbalised version of the desired mathematical or scientific expression and to have the corresponding mathematical or scientific notation displayed on the display device.

A method of creating a mathematical or scientific expression on a computer system in which a user interface is provided on a computer display device. Input data comprising a string of alphanumeric characters is received from a keyboard. The input data is matched with one or more verbalisations of a mathematical or scientific term. The or each matching term is displayed on the display device. When a user selects one of the displayed matching terms a corresponding graphical symbol is displayed on the display device. The method allows the user to type a verbalised version of the desired mathematical or scientific expression and to have the corresponding mathematical or scientific notation displayed on the display device.

Aspects of the present disclosure relate to grounded multimodal agent interactions, where a user input is processed using a multimodal machine learning model to generate model output. The model output may then be processed to affect the behavior of an application, for example to enable a user to control the application and/or to facilitate user interactions with a conversational agent, among other examples. In some instances, at least a part of the model output may be executed or parsed, for example to call an application programming interface or function of the application. Thus, use of a multimodal machine learning model according to aspects described herein may enable the use of user-provided natural language input to affect the behavior of an application accordingly.

Disclosed is an information added document preparation device including: a selection unit configured to select an addition format to be used when predetermined additional information is added to an original document; and an information adding unit configured to prepare a document in which the predetermined additional information is added to the original document in the addition format selected by the selection unit, wherein the selection unit selects the addition format in which the document prepared by the information adding unit satisfies a predetermined layout condition, among a plurality of addition formats which are previously prepared.