Methods and apparatus of a smart electronic health records platform for veterinarians and human providers are disclosed. The platform integrates clinical IT systems with patient tracking whiteboards, billing processes and artificial intelligence software to increase efficiency of the patient treatment process. By aggregating many services into one platform, interaction and communication between clinics and patients will be enhanced and streamlined.

Systems and methods are provided for performing operations including: receiving, by a messaging application, input that selects an option to generate a message using an avatar with a caption; presenting, by the messaging application, the avatar and a caption entry region proximate to the avatar; populating, by the messaging application, the caption entry region with a text string comprising one or more words; determining, by the messaging application, context based on the one or more words in the text string; and modifying, by the messaging application, an expression of the avatar based on the determined context.

Systems and methods are provided for performing operations including: receiving, by a messaging application, input that selects an option to generate a message using an avatar with a caption; presenting, by the messaging application, the avatar and a caption entry region proximate to the avatar; populating, by the messaging application, the caption entry region with a text string comprising one or more words; determining, by the messaging application, context based on the one or more words in the text string; and modifying, by the messaging application, an expression of the avatar based on the determined context.

There is provided a method and system for training and using a transformer language model (TLM) part of a recommendation engine. Natural language discussions about a category of items are received, the discussions comprising tags each indicative of a respective item belonging to the category of item. Information is received for each respective item. Based on the natural language discussions, the tags and the information about the respective item, the TLM is trained to: upon receipt of a user input, determine whether a given item should be recommended based on the user input, if the given item should be recommended, retrieving given information about the given item and generating a response to the user input, the response to the user input comprising the given item to be recommended and the given information, and output the response to the user input. The response is generated in natural language format.

A method and system for detecting, segmenting, and extracting salient regions in documents by using attention tracking sensors is provided. The method includes: receiving an image that corresponds to a document; receiving, from a sensor, a sequence of measurements that correspond to a human reading of the document; determining, based on the sequence of measurements, at least one region of the document as being a salient document region; demarcating the salient document region in an electronically displayable manner; and outputting a file that includes a displayable version of the document with the demarcated document region. The salient document region may include a title, a section header, and/or a table. The sensor may be an eye-tracking sensor that detects a sequence of eye-gaze positions on the document as a function of time.

Text is intelligently annotated by first creating a topic map summarizing topics of interest of the user. A data structure is created. The topic map is used to create two linked user dictionaries, a topic dictionary reflecting topic names and a traversal dictionary reflecting the knowledge structure of a topic. Actions may be linked with topic types. When the text to be annotated is being read, the topic data structure of the topics found in the text are automatically instantiated using the dictionaries and any actions previously linked to topic types. Instantiated topic data structures are automatically attached to the text being annotated. A user GUI may be created to allow the user to access and interact with the text annotations.

Text is intelligently annotated by first creating a topic map summarizing topics of interest of the user. A data structure is created. The topic map is used to create two linked user dictionaries, a topic dictionary reflecting topic names and a traversal dictionary reflecting the knowledge structure of a topic. Actions may be linked with topic types. When the text to be annotated is being read, the topic data structure of the topics found in the text are automatically instantiated using the dictionaries and any actions previously linked to topic types. Instantiated topic data structures are automatically attached to the text being annotated. A user GUI may be created to allow the user to access and interact with the text annotations.

Systems, devices, and methods discussed herein provide improved autonomous agent applications that are configured to provide explanations in response to user-submitted questions. Training data comprising a question, and an explanation pair may be accessed. A discourse tree and an explanation chain can be constructed from the explanation. The explanation chain may identify logical relationships between two entities of elementary discourse units identified from the discourse tree. A query may be submitted for the two entities, and a set of search results can be mined to identify text linking the two entities. An additional discourse tree can be generated from the text of a search result. The additional discourse tree can be combined with the original discourse tree to generate a complete discourse tree. A model may be trained using this augmented data (e.g., the complete discourse tree) to improve the quality of explanations provided by the autonomous agent application.

Systems, devices, and methods discussed herein provide improved autonomous agent applications that are configured to provide explanations in response to user-submitted questions. Training data comprising a question, and an explanation pair may be accessed. A discourse tree and an explanation chain can be constructed from the explanation. The explanation chain may identify logical relationships between two entities of elementary discourse units identified from the discourse tree. A query may be submitted for the two entities, and a set of search results can be mined to identify text linking the two entities. An additional discourse tree can be generated from the text of a search result. The additional discourse tree can be combined with the original discourse tree to generate a complete discourse tree. A model may be trained using this augmented data (e.g., the complete discourse tree) to improve the quality of explanations provided by the autonomous agent application.

A mechanism is provided in a data processing system to implement a cognitive natural language processing (NLP) system with descriptor uniqueness identification to support named entity mention clustering. The mechanism annotates a set of documents from a corpus of documents for entity types and mentions, collects descriptor usages from all documents in the corpus of documents, analyzes the descriptor usages to classify the descriptors as base terms or modifier terms, generates compatibility scores for the descriptors, and performs entity merging of entity clusters based on the compatibility scores.