Automatically mapping and combining the application of machine learning models to answer queries according to semantic specification. A query is parsed to extract keywords from the query and to contextualize the query. Based on the keywords, machine learning models are selected that process concepts associated with the keywords. The machine learning models are sorted according to the contextualization of the query. The machine learning models are run on multimodal data according to a sorted order, where data resulting from an output of one of the machine learning models is used as input to another one of the machine learning models. A query result is output based on a result from running the machine learning models.

Systems and methods are described for modifying a phonetic search index based on a use frequency associated with phonetic representations of text terms included in metadata of a media item. A first phonetic representation of a text term of the metadata, pronounced as a word, may be generated. A second phonetic representation of the text term may be generated by concatenating a phonetic representation of each letter in the text term. A database may be queried to determine use frequencies of the first and second phonetic representations, one of which may be selected based on a comparison of the use frequencies. A phonetic search index may be modified by including an entry for the selected phonetic representation. A voice query related to the media item may be received, and a reply to the voice query may be generated for output by performing a lookup in the modified phonetic search index.

A text summarization system auto-generates text summarization models using a combination of neural architecture search and knowledge distillation. Given an input dataset for generating/training a text summarization model, neural architecture search is used to sample a search space to select a network architecture for the text summarization model. Knowledge distillation includes fine-tuning a language model for a given text summarization task using the input dataset, and using the fine-tuned language model as a teacher model to inform the selection of the network architecture and the training of the text summarization model. Once a text summarization model has been generated, the text summarization model can be used to generate summaries for given text.

An information processing apparatus including circuitry. The circuitry receives a question from one of a user terminal apparatus and an administrator terminal apparatus. The circuitry performs determination as to whether the question is transmitted from the user terminal apparatus or transmitted from the administrator terminal apparatus. The circuitry searches for one or more answers including a word included in the question. The circuitry calculates a weighting of each of the one or more answers. When the determination result indicates that the question is transmitted from the user terminal apparatus, the circuitry transmits an answer having a weighting satisfying a predetermined threshold value of the weighting to the user terminal apparatus. When the determination result indicates the question is transmitted from the administrator terminal apparatus, the circuitry generates screen information of a screen for editing at least one of one or more answers.

The invention provides, in some aspects, a system for digital content retrieval and generation that includes a digital data processing system and one or more content management systems executing on the digital data processing system. Each content management system comprises, for each of a plurality of digital assets, (i) an identifier of the respective digital asset and (ii) one or more associated tags that characterize that asset, An ontology manager executing on the digital data processing system represents one or more ontologies of different respective knowledge domains. Each of those representations includes (i) plural content facets, each of which corresponds to one or more tags of the content management system, and (ii) one or more dialog facets, each associated with one or more content facets and each including a dialog segment expandable using those associated content facets, A plurality of chat bots execute on the digital data processing system. Each of those chat bots is configured to drive at least a portion of a conversation with a user through a human machine interface using dialog segments from one or more of the ontologies as expanded with content facets associated with the dialog facets in which those segments are included. The digital data processing system transmits to the user digital assets identified through the conversation.

Provided is an information search system that enables a searcher to efficiently find information they want to know, the system including: a database (12) that stores a plurality of pieces of information that are text-searchable; a query sentence acceptance unit (26) that accepts a query sentence in a natural language format; an inputted search keyword extractor (44) that extracts an inputted search keyword from the query sentence; a retrieval executor (40) that executes retrieval processing from the database using the inputted search keyword, along with a keyword relevant to the inputted search keyword; and a keyword dictionary (30) in which words associated with categories are registered, wherein the retrieval executor acquires, from the keyword dictionary, words associated with one of the categories selected by a searcher, re-sorts information retrieved as a result of the retrieval processing, based on the acquired words, and displays the information to the searcher.

Provided is an information search system by which high-speed search is possible commonly used across a plurality of districts, the system including: a database (12) that stores a plurality of pieces of information that are text-searchable; a query sentence acceptance unit (26) that accepts a query sentence; an inputted search keyword extractor (44) that extracts an inputted search keyword from the query sentence; a retrieval executor (40) that executes retrieval processing from the database using the inputted search keyword; a local management apparatus (100) that stores district material in a local database (104); and an information management apparatus (110) that executes character extraction processing on the material stored in the local database and converts a file format of the material according to a size thereof, stores the material in a temporary memory as stored material, and outputs the stored material to the database.

In one embodiment, a method includes receiving at a head-mounted device a speech input from a user and a visual input captured by cameras of the head-mounted device, wherein the visual input comprises subjects and attributes associated with the subjects, and wherein the speech input comprises a co-reference to one or more of the subjects, resolving entities corresponding to the subjects associated with the co-reference based on the attributes and the co-reference, and presenting a communication content responsive to the speech input and the visual input at the head-mounted device, wherein the communication content comprises information associated with executing results of tasks corresponding to the resolved entities.

The disclosed subject matter relates to a system and method for providing an automated assistant that retrieves information from a knowledge base in response to a user's natural language question. A user's natural language question voice is transformed into an intermediate representation. From the intermediate representation, a cypher query is generated which may be used to query the database. The query results are provided in response to the user. The transformation into the intermediate representation is database independent while the cypher query is dependent upon the database queried.

Systems and methods to implement commands based on selection sequences to a user interface are disclosed. Exemplary implementations may: store, electronic storage, a library of terms utterable by users that facilitate implementation of intended results; obtain audio information representing sounds captured by a client computing platform; detect the spoken terms uttered by the user present within the audio information; determine whether the spoken terms detected are included in the library of terms; responsive to determination that the spoken terms are not included in the library of terms, effectuate presentation of an error message via the user interface; record a selection sequence that the user performs subsequent to the presentation of the error message that causes a result; correlate the selection sequence with the spoken terms based on the selection sequence recorded subsequent to error message to generate correlation; and store the correlation to the electronic storage.