A method includes obtaining first training data having multiple first linguistic samples. The method also includes generating second training data using the first training data and multiple symmetries. The symmetries identify how to modify the first linguistic samples while maintaining structural invariants within the first linguistic samples, and the second training data has multiple second linguistic samples. The method further includes training a machine learning model using at least the second training data. At least some of the second linguistic samples in the second training data are selected during the training based on a likelihood of being misclassified by the machine learning model.

A method includes obtaining first training data having multiple first linguistic samples. The method also includes generating second training data using the first training data and multiple symmetries. The symmetries identify how to modify the first linguistic samples while maintaining structural invariants within the first linguistic samples, and the second training data has multiple second linguistic samples. The method further includes training a machine learning model using at least the second training data. At least some of the second linguistic samples in the second training data are selected during the training based on a likelihood of being misclassified by the machine learning model.

A system comprises a communications module; at least one processor coupled with the communications module; and a memory coupled to the at least one processor and storing processor-executable instructions which, when executed by the at least one processor, configure the at least one processor to provide, via the communications module, a first encryption key of an encryption key pair to a client device; receive, via the communications module and from a conversation agent server, a fulfillment request based on a natural language input transmitted from the client device to the conversation agent server; determine that the fulfillment request includes a request for personal data; obtain the requested personal data; encrypt the personal data with a second encryption key of the encryption key pair; and provide, via the communications module and to the conversation agent server, the encrypted personal data for transmission to the client device.

A system comprises a communications module; at least one processor coupled with the communications module; and a memory coupled to the at least one processor and storing processor-executable instructions which, when executed by the at least one processor, configure the at least one processor to provide, via the communications module, a first encryption key of an encryption key pair to a client device; receive, via the communications module and from a conversation agent server, a fulfillment request based on a natural language input transmitted from the client device to the conversation agent server; determine that the fulfillment request includes a request for personal data; obtain the requested personal data; encrypt the personal data with a second encryption key of the encryption key pair; and provide, via the communications module and to the conversation agent server, the encrypted personal data for transmission to the client device.

A system and method for upgrading an executable chatbot is disclosed. The system may include a processor including a fallout utterance analyzer, a response identifier, a deviation identifier, a flow generator and enhancer. The fallout utterance analyzer may receive chats logs comprising a plurality of utterances and corresponding bot responses. The fallout utterance analyzer may classify the plurality of utterances into multiple buckets pertaining to at least one of an out-of-scope intent, a newly identified intent, and a new variation of an existing intent. The response identifier may generate auto-generated responses corresponding to new intents for upgrading the executable chatbot. The deviation identifier may overlay corresponding intent in the chat logs with the prestored flow dialog network to designate an extent of deviation with respect to flow prediction performance by the executable chatbot. The flow generator and enhancer may generate an auto-generated conversational dialog flow for upgrading the executable chatbot.

Techniques for using a federated learning framework to update machine learning models for spoken language understanding (SLU) system are described. The system determines which labeled data is needed to update the models based on the models generating an undesired response to an input. The system identifies users to solicit labeled data from, and sends a request to a user device to speak an input. The device generates labeled data using the spoken input, and updates the on-device models using the spoken input and the labeled data. The updated model data is provided to the system to enable the system to update the system-level (global) models.

To enable provision of appropriate information for a user query even in a case there are multiple information provision modules which are different in answer generation processing. A query sending unit 212 sends a user query to each one of a plurality of information provision module units 220 that are different in the answer generation processing and that each generate an answer candidate for the user query. An output control unit 214 performs control such that the answer candidate acquired from each one of the plurality of information provision module units 220 is displayed on a display unit 300 on a per-agent basis with information on an agent associated with that information provision module unit 220.

To enable provision of appropriate information for a user query even in a case there are multiple information provision modules which are different in answer generation processing. A query sending unit 212 sends a user query to each one of a plurality of information provision module units 220 that are different in the answer generation processing and that each generate an answer candidate for the user query. An output control unit 214 performs control such that the answer candidate acquired from each one of the plurality of information provision module units 220 is displayed on a display unit 300 on a per-agent basis with information on an agent associated with that information provision module unit 220.

Embodiments are directed to organizing conversation information. Two or more machine learning (ML) models and a plurality of sentences provided from a conversation may be employed to generate insight scores for each sentence such that each insight score correlates to a probability that its sentence includes one or more of an action or a question. In response to one or more sentences having insight scores that exceed a threshold value an information score and a definiteness score may be determined for the one or more sentences. And one or more insights associated with the conversation may be generated based on the one or more sentences. A report may be generated that associates the one or more insights with one or more portions of the conversation that include the one or more sentences that are associated with the insights.

Embodiments are directed to organizing conversation information. Two or more machine learning (ML) models and a plurality of sentences provided from a conversation may be employed to generate insight scores for each sentence such that each insight score correlates to a probability that its sentence includes one or more of an action or a question. In response to one or more sentences having insight scores that exceed a threshold value an information score and a definiteness score may be determined for the one or more sentences. And one or more insights associated with the conversation may be generated based on the one or more sentences. A report may be generated that associates the one or more insights with one or more portions of the conversation that include the one or more sentences that are associated with the insights.