A system and method for automated chatbot testing to provide training and quality assurance of conversational artificial intelligence systems, comprising a chatbot testing administrator interface which allows chatbot makers to define what a chatbot is supposed to do, create test scripts to test the performance of the chatbot, and review the results of the chatbot tests, a chatbot testing server which provides and interface between chatbot testing agents and the administrator interface, instantiates chatbot agents and distributes them across available hardware and runs testing programs which activate, configure, and deactivate chatbot testing agents as needed. A plurality of chatbot agents may be running in parallel to provide automated testing based upon test script configuration.

A system and method for automated chatbot testing to provide training and quality assurance of conversational artificial intelligence systems, comprising a chatbot testing administrator interface which allows chatbot makers to define what a chatbot is supposed to do, create test scripts to test the performance of the chatbot, and review the results of the chatbot tests, a chatbot testing server which provides and interface between chatbot testing agents and the administrator interface, instantiates chatbot agents and distributes them across available hardware and runs testing programs which activate, configure, and deactivate chatbot testing agents as needed. A plurality of chatbot agents may be running in parallel to provide automated testing based upon test script configuration.

Concepts and technologies are disclosed herein for communications network security for handling proxy voice calls that employ a voicebot. According to one aspect disclosed herein, a call handling system can intercept, from a communications network, a call request that is directed to a called target device. The call handling system can determine that the call request was generated by a voicebot on behalf of a user equipment. The call handling system can suspend the call request from being routed to the called target device. The call handling system can generate a voicebot confirmation request that identifies the voicebot and the user equipment. The call handling system can provide the voicebot confirmation request to the called target. The call request can be suspended while the voicebot confirmation request is provided to the called target device.

An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; identifying, based on the utterance, a task to be performed by the computational assistant; responsive to determining, by the computational assistant, that complete performance of the task will take more than a threshold amount of time, outputting, for playback by one or more speakers operably connected to the computing device, synthesized voice data that informs a user of the computing device that complete performance of the task will not be immediate; and performing, by the computational assistant, the task.

A customer service assistance system includes: storage device that stores an address of an automated response device accumulating knowledge of a provided business in the output screen; and an arithmetic device that, when an inquiry specifying the address is received from a customer terminal, checks identification information of the output screen and an inquiry sentence indicated by the inquiry against questions-and-answers information held for each output screen of the provided business in the automated response device associated with the address, estimates a question matching an intention of the inquiry out of questions in the questions-and-answers information according to whether a screen associated with each question included in the questions-and-answers information matches the output screen and a degree of similarity between a sentence of each question included in the questions-and-answers information and the inquiry sentence, and extracts an answer to the question, and returns the answer to the customer terminal.

Among other things, a developer of an interaction application for an enterprise can create items of content to be provided to an assistant platform for use in responses to requests of end-users. The developer can deploy the interaction application using defined items of content and an available general interaction model including intents and sample utterances having slots. The developer can deploy the interaction application without requiring the developer to formulate any of the intents, sample utterances, or slots of the general interaction model.

Among other things, a developer of an interaction application for an enterprise can create items of content to be provided to an assistant platform for use in responses to requests of end-users. The developer can deploy the interaction application using defined items of content and an available general interaction model including intents and sample utterances having slots. The developer can deploy the interaction application without requiring the developer to formulate any of the intents, sample utterances, or slots of the general interaction model.

Described herein is a system and method for capturing data associated with actions attempted by an automated agent. The system described herein captures data associated with the actions attempted by an automated agent during the messaging session between an automated agent and the user and present a summary of the actions in a messaging platform. In an embodiment, the automated agent uploads data associated with actions attempted during the messaging session to a server. The server captures the data associated with the actions and generates a description of each action that was attempted. The server generates a summary including the description of each action. The summary of the actions are rendered in the messaging platform.

The present invention relates to communications methods and apparatus for determining whether a received call originated from an artificial intelligence system and the call handling procedures to be used on the received call based on whether or not the call was determined to have been originated from an artificial intelligence system. An exemplary method embodiment includes the steps of: receiving a first call; determining whether said first call originated from an artificial intelligence system; and when said first call is determined to have originated from an artificial intelligence system performing one or more artificial intelligence call handling operations.

An example operation may include one or more of transferring a copy of a plurality of revised translation data sets to be added to a software application into a grid structure, each revised translation data set comprising a prompt name in a first field, an interactive voice response (IVR) prompt in a second field, a translation of the IVR prompt into a different language in a third field, and a timestamp in a fourth field, identifying two revised translation data sets in the grid structure that comprise a duplicate prompt names in first fields thereof, deleting an oldest revised translation data set among the two identified translations data sets from the grid structure which has an oldest timestamp, and storing the grid structure without the deleted oldest revised translation data set in a repository.