A system for remotely and interactively controlling visual and multimedia content displayed on and rendered by a web browser using a telephony device. In particular, the system relates to receiving a voice input (e.g., dual tone multi-frequency DTMF input, spoken input, etc.) from a telephony device (e.g., a landline, a cellular telephone, or other system with telephone functionality, etc.) via a wide-area network to an intermediary computer that is configured to control the rendering of one or more web pages (or other web data) by a standard web browser.

A system and method for automated chatbot testing to provide training and quality assurance of conversational artificial intelligence systems, comprising a chatbot testing administrator interface which allows chatbot makers to define what a chatbot is supposed to do, create test scripts to test the performance of the chatbot, and review the results of the chatbot tests, a chatbot testing server which provides and interface between chatbot testing agents and the administrator interface, instantiates chatbot agents and distributes them across available hardware and runs testing programs which activate, configure, and deactivate chatbot testing agents as needed. A plurality of chatbot agents may be running in parallel to provide automated testing based upon test script configuration.

A method of using voice commands from a mobile device to remotely access and control a computer. The method includes receiving audio data from the mobile device at the computer. The audio data is decoded into a command. A software program that the command was provided for is determined. At least one process is executed at the computer in response to the command. Output data is generated at the computer in response to executing at least one process at the computer. The output data is transmitted to the mobile device.

A method of building a natural language understanding application is provided. The method includes receiving at least one electronic record containing programming code and creating executable code from the programming code. Further, the executable code, when executed by a processor, causes the processor to create a parse and an interpretation of a sequence of input tokens, the programming code includes an interpret-block and the interpret-block includes an interpret-statement. Additionally, the interpret-statement includes a pattern expression and the interpret-statement includes an action statement.

A method for interpreting messages, user-defined alert conditions, voice commands and performing an action in response is described. A method for annotating media content is described. A method for presenting additional content associated with media content identified based on a fingerprint is described. A method for identifying that an advertisement portion of media content is being played based on a fingerprint derived from the media content is described. A method of one media device recording particular media content automatically in response to another media device recording the particular media content is described. A method of concurrently playing media content on multiple devices is described. A method of publishing information associated with recording of media content is described. A method of deriving fingerprints by media devices that meet an idleness criteria is described. A method of loading, modifying, and displaying a high definition frame from a frame buffer is described. A method of recording or playing media content identified based on fingerprints is described.

A method and system are disclosed herein for accepting multimodal inputs and deriving synchronized and processed information. A reusable multimodal application is provided on the mobile device. A user transmits a multimodal command to the multimodal platform via the mobile network. The one or more modes of communication that are inputted are transmitted to the multimodal platform(s) via the mobile network(s) and thereafter synchronized and processed at the multimodal platform. The synchronized and processed information is transmitted to the multimodal application. If required, the user verifies and appropriately modifies the synchronized and processed information. The verified and modified information are transferred from the multimodal application to the visual application. The final result(s) are derived by inputting the verified and modified results into the visual application.

Systems and methods are provided for creating a cinematic storytelling experience. A user selection of a story is received from a client device. User input to initiate verbal recitation of the selected story is received. Correspondence between the verbal recitation and at least one keyword is detected, and the at least one corresponding action is performed.

A system and method for automated customer response system mapping and duplication to provide for a common Interactive Voice Response (“IVR”) system import language or structure, comprising a contact center crawler which connects with an existing automated contact center system, may navigate and map that system by recording and selecting each available option or by interfacing with the code that makes up the IVR itself to generate a model, records the response to each selected option, and feeds the options and responses to a tree creator; a CX model generator which organizes the options and responses into a data map such as a tree or more graph-like or map-like structure, where logical conditions or operations such as loops and recursion may be present; and a coding engine that generates programmatic code representing the data model that is imported into another IVR platform for execution.

A system and method for chatbot and search engine integration comprising chatbot crawler engine configured to detect all possible paths through a conversational flow between a chatbot and a user, and also comprising a chatbot search integration manager configured to receive a processed conversation flow from the chatbot crawler engine, parse the conversation flow to identify keywords and features, and build an indexable data structure which can be integrated into search engines in order to expose the information and data contained within the chatbot's knowledge base. This integration may allow search engine users to be redirected to a website hosting the chatbot when an indexed data structure comprises information relevant to a search engine query.

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a dialog system using user feedback. According to one implementation, a method includes receiving, by a dialog engine and from a computing device, a voice input; determining, by the dialog engine, that the received voice input is classified as feedback to an answer of a question; identifying, by the dialog engine, a predetermined feedback score associated with the feedback; and adjusting a confidence score associated with the question and the answer based on the predetermined feedback score.