Aspects of the present disclosure relate to systems and methods that aid users with hearing and/or speech impediments to have a conversation with a remote phone number without human assistance. In one aspect, an application residing on a user's device, such as a smartphone, tablet computer, laptop, etc., may be used to initiate a phone call to a recipient. Upon initiating the phone call locally, a service residing on the server may receive a request to initiate a connection to the recipient. Once the recipient answers, the user may converse with the recipient by providing text input to their local app. The text input may be transmitted to the service. The service may use a text to speech converter to translate the received text to speech that can be delivered to the recipient.

Implementations are directed to using an assistant to initiate automated telephone calls with entities. Some implementations identify an item of interest, identify a group of entities associated with the item, and initiate the calls with the entities. During a given call with a given entity, the assistant can request a status update regarding the item, and determine a temporal delay before initiating another call with the given entity to request a further status update regarding the item based on information received responsive to the request. Other implementations receive a request to perform an action on behalf of a user, identify a group of entities that can perform the action, and initiate a given call with a given entity. During the given call, the assistant can initiate an additional call with an additional entity, and generate notification(s), for the user, based on result(s) of the given call and/or the additional call.

Aspects of the disclosure relate to apparatus and methods of event scheduling and notification. According to one aspect, a method, operational at a server, may include determining that a prescheduled event is concluded, sending a first notification message to one or more user communication addresses associated with the prescheduled event, determining if a first acknowledgement to the first notification message is received before a first predetermined period of time elapses, and sending a second notification message to the one or more user communication addresses if the first acknowledgement is not received by expiration of the first predetermined period of time. The method may further include determining if a second acknowledgment to the second notification message is received before a second predetermined period of time elapses and sending a third notification message to the communication addresses and a first alternate contact notification message to an alternate contact communication address.

According to one embodiment, a method, computer system, and computer program product for detecting and repairing gaps within a call is provided. The present invention may include requesting a personal discourse gap recovery model (PDGRM) for participants in a call, where the PDGRM may be a machine learning model that models a user's speech patterns based on word collocation, dictionary, and speaking rate. The present invention may further comprise detecting one or more gaps in the call based on network connectivity, inserting an audio delay into the call, constructing repaired dialogue to fill at least one of the one or more gaps in the call based on the PDGRM, and inserting the repaired dialogue into the call.

Systems and methods for establishing communication connections using speech, such as establishing calls between speech-controlled devices, are described. A first speech-controlled device receives a communication request in the form of audio and sends audio data corresponding to the captured audio to a server. The server performs speech processing on the audio data to determine a recipient, a subject for the call, and a device associated with the recipient. The server then sends a message indicating the communication request and audio data corresponding to the communication topic to the recipient's speech-controlled device. The recipient device outputs audio to the recipient requesting whether the recipient accepts the communication request. The recipient audibly refuses or accepts the communication request, and the recipient's speech-controlled device sends an indication of the recipient's audible decision to the server. If the recipient accepted the communication request, the server causes a communication connection be established between the two speech-controlled devices.

A system and method are presented for multi-language communication sequencing. Communication flows may support one or more languages, which may need to be created, removed, or edited. During sequence editing, prompts, data, expressions, pauses, and text-to-speech may be added. This may be done through the use of inline-selectors, which comprise a prompt or TTS, or through the use of dialogs, which may also provide error feedback. A main sequence may be capable of handling multiple languages which are supported and managed independent of each other.

At least some embodiments, a system includes a memory, and a processor configured to convert an audio stream of a speech of a customer during a customer call session into customer-originated text. The customer-originated text is displayed in a first chat interface. A request from a first call center agent is sent to a second call center agent via the first chat interface to interact with the customer during the customer call session and displayed in a second chat interface. The second agent is allowed to participate in the customer call session when the second call center agent accepts the request from the first call center agent. First agent-originated text and second agent-originated text during the customer call session is merged to form a combined agent-originated text and synthesized to computer-generated agent speech having a voice of a computer-generated agent based on the combined agent-originated text communicated to the customer over the voice channel.

Disclosed is a multi-mode communication notification system and method for improving communication between an inmate and a third party by enabling a third party to send a web-initiated contact request for a specific inmate and further allowing the inmate to check his/her contact requests or be automatically notified of contact requests. Additionally, the system electronically notifies the third party when the specific inmate has been notified of the contact request. Further, the system notifies the third party if they have missed a call from the specific inmate.

Provided are techniques for sharing confidential information with privacy using a mobile phone. A voice preference and language preferences are received for an information provider profile of an information provider, where the language preferences include a first language for typing text and a second language for speaking the text. During an on-going live phone call between the information provider and an information requester, selection of a text to talk feature is received. Text is received in the first language, where the text includes confidential information. The text is converted from the first language to text in the second language. The text in the second language is converted to a voice message that is spoken in a voice identified by the voice preference through the on-going live phone call to provide the confidential information with privacy. Then, control is returned to the on-going live phone call.

A voice recognition system includes a call connection control device that controls the call destination of a user, and a computer. The computer is configured to perform voice recognition of speech voice data of the user, determine an intention of a speech of the user based on a voice recognition result of the speech voice data, evaluate the reliability of a response generated by the computer for the user based on the determined intention of the speech of the user, and cause the call connection control device to switch the call destination of the user to an operator terminal in a case where the reliability of the response is equal to or less than a threshold value.