Systems and methods for handling dual modality communication between at least one user device and at least one server. The modalities comprise audio modalities and mechanical motion modalities. The server may be simultaneously connected to the user device via a data network and a voice network and simultaneously receive audio-based input and mechanical motion-based input.

Techniques for joining a device of a third user to a communication between a device of a first user and a device of a second user are described herein. For instance, two or more users may utilize respective computing devices to engage in a telephone call, a video call, an instant-messaging session, or any other type of communication in which the users communicate with each other audibly and/or visually. In some instances, a first user of the two users may issue a voice command requesting to join a device of a third user to the communication. One or more computing devices may recognize this voice command and may attempt to join a device of a third user to the communication.

A computing system identifies an incoming voice call from a user device to an agent device associated with the computing system. The computing system generates a transcription of the incoming voice call using one or more natural language processing techniques. The computing system extracts a problem description from the transcription. The problem description indicates a topic for the incoming voice call. A first machine learning model estimates a situation vector from the problem description. A second machine learning model identifies a pre-existing situation vector that closely matches the estimated situation vector. The computing system retrieves a situation description that corresponds to the identified pre-existing situation vector.

A method includes connecting a call from a client device to a destination having an interactive voice response service; transcribing audio from the destination during the call to identify menu options of the interactive voice response service; generating visualizations representing the menu options; and outputting the visualizations to a display associated with the client device. A system includes a telephony system, an automatic speech recognition processing tool, and a visualization output generation tool. The telephony system connects a call from a client device to a destination having an interactive voice response service. The automatic speech recognition processing tool transcribes audio from the destination during the call to identify menu options of the interactive voice response service. The visualization output generation tool generates visualizations representing the menu options. The telephony system outputs the visualizations to a display associated with the client device.

A system and method for use with an assisted user's communication device that includes a display. The method includes providing a user communication device including a processor that is programmed to perform the step of, upon disconnection of an emergency call to a hearing user in which a captioning service has provided text transcription of voice messages from the hearing user, maintaining a link to the captioning service for a predetermined period of time. The processor also is programmed to perform the step of recognizing the call as an emergency call upon placement of the call, and the captioning service is automatically initiated upon the processor performing that recognition.

In general, the subject matter described in this specification can be embodied in methods, systems, and program products for providing search results automatically to a user of a computing device. A spoken input provided by a user to a computing device is received. The spoken input is transmitted to a computer server system that is remote from the computing device. Search result information that is responsive to the spoken input is receiving by the computing device and in response to the transmitted spoken input. An alert is provided to the user that the device will connect the user to a target of the search result information if the user does not intervene to stop the connecting of the user. The user is connected to the target of the search result information based on a determination that the user has not intervened to stop the connecting of the user.

A communication system includes a communication control section including a first control section configured to broadcast utterance voice data received from one of mobile communication terminals to other mobile communication terminals and a second control section configured to chronologically accumulate a result of utterance voice recognition from voice recognition processing on the received utterance voice data as a user-to-user communication history and to control text delivery such that the communication history is displayed on the mobile communication terminals in synchronization; and a utterance voice evaluation section configured to perform voice quality evaluation processing on the received utterance voice data and to output a result of voice quality evaluation. The communication control section is configured to control text delivery such that the result of voice recognition based on the utterance voice and the result of voice quality evaluation are displayed on the user terminals.

An interactive control system includes: an active pen; and an electronic device configured to wirelessly control the active pen, receive a user command, and generate a control command according to the user command, wherein at least one of the active pen and the electronic device is configured to execute a control function according to the control command.

The present invention makes it possible to efficiently create an appropriate dialogue history. This device for supporting creation of dialogue history (1) is provided with: a dialogue utterance focus point information store (19) which, according to utterance data indicating utterances, stores dialogue scene data indicating dialogue scenes of the utterances, utterance type indicating the types of the utterances, and utterance focus point information of the utterances; and an input/output interface (20) which, with respect to each of the dialogue scenes indicated by the dialogue scene data stored in the dialogue utterance focus point information store (19), causes a display device to display any one or more of utterances, utterance type, and utterance focus point information. Based on an operation input to the input/output interface (20), the dialogue utterance focus point information store (19) adds, modifies, or deletes any one or more of the dialogue scene data, the utterance type, and the utterance focus point information.

According to certain embodiments, an electronic device comprises: first housing; a first substrate disposed in the first housing; a second housing; a second substrate disposed in the second housing; a flexible printed circuit board (FPCB) connecting the first substrate and the second substrate; a hinge hingably connecting the first housing and the second housing; a hinge cover covering the hinge, the hinge cover having a microphone hole formed therein; at least one first microphone disposed in the first housing; a speaker disposed in the second housing; and at least one second microphone disposed in the hinge, and configured to collect external sound through the microphone hole formed in the hinge cover, and mounted on a portion extending from the FPCB.