A telephone system is described herein, wherein the telephone system is configured to assist a hearing-impaired person with telephone communications as well as face-to-face conversations. In telephone communication sessions, the telephone system is configured to audibly emit spoken utterances while simultaneously depicting a transcription of the spoken utterances on a display. When the telephone system is not employed in a telephone communication session, the telephone system is configured to display transcriptions of spoken utterances of people who are in proximity to the telephone system.

A system is provided that includes a first network interface for a first network type and a second network interface for a second network type that is different from the first network type. The system also includes at least one processor configured to cause the system to perform operations. The operations may include obtaining, from the first network interface, audio from a communication session with a remote device established over the first network and obtaining an indication of a communication device available to participate in the communication session and direct audio obtained from the communication session to a remote transcription system. The operations may also include directing the audio to the second network interface for transmission to the communication device, obtaining transcript data from the remote transcription system based on the audio, and directing the transcript data to the second network interface for transmission to the communication device.

Aspects of the present disclosure relate to systems and methods that aid users with hearing and/or speech impediments to have a conversation with a remote phone number without human assistance. In one aspect, an application residing on a user's device, such as a smartphone, tablet computer, laptop, etc., may be used to initiate a phone call to a recipient. Upon initiating the phone call locally, a service residing on the server may receive a request to initiate a connection to the recipient. Once the recipient answers, the user may converse with the recipient by providing text input to their local app. The text input may be transmitted to the service. The service may use a text to speech converter to translate the received text to speech that can be delivered to the recipient.

A method and system to transcribe communications the method comprising the steps of obtaining an audio message originating at a first device during a voice communication session between the first device and a second device, providing the audio message to a first speech recognition system to generate a first transcript of the audio message, directing the first transcript to the second device, in response to obtaining an indication that indicates a quality of the first transcript is below a quality threshold, using a second speech recognition system to generate a second transcript based on the audio message while continuing to provide the audio data to the first speech recognition system to generate the first transcript and, in response to occurrence of an event that indicates the second transcript is to be directed to the second device, directing the second transcript to the second device instead of directing the first transcript.

A method to transcribe communications during a voice communication session between first and second devices includes obtaining an audio message originating at the first device. Upon initiating a captioning session, the message is provided to an automated speech recognition system to generate a first caption set for at least some of the message without any captioning assistance from a call assistant. The first caption set is made available to the second device for presentation on a display screen. In response to obtaining a first indication via the second device to change the captioning process, the audio message is provided to a second speech recognition system to generate a second caption set based on at least some of the message, where a call assistant performs error corrections to generate the second caption set. The second caption set then is made available to the second device for presentation on the display screen.

A communication system and method usable to facilitate communication between a hearing user and an assisted user. In particular, the system employs a wireless portable tablet or other portable electronic computing device linked to a captioning enabled phone as a remote interface for that phone, thereby providing an assisted user with more options, more freedom, and improved usability of the system.

A method for maintaining contact information in a hearing impaired assisted user's communication device includes the steps of (a) providing a web site for altering assisted user contact information, (b) linking a proxy device to the web site, (c) receiving an identifier associated with the assisted user's device via the proxy device, (d) identifying an assisted user's device via the received identifier, (e) enabling the proxy device to be used to modify contact information for the assisted user associated with the received identifier, (f) starting a timer to time out a sync timeout period, (g) during the sync timeout period, receiving an indication via the assisted user's device confirming a desire to update the assisted user's contact information, (h) updating the assisted user's contact information, and (i) at the end of the timeout period, ceasing an indication that updated data is ready to be used from the assisted user's device.

A method to transcribe communications includes obtaining an audio message from a first device during a voice communication session with a second device including a display screen, providing the message to a first speech recognition system to generate a first message transcript, providing the transcript to the second device for presentation on the screen, obtaining an indication that a transcript quality is below a threshold, providing, in response, the message to a second system to generate a second transcript while still providing it to the first system to generate the first transcript and providing the first transcript to the second device for presentation on the display screen, and in response to an event occurring that indicates the second transcript is to be provided to the second device instead of the first transcript, providing the second transcript to the second device for presentation on the screen instead of the first transcript.

A method and apparatus that filters audio data received from a speaking person that includes a specific filter for that speaker. The audio characteristics of the speaker's voice may be collected and the specific filter may be formed to reduce noise while also enhancing voice quality. For instance, if a speaker's voice does not contain specific frequencies, then a filter may cancel the noise at such frequencies to ease noise cancellation and reduce processing sound spectrum for cleaning that is not needed. Additionally, the strength frequencies of a speaker's voice may be identified from the collected audio characteristics and those spectrums can be filtered with finer granularity to provide a speaker specific filter that enhances the voice quality of the speaker's voice data that is transmitted or output by a communication device. The audio data may also be output based upon a user's predefined hearing spectrum.

A hearing user's device for communicating with a hearing impaired assisted user using an assisted user's device that includes a speaker and a display screen for broadcasting a hearing user's voice signal and presenting captioned text associated with the hearing user's voice signal to the assisted user, respectively, the hearing user's device comprising a microphone for receiving the hearing user's voice signal as spoken by the hearing user, a display screen and a processor linked to the microphone and the display screen, the processor transmitting the hearing user's voice signal to the assisted users device, the processor presenting a quality indication of the captioned text presented to the assisted user via the assisted users device for consideration by the hearing user.