CAPTIONED TELEPHONE SERVICE SYSTEM FOR DETECTING AND ALERTING PEERS RETURN TO CALL

Abstract

A captioned telephone service (CTS) system provides a CTS system which includes a CTS server, a user device, and a user application where the CTS system provides a call resumption alert module to the user such that the call resumption alert module sends an alert to the user to assist the user in re-engaging with the phone call when the call has resumed from the peer device after being on hold. The call resumption alert module provides a timer mode, any text mode, and specific text mode, of which the user can select one or more modes. Alternatively, the call resumption alert module may include a call resumption checking module and an alert module. The call resumption checking module checks whether the phone call resumed from the peer device, and the alert module generates an alert upon receiving a call resumption message from the call resumption checking module.

Claims

1. A captioned telephone service (CTS) system, comprising: a CTS server for providing a transcription service to a user during a phone call between the user and a peer; a user device, which is constructed to be connected to the CTS server for the phone call between the user device and a peer device; and a user application installed on the user device, wherein the CTS server is connected to a call agent or an automatic speech recognition engine for the phone call to provide the transcription service, wherein the CTS system is configured to provide a call resumption alert module to the user such that the call resumption alert module sends an alert to the user to assist the user in re-engaging with the phone call, wherein the user application is configured for the user to enable or disable the call resumption alert module.

2. The CTS system of claim 1, wherein the call resumption alert module is configured to provide a timer mode, any text mode, and specific text mode, wherein under the timer mode, the user is allowed to select a time period after which the call resumption alert module sends the alert to the user, wherein under the any text mode, the call resumption alert module sends the alert to the user when the user application receives any text which is transcribed from a voice of the peer device, wherein under the specific text mode, the call resumption alert module sends the alert to the user when the user application receives a certain text, which is transcribed from the voice of the peer device, wherein the certain text matches one of expected texts listed in a stored database.

3. The CTS system of claim 2, wherein the call resumption alert module is configured to allow the user to select the timer mode together with either the any text mode or the specific text mode in which case the call resumption alert module sends the alert to the user when conditions for both modes are satisfied.

4. The CTS system of claim 2, wherein the call resumption alert module is configured to allow the user to select the timer mode together with either the any text mode or the specific text mode in which case the call resumption alert module sends the alert to the user when a condition for one of the two selected modes is satisfied.

5. The CTS system of claim 2, wherein the CTS system allows the user to add words, phrases, or sentences to the list of expected texts stored in the database.

6. The CTS system of claim 1, wherein the alert includes beeping from the user device, flashing of the user device's display or light, vibration of the user device, or haptic feedback from the user device.

7. The CTS system of claim 1, wherein the call resumption alert module is configured to send the alert to a connected device which is connected to the user device, and wherein the call resumption alert module is configured to send the alert to the user device, the connected device, or both.

8. The CTS system of claim 1, wherein the call resumption alert module is configured to detect a Dual Tone Multi-Frequency (DTMF) signal originating from the peer device, and if the DTMF signal is detected, the call resumption alert module is configured to send the alert to the user device.

9. The CTS system of claim 1, wherein the call resumption alert module is configured to send a message to the call agent to inquire whether the peer device has returned to the phone call, and if a reply from the call agent is positive, the call resumption alert module is configured to send the alert to the user.

10. A captioned telephone service (CTS) system, comprising: a CTS server for providing a transcription service to a user during a phone call between the user and a peer; a user device, which is constructed to be connected to the CTS server for the phone call between the user device and a peer device; and a user application installed on the user device, wherein the CTS server is connected to a call agent or an automatic speech recognition engine for the phone call to provide the transcription service, wherein the CTS system is configured to provide a call resumption alert module to the user such that the call resumption alert module sends an alert to the user to assist the user in re-engaging with the phone call, wherein the user application is configured for the user to enable or disable the call resumption alert module, wherein the call resumption alert module comprises: a call resumption checking module for checking whether the phone call resumed from the peer device; and an alert module for generating the alert upon receiving a call resumption message from the call resumption checking module.

11. The CTS system of claim 10, wherein the call resumption checking module sends the call resumption message to the alert module when the user application receives any text which is transcribed from a voice of the peer device.

12. The CTS system of claim 10, wherein the call resumption checking module sends the call resumption message to the alert module when the user application receives a certain text, which is transcribed from a voice of the peer device, wherein the certain text matches one of expected texts listed in a stored database.

13. The CTS system of claim 12, wherein the call resumption checking module allows the user to add words, phrases, or sentences to the list of expected texts stored in the database.

14. The CTS system of claim 12, wherein the CTS system is configured to add words, phrases, or sentences to the list of expected texts stored in the database by analyzing phone calls.

15. The CTS system of claim 10, wherein the call resumption alert module is configured to send a message to the call agent to inquire whether the peer device has returned to the phone call, and if a reply from the call agent is positive, the call resumption alert module is configured to send the call resumption message to the alert module.

16. The CTS system of claim 10, wherein the call resumption checking module sends the call resumption message to the alert module when the call resumption checking module detects a music or background music coming from the peer device, the call resumption checking module detects discontinuance of the music or background music from the peer device, and the user application receives any text which is transcribed from a voice of the peer device.

17. The CTS system of claim 10, wherein the call resumption checking module retrieves a first voice sample from the peer device before the user enables the call resumption alert module, wherein the call resumption checking module retrieves a second voice sample from the peer device after the user enables the call resumption alert module, wherein the call resumption checking module sends the call resumption message to the alert module if an analysis of the first voice sample and the second voice sample indicates that both of the two voice samples are made by the peer.

18. The CTS system of claim 10, wherein the alert includes beeping from the user device, flashing of the user device's display or light, vibration of the user device, or haptic feedback from the user device.

19. The CTS system of claim 10, wherein the call resumption alert module is configured to send the alert to a connected device which is connected to the user device, and wherein the call resumption alert module is configured to send the alert to the user device, the connected device, or both.

20. The CTS system of claim 10, wherein the call resumption checking module is configured to detect a Dual Tone Multi-Frequency (DTMF) signal originating from the peer device, and if the DTMF signal is detected, the call resumption checking module is configured to send the call resumption message to the alert module.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0014] These and other features, aspects and advantages of the present invention will become better understood with reference to the accompanying drawings, wherein:

[0015] FIG. 1 shows a schematic diagram of the CTS system according to the present invention;

[0016] FIG. 2 shows a schematic diagram of the display of the user device according to the present invention; and

[0017] FIG. 3 shows a schematic diagram to send an alert to the user via connected devices according to the present invention.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

[0018] Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings, which form a part of this disclosure. It is to be understood that this invention is not limited to the specific devices, methods, conditions or parameters described and/or shown herein, and that the terminology used herein is for the purpose of describing particular embodiments by way of example only and is not intended to be limiting of the claimed invention.

[0019] Also, as used in the specification including the appended claims, the singular forms a, an, and the include the plural, and reference to a particular numerical value includes at least that particular value, unless the context clearly dictates otherwise. Ranges may be expressed herein as from about or approximately one particular value and/or to about or approximately another particular value. When such a range is expressed, another embodiment includes from the one particular value and/or to the other particular value. Similarly, when values are expressed as approximations, by use of the antecedent about, it will be understood that the particular value forms another embodiment.

[0020] FIG. 1 shows a schematic diagram of the CTS system according to the present invention, and FIG. 2 shows a schematic diagram of the display of the user device according to the present invention. The captioned telephone service (CTS) system of the present invention includes a CTS server 500, a user device 100, and a user application 110. The CTS server 500 provides a transcription service to a user 200 during a phone call between the user 200 and a peer 400. The user device 100 is constructed to be connected to the CTS server 500 for the phone call between the user device 100 and a peer device 300 and the user application 110 is installed on the user device for the user 200 to use the transcription service. Furthermore, the CTS server 500 is connected to a call agent 600 or an automatic speech recognition (ASR) engine 700 for the phone call to provide the transcription service. A call gent 600 is an individual who transcribes the voice from the peer device 300 and sends the caption data to the user device 100 via the CTS server 500. The ASR engine 700 automatically converts the spoken language of the voice from the peer device 300 into written text of the caption data.

[0021] The phone call may be placed on hold or being transferred to another person by the peer 400, and the user 200 may have to wait until the phone call resumes. In this case, as explained above, the user 200 with hearing disability may have to wait for an extended period time and continue to watch the screen of the user device, waiting for a caption data. To address this problem, the CTS system 500 is configured to provide a call resumption alert module to the user 200 such that the call resumption alert module sends an alert to the user 200 to assist the user in re-engaging with the phone call. The user application 110 is configured for the user 200 to enable or disable the call resumption alert module. The call resumption alert module may be stored in the user device 100, the CTS server 500, or any other location through which the caption data passes, or even in multiple locations including these.

[0022] In one embodiment, the call resumption alert module is configured to provide a timer mode, any text mode, and specific text mode, of which the user 200 can select one or more modes. Under the timer mode, the user 200 is allowed to select a specific time period after which the call resumption alert module sends the alert to the user 200. Under the any text mode, the call resumption alert module sends the alert to the user 200 when the user application 110 receives any text which is transcribed from a voice of the peer device 300 by the call agent 600 or the ASR engine 700. Under the specific text mode, the call resumption alert module sends the alert to the user when the user application 110 receives a certain text, which is transcribed from the voice of the peer device 300 by the call agent 600 or the ASR engine 700, where the certain text matches one of expected texts listed in a stored database. The expected texts may include words, phrases, or sentences, and the database containing these texts may be stored in the user device 100 or the CTS server 500 or both. Exemplary expected texts include hello, thanks you, thanks for waiting, thank you for waiting, speaking, etc. Furthermore, the CTS system 500 may be configured to allow the user 200 to add words, phrases, or sentences to the list of expected texts stored in the database.

[0023] In addition, the call resumption alert module may be configured to allow the user 200 to select the timer mode together with either the any text mode or the specific text mode in which case the call resumption alert module sends the alert to the user when conditions for both modes are satisfied. For instance, when the user selected the timer mode and any text mode, the call resumption alert module sends the alert to the user if the selected time period has passed and any text is received thereafter. Alternatively, the call resumption alert module may be configured to allow the user 200 to select the timer mode together with either the any text mode or the specific text mode in which case the call resumption alert module sends the alert to the user when a condition for one of the two selected modes is satisfied. For instance, when the user selected the timer mode and any text mode, the call resumption alert module sends the alert to the user when the selected time period has passed and any text is received, whichever happens first.

[0024] The alert may be a beeping sound from the user device 200, flashing of the user device's display or light, vibration of the user device 200, haptic feedback from the user device 200, or any other means that effectively stimulates the sensory perception of the user 200. The alert may be just one means or multiple means.

[0025] FIG. 3 shows a schematic diagram to send an alert to the user via connected devices according to the present invention. The call resumption alert module may be configured to send the alert to a connected device 210 which is connected to the user device 200. Such a connected device 210 may be a smart watch, tablet computing device, smart television, virtual assistant (like Alexa (Trademark) or Google Assistance (Trademark)) or the like, which is connected to the user device via Bluetooth, Wi-Fi, near field communication, USB, infrared, etc. The call resumption alert module may be configured to send the alert to the user device 100, the connected device 210, or both.

[0026] Another way to initiate sending an alert is by sending a message to the call agent 600 to inquire whether the phone call resumed. Thus, the call resumption alert module may be further configured to send a message to the call agent to inquire whether the peer device has returned to the phone call, and if a reply from the call agent is positive, the call resumption alert module is configured to send the alert to the user 200.

[0027] In one embodiment, the call resumption alert module is configured to detect a Dual Tone Multi-Frequency (DTMF) signal originating from the peer device 300. DTMF is a signaling protocol commonly employed in telecommunications, especially in voice telephony systems. Each key press on a touch-tone phone or phone's keypad produces a distinct tone-a DTMF signal-which is a combination of two frequencies (one from a high-frequency group and the other from a low-frequency group). If the peer 400 places the phone call on hold, it is probable that a key such as mute, speaker, or the like has been pressed. Subsequently, when the call is to be resumed, another key is likely to be pressed. Therefore, by detecting a DTMF signal from the peer device 300, the call resumption alert module can determine whether the phone call has been resumed by the peer device 300. If the DTMF signal is detected, the call resumption alert module is configured to send the alert to the user device 200.

[0028] If the call resumption alert module detects a DTMF signal originating from the peer device 300 before the user 200 enables the call resumption alert module, and the user 200 enables the call resumption alert module thereafter, then the accuracy in determining a call resumption by the peer device is significantly improved by detecting another DTMF signal originating from the deer device 300 after the user 200 has enabled the call resumption alert module.

[0029] In the alternative embodiment, the CTS system includes a CTS server 500, a user device 100, and a user application 110. The CTS server 500 provides a transcription service to a user 200 during a phone call between the user 200 and a peer 400. The user device 100 is constructed to be connected to the CTS server 500 for the phone call between the user device 100 and a peer device 300, and the user application 110 is installed on the user device 100. The CTS server 500 is connected to a call agent 600 or an ASR engine 700 for the phone call to provide the transcription service. The CTS system 500 is configured to provide a call resumption alert module to the user 200 such that the call resumption alert module sends an alert to the user 200 to assist the user 200 in re-engaging with the phone call, and the user application 110 is configured for the user 200 to enable or disable the call resumption alert module.

[0030] In addition, the call resumption alert module includes a call resumption checking module and an alert module. The call resumption checking module checks whether the phone call resumed from the peer device, and the alert module generates an alert upon receiving a call resumption message from the call resumption checking module. The call resumption message is generated when the call resumption checking module determined that the phone call has resumed from the peer device.

[0031] In one embodiment, the call resumption checking module may be configured to send the call resumption message to the alert module when the user application 110 receives any text which is transcribed from a voice of the peer device 300.

[0032] In another embodiment, the call resumption checking module may send the call resumption message to the alert module when the user application 110 receives a certain text, which is transcribed from a voice of the peer device 300, where the certain text matches one of expected texts listed in a stored database. The call resumption checking module may allow the user 200 to add words, phrases, or sentences to the list of expected texts stored in the database. Alternatively, the CTS system itself may add terms, phrases, or sentences to the list of expected texts stored in the database by analyzing other phone calls where the call resumption alert module was employed.

[0033] In still another embodiment, the call resumption alert module may be configured to send a message to the call agent 600 to inquire whether the peer device 300 has returned to the phone call, and if a reply from the call agent 600 is positive, the call resumption alert module is configured to send the call resumption message to the alert module. Given that the call agent 600 is a human operator, their responses offer a high level of reliability in determining whether the call has resumed or not.

[0034] In still another embodiment, the call resumption checking module may send the call resumption message to the alert module when the call resumption checking module detects a music or background music coming from the peer device 300, the call resumption checking module detects discontinuance of the music or background music from the peer device 300, and the user application receives any text which is transcribed from a voice of the peer device 300. While the transcribed text alone can sometimes be misleading, corroborating it with information about the cessation of background music can significantly enhance the accuracy of the call resumption checking module's decision.

[0035] In still another embodiment, the call resumption checking module is configured to retrieve a first voice sample of the peer 400 from the peer device 300 before the user 200 enables the call resumption alert module, and the call resumption checking module is further configured to retrieve a second voice sample coming from the peer device 300 after the user 200 enabled the call resumption alert module. If the first and second voice samples are identified as belonging to the same person, the call resumption checking module would then transmit a call resumption message to the alert module. In other words, the call resumption checking module would send a call resumption message to the alert module if a comparative analysis of the two voice samples suggests that they are both the peer's voice.

[0036] In still another embodiment, the call resumption checking module is configured to detect a Dual Tone Multi-Frequency (DTMF) signal originating from the peer device 300. DTMF is a signaling protocol commonly employed in telecommunications, especially in voice telephony systems. Each key press on a touch-tone phone or phone's keypad produces a distinct tone-a DTMF signal-which is a combination of two frequencies (one from a high-frequency group and the other from a low-frequency group). If the peer 400 places the phone call on hold, it is probable that a key such as mute, speaker, or the like has been pressed. Subsequently, when the call is to be resumed, another key is likely to be pressed. Therefore, by detecting a DTMF signal from the peer device 300, the call resumption checking module can determine whether the phone call has been resumed by the peer device 300. If the DTMF signal is detected, the call resumption checking module transmits a call resumption message to the alert module.

[0037] The alert may be beeping from the user device, flashing of the user device's display or light, vibration of the user device, haptic feedback from the user device, or any other means that effectively stimulated the sensory perception of the user 200. The alert may be just one means or multiple means.

[0038] The call resumption alert module is configured to send the alert to a connected device which is connected to the user device 100, and the connected device may be a smart watch, tablet computing device, smart television, smart assistant, etc., which is connected to the user device via Bluetooth, Wi-Fi, near field communication, USB, infrared, etc The call resumption alert module may be configured to send the alert to the user device 100, the connected device 210, or both.

[0039] While the invention has been shown and described with reference to different embodiments thereof, it will be appreciated by those skilled in the art that variations in form, detail, compositions and operation may be made without departing from the spirit and scope of the invention as defined by accompanying claims.