COMMUNICATION DEVICE AND METHODS FOR USE BY HEARING IMPAIRED
20230164265 · 2023-05-25
Inventors
- Robert M. Engelke (Madison, WI, US)
- Kevin R. Colwell (Middleton, WI, US)
- Troy Vitek (Waunakee, WI, US)
Cpc classification
H04L67/02
ELECTRICITY
H04M3/42391
ELECTRICITY
International classification
H04M3/42
ELECTRICITY
H04L67/02
ELECTRICITY
H04M1/247
ELECTRICITY
Abstract
A method for maintaining contact information in a hearing impaired assisted user's communication device includes the steps of (a) providing a web site for altering assisted user contact information, (b) linking a proxy device to the web site, (c) receiving an identifier associated with the assisted user's device via the proxy device, (d) identifying an assisted user's device via the received identifier, (e) enabling the proxy device to be used to modify contact information for the assisted user associated with the received identifier, (f) starting a timer to time out a sync timeout period, (g) during the sync timeout period, receiving an indication via the assisted user's device confirming a desire to update the assisted user's contact information, (h) updating the assisted user's contact information, and (i) at the end of the timeout period, ceasing an indication that updated data is ready to be used from the assisted user's device.
Claims
1. A method to facilitate communication between an assisted user (AU) using an AU communication device and a hearing user (HU) using an HU communication device to communicate during a communication session, the AU communication device including a speaker, the method comprising the steps of, during the communication session; receiving an original HU voice signal originating at the HU communication device at the AU communication device; identifying characteristics of the original HU voice signal; using the identified characteristics to identify the original HU voice signal as one voice signal type out of a plurality of different voice signal types; changing the volume of at least one frequency in the original HU voice signal as a function of the identified voice signal type to generate a modified HU voice signal; and broadcasting the modified HU voice signal via the speaker.
2. The method of claim 1 where the AU communication device also includes a display, the method further including the steps of transmitting the original HU voice signal to a remote relay for captioning, receiving text captions from the relay corresponding the to the original HU voice signal, and presenting the text captions via the display.
3. The method of claim 1 wherein the plurality of voice signal types includes at least first and second different voice signal types.
4. The method of claim 3 wherein the first and second voice signal types include a male type and a female type and wherein the volume of at least one frequency setting is different for a male type and a female type.
5. The method of claim 1 further including a memory and storing a first set of HU voice signal characteristics associated with a first voice signal type and a second set of HU voice signal characteristics associated with a second voice signal type.
6. The method of claim 5 wherein the memory further stores at least one frequency volume adjustment for the first voice signal type and a second frequency volume adjustment for the second voice signal type.
7. The method of claim 6 wherein the AU communication device provides an interface for adjusting frequency volume adjustments while a user is listening to a voice signal being broadcast.
8. The method of claim 7 wherein, after an AU adjusts frequency volume for a voice signal of a specific type, the adjusted frequency volume settings are stored and used for subsequent communication sessions involving voice signals of the specific type.
9. The method of claim 2 wherein the original HU voice signal is only transmitted to the relay after a user of the AU communication device requests captioning.
10. The method of claim 1 further including the step of storing a plurality of audiograms in a database wherein each audiogram indicates frequency volume adjustments for a different one of the voice signal types, the step of changing the volume of at least one frequency in the original HU voice signal as a function of the identified voice signal type to generate a modified HU voice signal includes accessing an audiogram associated with the identified voice signal type and applying the audiogram to the original voice signal.
11. The method of claim 7 wherein the interface is provided to the user during a commissioning session and wherein voice signals broadcast during the commissioning procedure are a pre-stored voice signal.
12. The method of claim 11 wherein different voice signal types are presented to the user during the commissioning session and different user settings for frequency volumes are stored for the different voice signals.
13. The method of claim 1 wherein the step of changing the volume includes increasing the volume.
14. The method of claim 1 wherein the step of changing the volume includes adjusting at least one frequency volume relative to the other frequency volumes.
15. The method of claim 1 wherein, while the modified HU voice signal is broadcast, an interface is presented to the AU via the display by which AU input adjusting volumes of frequencies of the broadcast voice is received, the method further including, once frequency volumes are adjusted, storing the adjusted frequency volumes with the voice type associated with the original HU voice signal for subsequent use during subsequent communication sessions.
16. The method of claim 1 wherein the AU communication device includes a processor that is programmed to identify HU voice signal characteristics.
17. The method of claim 16 wherein the AU communication device changes the voice signal prior to broadcasting the modified voice signal.
18. The method of claim 1 wherein at least a subset of the different voice signal types correspond to specific HU voice signals.
19. A method to facilitate communication between an assisted user (AU) using an AU communication device and hearing users (HUs), each HU using an HU communication device to communicate during a communication session, the AU communication device including a speaker, the method comprising the steps of: during a first communication session: receiving a first original HU voice signal originating at a first HU communication device at the AU communication device; identifying characteristics of the first original HU voice signal; using the identified characteristics of the first original HU voice signal to identify the first original HU voice signal as one voice signal type out of a plurality of different voice signal types; changing the volume of at least one frequency in the first original HU voice signal as a function of the identified voice signal type to generate a modified first HU voice signal; and broadcasting the modified first HU voice signal via the speaker; and during a second communication session: receiving a second original HU voice signal originating at a second HU communication device at the AU communication device: identifying characteristics of the second original HU voice signal; using the identified characteristics of the second original HU voice signal to identify the second original HU voice signal as a second voice signal type out of a plurality of different voice signal types; changing the volume of at least one frequency in the second original HU voice signal as a function of the identified second voice signal type to generate a modified second HU voice signal; and broadcasting the modified second HU voice signal via the speaker.
20. A method to facilitate communication between an assisted user (AU) using an AU communication device and hearing users (HUs) using at least one HU communication device to communicate during a communication session, the AU communication device including a speaker, the method comprising the steps of, during a communication session: receiving a plurality of original HU voice signals originating at one or more HU communication device at the AU communication device; identifying characteristics of a currently received original HU voice signal; using the identified characteristics of the currently received original HU voice signal to identify the currently received original HU voice signal as a currently received voice signal type out of a plurality of different voice signal types; altering the volume of at least one frequency in the currently received original HU voice signal as a function of the identified voice signal type to generate a modified HU voice signal; and broadcasting the modified HU voice signal via the speaker; wherein, at least first and second different HU voice signals of first and second different voice signal types are received during the communication session and wherein the different types of voice signals received are changed in different ways prior to being broadcast as modified HU voice signals via the speaker.
Description
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038] While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawings and are herein described in detail. It should be understood, however, that the description herein of specific embodiments is not intended to limit the invention to the particular forms disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the appended claims.
DETAILED DESCRIPTION OF THE DISCLOSURE
[0039] The various aspects of the subject disclosure are now described with reference to the annexed drawings, wherein like reference numerals correspond to similar elements throughout the several views. It should be understood, however, that the drawings and detailed description hereafter relating thereto are not intended to limit the claimed subject matter to the particular form disclosed. Rather, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the claimed subject matter.
[0040] As used herein, the terms “component,” “system” and the like are intended to refer to a computer-related entity, either hardware, a combination of hardware and software, software, or software in execution. For example, a component may be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. By way of illustration, both an application running on a computer and the computer can be a component. One or more components may reside within a process and/or thread of execution and a component may be localized on one computer and/or distributed between two or more computers or processors.
[0041] Referring now to the drawings wherein like reference numerals correspond to similar elements throughout the several view and, more specifically, referring to
[0042] Referring again to
[0043] To place a call from the assisted user's device 12 to the hearing user's device 14, an assisted user may pick up the handset 24/26 and simply dial a telephone number associated with the hearing user's device 14 using keyboard 27. During a voice communication with a hearing user, the assisted user's voice is transmitted by device 12 via line 30 to device 14. Similarly, a hearing user's voice is transmitted along line 30 to device 12 and is broadcast via the speaker 24 in the handset of device 12 to the ear of the assisted user.
[0044] When an assisted user has difficulty hearing voice messages broadcast via speaker 24 from the hearing user, the assisted user can initiate a captioning service whereby the voice messages of the hearing user are transcribed into text and presented to the assisted user via the assisted user's device 12 substantially simultaneously with broadcast of the hearing user's voice messages. To this end, referring again to
[0045] At the relay 16, the hearing user's voice messages are transcribed into text and the text is transmitted back to the assisted user's device 12 via link 28 or a third communication link and the transcribed text is presented to the assisted user via display 22. The voice to text conversion or transcription at relay 16 may be automated, partially automated or facilitated via a call assistant that listens to the hearing user's voice messages and either types or revoices or both types and revoices the voice messages to transcribe the text as known in the art.
[0046] Referring to
[0047] Referring yet again to
[0048] Referring again to
[0049] Consistent with at least some aspects of the present disclosure, one feature that may be implemented via the system shown in
[0050] Referring still to
[0051] Continuing, at block 64, a proxy receives an assisted user's device ID which is required for the proxy to enter any information into the system associated with a specific assisted user. Here, it is contemplated that each assisted user device will be assigned a unique assisted device ID number or character string (hereinafter “a device ID”) which can be used by any proxy to enter information for the assisted user. In the present example, it will be assumed that each assisted device ID will include a seven-digit serial number. In the present example, an exemplary seven-digit number for user device 12 shown in
[0052] Referring still to
[0053] Referring still to
[0054] Referring still to
[0055] Referring yet again to
[0056] Referring still to
[0057] Referring still to
[0058] Referring again to
[0059] Referring again to
[0060] Referring again to
[0061] Referring again to
[0062] In
[0063] In at least some embodiments it is contemplated that an assisted user may want to view contact and other information updates that a proxy is attempting to make to the assisted user's contact and other information on the assisted user's device prior to authorizing a synchronization. To this end, a sub process 170 that may be substituted for block 144 in
[0064] While assisted user confirmation of contact information and other types of device updating is particularly preferred to ensure that only authorized updates are synchronized, in at least some embodiments it is contemplated that one or more “trusted” proxy locations may be designated for each or at least a subset of the assisted users where the trusted proxy can initiate a synchronization update or process without requiring authorization by an assisted user. For instance, in at least some cases a customer service representative for the entity providing the proxy features described above may be a trusted proxy associated with a device (e.g., a computer) that is associated with the provider (e.g., location would be a virtual location associated with a trusted network address, URL, etc., as opposed to a geographic location or may be a geographic location in some cases). This feature would be useful by a customer service representative to assist an assisted user without requiring user confirmation.
[0065] In still other embodiments it is contemplated that an assisted user may be able to designate one or more trusted proxies (e.g., a daughter, a social worker, etc.) enabling those proxies to update the assisted user's contact and other information without assisted user authorization. In any of these cases, when an assisted user accesses the user's device, the device may be programmed to automatically link to the system server, check for changes to the contact and other information for the assisted user's device made by a trusted proxy or a proxy at the trusted location and may then update the user's device information if suitable updates are available.
[0066] At block 174, the assisted user may be able to access and view the updated contact and other information prior to storing that information on the assisted user's device in a persistent fashion. To this end, see the exemplary screen shot shown in
[0067] While assisted user confirmation of contact information and other types of device updating is particularly preferred to ensure that only authorized updates are synchronized, in at least some embodiments it is contemplated that one or more “trusted” proxy locations may be designated for each or at least a subset of the assisted users where the trusted proxy can initiate a synchronization update or process without requiring authorization by an assisted user. For instance, in at least some cases a customer service representative for the entity providing the proxy features described above may be a trusted proxy associated with a device (e.g., a computer) that is associated with the provider (e.g., location would be a virtual location associated with a trusted network address, URL, etc., as opposed to a geographic location or may be a geographic location in some cases). This feature would be useful by a customer service representative to assist an assisted user without requiring user confirmation.
[0068] In still other embodiments it is contemplated that an assisted user may be able to designate one or more trusted proxies (e.g., a daughter, a social worker, etc.) enabling those proxies to update the assisted user's contact and other information without assisted user authorization. In any of these cases, when an assisted user accesses the user's device, the device may be programmed to automatically link to the system server, check for changes to the contact and other information for the assisted user's device made by a trusted proxy or a proxy at the trusted location and may then update the user's device information if suitable updates are available.
[0069] In some embodiments the system processors may be programmed to add another level of security to ensure that only updates from trusted proxies are made to an assisted user's device information. For instance, in at least some embodiments it is contemplated that the system will require both a proxy and an assisted user to enter an identical code or pin number or word in order to initiate data synchronization. To this end see the exemplary sub-process 298 in
[0070] Referring also to
[0071] Referring to
[0072] Referring again to
[0073] In still other embodiments the assisted user may select the random pin number and provide that number to the proxy for entry, the assisted user's device may generate the random number and present it to the assisted user upon selection of a sync control so that the assisted user can provide the pin to the proxy for entry, etc. In yet other embodiments where server 65 generates the random pin, the random pin may be automatically presented to each of the assisted user and the proxy, the proxy via the proxy work station 18 and the assisted user in any fashion including text, e-mail, a voice mail message, etc.
[0074] One advantage to requiring entry of identical pin numbers by a proxy and an assisted user is that the timeout timers can be discarded. This is because the pin numbers may provide sufficient security regardless of when an assisted user commences a synchronization process relative to when the proxy updated the user's information. Thus, for instance, a proxy may update an assisted user's content and then send an e-mail to the assisted user indicating that a sync should be performed and including the four digit pin number. Two weeks later the assisted user may want to first synchronize information and may, at that time, enter the pin number to synchronize.
[0075] While some embodiments contemplate that a proxy will have to always contact an assisted user to commence a synchronization process, in other embodiments it is contemplated that the server 65 may be programmed to automatically transmit an e-mail, text, voice mail, etc., to an assisted user any time updated information is stored at the server 65. This is particularly useful in cases where a pin number or other code is associated with an update. For instance, an automated e-mail may indicate that synchronization is in order and may provide a pin number to the assisted user irrespective of whether or not the pin was provided to the proxy. In this case the assisted user would simply enter the pin using the user's device 12 to commence synchronization.
[0076] Still other embodiments are contemplated that would include both the pin number and timeout timer features for an even higher level of security in some cases.
[0077] Referring now to
[0078] Once broadcast tone has been selected by an assisted user, in at least some embodiments, the assisted user may choose to listen to a pre-recorded sample voice recording broadcast by the device speaker 24 so that the assisted user can determine whether or not the tone settings are optimized for the particular user. To this end, the screen shot in
[0079] As a sample recording is played, a bar 214 moves along an elongated recording field to indicate where along the duration of the sample recording the broadcast is at any given time. Here, if desired, the assisted user may move bar 214 to any location along the recording field and again select the play icon 212 to listen to a portion of the recording. For example, if an assisted user can easily hear a female voice that is first broadcast as part of the recording, but is having difficulty hearing a male voice presented during the second half of the recording, the assisted user may move bar 214 to approximately the midway point along the recording field and then select the play icon 212 to play only the male portion of the sample recording.
[0080] The
[0081] If an assisted user perceives that the tone is optimized after one or more broadcasts of the recorded voices, the assisted user can select an accept icon 216 to store the frequency setting within a device memory (see again
[0082] Referring to
[0083] Each one of the slider controls can be moved up or down within the decibel range illustrated to adjust the relative effect of the associated frequency on the overall tone of the broadcasted voice messages. To this end, in at least some embodiments, the display 22 may be a touch sensitive display so that an assisted user can simply touch one of the slider controls and move the slider control up and down the associated slide column. Once the slider controls are set as desired by an assisted user, in at least some embodiments, the assisted user may choose to listen to an optimal sample voice recording broadcast by the device speaker 24 in the fashion described above with respect to
[0084] If the assisted user listens to a recording and does not believe that the tone has been optimally set for the user, the assisted user can simply reposition the slider controls 202, 204, 206, 208 and 210 along the slide columns to modify the output tone and select the play icon 212 again to rehear the sample recording and personally assess whether or not the tone is optimized.
[0085] Referring now to
[0086] Referring still to
[0087] In at least some embodiments it is contemplated that an assisted user may have different tone preferences for different types of voices. For instance, an assisted user may prefer one tone setting for a male voice and another tone setting for a female voice. In some embodiments an assisted user may be able to use the tone setting tools in
[0088] In at least some embodiments it is contemplated that an assisted user may be able to customize an audiogram for one or more specific hearing users. For instance, where an assisted user routinely converses with five hearing users, in at least some embodiments the assisted user may identify a separate audiogram for each of the five hearing users which can be stored in a database with one or more phone numbers associated with the specific hearing user. For instance, while an assisted user is conversing with the assisted user's daughter, the assisted user may access the equalizer tool in
[0089] In some embodiments processor 20 may be programmed to recognize specific hearing person's voices and to select previously stored audiograms for specific hearing user's that call an assisted user. Here, voice unique audiograms may be specified and stored by an assisted user for subsequent use. This feature would enable caller specific audiograms for at least a subset of frequent callers irrespective of the phone numbers used by the callers. This feature would also enable tone preferences for multiple callers that use the same phone to call an assisted user's device. For instance, where an assisted user's daughter is married and has four kids so that six people may call the assisted user routinely using the daughter's phone, different audiograms may be stored for each of the six possible callers or for the two most frequent callers (e.g., the daughter and a grandson) with a generic audiogram used when any of the other four callers call.
[0090] While the system is described above as one where an assisted user's contact and other information is stored in a memory maintained on an assisted user's device, in other embodiments it is contemplated that an assisted user's contact and other information may be stored somewhere else such as, for instance, in a database associated with the system server or some other remote server. In this case, if a proxy attempts to update or change contact information a process similar to the process described above would be performed to seek and obtain confirmation to update from an assisted user and then the data in the server would be updated accordingly.
[0091] The particular embodiments disclosed above are illustrative only, as the invention may be modified and practiced in different but equivalent manners apparent to those skilled in the art having the benefit of the teachings herein. For example, while the system described above does not allow a proxy to indicate to an assisted user's device when information is available for updating the user's device information, in other embodiments once a proxy has indicated that update data is ready to be synchronized with an assisted user's device, the proxy may transmit a sync request to an assisted user's device. In this case the sync control option may only be provided on the assisted user's device within a time out period after a proxy has requested synchronization. In this case the assisted user may select the sync control icon to commence synchronization as described above. Where the sync control is not selected within the time out period, the sync control may be removed from the assisted user's device.
[0092] In at least some cases it is contemplated that a “No sync” control may also be presented to an assisted user via a virtual control icon suitably labelled. In these cases, if the no sync icon is selected, a no sync signal may be sent to the server causing the server to forego the synchronization process.
[0093] Furthermore, no limitations are intended to the details of construction or design herein shown, other than as described in the claims below. It is therefore evident that the particular embodiments disclosed above may be altered or modified and all such variations are considered within the scope and spirit of the invention. Accordingly, the protection sought herein is as set forth in the claims below.
[0094] Thus, the invention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the following appended claims.
[0095] To apprise the public of the scope of this invention, the following claims are made: