METHOD, SYSTEM, AND HEARING DEVICE FOR ENHANCING AN ENVIRONMENTAL AUDIO SIGNAL OF SUCH A HEARING DEVICE

Abstract

The invention relates to a method for enhancing an audio signal of a hearing device, comprising the steps of: using a microphone of the hearing device to receive an environmental audio signal originating from an environment of a user listening to the hearing device, processing the environmental audio signal by means of a processing unit to enhance the environmental audio signal by suppressing noise and/or amplifying audio data, outputting the enhanced audio signal to the user listening to the hearing device by means of a speaker, characterized in that the processing unit is arranged in a communications network, away from the hearing device, wherein the processing unit is configured for receiving the environmental audio signal from the microphone of the hearing device and retransmitting the enhanced audio signal to the speaker of the hearing device via the communications network.

Claims

1. A method for enhancing an audio signal of a hearing device, comprising the steps of: using a microphone of the hearing device to receive an environmental audio signal originating from an environment of a user listening to the hearing device, processing the environmental audio signal by means of a processing unit to enhance the environmental audio signal by suppressing noise and/or amplifying audio data, outputting the enhanced audio signal to the user listening to the hearing device by means of a speaker, characterized in that the processing unit is arranged in a communications network, away from the hearing device, wherein the processing unit is configured for receiving the environmental audio signal from the microphone of the hearing device and retransmitting the enhanced audio signal to the speaker of the hearing device via the communications network.

2. The method according claim 1, wherein the communications network is configured to have a latency of less than 50 ms.

3. The method according to claim 1, wherein the communications network is configured to have a latency of less than 30 ms.

4. The method according to claim 1, wherein the communications network is configured to have a latency of less than 10 ms.

5. The method according to claim 1, wherein the communications network is configured to have a latency of 1-5 ms.

6. The method according to claim 1, wherein the hearing device is connected to a communications unit with a transmitter for wirelessly transmitting the environmental audio signal from the microphone of the hearing device to the processing unit in the communications network and a receiver for wirelessly receiving the enhanced audio signal from the processing unit in the communications network.

7. The method according to claim 1, wherein the communications network comprises a further processing unit to further process the enhanced audio signal to match an optimal hearing profile of the user.

8. A system for enhancing an audio signal of a hearing device, comprising: a microphone comprised by the hearing device to receive an environmental audio signal originating from an environment of a user listening to the hearing device, a processing unit for processing the environmental audio signal by means of enhancing the environmental audio signal by suppressing noise and/or amplifying audio data, a speaker configured for outputting the enhanced audio signal to the user listening to the hearing device, characterized in that the processing unit is arranged in a communications network, away from the hearing device, wherein the processing unit is configured for receiving the environmental audio signal from the microphone of the hearing device and retransmitting the enhanced audio signal to the speaker of the hearing device via the communications network.

9. The system according to claim 8, wherein the hearing device is connected to a communications unit with a transmitter for wirelessly transmitting the environmental audio signal from the microphone of the hearing device to the processing unit in the communications network and a receiver for wirelessly receiving the enhanced audio signal from the processing unit in the communications network.

10. The system according to claim 9, wherein the receiver and the transmitter of the communication unit are configured as a transceiver.

11. The system according to claim 8, wherein the hearing device comprises the communication unit.

12. The system according to claim 8, wherein the communications network is configured to have a latency of less than 50 ms, more preferably of less than 30 ms, even more preferably of less than 10 ms, most preferably of 1-5 ms.

13. The system according to claim 8, wherein the processing unit is in communication with a storage unit comprising a database containing an optimal hearing profile associated with the user.

14. The system according claim 13, wherein the processing unit is in communication with a storage unit comprising a database containing a multitude of optimal hearing profiles associated with a respective multitude of users, wherein each user's optimal hearing profile is taken into account when processing the environmental audio signal into the enhanced audio signal.

15. A hearing device, comprising: a microphone to receive an environmental audio signal originating from an environment of a user listening to the hearing device, a speaker configured for outputting an enhanced audio signal to the user listening to the hearing device, a communications unit with a transmitter for wirelessly transmitting the environmental audio signal from the microphone of the hearing device to a processing unit in a communications network and a receiver for wirelessly receiving the enhanced audio signal from the processing unit in the communications network, wherein the processing unit is arranged in the communications network, away from the hearing device, wherein the processing unit is configured for processing the environmental audio signal to enhance the environmental audio signal by suppressing noise and/or amplifying audio data, wherein the hearing device is configured to perform the following steps: using the microphone of the hearing device to receive an environmental audio signal originating from an environment of a user listening to the hearing device, processing the environmental audio to enhance the environmental audio signal by suppressing noise and/or amplifying audio data, outputting the enhanced audio signal to the user listening to the hearing device by means of a speaker.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The present invention will be explained hereafter with reference to exemplary embodiments of the method according to the invention and with reference to the drawings. Therein:

[0041] FIG. 1 shows an exemplary embodiment of the system according to the present invention; and

[0042] FIG. 2 shows an exemplary embodiment of the system according to the present invention.

DETAILED DESCRIPTION

[0043] FIG. 1 discloses an exemplary embodiment of the system according to the present invention. The system comprises a hearing device 2 in communication with a processing unit 3, wherein the processing unit 3 is positioned at a server 4. The server 4 is located at a distance from the hearing device 2, wherein the server 4 is in communication with the hearing device 2 via a communication network 14, such as a telecommunication network, or a public communication network such as the internet.

[0044] The hearing device 2 comprises a first and a second microphone 11, 11′, a first and a second speaker 9, 9′, a digital analogue converter 10, and a communication unit 1. The communication unit 1 comprises a transmitter 8 and a receiver 5.

[0045] The hearing device 2 is, for instance, user equipment such as a smartphone or a hearing to be worn by a user, comprising a sim-card or dedicated chip having similar functionality (not shown), wherein the hearing device is connected to the server 4 over a telecommunication network, such as a 5G telecommunication network.

[0046] The transmitter 8 of the communication unit 1 is communicatively connected with the two microphones 11, 11′ of the hearing device 2. With two microphones 11, 11′ it is possible to identify the direction from which an environmental audio signal is coming. The receiver 5 of the communication unit 1 is communicatively connected with speakers 9, 9′ of the hearing device 2. It is also possible that the hearing device 2 comprises a single microphone 11 and/or a single speaker 9.

[0047] The transmitter 8 and the receiver 5 are communicatively connected to the processing unit 3. The processing unit 3 is configured to process an audio signal received from the microphone 11, 11′ via the transmitter 8, and for sending a processed audio signal to the speaker 9, 9′ via the receiver 5 of the communication unit 1 which is arranged at the hearing device 2.

[0048] The digital-analogue-converter is configured to convert a digital signal into an analogue signal, and vice versa. In this case the digital-analogue-converter is configured to convert an analogue environmental audio signal received by the microphone 11, 11′, prior to sending the environmental audio signal wirelessly to processing unit 3 via the transmitter 8, into a digital signal. After the environmental audio signal is processed by the processing unit 3 into an enhanced audio signal, the enhanced audio signal is communicated to the receiver 5. The digital-analogue-converter then converts the digital enhanced audio signal into an analogue audio signal after which the enhanced audio signal is communicated to the user 12 via speaker 9.

[0049] In FIG. 1 it is shown that the speakers 9, 9′ are arranged at hearing device 2. It is however also possible that the speakers 9, 9′ of the hearing device 2 are arranged at a (short) distance from the hearing device 2 as is shown in FIG. 2. The receiver 5 is wirelessly connected to a further receiver 15 of a speaker unit 16 comprising speaker 9 and a digital-analogue-converter (not shown). A connection between the receiver 5 and the further receiver 15 can be, for example, arranged via Bluetooth, or Near Field Communication (NFC). It is, for instance, anticipated that the hearing device 2 with the microphone 11 is arranged on a table in a room near a user 12, wherein the user 12 wears the speaker unit 16.

[0050] The speaker unit 16 can be a headset, or a headphone, such as for example, Apple airpods. It is also possible that the speaker unit 16 comprises a single or two earphones 9, 9′ which can, at least partially, be inserted in respectively one or two ears of the user.

[0051] In an embodiment the speaker 9 is simply connected with the communication unit 1 via a wire. In this embodiment a speaker unit 16 comprising a digital-analogue-converter and the further receiver 15 is not necessary, whereas it is possible that the speaker 9 is provided at (a relatively short) distance from the hearing device 2.

[0052] FIG. 2 discloses an exemplary embodiment of a system 13 for enhancing an audio signal of a hearing device 2. A microphone 11 of the hearing device 2 is configured to receive an environmental audio signal originating from an environment of a user 12 listening to the hearing device 2, i.e. carrying the hearing device 2. The environmental audio signal is processed by means of a processing unit 3 to enhance the environmental audio signal by suppressing noise and/or amplifying audio data. The enhanced audio signal is outputted to the user 12 listening to the hearing device 2 by means of a speaker 9. The processing unit 3 is arranged in a communications network 14, (physically) away from the hearing device 2. The processing unit 3 is configured for receiving the environmental audio signal from the microphone 11 of the hearing device 2 and retransmitting the enhanced audio signal to the speaker 9 of the hearing device 2 via the communications network 14. The communications network 14 is preferably configured to have a latency of less than 50 ms, more preferably of less than 30 ms, even more preferably of less than 10 ms, most preferably of 1-5 ms. There are several factors playing a role in reducing the latency of the communications network 14, such as bandwidth of the communications network 14, load of the communications network 14, contention ratio (ratio of the potential maximum demand to the actual bandwidth), distance from the local exchange, traffic throttling, the load of the server, the network route and the number and magnitude of routing delays incurred. Also, it is expected that the number of nodes in the network influence the latency of the communication network, wherein the more nodes (e.g. router) the more the latency is increased due to a routing delay, as known to the skilled person.

[0053] It should be noted that small amounts of final processing may take place on e.g. the hearing aid 2 itself. However, the enhanced audio signal is essentially to be generated/processed nearly fully, such as for 90-100%, or fully, i.e. for 100%, by the processing unit 3 arranged in the communications network 14, such that no audio enhancement processing or only minimal audio enhancement processing and/or final processing need to take place locally, e.g. on the hearing device 2 itself.

[0054] Many audio enhancement techniques can be used for suppressing noise and/or amplifying audio data that fall within the scope of the present invention, for example but not limited to, active noise reduction/cancelling, wind noise reduction, impulse noise reduction, occlusion reduction, feedback control, sound smoothing, speech enhancement and/or focus, binaural connection of devices, T-setting, FM compatibility, digital signal processing, multiple channel processing, directional manipulation, sound selection, automatic setting control based on location or environment, multiple memories user defined, motion detection, frequency compression, directional speech enhancement, and audio/video (a/v) synchronisation. Also techniques and algorithms to enhance the elements of music: rhythm, dynamics, melody, harmony, form, timbre and texture are conceivable.

[0055] With a/v synchronisation, in particular with regards to lip synchronization during a movie, it was found that a deviation between audio and video is in general undetectable when the audio feed leads the video feed by no more than 100 ms and the audio lags the video by no more than 25 ms, thus when the audio delay time is between −100 ms and +25 ms with respect to the video feed. The deviation in general becomes detectable when the audio delay time is between −125 ms to +45 ms. Moreover, it is considered that an audio delay time between −185 ms to +90 ms is unacceptable. Following the above, the inventors found that, for an in general undetectable a/v synchronization by using the present invention, a connection having a latency of at least 50 ms should be provided, which they found is possible by using a 5G network. Similar estimations can be made for the other audio enhancement techniques.

[0056] The hearing device 2 comprises a communications unit 1 with a transmitter 8 for (wirelessly) transmitting the environmental audio signal from the microphone 11 of the hearing device 2 to the processing unit 3 in the communications network 14 and a receiver 5 for (wirelessly) receiving the enhanced audio signal from the processing unit 3 in the communications network 14. Preferably the communications unit 1 is physically contained in or by the hearing device 2.

[0057] The processing unit 3 is in communication with a storage unit 6 comprising a database 7. The storage unit 6 can also be arranged at the server 4. Preferably, the database contains a multitude of optimal hearing profiles associated with a respective multitude of users 12. Each optimal hearing profile comprises information of a user's 12 hearing range. By accessing the database 7, it is possible to take into account a user's 12 optimal hearing profile when processing the environmental audio signal into the enhanced audio signal. This way, the noise suppression and/or amplification can be based, albeit partly, on the optimal hearing profile of a user 12. This can be highly advantageous for instance when multiple users 12 are participating (simultaneously) in an online meeting, such as a Skype, Goto or Zoom meeting, with each user 12 being able to hear optimal sound, without having to locally process audio signals to produce enhanced audio signals.

[0058] A method for enhancing an audio signal of a hearing device 2 in accordance with the present invention comprises the steps of: [0059] receiving, via a microphone 11 of the hearing device 2, an environmental audio signal originating from an environment of a user 12 listening to the hearing device 2; [0060] sending the environmental audio signal, via a transmitter 8 of a communication unit 1, to a processing unit 3 arranged at a server 4, wherein the processing unit 3 is arranged at a distance from the communication unit 1 and connected thereto via a communication network 14; [0061] processing, by the processing unit 3, the environmental audio signal thereby forming an enhanced environmental audio signal by suppressing noise and/or amplifying audio data; [0062] communicating, by the processing unit 3, the enhanced audio signal via a receiver 5 of the communication unit 1 to a speaker 9; and [0063] outputting the enhanced audio signal to the user 12 listening to the hearing device 2 via the speaker 9.

[0064] It should be clear that the description above is intended to illustrate the operation of preferred embodiments of the invention, and not to reduce the scope of protection of the invention. Starting from the above description, many embodiments will be conceivable to the skilled person within the inventive concept and scope of protection of the present invention.

LIST OF REFERENCES

[0065] 1. Communication unit [0066] 2. Hearing device [0067] 3. Processing unit [0068] 4. Server [0069] 5. Receiver [0070] 6. Storage unit [0071] 7. Database [0072] 8. Transmitter [0073] 9. Speaker/earphone [0074] 10. (Digital-to-analog) converter [0075] 11. Microphone [0076] 12. User [0077] 13. System [0078] 14. Communications network [0079] 15. Further receiver [0080] 16. Speaker unit