Hearing device with input transducer and wireless receiver
10070231 · 2018-09-04
Assignee
Inventors
Cpc classification
H04R25/554
ELECTRICITY
H04R2225/49
ELECTRICITY
International classification
Abstract
The present disclosure regards a hearing device comprising a power source, electric circuitry, a loudspeaker, at least one microphone for sound from an acoustic environment, and at least one wireless receiver for wirelessly received sound signals. The microphone is configured to generate an environment sound signal. The wireless receiver is configured generate a source sound signal. The electric circuitry is configured to estimate at least one parameter of an impulse response from the location of the origin of the wirelessly received signal to the location of a user of the hearing device in dependence on the source sound signal and the environment sound signal. The electric circuitry is further configured to process the environment sound signal in dependence on the estimated at least one impulse-response parameter, thereby generating an output sound signal. The output sound signal is processed into sound by the loudspeaker.
Claims
1. A hearing device worn in or around a user's ear, the hearing aid comprising a power source, electric circuitry, an output transducer, an input transducer configured to receive sound from an acoustic environment and to generate a corresponding environment sound signal, and a wireless receiver configured to wirelessly receive a sound signal via an external microphone close to a sound source remote from the hearing device and to provide a corresponding wireless source sound signal which is substantially temporally-aligned with the environment sound signal, wherein the electric circuitry is configured to receive both the environment sound signal and wireless source sound signal, which are substantially temporally-aligned to one another, during use of the hearing device to estimate at least one parameter of an impulse-response of a sound path from a location of an origin of the wireless source sound signal to a location of the user of the hearing device in dependence of the wireless source sound signal and the environment sound signal, which are substantially temporally-aligned with one another, the electric circuitry is configured to process the environment sound signal in dependence of the at least one impulse-response parameter, which is estimated based on the substantially temporally-aligned wireless signal, thereby generating an output sound signal during use of the hearing device, wherein the electric circuitry is configured to use the estimated at least one impulse-response parameter to identify from the environment sound signal, which is substantially temporally-aligned to the wireless sound signal from which the at least one impulse-response parameter is estimated, signal portions that mainly comprise late reverberations and to indicate such signal portions, and the electric circuitry is configured to use the estimated at least one impulse-response parameter to modify the contents of the output sound signal, such that late reverberations in the identified signal portions are attenuated relative to direct sound and/or relative to early reverberations, and wherein the electric circuitry, which estimates the at least one impulse-response parameter and identifies the signal portions mainly comprising late reverberations, is entirely located within the hearing device worn in or around the user's ear.
2. The hearing device according to claim 1, wherein the electric circuitry is configured to reduce a signal amplitude of signal portions representing late reverberations in the output sound signal.
3. The hearing device according to claim 1, wherein the electric circuitry is configured to increase a signal amplitude of signal portions representing direct sound and/or early reverberations in the output sound signal.
4. The hearing device according to claim 1, wherein the electric circuitry is configured to perform at least partial de-reverberation of the environment sound signal in dependence on the estimated at least one impulse-response parameter.
5. The hearing device according to claim 1, wherein the electric circuitry comprises a time delay unit, which is configured to temporally align the source sound signal and the environment sound signal.
6. The hearing device according to claim 1, wherein the input transducer comprises a microphone.
7. The hearing device according to claim 1, wherein the wireless receiver comprises a telecoil.
8. The hearing device according to claim 1, wherein the hearing device is configured to allow a mixing of the source sound signal and the environment sound signal to be controlled by the user.
9. The hearing device according to claim 1, wherein the hearing device is configured to allow a mixing of the source sound signal and the environment sound signal to be controlled by an algorithm configured to be executed by the electric circuitry and wherein the algorithm is configured to adapt weighting of the source sound signal and the environment sound signal to a detected listening situation.
10. The hearing device according to claim 1, wherein the electric circuitry comprises a processing unit configured to enhance and/or reduce signal amplitudes of the identified signal portions of the environment sound signal.
11. A method for generating the output signal from the environment sound signal and the wireless sound signal using the hearing device according to claim 1, the method comprising: receiving at the hearing device the environment sound signal and the wireless sound signal; estimating, by the electric circuitry of the hearing device, the at least one parameter of an impulse-response of the sound path from the location of the origin of the wireless sound signal to the location of the user of the hearing device in dependence on the environment sound signal and the wireless sound signal; and generating, by the electric circuitry of the hearing device, the output sound signal in dependence on the environment sound signal and the estimated at least one impulse-response parameter comprising reducing the signal amplitude of signal portions representing reverberations in the output signal.
12. The method according to claim 11, wherein generating the output signal in dependence on the estimated at least one impulse-response parameter comprises increasing a signal amplitude of signal portions representing direct sound and/or early reverberations in the output signal.
13. The method according to claim 11, wherein generating the second output signal comprises mixing the noisy sound signal and the noiseless sound signal as a weighted sum of the noisy sound signal and the noiseless sound signal.
14. The hearing device according to claim 1, wherein said hearing device is a hearing aid.
15. The hearing device according to claim 14, wherein said electric circuitry is further configured to generate the output sound signal to compensate for hearing loss of the user.
16. The hearing device according to claim 14, wherein the hearing aid is configured for positioning the microphone behind an ear of the user.
17. The hearing device according to claim 16, wherein the hearing aid is configured for positioning the output transducer behind the ear of the user or in an ear canal of the user.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The present disclosure will be more fully understood from the following detailed description of embodiments thereof, taken together with the drawings in which:
(2)
(3)
(4)
(5) The figures are schematic and simplified for clarity, and they just show details, which are essential to the understanding of the disclosure, while other details are left out. Throughout, like reference numerals and/or names are used for identical or corresponding parts.
(6) Further scope of applicability of the present disclosure will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the disclosure, are given by way of illustration only, since various changes and modifications within the scope of the disclosure will become apparent to those skilled in the art from this detailed description.
MODE(S) FOR CARRYING OUT THE DISCLOSURE
(7)
(8) At the hearing-device user location 11, the direct sound 16 and the reflected sound 22 are received by a microphone 24 (see
(9)
(10) Both sound signals 34, 19 are processed in the electric circuitry 30, which generates an output sound signal 48 (see
(11)
(12) The environment sound signal 34 is transmitted to a pre-processing unit 40 and to a sound signal processing unit 42. The wireless receiver 44 receives the wireless sound signals 18 via the telecoil 26 and converts it into a source sound signal 19. Alternatively the wireless receiver 44 may be e.g. a radio, a Bluetooth receiver, an infrared receiver, a wireless LAN receiver or another wireless signal or data receiver, in which cases, the telecoil 26 is preferably replaced by a corresponding antenna or optical detector. The source sound signal 19 is transmitted to the pre-processing unit 40 and to the sound signal processing unit 42.
(13) The pre-processing unit 40 estimates at least one parameter of an impulse response of a sound path from the location 15 of the origin of the wirelessly received sound signal 18 to the location 11 of a user of the hearing device in dependence on the environment sound signal 34 and the source sound signal 19. The origin of the wirelessly received sound signal 18 is the location at which the acoustic signal comprised in the wirelessly received sound signal 18 is recorded, in this case the location of the external microphone, which is very close to the location 15 of the priest 14. The pre-processing unit 40 thus in principle estimates at least one parameter of an impulse response of the sound path from the location 15 of the sound source 14, however with a possible error due to a possible deviation between the location of the external microphone and the location of the sound source 14.
(14) The at least one parameter may be estimated as e.g. a transfer function, a reverberation decay time, such as T60 which denotes the time it takes for the reverberation 22 to decay to a sound pressure level 60 dB below the sound pressure level of the direct sound 16, a ratio, such as the direct-to-reverberation-ratio DRR which denotes the ratio between the energy in the direct sound 16 and the total energy in the reverberated signal 22, and/or as an arbitrary combination of such parameters. The at least one parameter of the impulse response may be estimated by methods known in the art, such as e.g. recursive or non-recursive least square estimation, normalised or non-normalised least minimum square estimation, cross correlation, linear time-invariant theory (LTI system theory), or the like.
(15) The electric circuitry 30 uses the estimated at least one impulse-response parameter to modify the contents of the output sound signal 48, such that late reverberations 22 are attenuated relative to the direct sound 16 and/or relative to early reverberations 22. This allows improving the quality and the intelligibility of the sound presented to the hearing-device user without degrading the user's awareness of the environment. In a church, for example, it allows the hearing-device user to hear and understand the priest while maintaining the sensation of being in a church around other people, i.e., to experience the room, people talking in the close surrounding, a door being opened, the organ playing, etc. The solution may even enable the hearing-device user to hear better than a normal-hearing person in highly reverberant environments.
(16) The modification of the relative amounts of early and late reverberations 22 and/or direct sound 16 may be achieved in different ways as explained below.
(17) In some embodiments, the pre-processing unit 40 uses the estimated at least one impulse-response parameter to identify signal portions of the environment sound signal 34 that mainly comprise late reverberations and to indicate such signal portions to the processing unit 42, which attenuates the indicated signal portions relative to other signal portions and/or amplifies or enhances other signal portions relative to the indicated signal portions. The indication may e.g. comprise a time-frequency representation of signal portions mainly comprising late reverberations, and the processing unit 42 may attenuate the indicated signal portions relative to other signal portions and/or amplify or enhance other signal portions relative to the indicated signal portions by manipulating the corresponding time-frequency segments of the environment sound signal 34 and/or of the output sound signal 48.
(18) In some embodiments, the pre-processing unit 40 uses the estimated at least one impulse-response parameter to perform a complete or partial de-reverberation of the environment sound signal 34 that attenuates at least the late reverberations in the environment sound signal 34. Various techniques for such de-reverberation using knowledge of at least one parameter of the impulse response are well known in the art and any of these may be applied in the hearing device 10. Alternatively, or additionally, the pre-processing unit 40 may use the estimated at least one impulse-response parameter to apply an estimated impulse response to the source sound signal 19 in order to artificially add early reverberations thereto. The pre-processing unit 40 may provide the de-reverberated environment sound signal 34 and/or the artificially reverberated source sound signal 19 in a pre-processed sound signal 46 to the processing unit 42. The processing unit 42 may provide the output sound signal 48 as a linear combination of any of the environment sound signal 34, the source sound signal 19, the de-reverberated environment sound signal 46 and the artificially reverberated source sound signal 46. The signals 19, 34, 46 may be weighted using different weights.
(19) In some embodiments, the pre-processing unit 40 may use the estimated at least one impulse-response parameter to classify a room type. Preferably the pre-processing unit 40 is configured to control further signal processing, such as e.g. noise reduction, signal compression and/or microphone directionality of the hearing device 10 according to a classified room type, e.g. by controlling corresponding parameters of the sound signal processing unit 42.
(20) In some embodiments, the beamformer 38 may perform adaptive beamforming in dependence on the estimated at least one impulse-response parameter. The beamformer 38 may e.g. be controlled by the pre-processing unit 40, such that late reverberations 22 are attenuated relative to the direct sound 16 and/or relative to early reverberations 22 in the environment sound signal 34. The beamformer 38 may alternatively be absent, and the hearing device 10 may e.g. comprise only a single microphone 24, the output signal of which may serve as the environment sound signal 34.
(21) In some embodiments, the sound signal processing unit 42 may add the signals into an output sound signal 48 comprising any of the pre-processed sound signal 46, the source sound signal 19 and the environment sound signal 34, or any mixture hereof. In some embodiments, the sound signal processing unit 42 performs further signal processing, such as e.g. noise reduction, signal compression and/or frequency-dependent amplification or attenuation, thereby modifying the pre-processed sound signal 46, the source sound signal 19, the environment sound signal 34 and/or the output signal 48, e.g. in order to compensate for the hearing-device user's hearing loss.
(22) The wireless sound signal 18 may alternatively comprise only a portion of the sound received by the external microphone, such as e.g. one or more frequency sub-band signals or one or more sound components obtained by a suitable decomposition of the recorded sound. This may reduce the required signal bandwidth and/or the amount of data to be transmitted. The transmitted portion of the recorded sound should be selected such that the hearing device 10 is still able estimate the at least one impulse-response parameter.
(23) The electric circuitry 30 may further comprise a control unit (not shown) connected to the pre-processing unit 40 and/or the sound signal processing unit 42 and configured to allow a user to control or influence the processing manually. The hearing device 10 may e.g. be configured to allow processing of the signals 19 and 34 to be controlled by a user, e.g. by allowing the user to switch between different acoustic environment modes and/or to adjust the weights used in combining the signals 19, 34, 46.
(24) The hearing device 10 may further or alternatively be configured to adaptively control generation of the output signal 48, e.g. by controlling the weights used in combining the signals 19, 34, 46, in dependence on one or more of the signals 19, 34, 48. The weights may e.g. be controlled in dependence on the relative amounts of early and late reverberations in the environment sound signal 34 and/or in the output signal 48 in order to attempt to maintain a predefined ratio therebetween, or to attempt to keep the ratio within a predefined range.
(25) The hearing device 10 shown in
(26) Preferably, the wirelessly received sound signal 18 is noiseless, meaning that it comprises only direct sound 16 from a single sound source 14 that the hearing-device user wants to listen to, or alternatively, that other sounds constitute only a minor portion of the wirelessly received sound signal 18. The environment sound signal may be noisy or noiseless. The environment sound may include direct sound 16, reverberation 22, i.e., early reflections and diffuse or late reflections, as well as other sounds from the environment. In some instances the amplitude of the direct sound 16 and/or the reverberations 22 may be too small to be recorded by the microphone 24, which in this case records only other sounds from the environment.
(27) In some embodiments the pre-processing unit 40 may be configured to use the estimated at least one impulse-response parameter to pre-process the environment sound signal 34. In some embodiments the pre-processing unit 40 may be configured to reduce the signal amplitude of signal portions representing late reverberations in the environment sound signal 34. Late reverberations are sounds which have been reflected a large number of times, e.g., more than 5, more than 10, more than 100 or more than 1000 times. Generally, late reverberations arrive with a large time delay, such as e.g. 30 ms, 50 ms or 100 ms, after the direct sound 16 due to a high number of reflections before the sound is recorded in the microphone 24. Late reverberations are known to affect speech intelligibility negatively. Direct sound 16 is sound that is received by the microphone 24 from a sound source 14 without reflections. Early reverberations are sounds which were reflected only one or a few times and which have only a small time delay compared to the direct sound. Early reverberations may e.g. be defined as the signal portion arriving within 30 to 60 ms after the direct sound 16. Direct sound 16 and early reverberations 22 are considered to improve speech intelligibility. The early reverberations 22 in combination with the direct sound 16 may give the listener information about the size of a room 12 and the location of a sound source 14 in the room 12.
(28) A reduction of the signal amplitude of signal portions representing late reverberations in the environment sound signal 34 and/or an enhancement of the signal amplitude of signal portions representing direct sound 16 and/or early reverberations may thus reduce the noise in the output sound signal 48, which may improve the sound quality and the intelligibility of the output sound of the hearing device 10.
(29) Preferably, the time delay unit 50 applies the time delay to the wirelessly received signal 18, as transmission of a wireless signal 18 is generally faster than acoustic transmission of signals 16, 22.
(30) The sound inlet for the microphone 24 is preferably arranged at a top side of the hearing device 10 when the hearing device 10 is mounted on an ear of a user. The hearing device 10 may include more than one sound inlet, more than one microphone 24 and/or more than one wireless receiver 44.
(31) A hearing device 10 according to the disclosure may be used to perform a method for generating an output sound signal 48 from a noisy sound signal, e.g., the environment sound signal 34, and a noiseless sound signal, e.g., the wirelessly received sound signal 18.
(32) A method for generating an output sound signal 48 from a noisy sound signal 34 and a noiseless sound signal 18 preferably comprises receiving a noisy sound signal 34 and a noiseless sound signal 18. The method may comprise temporally aligning the noisy sound signal 34 and the noiseless sound signal 18. The method may further comprise estimating at least one parameter of an impulse response from the location 15 of the origin of the noiseless sound signal 18, e.g., the location 15 of the priest 14, to the location 11 of the hearing-device user in dependence on the noisy sound signal 34 and the noiseless sound signal 18. Preferably the method comprises processing the noisy sound signal 34 and the noiseless sound signal 18, thereby generating an output sound signal 48 in dependence on the estimated at least one impulse-response parameter. The method may comprise processing the noisy sound signal 34 using the estimated at least one impulse-response parameter. The method may also comprise processing the noiseless sound signal 18 or both signals 34, 18 using the estimated at least one impulse-response parameter. The information in the noiseless sound signal 18 may be used to optimise the processing of the noisy sound signal 34, as a better estimate of a listening situation or environment parameters, such as room size, room type, or the like, may be obtained. The impulse response of the sound path from the location 15 of the origin of the noiseless sound signal 18 to the location 11 of the hearing-device user may be estimated with high precision in the hearing device 10, as both the noiseless sound signal 18 and the noisy sound signal 34 comprising reverberated sound 22 are available in the hearing device 10. Processing the noisy sound signal 34 may comprise reducing the signal amplitude of signal portions representing late reverberations 22 in the noisy sound signal 34 and/or enhancing the signal amplitude of signal portions representing direct sound 16 and/or early reverberations 22 in the noisy sound signal 34. This allows removal of unwanted or detrimental parts of the noisy sound 34 and/or enhancement of beneficial parts of the noisy sound 34. The method may further comprise mixing of the processed noisy sound signal 34 and the noiseless sound signal 18 into an output sound signal 48 by adding or mixing the sound signals. The mixing of the processed noisy sound signal 34 and the noiseless sound signal 18 may be performed as a weighted sum of the signals 34, 18, 46.
(33) The sound quality may be enhanced by reducing the impact of the late reverberations, i.e. the tail of the impulse response. The method may further or alternatively comprise enhancing the signal amplitude of signal portions representing direct sound 16 and/or early reverberations 22 in the noisy sound signal 34. Direct sound 16 and the first few reflections 22 are known to affect sound intelligibility positively, therefore enhancing the signal amplitude of these signal portions may improve the sound quality. The estimated at least one impulse-response parameter may also be used to process the noisy sound signal 34; specifically the sound quality may be increased by enhancing the impact of the first part of the impulse response, i.e., enhancing direct sound 16 and first few reflections 22.
(34) The output sound signal 48 may be processed into sound by a loudspeaker 32 of the hearing device 10. It is also possible to have two or more wireless receivers 44, receiving respective noiseless sound signals 18 originating at respective sound sources 14, which noiseless sound signals 18 may be processed by the hearing device 10 to determine at least one parameter of each of respective impulse responses of respective sound paths from the respective sound sources 14.
(35) Embodiments of the method may comprises using the estimated at least one impulse-response parameter to perform at least partial de-reverberation of the environment sound signal 34 in order to remove or attenuate late reverberations 22.
(36) In some embodiments of the method, the mixing of the noisy sound signal 34, the pre-processed sound signal 46 and/or the noiseless sound signal 18 is performed as a weighted sum of the signals 18, 34, 46. The method may comprise controlling one or more of the weights applied to the noisy sound signal 34, the pre-processed sound signal 46 and/or the noiseless sound signal 18. Preferably the weighted noisy sound signal 34, the weighted processed noisy sound signal 46 and/or the weighted noiseless sound signal 18 are mixed into an output sound signal 48 by temporary aligning and adding the sound signals 18, 34, 46. Also all three signals may be mixed, e.g., with the initial noisy sound signal 34 having a smaller weight than the other two signals 46, 18. The weights may be frequency-dependent, thus allowing e.g. different processing in different frequency bands.
(37) The electric circuitry 30 is preferably implemented mainly as digital circuits operating in the discrete time domain, but any or all parts hereof may alternatively be implemented as analog circuits operating in the continuous time domain. Accordingly, A/D and D/A converters may be used to convert signals between analog and digital representation. Digital functional blocks of the electric circuitry 30 may be implemented in any suitable combination of hardware, firmware and software and/or in any suitable combination of hardware units. Furthermore, any single hardware unit may execute the operations of several functional blocks in parallel or in interleaved sequence and/or in any suitable combination thereof.
(38) Some preferred embodiments have been described in the foregoing, but it should be stressed that the disclosure is not limited to these, but may be embodied in other ways within the subject-matter defined in the following claims. For example, the features of the described embodiments may be combined arbitrarily, e.g. in order to adapt the system, the devices and/or the method according to the disclosure to specific requirements.
(39) It is further intended that the structural features of the system and/or devices described above, in the detailed description of mode(s) for carrying out the disclosure and in the claims may be combined with the methods, when appropriately substituted by a corresponding process. Embodiments of the methods have the same advantages as the corresponding systems and/or devices.
(40) Any reference numerals and names in the claims are intended to be non-limiting for their scope.
REFERENCE SIGNS
(41) 10 hearing device 11 hearing-device user location 12 highly reverberant room 14 priest 15 sound source location 16 direct sound 18 wireless sound signal 19 source sound signal 20 wall 22 reflected sound 24 microphone 26 telecoil 28 power source 30 electric circuitry 32 loudspeaker 34 environment sound signal 36 thin tube 38 beamformer 40 pre-processing unit 42 sound signal processing unit 44 wireless receiver 46 pre-processed sound signal 48 output sound signal 50 time delay unit 52 time delay signal